File sending method and device, electronic equipment and storage equipment

Through the three-dimensional holographic projection device, the user's hand movements are scanned in real time and matched the sending file gesture flow, the problem of complex file sending operations in online meetings is solved, and the function of quickly sending files on the virtual meeting interface is realized.

CN119002699APending Publication Date: 2024-11-22SHAANXI ZHIYUAN INTERNET SOFTWARE CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202411089242.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-09
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

The file sending operation in existing online meetings is complicated, and users require multiple steps to operate on the client, resulting in inconvenient operation.

Method used

The user's hand movements are scanned in real time through a three-dimensional holographic projection device, matching the pre-created sending file gesture stream, and enabling the rapid sending of files through gesture operations.

Benefits of technology

In the conference room scenario, users can send files on the virtual conference interface through simple gesture operations, solving complex operations problems and achieving fast and convenient file transfer.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119002699A_ABST
    Figure CN119002699A_ABST
Patent Text Reader

Abstract

The invention discloses a method for sending a file. The method comprises the following steps: scanning a physical space in real time, and capturing hand actions when a user interacts with a virtual conference interface; the users are users participating in the online conference; the virtual conference interface is a conference interface of an online conference projected by the three-dimensional holographic projection equipment in the air in front of the user; matching the captured hand actions with gestures in a pre-created file sending gesture stream in sequence; if the matching is successful, confirming that a file sending gesture sent by the user is obtained; according to the file sending gesture, the to-be-sent file is sent to a target user, and the target user is a user participating in the same online conference with the user. The invention also discloses a device for realizing the method, electronic equipment and storage equipment.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data transmission, and in particular to a method, device, electronic device and storage device for sending files. Background Art

[0002] With the rapid development of computer technology, online meetings have become one of the important ways of communication. Online meetings allow people in different regions to participate in the same meeting without being restricted by geographical location. In the prior art, each participant shares the same screen through their own client. If a participant needs to send a file to other participants, the participant needs to open the chat interface with other participants on his or her client, then select the file to be sent, and finally click send to send the file to the client of other participants. However, the inventor found that in existing online meetings, participants need to perform a series of operations on their own clients before sending files, which has the problem of complex operations. Summary of the invention

[0003] The embodiments of the present invention provide a method, an apparatus, an electronic device and a storage device for sending a file, which are used to send a file to a target user through a simple gesture operation.

[0004] The specific technical solutions are as follows:

[0005] In a first aspect, an embodiment of the present invention provides a method for sending a file, which is applied to a three-dimensional holographic projection device, and the method includes:

[0006] The physical space is scanned in real time to capture the hand movements of the user when interacting with the virtual conference interface; the user is a user participating in an online conference; the virtual conference interface is a conference interface of the online conference projected in the air in front of the user by the three-dimensional holographic projection device;

[0007] Matching the captured hand movements with the gestures in the pre-created file sending gesture stream in sequence; if the match is successful, confirming that the file sending gesture issued by the user is obtained;

[0008] According to the file sending gesture, the file to be sent is sent to a target user, wherein the target user is a user participating in the same online conference as the user.

[0009] Optionally, the step of scanning the physical space in real time to capture hand movements of the user when interacting with the virtual conference interface includes:

[0010] Scan the physical space in real time to capture images of users interacting with the virtual meeting interface;

[0011] The user's hand movements in the captured image information are identified in sequence to obtain the user's hand movements.

[0012] Optionally, the pre-created gesture flow includes:

[0013] The user stands in front of the virtual conference interface, aligns his palm with the file to be sent in the virtual conference interface, bends his fingers into a grabbing posture, translates them to the user image position of the target user, or throws them in the direction of the seat of the target user, or throws them toward the three-dimensional holographic projection device, and releases the finger gesture flow; wherein the target user is a user who participates in the same online meeting as the user, or a user who participates in the same online meeting as the user and is in the same physical space.

[0014] Optionally, the step of sending the file to be sent to a target user according to the file sending gesture includes:

[0015] According to the gesture of sending a file, the user points his palm at the file to be sent in front of the virtual conference interface, and obtains the position of the user's palm in the air as the palm position; matches the palm position with the position of the file in the virtual conference interface, confirms the file whose file position matches the palm position as the file to be sent, moves the cursor to the file to be sent, and obtains the identification information of the file to be sent;

[0016] According to the gesture of bending the fingers into a grabbing posture in the file sending gesture, an operation of acquiring the file to be sent from the storage system according to the identification information of the file to be sent is performed;

[0017] According to the gesture of translating to the user image position of the target user in the file sending gesture, confirm the movement trajectory of the user's palm translation, and generate a picture corresponding to the movement of the file to be sent in the virtual conference interface according to the movement trajectory of the user's palm translation; match the end position of the trajectory with the user image position in the virtual conference interface; and confirm the user whose user image position matches the end position of the trajectory as the target user;

[0018] Or, according to the gesture of throwing to the seat direction of the target user in the file sending gesture, the movement trajectory of the user's palm and the action of the forearm are obtained, and the throwing direction is confirmed according to the movement trajectory of the user's palm and the action of the forearm; the position of the extension line of the throwing direction is matched with the seat positions of other users in the same physical space, and the user whose seat position is the same as the extension line position of the throwing direction is confirmed as the target user;

[0019] Or, according to the gesture of throwing the file toward the three-dimensional holographic projection device in the gesture of sending the file, other users who participate in the same online meeting with the user are confirmed as target users;

[0020] An operation of obtaining identification information of the target user; the identification information of the target user includes: a user name and a device identification of a device used by the user;

[0021] According to the gesture of releasing the finger in the file sending gesture, an operation of sending the file to be sent to the target user is performed according to the identification information of the target user.

[0022] Optionally, the step of obtaining the identification information of the target user includes:

[0023] When the conference interface of the target user is a virtual conference interface generated by a three-dimensional holographic projection device, obtaining the user name of the target user and the device identifier of the three-dimensional holographic projection device in the physical space where the target user is located as the identification information of the target user;

[0024] When the conference interface of the target user is a conference interface on a mobile phone or a computer, the user name of the target user and the device identification of the mobile phone or the computer are obtained as the identification information of the target user.

[0025] Optionally, before the step of scanning the physical space in real time to capture the hand movements of the user when interacting with the virtual conference interface, the method further includes:

[0026] Receive a request from a user to enter an online meeting, wherein the request includes identification information of the user and identification information of the online meeting; the identification information of the user includes a user name of the user and a device identification of a device used by the user;

[0027] According to the identification information of the online meeting in the request, obtaining the identification information of the target participant corresponding to the online meeting;

[0028] authenticating the identity of the user according to the identification information of the user in the request and the identification information of the target conference participant;

[0029] When the user's identity authentication is passed, the user is allowed to enter the online meeting; and a virtual meeting interface of the online meeting is projected in the air in front of the user; wherein the virtual meeting interface includes: image information of other users participating in the online meeting except the user.

[0030] In a second aspect, an embodiment of the present invention provides a device for sending a file, the device comprising:

[0031] A capture module is used to scan the physical space in real time and capture the hand movements of the user when interacting with the virtual conference interface; the user is a user participating in an online conference; the virtual conference interface is a conference interface of the online conference projected in the air in front of the user by the three-dimensional holographic projection device;

[0032] A matching module, used to sequentially match the captured hand movements with the gestures in the pre-created file sending gesture stream; if the match is successful, confirming that the file sending gesture issued by the user is obtained;

[0033] A confirmation module, used for confirming that the file sending gesture issued by the user is obtained when the captured hand movements are matched with the gestures in the pre-created file sending gesture stream in sequence;

[0034] A sending module is used to send the file to be sent to a target user according to the file sending gesture, wherein the target user is a user who participates in the same online conference as the user.

[0035] Optional, capture module, specifically used to:

[0036] Scan the physical space in real time to capture images of users interacting with the virtual meeting interface;

[0037] The user's hand movements in the captured image information are identified in sequence to obtain the user's hand movements.

[0038] Optionally, the pre-created gesture flow includes:

[0039] The user stands in front of the virtual conference interface, aligns his palm with the file to be sent in the virtual conference interface, bends his fingers into a grabbing posture, translates them to the user image position of the target user, or throws them in the direction of the seat of the target user, or throws them toward the three-dimensional holographic projection device, and releases the finger gesture flow; wherein the target user is a user who participates in the same online meeting as the user, or a user who participates in the same online meeting as the user and is in the same physical space.

[0040] Optional, sending module, specifically used for:

[0041] According to the gesture of sending a file, the user points his palm at the file to be sent in front of the virtual conference interface, and obtains the position of the user's palm in the air as the palm position; matches the palm position with the position of the file in the virtual conference interface, confirms the file whose file position matches the palm position as the file to be sent, moves the cursor to the file to be sent, and obtains the identification information of the file to be sent;

[0042] According to the gesture of bending the fingers into a grabbing posture in the file sending gesture, an operation of acquiring the file to be sent from the storage system according to the identification information of the file to be sent is performed;

[0043] According to the gesture of translating to the user image position of the target user in the file sending gesture, confirm the movement trajectory of the user's palm translation, and generate a picture corresponding to the movement of the file to be sent in the virtual conference interface according to the movement trajectory of the user's palm translation; match the end position of the trajectory with the user image position in the virtual conference interface; and confirm the user whose user image position matches the end position of the trajectory as the target user;

[0044] Or, according to the gesture of throwing to the seat direction of the target user in the file sending gesture, the movement trajectory of the user's palm and the action of the forearm are obtained, and the throwing direction is confirmed according to the movement trajectory of the user's palm and the action of the forearm; the position of the extension line of the throwing direction is matched with the seat positions of other users in the same physical space, and the user whose seat position is the same as the extension line position of the throwing direction is confirmed as the target user;

[0045] Or, according to the gesture of throwing the file toward the three-dimensional holographic projection device in the gesture of sending the file, other users who participate in the same online meeting with the user are confirmed as target users;

[0046] An operation of obtaining identification information of the target user; the identification information of the target user includes: a user name and a device identification of a device used by the user;

[0047] According to the gesture of releasing the finger in the file sending gesture, an operation of sending the file to be sent to the target user is performed according to the identification information of the target user.

[0048] Optional, sending module, specifically used for:

[0049] When the conference interface of the target user is a virtual conference interface generated by a three-dimensional holographic projection device, obtaining the user name of the target user and the device identifier of the three-dimensional holographic projection device in the physical space where the target user is located as the identification information of the target user;

[0050] When the conference interface of the target user is a conference interface on a mobile phone or a computer, the user name of the target user and the device identification of the mobile phone or the computer are obtained as the identification information of the target user.

[0051] Optionally, the device further includes:

[0052] A receiving module, configured to receive a request from a user to enter an online conference, wherein the request includes identification information of the user and identification information of the online conference; the identification information of the user includes a user name of the user and a device identification of a device used by the user;

[0053] An acquisition module, configured to acquire identification information of a target participant corresponding to the online meeting according to the identification information of the online meeting in the request;

[0054] An authentication module, used to authenticate the identity of the user according to the identification information of the user in the request and the identification information of the target conference participant;

[0055] A projection module is used to allow the user to enter the online meeting when the user's identity authentication is passed; and to project a virtual meeting interface of the online meeting in the air in front of the user; wherein the virtual meeting interface includes: image information of other users participating in the online meeting except the user.

[0056] In a third aspect, an embodiment of the present invention further provides an electronic device, comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus;

[0057] The memory is used to store computer programs;

[0058] The processor is used to implement the method steps of sending files described in the first aspect when executing the program stored in the memory.

[0059] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method steps for sending a file described in the first aspect above are implemented.

[0060] The method provided by the embodiment of the present invention can realize real-time scanning of the physical space, capture the hand movements of the user when interacting with the virtual conference interface; match the captured hand movements with the gestures in the pre-created file sending gesture stream in sequence; if the match is successful, it is confirmed that the file sending gesture issued by the user is obtained; according to the file sending gesture, the file to be sent is sent to the target user. It can be seen that the method provided by the embodiment of the present invention can realize the projection of the virtual conference interface of the online meeting in the air in front of the user in the conference room scenario, and quickly and conveniently send files to the user through hand movements when interacting with the virtual conference interface, thereby solving the problem of complex operation in the prior art.

[0061] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description, claims, and drawings.

[0062] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0064] Figure 1 A schematic diagram of a flow chart of a method for sending a file provided in an embodiment of the present invention;

[0065] Figure 2 A schematic diagram of a process of sending a file provided in Example 1;

[0066] Figure 3 A schematic diagram of a process of sending a file provided in Example 2;

[0067] Figure 4 A schematic diagram of a process of sending a file provided in Example 3;

[0068] Figure 5 A schematic diagram of the structure of a device for sending files provided by an embodiment of the present invention;

[0069] Figure 6 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0070] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0071] In practical applications, the physical space may be a conference room, and a three-dimensional holographic projection device is arranged in the physical space. Specifically, the three-dimensional holographic projection device may be a naked-eye three-dimensional holographic projection device. Figure 1 A flowchart of a method for sending a file provided by an embodiment of the present invention is shown in FIG. Figure 1 As shown, the method includes:

[0072] S101: Scanning the physical space in real time to capture hand movements of a user when interacting with a virtual conference interface; the user is a user participating in an online conference; the virtual conference interface is a conference interface of the online conference projected in the air in front of the user by a three-dimensional holographic projection device;

[0073] Specifically, the three-dimensional projector device can scan the conference room in real time, capture and identify the hand movements of each user in the conference room screen when interacting with the virtual conference interface.

[0074] In actual applications, before the steps of real-time scanning of the physical space and capturing the hand movements of users when interacting with the virtual meeting interface, it also includes:

[0075] Receive a request from a user to enter an online meeting, where the request includes identification information of the user and identification information of the online meeting; the identification information of the user includes a user name of the user and a device identification of a device used by the user;

[0076] According to the identification information of the online meeting in the request, obtain the identification information of the target participant corresponding to the online meeting;

[0077] Authenticate the user's identity based on the user's identification information in the request and the identification information of the target participant;

[0078] When the user's identity authentication is passed, the user is allowed to enter the online meeting; and a virtual meeting interface of the online meeting is projected in the air in front of the user; wherein the virtual meeting interface includes: image information of other users participating in the online meeting except the user.

[0079] Specifically, the conference interface is projected in the air in front of the user using the holographic projection technology in the 3D projector. Holographic projection technology (front-projected holographic display) is a type of 3D technology, which refers to the technology that uses the interference principle to record and reproduce the real three-dimensional image of an object.

[0080] If both parties in different offline conference rooms have 3D projector equipment, then the 3D projector equipment of both parties will use holographic projection technology to generate real portrait information for the other party's participants as user images based on the real picture of the other party's conference room, and display it on their own conference interface.

[0081] If one of the two participants in different offline conference rooms has a 3D projector device and the other does not, then the two participants will each generate a default user image for the other participant and display it on their own conference interface.

[0082] Specifically, the method for authenticating the identity of the user can be that the identification information of the persons who will participate in the online meeting has been saved in the system. When the user requests to enter the online meeting, the user's identification information is obtained, and the user's identification information is matched with the saved identification information of the persons who will participate in the online meeting. If the match is successful, it indicates that the user's identity authentication has passed, and the user is allowed to enter the online meeting; if the match is unsuccessful, it indicates that the user's identity authentication has failed, and the user cannot enter the online meeting.

[0083] S102: matching the captured hand motion with the gestures in the pre-created file sending gesture stream in sequence; if the matching is successful, confirming that the file sending gesture issued by the user is obtained;

[0084] Specifically, the pre-created gesture flows may include the following three gesture flows:

[0085] In the first method, the user stands in front of the virtual conference interface, aligns his palm with the file to be sent in the virtual conference interface, bends his fingers into a grabbing posture, moves them horizontally to the user image position of the target user, and releases the gesture flow of his fingers; the target user is a user who participates in the same online meeting as the user.

[0086] The second type is that the user stands in front of the virtual meeting interface, aligns his palm with the file to be sent in the virtual meeting interface, bends his fingers into a grabbing posture, throws it in the direction of the target user's seat, and releases the fingers; the target user is a user who participates in the same online meeting as the user and is in the same physical space.

[0087] The third type is that the user stands in front of the virtual meeting interface, aligns his palm with the file to be sent in the virtual meeting interface, bends his fingers into a grabbing posture, throws it toward the three-dimensional holographic projection device, and releases the fingers; the target user is the user who participates in the same online meeting as the user.

[0088] The first gesture flow mentioned above is a gesture flow for a participant in the conference room to send a file to an online participant. The second gesture flow is a gesture flow for a participant in the conference room to send a file to a participant in the same conference room as the participant. The third gesture flow is a gesture flow for a participant in the conference room to send a file to all other participants in the same online conference.

[0089] Based on the first gesture flow, in Embodiment 1, the step of sending the file to be sent to the target user according to the gesture of sending the file may include:

[0090] According to the gesture of sending a file, the user, in front of the virtual conference interface, aligns his palm with the file to be sent, and obtains the position of the user's palm in the air as the palm position; matches the palm position with the position of the file in the virtual conference interface, confirms the file whose file position matches the palm position as the file to be sent, moves the cursor to the file to be sent, and obtains the identification information of the file to be sent;

[0091] According to the gesture of bending the fingers into a grabbing posture in the file sending gesture, an operation of obtaining the file to be sent from the storage system according to the identification information of the file to be sent is performed;

[0092] According to the gesture of translating to the user image position of the target user in the gesture of sending the file, the moving trajectory of the user's palm is confirmed, and according to the moving trajectory of the user's palm, a picture corresponding to the movement of the file to be sent is generated in the virtual conference interface; the end position of the trajectory is matched with the user image position in the virtual conference interface; the user whose user image position matches the end position of the trajectory is confirmed as the target user; the operation of obtaining the identification information of the target user; the identification information of the target user includes: the user name and the device identification of the device used by the user;

[0093] According to the gesture of releasing the finger in the gesture of sending the file, an operation of sending the file to be sent to the target user is performed according to the identification information of the target user.

[0094] Based on the second gesture flow, in Embodiment 2, the step of sending the file to be sent to the target user according to the gesture of sending the file may include:

[0095] According to the gesture of sending a file, the user, in front of the virtual conference interface, aligns his palm with the file to be sent, and obtains the position of the user's palm in the air as the palm position; matches the palm position with the position of the file in the virtual conference interface, confirms the file whose file position matches the palm position as the file to be sent, moves the cursor to the file to be sent, and obtains the identification information of the file to be sent;

[0096] According to the gesture of bending the fingers into a grabbing posture in the file sending gesture, an operation of obtaining the file to be sent from the storage system according to the identification information of the file to be sent is performed;

[0097] According to the gesture of throwing to the target user's seat direction in the gesture of sending a file, the movement trajectory of the user's palm and the action of the forearm are obtained, and the throwing direction is confirmed according to the movement trajectory of the user's palm and the action of the forearm; the position of the extension line of the throwing direction is matched with the seat positions of other users in the same physical space, and the user whose seat position is the same as the extension line position of the throwing direction is confirmed as the target user; the operation of obtaining the identification information of the target user; the identification information of the target user includes: the user name and the device identification of the device used by the user;

[0098] According to the gesture of releasing the finger in the gesture of sending the file, an operation of sending the file to be sent to the target user is performed according to the identification information of the target user.

[0099] Based on the third gesture flow, in Embodiment 3, the step of sending the file to be sent to the target user according to the gesture of sending the file may include:

[0100] According to the gesture of sending a file, the user, in front of the virtual conference interface, aligns his palm with the file to be sent, and obtains the position of the user's palm in the air as the palm position; matches the palm position with the position of the file in the virtual conference interface, confirms the file whose file position matches the palm position as the file to be sent, moves the cursor to the file to be sent, and obtains the identification information of the file to be sent;

[0101] According to the gesture of bending the fingers into a grabbing posture in the file sending gesture, an operation of obtaining the file to be sent from the storage system according to the identification information of the file to be sent is performed;

[0102] According to the gesture of throwing the file toward the three-dimensional holographic projection device in the gesture of sending the file, other users who participate in the same online meeting with the user are confirmed as target users; the operation of obtaining the identification information of the target user is performed; the identification information of the target user includes: the user name and the device identification of the device used by the user;

[0103] According to the gesture of releasing the finger in the gesture of sending the file, an operation of sending the file to be sent to the target user is performed according to the identification information of the target user.

[0104] In a specific embodiment, when the conference interface of the target user is a virtual conference interface generated by a three-dimensional holographic projection device, the step of obtaining the identification information of the target user may include:

[0105] The user name of the target user and the device identification of the three-dimensional holographic projection device in the physical space where the target user is located are obtained as the identification information of the target user.

[0106] When the target user's conference interface is a conference interface on a mobile phone or a computer (that is, there is no three-dimensional holographic projection device in the conference room where the target user is located), the step of obtaining the target user's identification information may include:

[0107] Obtain the target user's user name and the device ID of the mobile phone or computer as the target user's identification information.

[0108] S103: Send the file to be sent to a target user according to the file sending gesture, wherein the target user is a user participating in the same online conference as the user.

[0109] Depend on Figure 1 It can be seen that the method provided by the embodiment of the present invention can realize real-time scanning of the physical space, capture the hand movements of the user when interacting with the virtual conference interface; match the captured hand movements with the gestures in the pre-created file sending gesture stream in sequence; if the match is successful, it is confirmed that the file sending gesture issued by the user is obtained; according to the file sending gesture, the file to be sent is sent to the target user. It can be seen that the method provided by the embodiment of the present invention can realize the projection of the virtual conference interface of the online meeting in the air in front of the user in the conference room scenario, and quickly and conveniently send files to the user through hand movements when interacting with the virtual conference interface, thereby solving the problem of complex operation in the prior art.

[0110] The following three practical examples are given to further illustrate the method provided by the embodiments of the present invention in more detail. The scenes of the three embodiments are all conference room scenes. And the conference room is equipped with a naked eye 3D projector device.

[0111] Example 1: This example is a process in which user A in a conference room sends a file to online participant B. Figure 2 , the process of this embodiment is:

[0112] S201: Scanning the conference room in real time, capturing and identifying hand movements of each user in the conference room screen when interacting with the virtual conference interface;

[0113] S202: when user A is captured in front of his virtual conference interface and makes an action of aligning his palm with the file to be sent, the operation of obtaining the position of the user's palm in the air as the palm position is executed; matching the palm position with the position of the file in the virtual conference interface, confirming the file whose file position matches the palm position as the file to be sent, moving the cursor to the file to be sent, and obtaining the identification information of the file to be sent is executed;

[0114] S203: when it is captured that user A makes a gesture of bending his fingers into a grabbing posture in front of his virtual conference interface, an operation of acquiring the file to be sent from the storage system according to the identification information of the file to be sent is executed;

[0115] S204: when user A is captured making a gesture of moving to the user image position of user B in front of his virtual conference interface, confirm the movement trajectory of the user's palm, and generate a corresponding moving picture of the file to be sent in the virtual conference interface according to the movement trajectory of the user's palm; match the end position of the trajectory with the user image position in the virtual conference interface; confirm user B whose user image position matches the end position of the trajectory as the target user; obtain the identification information of user B; the identification information of user B includes: the user name of user B and the device identification of the device used by user B;

[0116] S205: When it is captured that user A makes a finger-loosening gesture in front of his virtual conference interface, an operation of sending the file to be sent to user B is executed according to the identification information of user B.

[0117] Example 2: This example is a process in which user C in a conference room sends a file to participant D in the same offline conference room as the user. Figure 3 , the process of this embodiment is:

[0118] S301: Scan the conference room in real time, capture and identify the hand movements of each user in the conference room screen when interacting with the virtual conference interface;

[0119] S302: when user C is captured in front of his virtual conference interface and makes an action of aligning his palm with the file to be sent, the position of the user's palm in the air is obtained as the palm position; the palm position is matched with the position of the file in the virtual conference interface, the file whose file position matches the palm position is confirmed as the file to be sent, the cursor is moved to the file to be sent, and the identification information of the file to be sent is obtained;

[0120] S303: when it is captured that user C is making a gesture of bending his fingers into a grabbing posture in front of his virtual conference interface, an operation of obtaining the file to be sent from the storage system according to the identification information of the file to be sent is executed;

[0121] S304: When user C is captured in front of his virtual conference interface, making a gesture of throwing in the direction of user D's seat, the user's palm movement trajectory and forearm movement are obtained, and the throwing direction is confirmed according to the user's palm movement trajectory and forearm movement; the position of the extended line of the throwing direction is matched with the seat positions of other users in the same physical space, and user D whose seat position is the same as the extended line position of the throwing direction is confirmed as the target user; the identification information of user D is obtained; the identification information of user D includes: the user name of user D and the device identification of the device used by user D;

[0122] S305: When it is captured that user C makes a finger-loosening gesture in front of his virtual conference interface, an operation of sending the file to be sent to user D is executed according to the identification information of user D.

[0123] Example 3: This example is a process in which participant E in an offline conference room sends a file to all other participants in the same online conference. Figure 4 , the process of this embodiment is:

[0124] S401: Scan the conference room in real time, capture and identify the hand movements of each user in the conference room screen when interacting with the virtual conference interface;

[0125] S402: when user E is captured in front of his virtual conference interface and makes an action of aligning his palm with the file to be sent, the operation of obtaining the position of the user's palm in the air as the palm position is executed; matching the palm position with the position of the file in the virtual conference interface, confirming the file whose file position matches the palm position as the file to be sent, moving the cursor to the file to be sent, and obtaining the identification information of the file to be sent is executed;

[0126] S403: when it is captured that the user E makes a gesture of bending the fingers into a grabbing posture in front of his virtual conference interface, an operation of obtaining the file to be sent from the storage system according to the identification information of the file to be sent is executed;

[0127] S404: when user E is captured to make a gesture of throwing the 3D holographic projection device in front of his virtual conference interface, other users who participate in the same online conference as the user are confirmed as target users; and identification information of the target user is obtained; the identification information of the target user includes: a user name and a device identification of the device used by the user;

[0128] S405: When it is captured that user E makes a finger-loosening gesture in front of his virtual conference interface, an operation of sending the file to be sent to the target user is executed according to the identification information of the target user.

[0129] Depend on Figure 2-4 As can be seen from the illustrated embodiments, the method provided by the embodiments of the present invention can, in a conference room scenario, realize projecting a virtual conference interface of an online meeting in the air in front of the user, and quickly and conveniently send files to the user through hand movements when interacting with the virtual conference interface, thereby solving the problem of complex operation existing in the prior art.

[0130] and Figure 1 Corresponding to the embodiment shown in FIG. 1 , the embodiment of the present invention further provides a device for sending files. Figure 5 As shown, the device includes: a capture module 501, a matching module 502, a confirmation module 503, and a sending module 504, wherein:

[0131] The capture module 501 is used to scan the physical space in real time and capture the hand movements of the user when interacting with the virtual conference interface; the user is a user participating in an online conference; the virtual conference interface is a conference interface of the online conference projected in the air in front of the user by a three-dimensional holographic projection device;

[0132] The matching module 502 is used to sequentially match the captured hand movements with the gestures in the pre-created file sending gesture stream; if the match is successful, it is confirmed that the file sending gesture issued by the user is obtained;

[0133] The confirmation module 503 is used to confirm that the file sending gesture issued by the user is obtained when the captured hand motion is successfully matched with the gestures in the pre-created file sending gesture stream in sequence;

[0134] The sending module 504 is used to send the file to be sent to the target user according to the file sending gesture, wherein the target user is a user participating in the same online conference as the user.

[0135] Optionally, the capture module 501 is specifically used for:

[0136] Scan the physical space in real time to capture images of users interacting with the virtual meeting interface;

[0137] The user's hand movements in the captured image information are identified in sequence to obtain the user's hand movements.

[0138] Optional, pre-built gesture flows, including:

[0139] The user stands in front of the virtual conference interface, aligns his palm with the file to be sent in the virtual conference interface, bends his fingers into a grabbing posture, moves them horizontally to the user image position of the target user, or throws them in the direction of the seat of the target user, or throws them toward the three-dimensional holographic projection device, and releases the finger gesture flow; wherein the target user is a user who participates in the same online meeting as the user, or a user who participates in the same online meeting as the user and is in the same physical space.

[0140] Optionally, the sending module 504 is specifically configured to:

[0141] According to the gesture of sending a file, the user, in front of the virtual conference interface, aligns his palm with the file to be sent, and obtains the position of the user's palm in the air as the palm position; matches the palm position with the position of the file in the virtual conference interface, confirms the file whose file position matches the palm position as the file to be sent, moves the cursor to the file to be sent, and obtains the identification information of the file to be sent;

[0142] According to the gesture of bending the fingers into a grabbing posture in the file sending gesture, an operation of obtaining the file to be sent from the storage system according to the identification information of the file to be sent is performed;

[0143] According to the gesture of moving to the user image position of the target user in the gesture of sending the file, the moving trajectory of the user's palm is confirmed, and according to the moving trajectory of the user's palm, a picture corresponding to the movement of the file to be sent is generated in the virtual conference interface; the end position of the trajectory is matched with the user image position in the virtual conference interface; the user whose user image position matches the end position of the trajectory is confirmed as the target user;

[0144] Or, according to the gesture of throwing the file in the direction of the target user's seat in the gesture of sending the file, the movement trajectory of the user's palm and the action of the forearm are obtained, and the throwing direction is confirmed according to the movement trajectory of the user's palm and the action of the forearm; the position of the extension line of the throwing direction is matched with the seat positions of other users in the same physical space, and the user whose seat position is the same as the extension line position of the throwing direction is confirmed as the target user;

[0145] Or, according to the gesture of throwing the file toward the three-dimensional holographic projection device in the gesture of sending the file, other users who participate in the same online meeting with the user are confirmed as target users;

[0146] An operation of obtaining identification information of a target user; the identification information of the target user includes: a user name and a device identification of a device used by the user;

[0147] According to the gesture of releasing the finger in the gesture of sending the file, an operation of sending the file to be sent to the target user is performed according to the identification information of the target user.

[0148] Optionally, the sending module 504 is specifically configured to:

[0149] When the conference interface of the target user is a virtual conference interface generated by a three-dimensional holographic projection device, obtaining the user name of the target user and the device identifier of the three-dimensional holographic projection device in the physical space where the target user is located as the identification information of the target user;

[0150] When the conference interface of the target user is a conference interface on a mobile phone or a computer, the user name of the target user and the device identifier of the mobile phone or the computer are obtained as the identification information of the target user.

[0151] Optionally, the device further includes:

[0152] A receiving module, used to receive a request from a user to enter an online meeting, wherein the request includes identification information of the user and identification information of the online meeting; the identification information of the user includes the user name of the user and the device identification of the device used by the user;

[0153] An acquisition module, used to acquire identification information of target participants corresponding to the online meeting according to the identification information of the online meeting in the request;

[0154] An authentication module, used to authenticate the user's identity based on the user's identification information in the request and the identification information of the target participant;

[0155] The projection module is used to allow the user to enter the online meeting when the user's identity authentication is passed; and to project the virtual meeting interface of the online meeting in the air in front of the user; wherein the virtual meeting interface includes: image information of other users participating in the online meeting except the user.

[0156] It can be seen that the device provided by the embodiment of the present invention can, in a conference room scenario, realize projecting a virtual conference interface of an online meeting in the air in front of the user, and quickly and conveniently send files to the user through hand movements when interacting with the virtual conference interface, thereby solving the problem of complex operation existing in the prior art.

[0157] and Figure 1 Corresponding to the embodiment shown, the embodiment of the present invention further provides an electronic device, see Figure 6 , including a processor 601, a communication interface 602, a memory 603 and a communication bus 604, wherein the processor 601, the communication interface 602, and the memory 603 communicate with each other through the communication bus 604;

[0158] Memory 603, used for storing computer programs;

[0159] The processor 601 is configured to implement any of the steps of the method for sending a file described in the above embodiments when executing a program stored in the memory.

[0160] It can be seen that the electronic device provided by the embodiment of the present invention can, in a conference room scenario, project a virtual conference interface of an online meeting in the air in front of the user, and quickly and conveniently send files to the user through hand movements when interacting with the virtual conference interface, thereby solving the problem of complex operation existing in the prior art.

[0161] and Figure 1 Corresponding to the embodiment shown, an embodiment of the present invention further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, any method step of sending a file described in the above embodiments is implemented.

[0162] It can be seen that the storage medium provided in the embodiment of the present invention can realize the projection of a virtual conference interface of an online meeting in the air in front of the user in a conference room scenario, and quickly and conveniently send files to the user through hand movements when interacting with the virtual conference interface, thereby solving the problem of complex operation existing in the prior art.

[0163] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer-usable program code.

[0164] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0165] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0166] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0167] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A method for sending a file, characterized in that: Applied to a three-dimensional holographic projection device, the method comprises: The physical space is scanned in real time to capture the hand movements of the user when interacting with the virtual conference interface; the user is a user participating in an online conference; the virtual conference interface is a conference interface of the online conference projected in the air in front of the user by the three-dimensional holographic projection device; Matching the captured hand movements with the gestures in the pre-created file sending gesture stream in sequence; if the match is successful, confirming that the file sending gesture issued by the user is obtained; According to the file sending gesture, the file to be sent is sent to a target user, wherein the target user is a user participating in the same online conference as the user.

2. The method according to claim 1, characterized in that The step of scanning the physical space in real time and capturing the hand movements of the user when interacting with the virtual conference interface includes: Scan the physical space in real time to capture images of users interacting with the virtual meeting interface; The user's hand movements in the captured image information are identified in sequence to obtain the user's hand movements.

3. The method according to claim 2, characterized in that The pre-created gesture flow includes: The user stands in front of the virtual conference interface, aligns his palm with the file to be sent in the virtual conference interface, bends his fingers into a grabbing posture, translates them to the user image position of the target user, or throws them in the direction of the seat of the target user, or throws them toward the three-dimensional holographic projection device, and releases the finger gesture flow; wherein the target user is a user who participates in the same online meeting as the user, or a user who participates in the same online meeting as the user and is in the same physical space.

4. The method according to claim 3, characterized in that: The step of sending the file to be sent to the target user according to the file sending gesture includes: According to the gesture of sending a file, the user points his palm at the file to be sent in front of the virtual conference interface, and obtains the position of the user's palm in the air as the palm position; matches the palm position with the position of the file in the virtual conference interface, confirms the file whose file position matches the palm position as the file to be sent, moves the cursor to the file to be sent, and obtains the identification information of the file to be sent; According to the gesture of bending the fingers into a grabbing posture in the file sending gesture, an operation of acquiring the file to be sent from the storage system according to the identification information of the file to be sent is performed; According to the gesture of translating to the user image position of the target user in the file sending gesture, confirm the movement trajectory of the user's palm translation, and generate a picture corresponding to the movement of the file to be sent in the virtual conference interface according to the movement trajectory of the user's palm translation; match the end position of the trajectory with the user image position in the virtual conference interface; and confirm the user whose user image position matches the end position of the trajectory as the target user; Or, according to the gesture of throwing to the seat direction of the target user in the file sending gesture, the movement trajectory of the user's palm and the action of the forearm are obtained, and the throwing direction is confirmed according to the movement trajectory of the user's palm and the action of the forearm; the position of the extension line of the throwing direction is matched with the seat positions of other users in the same physical space, and the user whose seat position is the same as the extension line position of the throwing direction is confirmed as the target user; Or, according to the gesture of throwing the file toward the three-dimensional holographic projection device in the gesture of sending the file, other users who participate in the same online meeting with the user are confirmed as target users; An operation of obtaining identification information of the target user; the identification information of the target user includes: a user name and a device identification of a device used by the user; According to the gesture of releasing the finger in the file sending gesture, an operation of sending the file to be sent to the target user is performed according to the identification information of the target user.

5. The method according to claim 4, characterized in that The step of obtaining the identification information of the target user includes: When the conference interface of the target user is a virtual conference interface generated by a three-dimensional holographic projection device, obtaining the user name of the target user and the device identifier of the three-dimensional holographic projection device in the physical space where the target user is located as the identification information of the target user; When the conference interface of the target user is a conference interface on a mobile phone or a computer, the user name of the target user and the device identification of the mobile phone or the computer are obtained as the identification information of the target user.

6. The method according to claim 1, characterized in that Before the step of scanning the physical space in real time to capture the hand movements of the user when interacting with the virtual meeting interface, the method further includes: Receive a request from a user to enter an online meeting, wherein the request includes identification information of the user and identification information of the online meeting; the identification information of the user includes a user name of the user and a device identification of a device used by the user; According to the identification information of the online meeting in the request, obtaining the identification information of the target participant corresponding to the online meeting; authenticating the identity of the user according to the identification information of the user in the request and the identification information of the target conference participant; When the user's identity authentication is passed, the user is allowed to enter the online meeting; and a virtual meeting interface of the online meeting is projected in the air in front of the user; wherein the virtual meeting interface includes: image information of other users participating in the online meeting except the user.

7. A device for sending a file, characterized in that: The device comprises: A capture module is used to scan the physical space in real time and capture the hand movements of the user when interacting with the virtual conference interface; the user is a user participating in an online conference; the virtual conference interface is a conference interface of the online conference projected in the air in front of the user by the three-dimensional holographic projection device; A matching module, used to sequentially match the captured hand movements with the gestures in the pre-created file sending gesture stream; if the match is successful, confirming that the file sending gesture issued by the user is obtained; A confirmation module, used for confirming that the file sending gesture issued by the user is obtained when the captured hand movements are matched with the gestures in the pre-created file sending gesture stream in sequence; A sending module is used to send the file to be sent to a target user according to the file sending gesture, wherein the target user is a user who participates in the same online conference as the user.

8. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; The memory is used to store computer programs; The processor is used to implement the method steps described in any one of claims 1-6 when executing the program stored in the memory.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method steps described in any one of claims 1 to 6 are implemented.

Citation Information

Patent Citations

  • Methods and systems for creating virtual and augmented reality

    CN106937531A

  • Virtual office system based on meta universe

    CN116449958A

  • Method and device for developing multimedia conference

    CN117676070A