Method, system, computer equipment and medium for multi-person handwriting collaborative conference

Abstract

The present disclosure discloses a method, system, computer device, and medium for a multi-person handwriting collaborative conference. In a specific embodiment, the method includes setting parameters according to a segmentation method to form segmented areas; collecting instruction images of each participant in the segmented areas corresponding to each participant, and when the instruction images are recognized as preset instructions, sending a request signal to the conference all-in-one machine and receiving a first display content; projecting the segmented area corresponding to the participant who issued the instruction image and displaying the first display content; collecting first coordinate point data of the participant who issued the instruction image writing on the first display content and sending it to the conference all-in-one machine, so that the conference all-in-one machine converts the first coordinate point data to obtain second coordinate point data and displays the second coordinate point data to form a written note.

Description

Technical Field

[0001] The present disclosure relates to the technical field of conference management, and more specifically, to a method, system, computer device, and medium for multi-person handwriting collaborative conference. Background Art

[0002] In related technologies, multiple tablet computers (Portable Android Devices, PADs) are installed in conference rooms for each participant to use, and each PAD can interact with the all-in-one conference machine. However, this technology has disadvantages such as requiring individual maintenance for each PAD, ensuring sufficient battery power, ensuring PAD mobility, ensuring that PADs are not accidentally taken out of the conference room, ensuring that PAD network settings are not manipulated, and ensuring that the PADs and the all-in-one conference machine are connected to the same local area network. Summary of the Invention

[0003] The present disclosure aims to provide a method, system, computer device and medium for multi-person handwriting collaborative conferencing to solve at least one of the problems existing in the prior art.

[0004] To achieve the above objectives, the present disclosure adopts the following technical solutions:

[0005] A first aspect of the present disclosure provides a method for multi-person handwriting collaborative conferencing, which is applied to a projection device and includes:

[0006] Set parameters according to the segmentation method to form segmentation areas;

[0007] Collecting the command image of each participant in the corresponding segmented area, and when identifying the command image as a preset command, sending a request signal to the all-in-one conference machine and receiving the first display content;

[0008] Projecting the segmented area corresponding to the participant who issued the command image and displaying the first display content;

[0009] The first coordinate point data of the first display content written by the participant who issued the command image is collected and sent to the conference all-in-one machine, so that the conference all-in-one machine converts the first coordinate point data to obtain second coordinate point data suitable for the conference all-in-one machine and displays the second coordinate point data to form written notes.

[0010] Optionally, setting parameters according to the segmentation mode to form segmented regions further includes:

[0011] receiving the segmentation mode setting parameters through an external device connected to the projection device, wherein the segmentation mode setting parameters include the number of segmentation areas and the positions of the segmentation areas;

[0012] The number of the divided areas is the same as the number of the participants;

[0013] The location of the segmented area is on a side of the conference desktop close to the participant.

[0014] Optionally, after forming segmented areas by setting parameters according to the segmentation mode, the method further includes:

[0015] Perform a first brightness projection on each of the segmented areas.

[0016] Optionally, projecting the segmented area corresponding to the participant who issued the command image and displaying the first display content further includes:

[0017] Performing a second brightness projection on the segmented area corresponding to the participant who issued the command image and displaying the first display content;

[0018] The second brightness is greater than the first brightness.

[0019] Optionally, collecting first coordinate point data of the participant who issued the command image writing on the first display content further includes:

[0020] capturing an image of the participant who issued the command image writing on the first display content;

[0021] Acquire a first coordinate point of the writing operation in a first coordinate system according to the image;

[0022] The origin of the first coordinate system is the vertex in the lower left corner of the segmented area corresponding to the participant who issued the command image;

[0023] The horizontal axis of the first coordinate system is an edge extending from the vertex along a first direction in the segmented area corresponding to the participant who issued the command image, and the first direction is an extending direction of the edge of the segmented area close to the participant;

[0024] The vertical axis of the first coordinate system is an edge extending from the vertex along the second direction in the segmented area corresponding to the participant who issued the command image, and the first direction is perpendicular to the second direction;

[0025] The horizontal coordinate of the first coordinate point in the first coordinate system is X R1 , the vertical coordinate is Y R1 , X R1 Y is the distance between the projection of the first coordinate point on the horizontal axis and the origin, R1 is the distance between the projection of the first coordinate point on the vertical axis and the origin.

[0026] Optionally, converting the first coordinate point data to obtain second coordinate point data suitable for the all-in-one conference device further includes:

[0027] Obtaining coordinate data of a second coordinate point in a second coordinate system according to the coordinate data of the first coordinate point in the first coordinate system and a coordinate conversion coefficient;

[0028] The origin of the second coordinate system is the vertex in the lower left corner of the display screen of the conference all-in-one machine;

[0029] The horizontal axis of the second coordinate system is an edge extending from the vertex along the third direction on the display screen of the all-in-one conference machine;

[0030] The longitudinal axis of the second coordinate system is an edge extending from the vertex along a fourth direction on the display screen of the all-in-one conference machine, and the third direction is perpendicular to the fourth direction;

[0031] The horizontal coordinate of the second coordinate point in the second coordinate system is a*X R1 , the vertical coordinate is b*Y R1 , a is the ratio of the length of the side extending along the third direction in the display screen of the all-in-one conference machine to the length of the side extending along the first direction in the divided area corresponding to the participant who issued the command image, and b is the ratio of the length of the side extending along the fourth direction in the display screen of the all-in-one conference machine to the length of the side extending along the second direction in the divided area corresponding to the participant who issued the command image.

[0032] Optionally, collecting first coordinate point data of the participant who issued the command image writing on the first display content further includes:

[0033] capturing an image of the participant who issued the command image writing on the first display content;

[0034] Acquire a first coordinate point of the writing operation in a first coordinate system according to the image;

[0035] The origin of the first coordinate system is the vertex in the lower left corner of the conference desktop;

[0036] The horizontal axis of the first coordinate system is an edge of the conference desktop extending from the vertex along a first direction, and the first direction is an extending direction of an edge of the segmented area close to the participant;

[0037] The longitudinal axis of the first coordinate system is an edge of the conference desktop extending from the vertex along a second direction, and the first direction is perpendicular to the second direction;

[0038] The horizontal coordinate of the first coordinate point in the first coordinate system is Xm =X1+X L1 , the vertical coordinate is Y m =Y1+Y L2 , X1 is the horizontal coordinate of any vertex in the segmented area to which the writing operation belongs in the first coordinate system, Y1 is the vertical coordinate corresponding to X1 in the first coordinate system, X L1 Y is the distance between the projection of the first coordinate point on the edge extending along the first direction in the segmented area to which it belongs and X1, L2 is the distance between the projection of the first coordinate point on the side extending along the second direction in the corresponding segmented area and Y1.

[0039] Optionally, converting the first coordinate point data to obtain second coordinate point data suitable for the all-in-one conference device further includes:

[0040] Obtaining coordinate data of a second coordinate point in a second coordinate system according to the coordinate data of the first coordinate point in the first coordinate system and a coordinate conversion coefficient;

[0041] The origin of the second coordinate system is the vertex in the lower left corner of the display screen of the conference all-in-one machine;

[0042] The horizontal axis of the second coordinate system is an edge extending from the vertex along the third direction on the display screen of the all-in-one conference machine;

[0043] The longitudinal axis of the second coordinate system is an edge extending from the vertex along a fourth direction on the display screen of the all-in-one conference machine, and the third direction is perpendicular to the fourth direction;

[0044] The horizontal coordinate of the second coordinate point in the second coordinate system is X n =(X m -X1) / c, the vertical coordinate is Y n =(Y m -Y1) / d; c is the ratio of the length of the side extending along the third direction in the display screen of the all-in-one conference machine to the length of the side extending along the first direction in the divided area corresponding to the participant who issued the command image, and d is the ratio of the length of the side extending along the fourth direction in the display screen of the all-in-one conference machine to the length of the side extending along the second direction in the divided area corresponding to the participant who issued the command image.

[0045] Optionally, collecting first coordinate point data of the participant who issued the command image writing on the first display content further includes:

[0046] Receive infrared signals;

[0047] Generate the first coordinate point data according to the infrared signal;

[0048] The infrared signal is a signal emitted by an infrared touch frame provided on a conference desktop, and the infrared touch frame generates a signal in response to the participant who issues the instruction image writing on the first display content.

[0049] Optionally, before sending a request to the all-in-one conference device and receiving the first display content when the command image is identified as a preset command, the method further includes:

[0050] The command images of each participant in the corresponding segmented area are identified according to a preset priority order, wherein the priority order is the order in which the commands are issued by each participant or the seating order of each participant.

[0051] Optionally, before identifying the instruction images of the participants in their corresponding segmented areas according to the preset priority order, the method further includes:

[0052] Perform distortion correction on the collected images covering the conference desktop.

[0053] A second aspect of the present disclosure provides a method for multi-person handwriting collaborative conferencing, which is applied to an all-in-one conference machine and includes:

[0054] receiving a request signal and sending the first display content to the projection device, so that the projection device projects the first display content onto the segmented area corresponding to the participant who issued the command image; wherein the request signal is a signal sent by the projection device when it collects the command image of each participant in the segmented area corresponding to each participant and recognizes the command image as a preset command, and the segmented area is formed by the projection device according to the parameters set in the segmentation method;

[0055] Receive first coordinate point data, convert the first coordinate point data to obtain second coordinate point data suitable for the conference all-in-one machine, and display the second coordinate point data to form written notes. The first coordinate point data is the data collected by the projection device and written by the participant who issued the command image on the first display content.

[0056] The third aspect of the present disclosure provides a multi-person handwriting collaborative conference system, including a projection device and an all-in-one conference machine;

[0057] The projection device is used to set parameters according to the segmentation method to form segmented areas; it is also used to collect the command images of each participant in the corresponding segmented areas, and send a request signal to the conference all-in-one machine when the command image is recognized as a preset command;

[0058] The all-in-one conference machine is configured to receive the request signal and send the first display content to the projection device;

[0059] The projection device is further configured to project the segmented area corresponding to the participant who issued the command image and display the first display content; and is further configured to collect first coordinate point data of the participant who issued the command image writing on the first display content and send the data to the conference all-in-one machine;

[0060] The all-in-one conference machine is further used to convert the first coordinate point data to obtain second coordinate point data suitable for the all-in-one conference machine and display the second coordinate point data to form written notes.

[0061] A fourth aspect of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method according to the first aspect of the present disclosure;

[0062] or

[0063] When the program is executed by a processor, the method described in the second aspect of the present disclosure is implemented.

[0064] A fifth aspect of the present disclosure provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein:

[0065] When the processor executes the program, the method according to the first aspect of the present disclosure is implemented;

[0066] or

[0067] When the processor executes the program, the method described in the second aspect of the present disclosure is implemented.

[0068] The beneficial effects of the present disclosure are as follows:

[0069] According to the technical solution disclosed herein, the projection device collects the command images of each participant in each divided area, and when identifying the command image as a preset command, sends a request signal to the conference all-in-one machine, receives and displays the first display content, and then collects the trajectory data of the participant writing on the first display content and sends it to the conference all-in-one machine for conversion so that the conference all-in-one machine displays the participant's writing trajectory on the first display content. The present disclosure interacts with the conference all-in-one machine through information exchange between the projection device and the conference all-in-one machine, and can synchronize the participant's writing content to the conference all-in-one machine in a timely manner; at the same time, it can realize the fixed installation of multi-person handwriting collaboration equipment, avoid equipment loss, reduce equipment maintenance costs, and effectively improve conference collaboration efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] The specific embodiments of the present disclosure will be further described in detail below with reference to the accompanying drawings.

[0071] Figure 1 A flowchart showing a method for multi-person handwriting collaborative conferencing according to an embodiment of the present invention is shown.

[0072] Figure 2 A schematic structural diagram of a multi-person handwriting collaborative conference system according to an embodiment of the present invention is shown.

[0073] Figure 3 A schematic top view of a multi-person handwriting collaborative conference system according to an embodiment of the present invention is shown.

[0074] Figure 4 A swim-lane diagram illustrating a method for multi-person handwriting collaborative conferencing according to an embodiment of the present invention.

[0075] Figure 5 A schematic diagram showing a first coordinate point of a multi-person handwriting collaborative conference method according to an embodiment of the present invention.

[0076] Figure 6 A schematic diagram showing a first coordinate point of a multi-person handwriting collaborative conference method according to another embodiment of the present invention.

[0077] Figure 7 A schematic diagram illustrating a second coordinate point of a multi-person handwriting collaborative conference method according to an embodiment of the present invention.

[0078] Figure 8 A flowchart showing a method for multi-person handwriting collaborative conferencing according to another embodiment of the present invention is shown.

[0079] Figure 9 A schematic structural diagram of a computer device according to another embodiment of the present invention is shown. DETAILED DESCRIPTION

[0080] In order to more clearly illustrate the present invention, the present invention is further described below in conjunction with preferred embodiments and accompanying drawings. Similar components in the accompanying drawings are represented by the same reference numerals. It should be understood by those skilled in the art that the following detailed description is illustrative rather than restrictive and should not be used to limit the scope of protection of the present invention.

[0081] In a meeting, the speaker typically presents a presentation or handwrites on a conference machine, while others gather around a conference table. If someone has different suggestions or additions to the speaker's presentation, it's difficult to communicate in real time.

[0082] Currently, in related technologies, multiple tablet computers (Portable Android Devices, PADs) are set up in the conference room for each participant to use, and each PAD can interact with the conference all-in-one machine. However, there are disadvantages in related technologies, such as each PAD needs to be maintained separately, it is necessary to ensure that the PAD has sufficient power, it is necessary to ensure that the PAD is movable, it is necessary to pay attention to whether the PAD is accidentally taken out of the conference room, it is necessary to ensure that the network settings of the PAD are not manipulated, and it is necessary to ensure that the PAD and the conference all-in-one machine are connected to the same local area network. Therefore, although related technologies can achieve writing collaboration, they are not the best solution.

[0083] In response to the problems existing in related technologies, such as Figure 1 As shown, an embodiment of the present invention provides a method for multi-person handwriting collaborative conferencing applied to a projection device, the method comprising:

[0084] Set parameters according to the segmentation method to form segmentation areas;

[0085] Collecting the command image of each participant in the corresponding segmented area, and when identifying the command image as a preset command, sending a request signal to the all-in-one conference machine and receiving the first display content;

[0086] Projecting the segmented area corresponding to the participant who issued the command image and displaying the first display content;

[0087] The first coordinate point data of the first display content written by the participant who issued the command image is collected and sent to the conference all-in-one machine, so that the conference all-in-one machine converts the first coordinate point data to obtain second coordinate point data suitable for the conference all-in-one machine and displays the second coordinate point data to form written notes.

[0088] The projection device of this embodiment collects the command images of each participant in each divided area, and when identifying the command image as a preset command, sends a request signal to the conference all-in-one machine, receives and displays the first display content, and then collects the trajectory data of the participant writing on the first display content and sends it to the conference all-in-one machine for conversion so that the conference all-in-one machine displays the writing trajectory of the participant on the first display content. This embodiment interacts with the conference all-in-one machine through information exchange between the projection device and the conference all-in-one machine, and can synchronize the written content of the participant to the conference all-in-one machine in a timely manner; at the same time, it can realize the fixed installation of multi-person handwriting collaboration equipment, avoid equipment loss, reduce equipment maintenance costs, and effectively improve conference collaboration efficiency.

[0089] In a specific example, Figure 2The figure shows the structure of a multi-person handwriting collaborative conferencing system. Projection device 100 includes a first core processing unit 101, a first display driver unit 102, a camera 103, a projection lamp 104, and a first wireless communication module 105. The all-in-one conferencing device 200 includes a second core processing unit 201, a second display driver unit 202, a display screen 203, a handwriting module 204, and a second wireless communication module 205. Furthermore, first wireless communication module 105 and second wireless communication module 205 can be Wi-Fi communication modules.

[0090] In a specific example, the projection device has an intelligent system, such as an Android system or a LINUX system, and its system settings and other contents can be viewed through an external display, a screen, or a desktop. Furthermore, it can be configured using a mouse or a remote control.

[0091] In a specific example, the projection device and the all-in-one conference machine in the conference room are connected to the same local area network through a wireless network module and transmit data through the wireless network module. Furthermore, the wireless network module can be a first wireless communication module or a second wireless communication module.

[0092] In a specific example, Figure 3 As shown, the projection device 100 is installed above the conference table 300 in the conference room, looking down and projecting onto the conference table and covering the entire conference table. At the same time, the camera acquisition range of the projection device covers the entire conference table.

[0093] In a specific example, after the all-in-one conference machine and the projection device receive the synchronous start signal, the all-in-one conference machine and the projection device start working at the same time.

[0094] The following describes the implementation process of a specific multi-person handwriting collaborative conference step by step as an example.

[0095] Step 1: Set parameters according to the segmentation method to form segmentation areas.

[0096] In this embodiment, the projection device receives the segmentation mode setting parameters input by the user, and the first core processing unit outputs a control signal to the first display driving unit according to the segmentation mode setting parameters. The first display driving unit receives the control signal and outputs a driving signal to the projection lamp, thereby driving the projection lamp to form a projection segmentation area corresponding to the segmentation mode setting parameters on the conference desktop.

[0097] In a specific example, the first step specifically includes: the projection device receives segmentation mode setting parameters and performs first brightness projection on each segmented area.

[0098] In this embodiment, if Figure 4As shown, the projecting device receives the segmentation mode setting parameters and performs first brightness projection on each segmented area, specifically including:

[0099] Step S1: The projection device receives segmentation mode setting parameters through an external device;

[0100] In one possible implementation, the forming of segmented areas according to segmentation mode setting parameters further includes: in this embodiment, the segmentation mode setting parameters are received by an external device connected to the projection device, and the segmentation mode setting parameters include the number of segmented areas and the positions of the segmented areas; the number of segmented areas is the same as the number of participants; the position of the segmented areas is on the side of the conference desktop close to the participant.

[0101] In a specific example, for example, the partition mode setting parameters are set by an external display connected to the projection device; for another example, the projection range of the projection lamp is set to cover the entire conference desktop and the camera is set to capture the image of the entire conference desktop through the external display of the projection device.

[0102] In a specific example, Figure 3 As shown, through the system settings of the projection device, the user (e.g., participant 301 or speaker 303) can set the partitioning method of the conference desktop projection based on the current conference room conditions, such as the size of the conference room, the size of the conference table 300, and the number of participants, thereby supporting the recognition of subsequent hand-raising actions of participant 301. Furthermore, for example, when there are 6 participants, 6 partitioning areas are set; when there are 8 participants, 8 partitioning areas are set.

[0103] In a specific example, the size of the segmented regions may be calculated according to the number of segmented regions and the positions of the segmented regions.

[0104] In a specific example, the width-to-length ratio of the segmented area is the same as the width-to-length ratio of the display screen of the all-in-one conference machine.

[0105] In a specific example, Figure 3 As shown, the aspect ratio of each segmented area 302 is consistent with the aspect ratio of the display screen of the all-in-one conference machine 200, which is generally 16:9.

[0106] Step S2: The projection device performs a first brightness projection on each segmented area;

[0107] In a possible implementation manner, after forming segmented areas by setting parameters according to the segmentation manner, the method further includes: performing a first brightness projection on each of the segmented areas.

[0108] In a specific example, the projection lamp of the projection device projects a first brightness onto the conference desktop. The first brightness projection means that the projection lamp is in a lower brightness projection state, preparing for a subsequent second brightness projection of a certain segmented area.

[0109] Step 2: The projection device collects the instruction images of each participant in their corresponding segmented areas.

[0110] In this embodiment, if Figure 4 As shown, the projector collects the instruction images of each participant in the corresponding segmented area, specifically including:

[0111] Step S3: The projection device collects the instruction image of each participant in the corresponding segmented area;

[0112] In a specific example, the camera of the projection device captures the command image on the conference desktop by capturing an image of the entire conference desktop. Furthermore, the command image refers to the gesture image of the participant captured by the camera when the participant places his or her hand in the divided area of ​​the projection range.

[0113] The camera in this embodiment is in a shooting state all the time when the projection device is turned on, ensuring that the gestures made by the participants can be transmitted to the first core processing unit of the projection device in a timely manner.

[0114] Step 3: The projection device performs distortion correction on the collected conference desktop image and identifies the command image in order of priority.

[0115] In this embodiment, if Figure 4 As shown, the projection device corrects the distortion of the collected conference desktop image and identifies the command image in order of priority, specifically including:

[0116] Step S4: the projection device performs distortion correction on the collected image covering the conference desktop;

[0117] In a possible implementation, the method further includes: performing distortion correction on the captured image covering the conference desktop.

[0118] In a specific example, a camera in a projection device is fixed at a certain position directly above a conference table, and a first core processing unit of the projection device is used to perform distortion correction on an image of a gesture on a distant desktop captured by the camera.

[0119] Step S5: The projection device identifies the instruction image of each participant in the corresponding segmented area according to a preset priority order;

[0120] In a possible implementation, the instruction image of each participant in the corresponding segmented area is identified according to a preset priority order; wherein the priority order is the order in which the instructions are issued by each participant or the seating order of each participant.

[0121] In a specific example, if multiple people issue commands, a judgment mechanism can also be added. For example, the order of command issuance time or the pre-set seating order will be used, with the earlier the command is issued or the closer the seat is to the main seat, the higher the priority.

[0122] Step 4: The projection device recognizes the command image and sends a request signal to the conference all-in-one machine.

[0123] In this embodiment, if Figure 4 As shown, the projector device recognizes the command image and sends a request signal to the conference all-in-one device, specifically including:

[0124] Step S6: The projection device generates a request signal when recognizing the instruction image as a preset instruction;

[0125] In a specific example, a camera captures a participant's gestures and feeds them back to the projection device's first core processing unit for recognition. Furthermore, the first core processing unit is pre-configured with a gesture library, where one or more gestures correspond to hand-raising instructions. For example, a gesture where a participant's palm covers the conference table in front of them with five fingers spread out, or other gestures to avoid misidentification, such as a thumb-up gesture that hides the remaining four fingers. This is merely an example, and the purpose is for the projection device to identify which participant has raised their hand to indicate their intention to write or annotate the current presentation content.

[0126] In a specific example, when a participant makes a gesture on the divided area of ​​the conference desktop in front of him, the camera captures the gesture and feeds the gesture image back to the first core processing unit in real time. The first core processing unit compares the collected gesture image with the preset gestures in the gesture library and determines whether the gesture is an instruction to raise the hand.

[0127] In a specific example, the first core processing unit generates a request signal after determining a hand-raising instruction in a certain segmented area.

[0128] Step S7: The projection device sends a request signal to the all-in-one conference device;

[0129] In a specific example, the projection device sends a request signal to the all-in-one conference machine through the first wireless communication module.

[0130] Step 5: The all-in-one conference machine sends the first display content to the projection device.

[0131] In this embodiment, if Figure 4As shown, the all-in-one conference device sends the first display content to the projection device specifically including:

[0132] Step S8: The all-in-one conference device sends the first display content to the projection device;

[0133] In a specific example, when the all-in-one conference machine receives a request signal, the second core processing unit of the all-in-one conference machine will display the current presentation image on the screen and transmit it to the first wireless communication module of the projection device through the second wireless communication module, so that the first core processing unit of the projection device projects the first display content to the divided area corresponding to the participant who issued the command image.

[0134] Step 6: The projection device receives the first display content and performs second brightness projection.

[0135] In this embodiment, if Figure 4 As shown, the projection device receives the first display content and performs second brightness projection specifically including:

[0136] Step S9: the projection device projects the first display content on the designated segmented area corresponding to the participant who issued the command image at a second brightness;

[0137] In one possible implementation, projecting the segmented area corresponding to the participant who issued the command image and displaying the first display content further includes: projecting the segmented area corresponding to the participant who issued the command image at a second brightness and displaying the first display content; the second brightness is greater than the first brightness.

[0138] In a specific example, the second brightness projection means that the projection lamp is in a high brightness projection state.

[0139] In a specific example, in different segmentation modes, such as a segmentation mode of 6 segmentation areas or a segmentation mode of 8 segmentation areas, the resolution of the highlight projection area is fixed.

[0140] In a specific example, the camera captures an image covering the conference desktop and sends it to the first core processing unit. The first core processing unit identifies the position of the participant who issued the command image and highlights the position to make the highlighted area more suitable for the participant to perform writing operations.

[0141] Specifically, after the projection device's first core processing unit recognizes that a participant intends to raise their hand, it determines the partitioned area of ​​the conference desktop corresponding to the current hand-raising position based on system settings, and sends the location information of the partitioned area of ​​the conference desktop to the first display driver unit. The first display driver unit then determines which partition of the entire projection area to highlight, and based on the determination result, drives the projection light, ultimately presenting the corresponding partitioned area with the first display content highlighted on the conference desktop. Furthermore, the partitioned area of ​​the conference desktop in front of all participants other than the participant who issued the command image remains dimmed.

[0142] In one specific example, a participant issuing a command image operates in a highlighted area, and their writing or operation traces can be captured by the projection device's camera. Furthermore, the display screen in the highlighted area includes buttons for operation, such as a stylus button, a spotlight or laser pointer button, and a button to close the highlighted window.

[0143] Step 7: The projection device collects the first coordinate point data of the participant's writing on the first display content.

[0144] In this embodiment, if Figure 4 As shown, the projecting device collects the first coordinate point data of the participant's writing on the first display content, specifically including:

[0145] Step S10: The projection device collects first coordinate point data of the first display content written by the participant who issued the command image at preset intervals;

[0146] In a possible implementation, an image of the participant who issues the command image writing on the first display content is collected; a first coordinate point of the writing operation in the first coordinate system is obtained based on the image; the origin of the first coordinate system is the vertex in the lower left corner of the segmented area corresponding to the participant who issues the command image; the horizontal axis of the first coordinate system is the edge extending from the vertex along the first direction in the segmented area corresponding to the participant who issues the command image, and the first direction is the extension direction of the edge of the segmented area close to the participant; the vertical axis of the first coordinate system is the edge extending from the vertex along the second direction in the segmented area corresponding to the participant who issues the command image, and the first direction is perpendicular to the second direction; the horizontal coordinate of the first coordinate point in the first coordinate system is X R1 , the vertical coordinate is Y R1 , X R1 Y is the distance between the projection of the first coordinate point on the horizontal axis and the origin, R1 is the distance between the projection of the first coordinate point on the vertical axis and the origin.

[0147] In a specific example, Figure 5 As shown, the first coordinate system takes the segmented area 302 in the conference desktop 300 corresponding to the participant who issued the command image as the coordinate system; further, the origin of the first coordinate system is the vertex in the lower left corner of the segmented area 302 corresponding to the participant who issued the command image, and the coordinates of the origin are (0, 0); further, the origin of the first coordinate system is set to be aligned with the origin of the second coordinate system. Since the aspect ratio of the segmented area 302 is the same as the aspect ratio of the display screen of the conference all-in-one machine, the coordinate conversion is performed according to the proportional relationship between the two coordinate systems.

[0148] In a specific example, Figure 5 As shown, the coordinates of the vertex of the upper left corner of the segmented area 302 corresponding to the participant who issued the command image are (0, Y3); the coordinates of the vertex of the lower right corner of the segmented area 302 corresponding to the participant who issued the command image are (X3, 0); and the coordinates of the upper right corner of the segmented area 302 corresponding to the participant who issued the command image are (X3, Y3). R2 Y is the distance between the projection of the first coordinate point on the horizontal axis and X3, R2 is the distance between the projection of the first coordinate point on the vertical axis and Y3.

[0149] In another possible implementation, an image of the participant who issues the command image writing on the first display content is collected; a first coordinate point of the writing operation in the first coordinate system is obtained based on the image; the origin of the first coordinate system is the vertex in the lower left corner of the conference desktop; the horizontal axis of the first coordinate system is the edge of the conference desktop extending from the vertex along the first direction, and the first direction is the extension direction of the edge of the divided area close to the participant; the vertical axis of the first coordinate system is the edge of the conference desktop extending from the vertex along the second direction, and the first direction is perpendicular to the second direction; the horizontal coordinate of the first coordinate point in the first coordinate system is X m =X1+X L1 , the vertical coordinate is Y m =Y1+Y L2 , X1 is the horizontal coordinate of any vertex in the segmented area to which the writing operation belongs in the first coordinate system, Y1 is the vertical coordinate corresponding to X1 in the first coordinate system, X L1 Y is the distance between the projection of the first coordinate point on the edge extending along the first direction in the segmented area to which it belongs and X1, L2 is the distance between the projection of the first coordinate point on the side extending along the second direction in the corresponding segmented area and Y1.

[0150] In a specific example, Figure 6 As shown, any one of the vertices can be the vertex at the lower left corner in the segmented area 302 to which the writing operation belongs, and the coordinates of the vertex at the lower left corner are (X1, Y1); it can also be the vertex at the upper left corner in the segmented area 302 to which the writing operation belongs, and the coordinates of the vertex at the upper left corner of the segmented area 302 are (X1, Y2); it can also be the vertex at the lower right corner in the segmented area 302 to which the writing operation belongs, and the coordinates of the vertex at the lower right corner of the segmented area 302 are (X2, Y1); it can also be the vertex at the upper right corner in the segmented area 302 to which the writing operation belongs, and the coordinates of the vertex at the upper right corner of the segmented area 302 are (X2, Y2).

[0151] Further, such as Figure 6 As shown, X L2 Y is the distance between the projection of the first coordinate point on the edge extending along the first direction in the segmented area to which it belongs and X2, L1 is the distance between the projection of the first coordinate point on the side extending along the second direction in the corresponding segmented area and Y2.

[0152] In a specific example, Figure 6 As shown, the first coordinate system is based on the conference desktop 300. The origin of the first coordinate system is the vertex in the lower left corner of the conference desktop 300, and the coordinates of the origin are (0, 0). Furthermore, the coordinates of the vertex in the upper left corner of the conference desktop 300 are (0, Y4); the coordinates of the vertex in the lower right corner of the conference desktop 300 are (X4, 0); and the coordinates of the vertex in the upper right corner of the conference desktop 300 are (X4, Y4).

[0153] Further, such as Figure 6 As shown, taking the vertex of the lower left corner in the segmented area 302 to which the writing operation belongs as an example, the coordinates (X1, Y1) of the vertex of the lower left corner in the segmented area 302 to which the writing operation belongs are equivalent to the offset of the coordinates (0, 0) used to align the origin of the coordinates. Further, the dot 501 is the first coordinate point, i.e., the writing point. According to the relationship X between the first coordinate point and the first coordinate system, L1 +X L2 =X2-X1,Y L1 +Y L2 =Y2-Y1, the coordinates of the writing point are (X1+X L1 , Y1+Y L2 ).

[0154] It should be noted that those skilled in the art should understand that, based on the determination of the conversion relationship between the first coordinate system and the second coordinate system, the first coordinate system may also be any point on the conference desktop.

[0155] In another possible implementation, an infrared signal is received; the first coordinate point data is generated based on the infrared signal; wherein the infrared signal is a signal emitted by an infrared touch frame set on the conference table, and the infrared touch frame generates a signal in response to the participant who issued the command image writing on the first display content.

[0156] In a specific example, an infrared touch frame is integrated on a conference table and connected to a projection device, for example, via a Universal Serial Bus (USB) interface. The infrared touch frame is used to identify touch points, and the position information of the touch points is transmitted to the projection device. Multiple touch points form a writing track.

[0157] The infrared touch technology of this embodiment is relatively mature and can effectively improve the accuracy and real-time performance of identifying the handwriting traces of participants.

[0158] Step 8: The projection device sends the first coordinate point data to the conference all-in-one machine.

[0159] In this embodiment, if Figure 4 As shown, the projector sends the first coordinate point data to the conference all-in-one device specifically including:

[0160] Step S11: The projection device sends first coordinate point data to the all-in-one conference device;

[0161] In a specific example, the projection device transmits the first coordinate point data to the all-in-one conference machine through the first wireless communication module.

[0162] Step 9: The all-in-one conference device performs coordinate conversion on the first coordinate point data to obtain the second coordinate point data.

[0163] In this embodiment, if Figure 4 As shown, the all-in-one conference machine performs coordinate conversion on the first coordinate point data to obtain the second coordinate point data, specifically including:

[0164] Step S12: the all-in-one conference device converts the first coordinate point data to obtain second coordinate point data;

[0165] In a possible implementation, the conversion according to the first coordinate point data to obtain the second coordinate point data suitable for the conference all-in-one machine further includes: obtaining the coordinate data of the second coordinate point in the second coordinate system according to the coordinate data of the first coordinate point in the first coordinate system and the coordinate conversion coefficient; the origin of the second coordinate system is the vertex in the lower left corner of the display screen of the conference all-in-one machine; the horizontal axis of the second coordinate system is the edge extending from the vertex along the third direction in the display screen of the conference all-in-one machine; the vertical axis of the second coordinate system is the edge extending from the vertex along the fourth direction in the display screen of the conference all-in-one machine, and the third direction is perpendicular to the fourth direction; the horizontal coordinate of the second coordinate point in the second coordinate system is a*X R1 , the vertical coordinate is b*Y R1 , a is the ratio of the length of the side extending along the third direction in the display screen of the all-in-one conference machine to the length of the side extending along the first direction in the divided area corresponding to the participant who issued the command image, and b is the ratio of the length of the side extending along the fourth direction in the display screen of the all-in-one conference machine to the length of the side extending along the second direction in the divided area corresponding to the participant who issued the command image.

[0166] In a specific example, the projection device sends first coordinate point data to the all-in-one conference machine. After the second core processing unit of the all-in-one conference machine receives the first coordinate point data of the trajectory point of the projection device, it converts it into a second coordinate point in the second coordinate system of the display screen of the all-in-one conference machine based on the first coordinate point data, the horizontal coordinate conversion coefficient and the vertical coordinate conversion coefficient.

[0167] In a specific example, Figure 7 As shown, the origin of the second coordinate system is the vertex of the lower left corner of the display screen 201 of the conference all-in-one machine; Figure 7 The dot 601 in the figure is Figure 5 The second coordinate point corresponding to the writing point 401 in the figure; further, (X0, Y0) is the coordinate of the vertex in the lower left corner of the display screen of the conference all-in-one machine, that is, the origin coordinate (X0, Y0) = (0, 0); (X X , Y0) is the coordinate of the vertex in the lower right corner of the display screen of the conference all-in-one machine; (X0, Y Y ) is the coordinate of the vertex in the upper left corner of the display screen of the conference all-in-one machine; (X X , Y Y ) are the coordinates of the vertex in the upper right corner of the display screen of the all-in-one conference machine.

[0168] In a specific example, Figure 5 and Figure 7As shown, a is the ratio of the length of the side extending along the third direction in the display screen of the conference all-in-one machine to the length of the side extending along the first direction in the segmented area corresponding to the participant who issued the command image, that is, the horizontal coordinate conversion coefficient; further, the calculation formula of the horizontal coordinate conversion coefficient a is a=(X x -X0) / (X3-0); b is the ratio of the length of the side extending along the fourth direction in the display screen of the conference all-in-one machine to the length of the side extending along the second direction in the segmented area corresponding to the participant who issued the command image, that is, the ordinate conversion coefficient; the calculation formula of the ordinate conversion coefficient b is b=(Y Y -Y0) / (Y3-0).

[0169] In another possible implementation, the conversion according to the first coordinate point data to obtain the second coordinate point data suitable for the conference all-in-one machine further includes: obtaining the coordinate data of the second coordinate point in the second coordinate system according to the coordinate data of the first coordinate point in the first coordinate system and the coordinate conversion coefficient; the origin of the second coordinate system is the vertex in the lower left corner of the display screen of the conference all-in-one machine; the horizontal axis of the second coordinate system is the edge extending from the vertex along the third direction in the display screen of the conference all-in-one machine; the vertical axis of the second coordinate system is the edge extending from the vertex along the fourth direction in the display screen of the conference all-in-one machine, and the third direction is perpendicular to the fourth direction; the horizontal coordinate of the second coordinate point in the second coordinate system is X n =(X m -X1) / c, the vertical coordinate is Y n =(Y m -Y1) / d; c is the ratio of the length of the side extending along the third direction in the display screen of the all-in-one conference machine to the length of the side extending along the first direction in the divided area corresponding to the participant who issued the command image, and d is the ratio of the length of the side extending along the fourth direction in the display screen of the all-in-one conference machine to the length of the side extending along the second direction in the divided area corresponding to the participant who issued the command image.

[0170] In a specific example, the projection device sends first coordinate point data to the all-in-one conference machine. After the second core processing unit of the all-in-one conference machine receives the first coordinate point data of the trajectory point of the projection device, it converts it into a second coordinate point in the second coordinate system of the display screen of the all-in-one conference machine based on the first coordinate point data, the horizontal coordinate conversion coefficient and the vertical coordinate conversion coefficient.

[0171] In a specific example, Figure 7 As shown, the origin of the second coordinate system is the vertex in the lower left corner of the display screen of the conference all-in-one machine; Figure 7 The dot 601 in the figure is Figure 6 The second coordinate point corresponding to the writing point 501 in the figure; further, (X0, Y0) is the coordinate of the vertex in the lower left corner of the display screen of the conference all-in-one machine, that is, the origin coordinate (X0, Y0) = (0, 0); (X X , Y0) is the coordinate of the vertex in the lower right corner of the display screen of the conference all-in-one machine; (X0, Y Y ) is the coordinate of the vertex in the upper left corner of the display screen of the conference all-in-one machine; (X X , Y Y ) are the coordinates of the vertex in the upper right corner of the display screen of the all-in-one conference machine.

[0172] In a specific example, Figure 6 As shown, c is the ratio of the length of the side extending along the third direction in the display screen of the conference all-in-one machine to the length of the side extending along the first direction in the segmented area corresponding to the participant who issued the command image, that is, the horizontal coordinate conversion coefficient; the calculation formula of the horizontal coordinate conversion coefficient is c=(X x -X0) / (X2-X1); d is the ratio of the length of the side extending along the fourth direction in the display screen of the conference all-in-one machine to the length of the side extending along the second direction in the segmented area corresponding to the participant who issued the command image, that is, the ordinate conversion coefficient. The calculation formula of the ordinate conversion coefficient is d=(Y Y -Y0) / (Y2-Y1).

[0173] In a specific example, Figure 7 As shown, in the second coordinate system, X L3 Y is the distance between the projection of the second coordinate point on the horizontal axis and the vertex of the lower left corner; L4 X is the distance between the projection of the second coordinate point on the vertical axis and the vertex of the lower left corner; L4 Y is the distance between the projection of the second coordinate point on the horizontal axis and the vertex of the lower right corner; L3 is the distance between the projection of the second coordinate point on the vertical axis and the vertex of the upper left corner.

[0174] Step 10: The all-in-one conference machine displays the written notes formed by the continuous second coordinate point data.

[0175] In this embodiment, if Figure 4 As shown, the written notes formed by the continuous second coordinate point data displayed by the all-in-one conference machine include:

[0176] Step S13: the all-in-one conference machine displays the written notes formed by the continuous second coordinate point data.

[0177] In a specific example, the continuous coordinates of the first coordinate point can be converted into continuous second coordinate point data according to the above conversion method. Furthermore, the second core processing unit of the all-in-one conference machine completes layer drawing or function triggering according to the operations corresponding to the continuous second coordinate point data, and then displays the participant's writing or annotation operations on the display content on the display screen.

[0178] In this embodiment, the projection device collects the command images of each participant in each divided area, and when the command image is identified as a preset command, it sends a request signal to the conference all-in-one machine, receives and displays the first display content, and then collects the trajectory data of the participant writing on the first display content and sends it to the conference all-in-one machine for conversion so that the conference all-in-one machine displays the participant's writing trajectory on the first display content. This embodiment interacts with the conference all-in-one machine through information exchange between the projection device and the conference all-in-one machine, and can synchronize the participant's writing content to the conference all-in-one machine in a timely manner; at the same time, it can realize the fixed installation of multi-person handwriting collaboration equipment, avoid equipment loss, reduce equipment maintenance costs, and effectively improve conference collaboration efficiency.

[0179] The second embodiment of the present disclosure provides a method for multi-person handwriting collaborative conference, which is applied to a conference all-in-one machine, such as Figure 8 As shown, the method includes:

[0180] receiving a request signal and sending the first display content to the projection device, so that the projection device projects the first display content onto the segmented area corresponding to the participant who issued the command image; wherein the request signal is a signal sent by the projection device when it collects the command image of each participant in the segmented area corresponding to each participant and recognizes the command image as a preset command, and the segmented area is formed by the projection device according to the parameters set in the segmentation method;

[0181] Receive first coordinate point data, convert the first coordinate point data to obtain second coordinate point data suitable for the conference all-in-one machine, and display the second coordinate point data to form written notes. The first coordinate point data is the data collected by the projection device and written by the participant who issued the command image on the first display content.

[0182] In this embodiment, the all-in-one conference machine receives a request signal sent by the projection device and sends the first display content to the projection device. The all-in-one conference machine receives the trajectory data of the participant's writing on the first display content, converts it and displays the participant's writing trajectory on the first display content. In this embodiment, the projection device and the all-in-one conference machine exchange information, so that the participant's writing content can be synchronized to the all-in-one conference machine in a timely manner; at the same time, it can realize the fixed installation of multi-person handwriting collaboration equipment, avoid equipment loss, reduce equipment maintenance costs, and effectively improve conference collaboration efficiency.

[0183] The third embodiment of the present disclosure provides a multi-person handwriting collaborative conference system, including a projection device and an all-in-one conference machine; the projection device is used to set parameters according to the segmentation method to form segmented areas; it is also used to collect the instruction images of each participant in the segmented area corresponding to each participant, and send a request signal to the all-in-one conference machine when the instruction image is identified as a preset instruction; the all-in-one conference machine is used to receive the request signal and send a first display content to the projection device; the projection device is also used to project the segmented area corresponding to the participant who issued the instruction image and display the first display content; it is also used to collect the first coordinate point data of the participant who issued the instruction image writing the first display content and send it to the all-in-one conference machine; the all-in-one conference machine is also used to convert the first coordinate point data to obtain second coordinate point data suitable for the all-in-one conference machine and display according to the second coordinate point data to form written notes.

[0184] In a specific example, Figure 2 As shown, the projection device 100 is used to perform a first brightness projection on each segmented area through the first display driving unit 102 and the projection lamp 104 according to the segmentation mode setting parameters received by the first display driving unit 102, and the segmentation mode setting parameters include the number and position of the segmented areas; further, the size of the segmented area can be calculated according to the number and position of the segmented areas; it is used to use the camera 103 to collect the instruction image of the participant in the respective corresponding segmented area, and when the first display driving unit 102 recognizes that the instruction image is a preset instruction, it sends a request signal to the conference all-in-one machine through the first wireless communication module 105; the conference all-in-one machine is used to receive the request signal through the second wireless communication module 205 and send it to the first wireless communication module 10 5. The first display content of the display screen 203 is sent to the projection device; the projection device is further used to use the camera 103 to project the designated segmented area corresponding to the participant who issued the command image at a second brightness through the first display driver unit 102 and the projection lamp 104 and display the first display content; use the camera 103 to collect the first coordinate point data of the first display content written by the participant who issued the command image at a preset interval and send it to the conference all-in-one machine; the conference all-in-one machine is further used to use the second core processing unit 201 to convert the first coordinate point data to obtain second coordinate point data, and drive the display screen 203 to display the written notes formed by the continuous second coordinate point data through the second display driver unit 202.

[0185] In a specific example, Figure 2As shown, the handwriting module 204 is used to collect the handwriting trajectory data of the speaker and send it to the second core processing unit 201. The second core processing unit 201 drives the display screen 203 to display the handwriting trajectory of the speaker through the second display driving unit 202.

[0186] In this embodiment, the projection device collects the command images of each participant in each divided area, and when the command image is identified as a preset command, it sends a request signal to the conference all-in-one machine, receives and displays the first display content, and then collects the trajectory data of the participant writing on the first display content and sends it to the conference all-in-one machine for conversion so that the conference all-in-one machine displays the participant's writing trajectory on the first display content. This embodiment interacts with the conference all-in-one machine through information exchange between the projection device and the conference all-in-one machine, and can synchronize the participant's writing content to the conference all-in-one machine in a timely manner; at the same time, it can realize the fixed installation of multi-person handwriting collaboration equipment, avoid equipment loss, reduce equipment maintenance costs, and effectively improve conference collaboration efficiency.

[0187] A fourth embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which implements the method described in the first embodiment when the program is executed by a processor; or implements the method described in the second embodiment when the program is executed by a processor.

[0188] In a specific example, a computer-readable storage medium stores a computer program thereon, which, when executed by a processor, implements: performing a first brightness projection on each segmented area according to received segmentation method setting parameters, the segmentation method setting parameters including the number and position of the segmented areas; further, the size of the segmented area can be calculated based on the number and position of the segmented areas; collecting the instruction images of the participants in their respective corresponding segmented areas, and when the instruction images are identified as preset instructions, sending a request to the conference all-in-one machine and receiving a first display content; performing a second brightness projection on the designated segmented area corresponding to the preset instruction and displaying the first display content; collecting the first coordinate point data of the writing of the first display content by the participant who issued the instruction image at a preset interval and sending it to the conference all-in-one machine, so that the conference all-in-one machine converts the first coordinate point data to obtain second coordinate point data and displays the written notes formed by the continuous second coordinate point data.

[0189] In another specific example, a computer-readable storage medium stores a computer program thereon, which, when executed by a processor, implements: receiving a request signal and sending a first display content to a projection device, so that the projection device performs a second brightness projection on a designated segmented area corresponding to the preset instruction and displays the first display content, the request signal being that the projection device performs a first brightness projection on each segmented area according to the received segmentation method setting parameters, the segmentation method setting parameters including the number and position of the segmented areas; further, the size of the segmented areas can be calculated based on the number and position of the segmented areas; collecting instruction images of participants in their respective corresponding segmented areas, and identifying the instruction images as signals sent when the preset instructions are received; receiving first coordinate point data, the first coordinate point data being the coordinate point data of the writing of the participant who issued the instruction image on the first display content collected by the projection device at preset intervals; converting the first coordinate point data to obtain second coordinate point data and displaying written notes formed by continuous second coordinate point data.

[0190] In practical applications, the computer-readable storage medium can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or component, or any combination thereof. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CDROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present embodiment, the computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, device or device or used in combination with it.

[0191] A computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0192] Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0193] Computer program code for performing the operations of the present invention may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0194] The fifth embodiment of the present disclosure provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method described in the first embodiment is implemented; or when the processor executes the program, the method described in the second embodiment is implemented.

[0195] In a specific example, Figure 9 Shown is a schematic structural diagram of a computer device. Figure 9 The computer device 12 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0196] Further, such as Figure 9 As shown, computer device 12 is implemented as a general-purpose computing device. Components of computer device 12 may include, but are not limited to, one or more processors or processing units 16, system memory 28, and a bus 18 that connects various system components (including system memory 28 and processing unit 16).

[0197] Furthermore, bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor or a local bus using any of a variety of bus architectures. Examples of such architectures include, but are not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MAC) bus, an Enhanced ISA bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus.

[0198] Furthermore, the computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the computer device 12, including volatile and non-volatile media, removable and non-removable media.

[0199] Furthermore, the system memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. The computer device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 34 may be configured to read and write non-removable, non-volatile magnetic media ( Figure 9 Not shown, often called a "hard drive"). Although Figure 8 Not shown, a magnetic disk drive for reading and writing to a removable non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 via one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of various embodiments of the present invention.

[0200] Furthermore, a program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28. Such program modules 42 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may include an implementation of a network environment. Program modules 42 generally perform the functions and / or methods of the embodiments described herein.

[0201] Furthermore, the computer device 12 may also communicate with one or more external devices 14 (e.g., a keyboard, a pointing device, a display 24, etc.), one or more devices that enable a user to interact with the computer device 12, and / or any device that enables the computer device 12 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface 22. Furthermore, the computer device 12 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 20. Figure 9 As shown, the network adapter 20 communicates with the other modules of the computer device 12 via the bus 18. Figure 9Not shown, other hardware and / or software modules may be used in conjunction with computer device 12, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0202] Furthermore, the processor unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, such as implementing a method for multi-person handwriting collaborative conferencing provided in the first embodiment of the present invention, or a method for multi-person handwriting collaborative conferencing provided in the second embodiment of the present invention.

[0203] In response to the current problems, the present invention proposes a method, system, computer equipment and medium for multi-person handwriting collaborative conference, which interacts with the conference all-in-one machine through a projection device. It can achieve fixed installation of the multi-person handwriting collaborative device, avoid device loss, reduce equipment maintenance costs, and effectively improve conference collaboration efficiency.

[0204] Obviously, the above embodiments of the present disclosure are merely examples for clearly illustrating the present disclosure, and are not intended to limit the implementation methods of the present disclosure. For those skilled in the art, other different forms of changes or modifications can be made based on the above description. It is impossible to enumerate all the implementation methods here. Any obvious changes or modifications derived from the technical solution of the present disclosure are still within the scope of protection of the present disclosure.

Claims

1. A multi-person handwriting collaborative conference method, applied to a projection device, characterized in that: include: Set parameters according to the segmentation mode to form segmented areas on the conference desktop; Collecting the command image of each participant in the corresponding segmented area, and when identifying the command image as a preset command, sending a request signal to the all-in-one conference machine and receiving the first display content; Projecting the segmented area corresponding to the participant who issued the command image and displaying the first display content; The first coordinate point data of the first display content written by the participant who issued the command image is collected and sent to the conference all-in-one machine, so that the conference all-in-one machine converts the first coordinate point data to obtain second coordinate point data suitable for the conference all-in-one machine and displays the second coordinate point data to form written notes.

2. The method for multi-person handwriting collaborative conference according to claim 1, characterized in that: The forming of segmented areas on the conference desktop according to the segmentation mode setting parameters further includes: receiving the segmentation mode setting parameters through an external device connected to the projection device, wherein the segmentation mode setting parameters include the number of segmentation areas and the positions of the segmentation areas; The number of the divided areas is the same as the number of the participants; The location of the segmented area is on a side of the conference desktop close to the participant.

3. The method for multi-person handwriting collaborative conference according to claim 1, characterized in that: After forming segmented areas on the conference desktop by setting parameters according to the segmentation mode, the method further includes: Perform a first brightness projection on each of the segmented areas.

4. The method for multi-person handwriting collaborative conference according to claim 3, characterized in that: The projecting the segmented area corresponding to the participant who issued the command image and displaying the first display content further includes: Performing a second brightness projection on the segmented area corresponding to the participant who issued the command image and displaying the first display content; The second brightness is greater than the first brightness.

5. The method for multi-person handwriting collaborative conference according to claim 1, characterized in that: The collecting of the first coordinate point data of the first display content written by the participant who issued the command image further includes: capturing an image of the participant who issued the command image writing on the first display content; Acquire a first coordinate point of the writing operation in a first coordinate system according to the image; The origin of the first coordinate system is the vertex in the lower left corner of the segmented area corresponding to the participant who issued the command image; The horizontal axis of the first coordinate system is an edge extending from the vertex along a first direction in the segmented area corresponding to the participant who issued the command image, and the first direction is an extending direction of the edge of the segmented area close to the participant; The vertical axis of the first coordinate system is an edge extending from the vertex along the second direction in the segmented area corresponding to the participant who issued the command image, and the first direction is perpendicular to the second direction; The horizontal coordinate of the first coordinate point in the first coordinate system is X R1 , the vertical coordinate is Y R1 , X R1 Y is the distance between the projection of the first coordinate point on the horizontal axis and the origin, R1 is the distance between the projection of the first coordinate point on the vertical axis and the origin.

6. The method for multi-person handwriting collaborative conference according to claim 5, characterized in that: The converting the first coordinate point data to obtain the second coordinate point data applicable to the all-in-one conference machine further includes: Obtaining coordinate data of a second coordinate point in a second coordinate system according to the coordinate data of the first coordinate point in the first coordinate system and a coordinate conversion coefficient; The origin of the second coordinate system is the vertex in the lower left corner of the display screen of the conference all-in-one machine; The horizontal axis of the second coordinate system is an edge extending from the vertex along the third direction on the display screen of the all-in-one conference machine; The longitudinal axis of the second coordinate system is an edge extending from the vertex along a fourth direction on the display screen of the all-in-one conference machine, and the third direction is perpendicular to the fourth direction; The horizontal coordinate of the second coordinate point in the second coordinate system is a*X R1 , the vertical coordinate is b*Y R1 , a is the ratio of the length of the side extending along the third direction in the display screen of the all-in-one conference machine to the length of the side extending along the first direction in the divided area corresponding to the participant who issued the command image, and b is the ratio of the length of the side extending along the fourth direction in the display screen of the all-in-one conference machine to the length of the side extending along the second direction in the divided area corresponding to the participant who issued the command image.

7. The method for multi-person handwriting collaborative conference according to claim 1, characterized in that: The collecting of the first coordinate point data of the first display content written by the participant who issued the command image further includes: capturing an image of the participant who issued the command image writing on the first display content; Acquire a first coordinate point of the writing operation in a first coordinate system according to the image; The origin of the first coordinate system is the vertex in the lower left corner of the conference desktop; The horizontal axis of the first coordinate system is an edge of the conference desktop extending from the vertex along a first direction, and the first direction is an extending direction of an edge of the segmented area close to the participant; The longitudinal axis of the first coordinate system is an edge of the conference desktop extending from the vertex along a second direction, and the first direction is perpendicular to the second direction; The horizontal coordinate of the first coordinate point in the first coordinate system is X m =X1+X L1 , the vertical coordinate is Y m =Y1+Y L2 , X1 is the horizontal coordinate of any vertex in the segmented area to which the writing operation belongs in the first coordinate system, Y1 is the vertical coordinate corresponding to X1 in the first coordinate system, X L1 Y is the distance between the projection of the first coordinate point on the edge extending along the first direction in the segmented area to which it belongs and X1, L2 is the distance between the projection of the first coordinate point on the side extending along the second direction in the corresponding segmented area and Y1.

8. The method for multi-person handwriting collaborative conference according to claim 7, characterized in that: The converting the first coordinate point data to obtain the second coordinate point data applicable to the all-in-one conference machine further includes: Obtaining coordinate data of a second coordinate point in a second coordinate system according to the coordinate data of the first coordinate point in the first coordinate system and a coordinate conversion coefficient; The origin of the second coordinate system is the vertex in the lower left corner of the display screen of the conference all-in-one machine; The horizontal axis of the second coordinate system is an edge extending from the vertex along the third direction on the display screen of the all-in-one conference machine; The longitudinal axis of the second coordinate system is an edge extending from the vertex along a fourth direction on the display screen of the all-in-one conference machine, and the third direction is perpendicular to the fourth direction; The horizontal coordinate of the second coordinate point in the second coordinate system is X n =(X m -X1) / c, the vertical coordinate is Y n =(Y m -Y1) / d; c is the ratio of the length of the side extending along the third direction in the display screen of the all-in-one conference machine to the length of the side extending along the first direction in the divided area corresponding to the participant who issued the command image, and d is the ratio of the length of the side extending along the fourth direction in the display screen of the all-in-one conference machine to the length of the side extending along the second direction in the divided area corresponding to the participant who issued the command image.

9. The method for multi-person handwriting collaborative conference according to claim 1, characterized in that: The collecting of the first coordinate point data of the first display content written by the participant who issued the command image further includes: Receive infrared signals; Generate the first coordinate point data according to the infrared signal; The infrared signal is a signal emitted by an infrared touch frame provided on a conference desktop, and the infrared touch frame generates a signal in response to the participant who issues the instruction image writing on the first display content.

10. The method for multi-person handwriting collaborative conference according to claim 1, characterized in that: Before sending a request to the all-in-one conference device and receiving the first display content when the command image is identified as a preset command, the method further includes: The command images of each participant in the corresponding segmented area are identified according to a preset priority order, wherein the priority order is the order in which the commands are issued by each participant or the seating order of each participant.

11. The method for multi-person handwriting collaborative conference according to claim 10, characterized in that: Before identifying the instruction images of the participants in the corresponding segmented areas according to the preset priority order, the method further includes: Perform distortion correction on the collected images covering the conference desktop.

12. A method for multi-person handwriting collaborative conference, applied to an all-in-one conference machine, characterized in that: include: receiving a request signal and sending a first display content to a projection device, so that the projection device projects the first display content onto a segmented area corresponding to the participant who issued the command image; wherein the request signal is a signal sent by the projection device when it collects the command image of each participant in the segmented area corresponding to each participant and recognizes the command image as a preset command, and the segmented area is formed on the conference desktop by the projection device according to the parameters set in the segmentation method; Receive first coordinate point data, convert the first coordinate point data to obtain second coordinate point data suitable for the conference all-in-one machine, and display the second coordinate point data to form written notes. The first coordinate point data is the data collected by the projection device and written by the participant who issued the command image on the first display content.

13. A multi-person handwriting collaborative conference system, characterized in that: Including projection equipment and conference all-in-one machine; The projection device is used to form segmented areas on the conference desktop according to the parameters set in the segmentation mode; it is also used to collect the command images of each participant in the corresponding segmented areas, and send a request signal to the conference all-in-one machine when the command image is recognized as a preset command; The all-in-one conference machine is configured to receive the request signal and send the first display content to the projection device; The projection device is further configured to project the segmented area corresponding to the participant who issued the command image and display the first display content; and is further configured to collect first coordinate point data of the participant who issued the command image writing on the first display content and send the data to the conference all-in-one machine; The all-in-one conference machine is further used to convert the first coordinate point data to obtain second coordinate point data suitable for the all-in-one conference machine and display the second coordinate point data to form written notes.

14. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 11 is implemented; or When the program is executed by a processor, the method according to claim 12 is implemented.

15. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the method according to any one of claims 1 to 11 is implemented; or When the processor executes the program, the method according to claim 12 is implemented.

Images