Multi-person handwriting collaborative conference method and system, computer equipment and medium

Abstract

The embodiment of the invention discloses a multi-person handwriting collaborative conference method and system, computer equipment and a medium. In one specific embodiment, the method comprises the following steps: setting parameters according to a segmentation mode to form a segmentation region; acquiring an instruction image of each participant in the respective corresponding segmented area, and when the instruction image is identified as a preset instruction, sending a request signal to the conference all-in-one machine and receiving first display content; projecting the segmented area corresponding to the participant who sends the instruction image and displaying first display content; and collecting first coordinate point data for writing the first display content by the participant sending the instruction image, and sending the first coordinate point data to the conference all-in-one machine, so that the conference all-in-one machine performs conversion according to the first coordinate point data to obtain second coordinate point data and performs display according to the second coordinate point data to form a written note.

Description

Technical Field

[0001] The present disclosure relates to the technical field of conference management, and more specifically, to a method, system, computer device and medium for multi-person handwriting collaborative conference. Background Art

[0002] In the related art, multiple tablet computers (Portable Android Device, PAD) are set up in the conference room for each participant to use, and each PAD can interact with the conference all-in-one machine. However, the related art has the disadvantages that each PAD needs to be maintained separately, the PAD needs to be ensured to have sufficient power, the PAD needs to be ensured to be movable, the PAD needs to be ensured not to be taken out of the conference room by mistake, the PAD network settings need to be ensured not to be manipulated, and the PAD and the conference all-in-one machine need to be connected to the same local area network. Summary of the invention

[0003] The purpose of the present disclosure is to provide a method, system, computer device and medium for a multi-person handwriting collaborative conference to solve at least one of the problems existing in the prior art.

[0004] In order to achieve the above objectives, the present invention adopts the following technical solutions:

[0005] A first aspect of the present disclosure provides a method for a multi-person handwriting collaborative conference, which is applied to a projection device and includes:

[0006] Set parameters according to the segmentation method to form segmentation areas;

[0007] Collecting the command images of the participants in the corresponding segmented areas, and sending a request signal to the all-in-one conference machine when identifying the command images as preset commands, and receiving the first display content;

[0008] Projecting the segmented area corresponding to the participant who issued the command image and displaying the first display content;

[0009] The first coordinate point data of the participant who issued the command image writing on the first display content is collected and sent to the all-in-one conference machine, so that the all-in-one conference machine converts the first coordinate point data to obtain second coordinate point data suitable for the all-in-one conference machine and displays the second coordinate point data to form written notes.

[0010] Optionally, the forming segmented regions by setting parameters according to the segmentation mode further comprises:

[0011] receiving the segmentation mode setting parameters through an external device connected to the projection device, wherein the segmentation mode setting parameters include the number of segmentation areas and the positions of the segmentation areas;

[0012] The number of the divided areas is the same as the number of the participants;

[0013] The location of the segmented area is on a side of the conference desktop close to the participant.

[0014] Optionally, after forming segmented areas by setting parameters according to the segmentation mode, the method further comprises:

[0015] Perform a first brightness projection on each of the segmented areas.

[0016] Optionally, projecting the segmented area corresponding to the participant who issued the command image and displaying the first display content further includes:

[0017] Performing a second brightness projection on the segmented area corresponding to the participant who issued the command image and displaying the first display content;

[0018] The second brightness is greater than the first brightness.

[0019] Optionally, the collecting of first coordinate point data of the participant who issues the command image writing on the first display content further includes:

[0020] capturing an image of the participant who issues the command image writing on the first display content;

[0021] Acquire a first coordinate point of the writing operation in a first coordinate system according to the image;

[0022] The origin of the first coordinate system is the vertex in the lower left corner of the segmented area corresponding to the participant who issued the command image;

[0023] The horizontal axis of the first coordinate system is an edge extending from the vertex along a first direction in the segmented area corresponding to the participant who issued the command image, and the first direction is an extending direction of the edge of the segmented area close to the participant;

[0024] The vertical axis of the first coordinate system is an edge extending from the vertex along the second direction in the segmented area corresponding to the participant who issued the command image, and the first direction is perpendicular to the second direction;

[0025] The horizontal coordinate of the first coordinate point in the first coordinate system is X R1 , the vertical coordinate is Y R1 , X R1 is the distance between the projection of the first coordinate point on the horizontal axis and the origin, Y R1 is the distance between the projection of the first coordinate point on the longitudinal axis and the origin.

[0026] Optionally, converting the first coordinate point data to obtain second coordinate point data suitable for the all-in-one conference machine further includes:

[0027] Obtaining coordinate data of a second coordinate point in a second coordinate system according to the coordinate data of the first coordinate point in the first coordinate system and a coordinate conversion coefficient;

[0028] The origin of the second coordinate system is the vertex at the lower left corner of the display screen of the all-in-one conference machine;

[0029] The horizontal axis of the second coordinate system is an edge extending from the vertex along the third direction on the display screen of the all-in-one conference machine;

[0030] The longitudinal axis of the second coordinate system is an edge extending from the vertex along a fourth direction in the display screen of the all-in-one conference machine, and the third direction is perpendicular to the fourth direction;

[0031] The horizontal coordinate of the second coordinate point in the second coordinate system is a*X R1 , the vertical coordinate is b*Y R1 , a is the ratio of the length of the side extending along the third direction in the display screen of the all-in-one conference machine to the length of the side extending along the first direction in the divided area corresponding to the participant who issued the command image, and b is the ratio of the length of the side extending along the fourth direction in the display screen of the all-in-one conference machine to the length of the side extending along the second direction in the divided area corresponding to the participant who issued the command image.

[0032] Optionally, the collecting of first coordinate point data of the participant who issues the command image writing on the first display content further includes:

[0033] capturing an image of the participant who issues the command image writing on the first display content;

[0034] Acquire a first coordinate point of the writing operation in a first coordinate system according to the image;

[0035] The origin of the first coordinate system is the vertex at the lower left corner of the conference desktop;

[0036] The horizontal axis of the first coordinate system is an edge of the conference desktop extending from the vertex along a first direction, and the first direction is an extension direction of an edge of the segmented area close to the participant;

[0037] The longitudinal axis of the first coordinate system is an edge of the conference desktop extending from the vertex along a second direction, and the first direction is perpendicular to the second direction;

[0038] The horizontal coordinate of the first coordinate point in the first coordinate system is Xm =X 1 +X L1 , the vertical coordinate is Y m =Y 1 +Y L2 , X 1 is the horizontal coordinate of any vertex in the segmented area to which the writing operation belongs in the first coordinate system, Y 1 For the X 1 The corresponding ordinate in the first coordinate system, X L1 is the projection of the first coordinate point on the edge extending along the first direction in the corresponding segmented area and the X 1 The distance between L2 is the projection of the first coordinate point on the edge extending along the second direction in the corresponding segmented area and the Y 1 The distance between.

[0039] Optionally, converting the first coordinate point data to obtain second coordinate point data suitable for the all-in-one conference machine further includes:

[0040] Obtaining coordinate data of a second coordinate point in a second coordinate system according to the coordinate data of the first coordinate point in the first coordinate system and a coordinate conversion coefficient;

[0041] The origin of the second coordinate system is the vertex at the lower left corner of the display screen of the all-in-one conference machine;

[0042] The horizontal axis of the second coordinate system is an edge extending from the vertex along the third direction on the display screen of the all-in-one conference machine;

[0043] The longitudinal axis of the second coordinate system is an edge extending from the vertex along a fourth direction in the display screen of the all-in-one conference machine, and the third direction is perpendicular to the fourth direction;

[0044] The horizontal coordinate of the second coordinate point in the second coordinate system is X n =(X m -X 1 ) / c, the vertical axis is Y n =(Y m -Y 1 ) / d; c is the ratio of the length of the side extending along the third direction in the display screen of the all-in-one conference machine to the length of the side extending along the first direction in the divided area corresponding to the participant who issued the command image, and d is the ratio of the length of the side extending along the fourth direction in the display screen of the all-in-one conference machine to the length of the side extending along the second direction in the divided area corresponding to the participant who issued the command image.

[0045] Optionally, the collecting of first coordinate point data of the participant who issues the command image writing on the first display content further includes:

[0046] Receive infrared signals;

[0047] Generate the first coordinate point data according to the infrared signal;

[0048] The infrared signal is a signal sent by an infrared touch frame arranged on the conference desktop, and the infrared touch frame generates a signal in response to the participant who sends the instruction image writing on the first display content.

[0049] Optionally, before sending a request to the all-in-one conference machine and receiving the first display content when the command image is identified as a preset command, the method further includes:

[0050] The command images of each participant in the corresponding segmented area are identified according to a preset priority order; wherein the priority order is the order in which the commands are issued by each participant or the order in which the participants are seated.

[0051] Optionally, before identifying the instruction images of the participants in the corresponding segmented areas according to the preset priority order, the method further includes:

[0052] Distortion correction is performed on the collected images covering the conference desktop.

[0053] A second aspect of the present disclosure provides a method for a multi-person handwriting collaborative conference, which is applied to an all-in-one conference machine, including:

[0054] Receive a request signal and send a first display content to a projection device, so that the projection device projects the first display content to a segmented area corresponding to a participant who issues a command image; wherein the request signal is a signal sent by the projection device when collecting the command images of each participant in the segmented area corresponding to each participant and identifying the command image as a preset command, and the segmented area is formed by the projection device according to the parameters set in the segmentation method;

[0055] Receive first coordinate point data, convert the first coordinate point data to obtain second coordinate point data suitable for the conference all-in-one machine, and display the second coordinate point data to form written notes, wherein the first coordinate point data is data collected by the projection device and written by the participant who issued the command image on the first display content.

[0056] The third aspect of the present disclosure provides a multi-person handwriting collaborative conference system, including a projection device and an all-in-one conference machine;

[0057] The projection device is used to set parameters according to the segmentation method to form segmented areas; it is also used to collect the command images of each participant in the corresponding segmented area, and send a request signal to the conference all-in-one machine when the command image is recognized as a preset command;

[0058] The all-in-one conference machine is used to receive the request signal and send the first display content to the projection device;

[0059] The projection device is further used to project the segmented area corresponding to the participant who issued the command image and display the first display content; and is also used to collect the first coordinate point data of the participant who issued the command image writing the first display content and send it to the conference all-in-one machine;

[0060] The all-in-one conference machine is also used to convert the first coordinate point data to obtain second coordinate point data suitable for the all-in-one conference machine and display the second coordinate point data to form written notes.

[0061] A fourth aspect of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method described in the first aspect of the present disclosure;

[0062] or

[0063] When the program is executed by a processor, the method described in the second aspect of the present disclosure is implemented.

[0064] A fifth aspect of the present disclosure provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein:

[0065] When the processor executes the program, the method described in the first aspect of the present disclosure is implemented;

[0066] or

[0067] When the processor executes the program, the method described in the second aspect of the present disclosure is implemented.

[0068] The beneficial effects of the present disclosure are as follows:

[0069] The technical solution of the present invention is that the projection device collects the command images of each participant in each divided area, and when identifying the command image as a preset command, sends a request signal to the conference all-in-one machine, receives and displays the first display content, and then collects the trajectory data of the participant writing on the first display content and sends it to the conference all-in-one machine for conversion so that the conference all-in-one machine displays the writing trajectory of the participant on the first display content. The present invention can realize the timely synchronization of the participant's writing content to the conference all-in-one machine through information interaction between the projection device and the conference all-in-one machine; at the same time, it can realize the fixed installation of multi-person handwriting collaboration equipment, avoid equipment loss, reduce equipment maintenance costs, and effectively improve conference collaboration efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] The specific implementation methods of the present disclosure are further described in detail below with reference to the accompanying drawings.

[0071] Figure 1 A flow chart showing a method for multi-person handwriting collaborative conferencing according to an embodiment of the present invention is shown.

[0072] Figure 2 A schematic diagram showing the structure of a multi-person handwriting collaborative conference system according to an embodiment of the present invention is shown.

[0073] Figure 3 A schematic top view of a multi-person handwriting collaborative conference system according to an embodiment of the present invention is shown.

[0074] Figure 4 A swimlane diagram showing a method for multi-person handwriting collaborative conferencing according to an embodiment of the present invention.

[0075] Figure 5 A schematic diagram showing a first coordinate point of a method for multi-person handwriting collaborative conferencing according to an embodiment of the present invention.

[0076] Figure 6 A schematic diagram showing a first coordinate point of a method for multi-person handwriting collaborative conferencing according to another embodiment of the present invention.

[0077] Figure 7 A schematic diagram showing a second coordinate point of a method for multi-person handwriting collaborative conferencing according to an embodiment of the present invention.

[0078] Figure 8 A flow chart showing a method for multi-person handwriting collaborative conferencing according to another embodiment of the present invention.

[0079] Fig. 9 A schematic structural diagram of a computer device according to another embodiment of the present invention is shown. DETAILED DESCRIPTION

[0080] In order to more clearly illustrate the present invention, the present invention is further described below in conjunction with preferred embodiments and accompanying drawings. Similar components in the accompanying drawings are represented by the same reference numerals. It should be understood by those skilled in the art that the content specifically described below is illustrative rather than restrictive, and should not be used to limit the scope of protection of the present invention.

[0081] In a conference scenario, the speaker usually presents the content of the presentation in front of the conference machine, or writes the content on the conference machine, and others sit around the conference table to participate in the meeting. If you have different suggestions or supplements to the speaker's speech, it is difficult to write and communicate in real time.

[0082] At present, in the related technology, multiple tablet computers (Portable Android Device, PAD) are set up in the conference room for each participant to use, and each PAD can interact with the conference all-in-one machine. However, there are disadvantages in the related technology that each PAD needs to be maintained separately, it is necessary to ensure that the PAD has sufficient power, it is necessary to ensure that the PAD is movable, it is necessary to pay attention to not taking the PAD out of the conference room by mistake, it is necessary to ensure that the network settings of the PAD are not operated, and it is necessary to ensure that the PAD and the conference all-in-one machine are connected to the same local area network. Therefore, although the related technology can achieve writing collaboration, it is not the best solution.

[0083] In view of the problems existing in related technologies, such as Figure 1 As shown, an embodiment of the present invention provides a method for multi-person handwriting collaborative conference applied to a projection device, the method comprising:

[0084] Set parameters according to the segmentation method to form segmentation areas;

[0085] Collecting the command images of the participants in the corresponding segmented areas, and sending a request signal to the all-in-one conference machine when identifying the command images as preset commands, and receiving the first display content;

[0086] Projecting the segmented area corresponding to the participant who issued the command image and displaying the first display content;

[0087] The first coordinate point data of the participant who issued the command image writing on the first display content is collected and sent to the all-in-one conference machine, so that the all-in-one conference machine converts the first coordinate point data to obtain second coordinate point data suitable for the all-in-one conference machine and displays the second coordinate point data to form written notes.

[0088] The projection device of this embodiment collects the command images of each participant in each divided area, and when identifying the command image as a preset command, sends a request signal to the conference all-in-one machine, receives and displays the first display content, then collects the trajectory data of the participant's writing on the first display content and sends it to the conference all-in-one machine for conversion so that the conference all-in-one machine displays the participant's writing trajectory on the first display content. This embodiment exchanges information with the conference all-in-one machine through the projection device, so that the written content of the participant can be synchronized to the conference all-in-one machine in a timely manner; at the same time, it can realize the fixed installation of multi-person handwriting collaboration equipment, avoid equipment loss, reduce equipment maintenance costs, and effectively improve conference collaboration efficiency.

[0089] In a specific example, Figure 2 The figure shows a schematic diagram of the structure of a multi-person handwriting collaborative conference system, in which the projection device 100 includes a first core processing unit 101, a first display driver unit 102, a camera 103, a projection lamp 104, and a first wireless communication module 105; the all-in-one conference machine 200 includes a second core processing unit 201, a second display driver unit 202, a display screen 203, a handwriting module 204, and a second wireless communication module 205. Furthermore, the first wireless communication module 105 and the second wireless communication module 205 can be WIFI communication modules.

[0090] In a specific example, the projection device has an intelligent system, such as an Android system or a LINUX system, and its system settings and other contents can be viewed through an external display or a screen or a desktop. Furthermore, it can be set through a mouse or a remote control.

[0091] In a specific example, the projection device and the all-in-one conference machine in the conference room are connected to the same local area network through a wireless network module and transmit data through the wireless network module. Further, the wireless network module is, for example, a first wireless communication module and a second wireless communication module.

[0092] In a specific example, Figure 3 As shown, the projection device 100 is installed above the conference table 300 in the conference room, and projects downward onto the conference table and can cover the entire conference table. At the same time, the camera acquisition range of the projection device covers the entire conference table.

[0093] In a specific example, after the all-in-one conference machine and the projection device receive the synchronous start signal, the all-in-one conference machine and the projection device start working at the same time.

[0094] The following is an example of a specific implementation process of a multi-person handwriting collaborative conference and explains it step by step.

[0095] Step 1: Set parameters according to the segmentation method to form segmentation areas.

[0096] In this embodiment, the projection device receives segmentation mode setting parameters input by the user, and the first core processing unit outputs a control signal to the first display driving unit according to the segmentation mode setting parameters. The first display driving unit receives the control signal and outputs a driving signal to the projection lamp, thereby driving the projection lamp to form a projection segmentation area corresponding to the segmentation mode setting parameters on the conference desktop.

[0097] In a specific example, the first step specifically includes: the projection device receives segmentation mode setting parameters and performs a first brightness projection on each segmented area.

[0098] In this embodiment, if Figure 4 As shown, the projecting device receives the segmentation mode setting parameters and performs the first brightness projection on each segmented area, specifically including:

[0099] Step S1: The projection device receives segmentation mode setting parameters through an external device;

[0100] In a possible implementation, forming segmented areas according to segmentation mode setting parameters further includes: in this embodiment, the segmentation mode setting parameters are received by an external device connected to the projection device, and the segmentation mode setting parameters include the number of segmented areas and the positions of the segmented areas; the number of segmented areas is the same as the number of participants; the position of the segmented areas is on the side of the conference desktop close to the participants.

[0101] In a specific example, for example, the partition mode setting parameters are set by an external display connected to the projection device; for another example, the projection range of the projection lamp is set to cover the entire conference desktop and the camera captures the image of the entire conference desktop through the external display of the projection device.

[0102] In a specific example, Figure 3 As shown, through the system settings of the projection device, the user (e.g., participant 301 or speaker 303) can set the division mode of the conference desktop projection according to the current situation of the conference room, such as the size of the conference room, the size of the conference table 300, and the general number of participants, so as to support the recognition of the subsequent hand raising action of the participant 301. Further, for example, when there are 6 participants, 6 division areas are set; when there are 8 participants, 8 division areas are set.

[0103] In a specific example, the size of the segmented region may be calculated according to the number of segmented regions and the positions of the segmented regions.

[0104] In a specific example, the width-to-length ratio of the segmented area is the same as the width-to-length ratio of the display screen of the all-in-one conference machine.

[0105] In a specific example, Figure 3 As shown, the aspect ratio of each segmented area 302 is consistent with the aspect ratio of the display screen of the all-in-one conference machine 200, which is generally 16:9.

[0106] Step S2: the projection device performs a first brightness projection on each segmented area;

[0107] In a possible implementation manner, after the segmentation regions are formed by setting parameters according to the segmentation manner, the method further includes: performing a first brightness projection on each of the segmented regions.

[0108] In a specific example, a projection lamp of a projection device projects a first brightness onto a conference desktop. The first brightness projection means that the projection lamp is in a lower brightness projection state, preparing for a subsequent second brightness projection of a certain segmented area.

[0109] Step 2: The projection device collects the instruction images of each participant in their corresponding segmented areas.

[0110] In this embodiment, if Figure 4 As shown, the projector collects the instruction images of each participant in the corresponding segmented area, specifically including:

[0111] Step S3: The projection device collects the instruction image of each participant in the corresponding segmented area;

[0112] In a specific example, the camera of the projection device captures the command image on the conference desktop by capturing the image of the entire conference desktop. Further, the command image refers to the gesture image of the participant captured by the camera when the participant places his hand in the segmented area of ​​the projection range.

[0113] The camera in this embodiment is in a shooting state all the time when the projection device is turned on, ensuring that the gestures made by the participants can be transmitted to the first core processing unit of the projection device in a timely manner.

[0114] Step 3: The projection device performs distortion correction on the collected conference desktop image and identifies the command image in order of priority.

[0115] In this embodiment, if Figure 4 As shown, the projection device performs distortion correction on the collected conference desktop image and identifies the instruction image in order of priority, specifically including:

[0116] Step S4: the projection device performs distortion correction on the collected image covering the conference desktop;

[0117] In a possible implementation manner, the method further includes: performing distortion correction on the captured image covering the conference desktop.

[0118] In a specific example, a camera in a projection device is fixed at a position directly above a conference table, and a first core processing unit of the projection device is used to perform distortion correction on an image of a gesture on a distant desktop captured by the camera.

[0119] Step S5: The projection device identifies the instruction image of each participant in the corresponding segmented area according to a preset priority order;

[0120] In a possible implementation, the command images of the participants in the corresponding segmented areas are identified according to a preset priority order; wherein the priority order is the order in which the commands are issued by the participants or the order in which the participants are seated.

[0121] In a specific example, if multiple people issue commands, a judgment mechanism can also be added, such as according to the time sequence of issuing commands or setting the seating order in advance, the earlier the command is issued or the closer to the main seat, the higher the priority.

[0122] Step 4: The projection device recognizes the command image and sends a request signal to the conference all-in-one machine.

[0123] In this embodiment, if Figure 4 As shown, the projector device recognizes the command image and sends a request signal to the conference all-in-one device, specifically including:

[0124] Step S6: the projection device generates a request signal when recognizing that the command image is a preset command;

[0125] In a specific example, the camera captures the gestures of the participants and feeds them back to the first core processing unit of the projection device for recognition. Furthermore, the first core processing unit is preset with a gesture library, and one or more gestures correspond to hand-raising instructions, such as setting a gesture of a participant covering the conference table in front of him with his palm and five fingers open; or other gestures to avoid misidentification, such as a gesture of the thumb hiding the other four fingers open; this is just an example, the purpose is that the projection device can recognize which participant has raised his hand to indicate that he intends to write or annotate the current presentation content.

[0126] In a specific example, when a participant makes a gesture on the divided area of ​​the conference desktop in front of him, the camera captures the gesture and feeds back the gesture image to the first core processing unit in real time. The first core processing unit compares the collected gesture image with the preset gestures in the gesture library and determines whether the gesture is an instruction to raise the hand.

[0127] In a specific example, when the first core processing unit determines a hand-raising instruction of a certain segmented area, a request signal is generated.

[0128] Step S7: The projection device sends a request signal to the all-in-one conference machine;

[0129] In a specific example, the projection device sends a request signal to the all-in-one conference machine through the first wireless communication module.

[0130] Step 5: The all-in-one conference machine sends the first display content to the projection device.

[0131] In this embodiment, if Figure 4 As shown, the integrated conference machine sends the first display content to the projection device specifically including:

[0132] Step S8: the all-in-one conference machine sends the first display content to the projection device;

[0133] In a specific example, when the all-in-one conference machine receives a request signal, the second core processing unit of the all-in-one conference machine will display the current presentation image on the screen and transmit it to the first wireless communication module of the projection device through the second wireless communication module, so that the first core processing unit of the projection device projects the first display content to the segmented area corresponding to the participant who issued the command image.

[0134] Step 6: The projection device receives the first display content and performs second brightness projection.

[0135] In this embodiment, if Figure 4 As shown, the projecting device receives the first display content and performs the second brightness projection specifically including:

[0136] Step S9: the projection device performs second brightness projection on the designated segmented area corresponding to the participant who issued the command image and displays the first display content;

[0137] In a possible implementation, projecting the segmented area corresponding to the participant who issued the command image and displaying the first display content further includes: projecting the segmented area corresponding to the participant who issued the command image with a second brightness and displaying the first display content; the second brightness is greater than the first brightness.

[0138] In a specific example, the second brightness projection means that the projection lamp is in a high brightness projection state.

[0139] In a specific example, in different segmentation modes, such as a segmentation mode of 6 segmentation areas or a segmentation mode of 8 segmentation areas, the resolution of the highlight projection area is fixed.

[0140] In a specific example, the camera captures an image covering the conference desktop and sends it to the first core processing unit. The first core processing unit identifies the position of the participant who issued the command image and highlights the position to make the highlighted area more suitable for the participant to perform writing operations.

[0141] Specifically, after the first core processing unit of the projection device recognizes that a certain participant intends to raise his hand, the first core processing unit determines the segmented area of ​​the conference desktop corresponding to the current hand-raising position according to the system settings, and sends the position information of the segmented area of ​​the conference desktop to the first display driver unit. The first display driver unit determines which segmented area in the entire projection area is to be highlighted, and drives the projection lamp based on the judgment result, and finally presents the result of highlighting the first display content in the corresponding segmented area on the conference desktop. Furthermore, the segmented area of ​​the conference desktop in front of other participants except the participant who issued the command image remains in a low-brightness state.

[0142] In a specific example, the participant who issues the command image operates in the highlighted area, and his writing or operation track can be captured by the camera of the projection device. Furthermore, the display screen of the highlighted area has buttons for operation selection, such as a stylus button, a spotlight or laser pen button, and a button to close the highlighted window.

[0143] Step 7: The projection device collects the first coordinate point data of the participant's writing on the first display content.

[0144] In this embodiment, if Figure 4 As shown, the projecting device collects the first coordinate point data of the participant's writing on the first display content, specifically including:

[0145] Step S10: the projection device collects the first coordinate point data of the first display content written by the participant who issues the command image at a preset interval;

[0146] In a possible implementation, an image of the participant who issues the command image writing on the first display content is collected; a first coordinate point of the writing operation in the first coordinate system is obtained according to the image; the origin of the first coordinate system is the vertex in the lower left corner of the segmented area corresponding to the participant who issues the command image; the horizontal axis of the first coordinate system is the edge extending from the vertex along the first direction in the segmented area corresponding to the participant who issues the command image, and the first direction is the extension direction of the edge in the segmented area close to the participant; the vertical axis of the first coordinate system is the edge extending from the vertex along the second direction in the segmented area corresponding to the participant who issues the command image, and the first direction is perpendicular to the second direction; the horizontal coordinate of the first coordinate point in the first coordinate system is X R1 , the vertical coordinate is Y R1 , X R1 is the distance between the projection of the first coordinate point on the horizontal axis and the origin, Y R1 is the distance between the projection of the first coordinate point on the longitudinal axis and the origin.

[0147] In a specific example, Figure 5 As shown, the first coordinate system takes the segmented area 302 in the conference desktop 300 corresponding to the participant who issued the command image as the coordinate system; further, the origin of the first coordinate system is the vertex in the lower left corner of the segmented area 302 corresponding to the participant who issued the command image, and the coordinates of the origin are (0, 0); further, the origin of the first coordinate system is set to be aligned with the origin of the second coordinate system. Since the aspect ratio of the segmented area 302 is the same as the aspect ratio of the display screen of the conference all-in-one machine, the coordinate conversion is performed according to the proportional relationship between the two coordinate systems.

[0148] In a specific example, Figure 5 As shown, the coordinates of the vertex of the upper left corner of the segmented area 302 corresponding to the participant who issued the command image are (0, Y 3 ); The vertex coordinates of the lower right corner of the segmented area 302 corresponding to the participant who issued the command image are (X 3 , 0); the coordinates of the upper right corner of the segmented area 302 corresponding to the participant who issued the command image are (X 3 , Y 3 ). Further, X R2 is the projection of the first coordinate point on the horizontal axis and the X 3 The distance between R2 is the projection of the first coordinate point on the vertical axis and the Y 3 The distance between.

[0149] In another possible implementation, an image of the participant who issues the command image writing on the first display content is collected; a first coordinate point of the writing operation in the first coordinate system is obtained according to the image; the origin of the first coordinate system is the vertex in the lower left corner of the conference desktop; the horizontal axis of the first coordinate system is the edge of the conference desktop extending from the vertex along the first direction, and the first direction is the extension direction of the edge of the segmented area close to the participant; the vertical axis of the first coordinate system is the edge of the conference desktop extending from the vertex along the second direction, and the first direction is perpendicular to the second direction; the horizontal coordinate of the first coordinate point in the first coordinate system is X m =X 1 +X L1 , the vertical coordinate is Y m =Y 1 +Y L2 , X 1 is the horizontal coordinate of any vertex in the segmented area to which the writing operation belongs in the first coordinate system, Y 1 For the X 1The corresponding ordinate in the first coordinate system, X L1 is the projection of the first coordinate point on the edge extending along the first direction in the corresponding segmented area and the X 1 The distance between L2 is the projection of the first coordinate point on the edge extending along the second direction in the corresponding segmented area and the Y 1 The distance between.

[0150] In a specific example, Figure 6 As shown, the arbitrary vertex may be the vertex at the lower left corner in the segmented area 302 to which the writing operation belongs, and the coordinates of the vertex at the lower left corner are (X 1 , Y 1 ); it may also be the vertex of the upper left corner in the segmented area 302 to which the writing operation belongs, and the coordinates of the vertex of the upper left corner of the segmented area 302 are (X 1 , Y 2 ); or it can be the vertex of the lower right corner in the segmented area 302 to which the writing operation belongs, and the coordinates of the vertex of the lower right corner of the segmented area 302 are (X 2 , Y 1 ); it may also be the vertex of the upper right corner in the segmented area 302 to which the writing operation belongs, and the coordinates of the vertex of the upper right corner of the segmented area 302 are (X 2 , Y 2 ).

[0151] Further, such as Figure 6 As shown, X L2 is the projection of the first coordinate point on the edge extending along the first direction in the corresponding segmented area and the X 2 The distance between L1 is the projection of the first coordinate point on the edge extending along the second direction in the corresponding segmented area and the Y 2 The distance between.

[0152] In a specific example, Figure 6 As shown, the first coordinate system takes the conference desktop 300 as the coordinate system, and the origin of the first coordinate system is the vertex in the lower left corner of the conference desktop 300, and the coordinates of the origin are (0, 0). Further, the coordinates of the vertex in the upper left corner of the conference desktop 300 are (0, Y 4 ); The coordinates of the vertex in the lower right corner of the conference desktop 300 are (X 4 , 0); the coordinates of the vertex in the upper right corner of the conference desktop 300 are (X 4 , Y 4 ).

[0153] Further, such as Figure 6As shown, taking the vertex of the lower left corner in the segmented area 302 to which the writing operation belongs as an example, the coordinates (X 1 , Y 1 ), which is equivalent to the offset of the coordinate (0, 0) used to align the coordinate origin. Further, the dot 501 is the first coordinate point, that is, the writing point. According to the relationship X between the first coordinate point and the first coordinate system, L1 +X L2 =X 2 -X 1 , Y L1 +Y L2 =Y 2 -Y 1 , the coordinates of the writing point are (X 1 +X L1 , Y 1 +Y L2 ).

[0154] It should be noted that those skilled in the art should understand that, on the basis of determining the conversion relationship between the first coordinate system and the second coordinate system, the first coordinate system may also be any point on the conference desktop.

[0155] In another possible implementation, an infrared signal is received; the first coordinate point data is generated according to the infrared signal; wherein the infrared signal is a signal emitted by an infrared touch box disposed on a conference table, and the infrared touch box generates a signal in response to a participant who issues the command image writing on the first display content.

[0156] In a specific example, an infrared touch frame is integrated on a conference table and connected to a projection device, for example, via a Universal Serial Bus (USB) interface. The infrared touch frame is used to identify touch points, and the position information of the touch points is transmitted to the projection device. Multiple touch points form a writing track.

[0157] The infrared touch technology of this embodiment is relatively mature and can effectively improve the accuracy and real-time performance of identifying the handwriting trajectory of the participants.

[0158] Step 8: The projection device sends the first coordinate point data to the conference all-in-one machine.

[0159] In this embodiment, if Figure 4 As shown, the projector sends the first coordinate point data to the conference all-in-one device specifically including:

[0160] Step S11: the projection device sends the first coordinate point data to the all-in-one conference machine;

[0161] In a specific example, the projection device transmits the first coordinate point data to the all-in-one conference machine through the first wireless communication module.

[0162] Step 9: The all-in-one conference machine performs coordinate conversion on the first coordinate point data to obtain the second coordinate point data.

[0163] In this embodiment, if Figure 4 As shown, the integrated conference machine performs coordinate conversion on the first coordinate point data to obtain the second coordinate point data, specifically including:

[0164] Step S12: the all-in-one conference machine converts the first coordinate point data to obtain second coordinate point data;

[0165] In a possible implementation, the conversion according to the first coordinate point data to obtain the second coordinate point data suitable for the conference all-in-one machine further includes: obtaining the coordinate data of the second coordinate point in the second coordinate system according to the coordinate data of the first coordinate point in the first coordinate system and the coordinate conversion coefficient; the origin of the second coordinate system is the vertex in the lower left corner of the display screen of the conference all-in-one machine; the horizontal axis of the second coordinate system is the edge extending from the vertex along the third direction in the display screen of the conference all-in-one machine; the vertical axis of the second coordinate system is the edge extending from the vertex along the fourth direction in the display screen of the conference all-in-one machine, and the third direction is perpendicular to the fourth direction; the horizontal coordinate of the second coordinate point in the second coordinate system is a*X R1 , the vertical coordinate is b*Y R1 , a is the ratio of the length of the side extending along the third direction in the display screen of the all-in-one conference machine to the length of the side extending along the first direction in the divided area corresponding to the participant who issued the command image, and b is the ratio of the length of the side extending along the fourth direction in the display screen of the all-in-one conference machine to the length of the side extending along the second direction in the divided area corresponding to the participant who issued the command image.

[0166] In a specific example, the projection device sends first coordinate point data to the all-in-one conference machine. After the second core processing unit of the all-in-one conference machine receives the first coordinate point data of the trajectory point of the projection device, it converts it into a second coordinate point in the second coordinate system of the display screen of the all-in-one conference machine based on the first coordinate point data, the horizontal coordinate conversion coefficient and the vertical coordinate conversion coefficient.

[0167] In a specific example, Figure 7 As shown, the origin of the second coordinate system is the vertex of the lower left corner of the display screen 201 of the all-in-one conference machine; Figure 7 The dot 601 in the figure is Figure 5 The second coordinate point corresponding to the writing point 401 in (X 0 , Y0 ) is the coordinate of the vertex in the lower left corner of the display screen of the conference all-in-one machine, that is, the origin coordinate (X 0 , Y 0 )=(0,0);(X X , Y 0 ) is the coordinate of the vertex in the lower right corner of the display screen of the conference all-in-one machine; (X 0 , Y Y ) is the coordinate of the vertex in the upper left corner of the display screen of the conference all-in-one machine; (X X , Y Y ) are the coordinates of the vertex in the upper right corner of the display screen of the all-in-one conference machine.

[0168] In a specific example, Figure 5 and Figure 7 As shown, a is the ratio of the length of the side extending along the third direction in the display screen of the conference all-in-one machine to the length of the side extending along the first direction in the segmented area corresponding to the participant who issued the command image, that is, the horizontal coordinate conversion coefficient; further, the calculation formula of the horizontal coordinate conversion coefficient a is a=(X x -X 0 ) / (X 3 -0); b is the ratio of the length of the side extending along the fourth direction in the display screen of the conference all-in-one machine to the length of the side extending along the second direction in the segmented area corresponding to the participant who issued the command image, that is, the ordinate conversion coefficient; the calculation formula of the ordinate conversion coefficient b is b=(Y Y -Y 0 ) / (Y 3 -0).

[0169] In another possible implementation, the conversion according to the first coordinate point data to obtain the second coordinate point data suitable for the conference all-in-one machine further includes: obtaining the coordinate data of the second coordinate point in the second coordinate system according to the coordinate data of the first coordinate point in the first coordinate system and the coordinate conversion coefficient; the origin of the second coordinate system is the vertex in the lower left corner of the display screen of the conference all-in-one machine; the horizontal axis of the second coordinate system is the edge extending from the vertex along the third direction in the display screen of the conference all-in-one machine; the vertical axis of the second coordinate system is the edge extending from the vertex along the fourth direction in the display screen of the conference all-in-one machine, and the third direction is perpendicular to the fourth direction; the horizontal coordinate of the second coordinate point in the second coordinate system is X n =(X m -X 1 ) / c, the vertical axis is Y n =(Y m -Y 1) / d; c is the ratio of the length of the side extending along the third direction in the display screen of the all-in-one conference machine to the length of the side extending along the first direction in the divided area corresponding to the participant who issued the command image, and d is the ratio of the length of the side extending along the fourth direction in the display screen of the all-in-one conference machine to the length of the side extending along the second direction in the divided area corresponding to the participant who issued the command image.

[0170] In a specific example, the projection device sends first coordinate point data to the all-in-one conference machine. After the second core processing unit of the all-in-one conference machine receives the first coordinate point data of the trajectory point of the projection device, it converts it into a second coordinate point in the second coordinate system of the display screen of the all-in-one conference machine based on the first coordinate point data, the horizontal coordinate conversion coefficient and the vertical coordinate conversion coefficient.

[0171] In a specific example, Figure 7 As shown, the origin of the second coordinate system is the vertex at the lower left corner of the display screen of the all-in-one conference machine; Figure 7 The dot 601 in the figure is Figure 6 The second coordinate point corresponding to the writing point 501 in (X 0 , Y 0 ) is the coordinate of the vertex in the lower left corner of the display screen of the conference all-in-one machine, that is, the origin coordinate (X 0 , Y 0 )=(0,0);(X X , Y 0 ) is the coordinate of the vertex in the lower right corner of the display screen of the conference all-in-one machine; (X 0 , Y Y ) is the coordinate of the vertex in the upper left corner of the display screen of the conference all-in-one machine; (X X , Y Y ) are the coordinates of the vertex in the upper right corner of the display screen of the all-in-one conference machine.

[0172] In a specific example, Figure 6 As shown, c is the ratio of the length of the side extending along the third direction in the display screen of the conference all-in-one machine to the length of the side extending along the first direction in the segmented area corresponding to the participant who issued the command image, that is, the horizontal coordinate conversion coefficient; the calculation formula of the horizontal coordinate conversion coefficient is c=(X x -X 0 ) / (X 2 -X 1 );d is the ratio of the length of the side extending along the fourth direction in the display screen of the conference all-in-one machine to the length of the side extending along the second direction in the segmented area corresponding to the participant who issued the command image, that is, the ordinate conversion coefficient, and the calculation formula of the ordinate conversion coefficient is d=(YY -Y 0 ) / (Y 2 -Y 1 ).

[0173] In a specific example, Figure 7 As shown, in the second coordinate system, X L3 Y is the distance between the projection of the second coordinate point on the horizontal axis and the vertex of the lower left corner; L4 X is the distance between the projection of the second coordinate point on the vertical axis and the vertex of the lower left corner; L4 Y is the distance between the projection of the second coordinate point on the horizontal axis and the vertex of the lower right corner; L3 is the distance between the projection of the second coordinate point on the vertical axis and the vertex of the upper left corner.

[0174] Step 10: The all-in-one conference machine displays the written notes formed by the continuous data of the second coordinate points.

[0175] In this embodiment, if Figure 4 As shown, the written notes formed by the continuous second coordinate point data displayed by the integrated conference machine include:

[0176] Step S13: the all-in-one conference machine displays the written notes formed by the continuous second coordinate point data.

[0177] In a specific example, the continuous coordinates of the first coordinate point can be converted into continuous second coordinate point data according to the above conversion method. Furthermore, the second core processing unit of the all-in-one conference machine completes layer drawing or function triggering according to the operation corresponding to the continuous second coordinate point data, and then displays the writing or annotation operation of the participants on the display content on the display screen.

[0178] In this embodiment, the projection device collects the command images of each participant in each divided area, and when identifying the command image as a preset command, sends a request signal to the conference all-in-one machine, receives and displays the first display content, and then collects the trajectory data of the participant's writing on the first display content and sends it to the conference all-in-one machine for conversion so that the conference all-in-one machine displays the participant's writing trajectory on the first display content. In this embodiment, the projection device and the conference all-in-one machine exchange information, so that the written content of the participant can be synchronized to the conference all-in-one machine in a timely manner; at the same time, it can realize the fixed installation of multi-person handwriting collaboration equipment, avoid equipment loss, reduce equipment maintenance costs, and effectively improve conference collaboration efficiency.

[0179] The second embodiment of the present disclosure provides a method for multi-person handwriting collaborative conference, which is applied to a conference all-in-one machine, such as Figure 8 As shown, the method includes:

[0180] Receive a request signal and send a first display content to a projection device, so that the projection device projects the first display content to a segmented area corresponding to a participant who issues a command image; wherein the request signal is a signal sent by the projection device when collecting the command images of each participant in the segmented area corresponding to each participant and identifying the command image as a preset command, and the segmented area is formed by the projection device according to the parameters set in the segmentation method;

[0181] Receive first coordinate point data, convert the first coordinate point data to obtain second coordinate point data suitable for the conference all-in-one machine, and display the second coordinate point data to form written notes, wherein the first coordinate point data is data collected by the projection device and written by the participant who issued the command image on the first display content.

[0182] In this embodiment, the all-in-one conference machine receives a request signal sent by the projection device and sends the first display content to the projection device. The all-in-one conference machine receives the trajectory data of the participant's writing on the first display content and converts it to display the participant's writing trajectory on the first display content. This embodiment exchanges information with the projection device and the all-in-one conference machine, so that the participant's writing content can be synchronized to the all-in-one conference machine in a timely manner; at the same time, it can realize the fixed installation of multi-person handwriting collaboration equipment, avoid equipment loss, reduce equipment maintenance costs, and effectively improve conference collaboration efficiency.

[0183] The third embodiment of the present disclosure provides a multi-person handwriting collaborative conference system, including a projection device and an all-in-one conference machine; the projection device is used to set parameters according to the segmentation method to form segmented areas; it is also used to collect the command images of each participant in the segmented area corresponding to each participant, and send a request signal to the all-in-one conference machine when identifying the command image as a preset command; the all-in-one conference machine is used to receive the request signal and send a first display content to the projection device; the projection device is also used to project the segmented area corresponding to the participant who issued the command image and display the first display content; it is also used to collect the first coordinate point data of the participant who issued the command image writing the first display content and send it to the all-in-one conference machine; the all-in-one conference machine is also used to convert according to the first coordinate point data to obtain second coordinate point data suitable for the all-in-one conference machine and display according to the second coordinate point data to form written notes.

[0184] In a specific example, Figure 2As shown, the projection device 100 is used to perform a first brightness projection on each segmented area through the first display driving unit 102 and the projection lamp 104 according to the segmentation mode setting parameters received by the first display driving unit 102, and the segmentation mode setting parameters include the number and position of the segmented areas; further, the size of the segmented area can be calculated according to the number and position of the segmented areas; it is used to use the camera 103 to collect the instruction image of the participants in the respective corresponding segmented areas, and when the first display driving unit 102 recognizes that the instruction image is a preset instruction, it sends a request signal to the conference all-in-one machine through the first wireless communication module 105; the conference all-in-one machine is used to receive the request signal through the second wireless communication module 205 and send it to the first wireless communication module 10 5 sends the first display content of the display screen 203 to the projection device; the projection device is further used to use the camera 103 to perform second brightness projection on the designated segmented area corresponding to the participant who issued the command image through the first display driving unit 102 and the projection lamp 104 and display the first display content; use the camera 103 to collect the first coordinate point data of the first display content written by the participant who issued the command image at a preset interval and send it to the conference all-in-one machine; the conference all-in-one machine is further used to use the second core processing unit 201 to convert the first coordinate point data to obtain the second coordinate point data and drive the display screen 203 through the second display driving unit 202 to display the writing notes formed by the continuous second coordinate point data.

[0185] In a specific example, Figure 2 As shown, the handwriting module 204 is used to collect the handwriting trajectory data of the speaker and send it to the second core processing unit 201. The second core processing unit 201 drives the display screen 203 to display the handwriting trajectory of the speaker through the second display driving unit 202.

[0186] In this embodiment, the projection device collects the command images of each participant in each divided area, and when identifying the command image as a preset command, sends a request signal to the conference all-in-one machine, receives and displays the first display content, and then collects the trajectory data of the participant's writing on the first display content and sends it to the conference all-in-one machine for conversion so that the conference all-in-one machine displays the participant's writing trajectory on the first display content. In this embodiment, the projection device and the conference all-in-one machine exchange information, so that the written content of the participant can be synchronized to the conference all-in-one machine in a timely manner; at the same time, it can realize the fixed installation of multi-person handwriting collaboration equipment, avoid equipment loss, reduce equipment maintenance costs, and effectively improve conference collaboration efficiency.

[0187] A fourth embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which implements the method described in the first embodiment when the program is executed by a processor; or implements the method described in the second embodiment when the program is executed by a processor.

[0188] In a specific example, a computer-readable storage medium stores a computer program thereon, which, when executed by a processor, implements: performing a first brightness projection on each segmented area according to received segmentation mode setting parameters, the segmentation mode setting parameters including the number and position of the segmented areas; further, the size of the segmented area can be calculated according to the number and position of the segmented areas; collecting instruction images of participants in their respective corresponding segmented areas, and sending a request to the conference all-in-one machine and receiving a first display content when the instruction image is identified as a preset instruction; performing a second brightness projection on the designated segmented area corresponding to the preset instruction and displaying the first display content; collecting first coordinate point data of the writing of the first display content by the participant who issued the instruction image at a preset interval and sending it to the conference all-in-one machine, so that the conference all-in-one machine converts the first coordinate point data to obtain second coordinate point data and displays the writing notes formed by continuous second coordinate point data.

[0189] In another specific example, a computer-readable storage medium stores a computer program thereon, which, when executed by a processor, implements: receiving a request signal and sending a first display content to a projection device, so that the projection device performs a second brightness projection on a designated segmented area corresponding to the preset instruction and displays the first display content, the request signal being that the projection device performs a first brightness projection on each segmented area according to the received segmentation method setting parameters, the segmentation method setting parameters including the number and position of the segmented areas; further, the size of the segmented areas can be calculated according to the number and position of the segmented areas; collecting instruction images of participants in their respective corresponding segmented areas, and identifying that the instruction images are signals sent when the preset instructions are received; receiving first coordinate point data, the first coordinate point data being the coordinate point data of the writing of the first display content by the participant who issued the instruction image collected by the projection device at preset intervals; converting the first coordinate point data to obtain second coordinate point data and displaying the writing notes formed by continuous second coordinate point data.

[0190] In practical applications, the computer-readable storage medium can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CDROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present embodiment, the computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, device or device or used in combination with it.

[0191] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, which carry computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0192] The program code embodied on the computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0193] Computer program code for performing the operations of the present invention may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0194] The fifth embodiment of the present disclosure provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method described in the first embodiment is implemented; or when the processor executes the program, the method described in the second embodiment is implemented.

[0195] In a specific example, Fig. 9 Shown is a schematic diagram of the structure of a computer device. Fig. 9 The computer device 12 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0196] Further, such as Fig. 9 As shown, the computer device 12 is in the form of a general-purpose computing device. The components of the computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that connects various system components (including the system memory 28 and the processing unit 16).

[0197] Further, bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor or a local bus using any of a variety of bus architectures. For example, these architectures include but are not limited to Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus and Peripheral Component Interconnect (PCI) bus.

[0198] Furthermore, the computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the computer device 12, including volatile and non-volatile media, removable and non-removable media.

[0199] Further, the system memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. The computer device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 34 may be used to read and write non-removable, non-volatile magnetic media ( Fig. 9 not shown, usually called a "hard drive"). Although Figure 8Not shown in the figure, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, a DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 18 via one or more data medium interfaces. The memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of the various embodiments of the present invention.

[0200] Further, a program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in the memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. The program modules 42 generally perform the functions and / or methods of the embodiments described herein.

[0201] Further, the computer device 12 may also communicate with one or more external devices 14 (e.g., keyboards, pointing devices, displays 24, etc.), may also communicate with one or more devices that enable a user to interact with the computer device 12, and / or communicate with any device that enables the computer device 12 to communicate with one or more other computing devices (e.g., network cards, modems, etc.). Such communication may be performed via an input / output (I / O) interface 22. Furthermore, the computer device 12 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via a network adapter 20. Fig. 9 As shown, the network adapter 20 communicates with other modules of the computer device 12 via the bus 18. It should be understood that although Fig. 9 Not shown, other hardware and / or software modules may be used in conjunction with computer device 12, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0202] Furthermore, the processor unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, such as implementing a method for multi-person handwriting collaborative conferencing provided in the first embodiment of the present invention, or a method for multi-person handwriting collaborative conferencing provided in the second embodiment of the present invention.

[0203] In view of the current existing problems, the present invention proposes a method, system, computer equipment and medium for multi-person handwriting collaborative conference, which interacts with the all-in-one conference machine through a projection device, can realize the fixed installation of the multi-person handwriting collaborative equipment, avoid the loss of equipment, reduce the equipment maintenance cost, and effectively improve the efficiency of conference collaboration.

[0204] Obviously, the above embodiments of the present disclosure are merely examples for clearly illustrating the present disclosure, and are not limitations on the implementation methods of the present disclosure. For ordinary technicians in this field, other different forms of changes or modifications can be made on the basis of the above description. It is impossible to list all the implementation methods here. All obvious changes or modifications derived from the technical solution of the present disclosure are still within the protection scope of the present disclosure.

Claims

1. A method for multi-person handwriting collaborative conference, applied to a projection device, characterized in that: include: Set parameters according to the segmentation method to form segmentation areas; Collecting the command images of the participants in the corresponding segmented areas, and sending a request signal to the all-in-one conference machine when identifying the command images as preset commands, and receiving the first display content; Projecting the segmented area corresponding to the participant who issued the command image and displaying the first display content; The first coordinate point data of the participant who issued the command image writing on the first display content is collected and sent to the all-in-one conference machine, so that the all-in-one conference machine converts the first coordinate point data to obtain second coordinate point data suitable for the all-in-one conference machine and displays the second coordinate point data to form written notes.

2. The method for multi-person handwriting collaborative conference according to claim 1, characterized in that: The forming of segmented regions by setting parameters according to the segmentation method further comprises: receiving the segmentation mode setting parameters through an external device connected to the projection device, wherein the segmentation mode setting parameters include the number of segmentation areas and the positions of the segmentation areas; The number of the divided areas is the same as the number of the participants; The location of the segmented area is on a side of the conference desktop close to the participant.

3. The method for multi-person handwriting collaborative conference according to claim 1, characterized in that: After the parameters are set according to the segmentation mode to form segmented areas, the method further includes: Perform a first brightness projection on each of the segmented areas.

4. The method for multi-person handwriting collaborative conference according to claim 3, characterized in that: The projecting the segmented area corresponding to the participant who issued the command image and displaying the first display content further includes: Performing a second brightness projection on the segmented area corresponding to the participant who issued the command image and displaying the first display content; The second brightness is greater than the first brightness.

5. The method for multi-person handwriting collaborative conference according to claim 1, characterized in that: The step of collecting the first coordinate point data of the participant who issues the command image writing on the first display content further includes: capturing an image of the participant who issues the command image writing on the first display content; Acquire a first coordinate point of the writing operation in a first coordinate system according to the image; The origin of the first coordinate system is the vertex in the lower left corner of the segmented area corresponding to the participant who issued the command image; The horizontal axis of the first coordinate system is an edge extending from the vertex along a first direction in the segmented area corresponding to the participant who issued the command image, and the first direction is an extending direction of the edge of the segmented area close to the participant; The vertical axis of the first coordinate system is an edge extending from the vertex along the second direction in the segmented area corresponding to the participant who issued the command image, and the first direction is perpendicular to the second direction; The horizontal coordinate of the first coordinate point in the first coordinate system is X R1 , the vertical coordinate is Y R1 , X R1 is the distance between the projection of the first coordinate point on the horizontal axis and the origin, Y R1 is the distance between the projection of the first coordinate point on the longitudinal axis and the origin.

6. The method for multi-person handwriting collaborative conference according to claim 5, characterized in that: The converting the first coordinate point data to obtain the second coordinate point data suitable for the conference all-in-one device further includes: Obtaining coordinate data of a second coordinate point in a second coordinate system according to the coordinate data of the first coordinate point in the first coordinate system and a coordinate conversion coefficient; The origin of the second coordinate system is the vertex at the lower left corner of the display screen of the all-in-one conference machine; The horizontal axis of the second coordinate system is an edge extending from the vertex along the third direction on the display screen of the all-in-one conference machine; The longitudinal axis of the second coordinate system is an edge extending from the vertex along a fourth direction in the display screen of the all-in-one conference machine, and the third direction is perpendicular to the fourth direction; The horizontal coordinate of the second coordinate point in the second coordinate system is a*X R1 , the vertical coordinate is b*Y R1 , a is the ratio of the length of the side extending along the third direction in the display screen of the all-in-one conference machine to the length of the side extending along the first direction in the divided area corresponding to the participant who issued the command image, and b is the ratio of the length of the side extending along the fourth direction in the display screen of the all-in-one conference machine to the length of the side extending along the second direction in the divided area corresponding to the participant who issued the command image.

7. The method for multi-person handwriting collaborative conference according to claim 1, characterized in that: The step of collecting the first coordinate point data of the participant who issues the command image writing on the first display content further includes: capturing an image of the participant who issues the command image writing on the first display content; Acquire a first coordinate point of the writing operation in a first coordinate system according to the image; The origin of the first coordinate system is the vertex at the lower left corner of the conference desktop; The horizontal axis of the first coordinate system is an edge of the conference desktop extending from the vertex along a first direction, and the first direction is an extension direction of an edge of the segmented area close to the participant; The longitudinal axis of the first coordinate system is an edge of the conference desktop extending from the vertex along a second direction, and the first direction is perpendicular to the second direction; The horizontal coordinate of the first coordinate point in the first coordinate system is X m =X1+X L1 , the vertical coordinate is Y m =Y1+Y L2 , X1 is the horizontal coordinate of any vertex in the segmented area to which the writing operation belongs in the first coordinate system, Y1 is the vertical coordinate corresponding to X1 in the first coordinate system, X L1 is the distance between the projection of the first coordinate point on the edge extending along the first direction in the corresponding segmented area and X1, Y L2 is the distance between the projection of the first coordinate point on the edge extending along the second direction in the corresponding segmented area and Y1.

8. The method for multi-person handwriting collaborative conference according to claim 7, characterized in that: The converting the first coordinate point data to obtain the second coordinate point data suitable for the conference all-in-one device further includes: Obtaining coordinate data of a second coordinate point in a second coordinate system according to the coordinate data of the first coordinate point in the first coordinate system and a coordinate conversion coefficient; The origin of the second coordinate system is the vertex at the lower left corner of the display screen of the all-in-one conference machine; The horizontal axis of the second coordinate system is an edge extending from the vertex along the third direction on the display screen of the all-in-one conference machine; The longitudinal axis of the second coordinate system is an edge extending from the vertex along a fourth direction in the display screen of the all-in-one conference machine, and the third direction is perpendicular to the fourth direction; The horizontal coordinate of the second coordinate point in the second coordinate system is X n =(X m -X1) / c, the ordinate is Y n =(Y m -Y1) / d; c is the ratio of the length of the side extending along the third direction in the display screen of the all-in-one conference machine to the length of the side extending along the first direction in the divided area corresponding to the participant who issued the command image, and d is the ratio of the length of the side extending along the fourth direction in the display screen of the all-in-one conference machine to the length of the side extending along the second direction in the divided area corresponding to the participant who issued the command image.

9. The method for multi-person handwriting collaborative conference according to claim 1, characterized in that: The step of collecting the first coordinate point data of the participant who issues the command image writing on the first display content further includes: Receive infrared signals; Generate the first coordinate point data according to the infrared signal; The infrared signal is a signal sent by an infrared touch frame arranged on the conference desktop, and the infrared touch frame generates a signal in response to the participant who sends the instruction image writing on the first display content.

10. The method for multi-person handwriting collaborative conference according to claim 1, characterized in that: Before sending a request to the all-in-one conference machine and receiving the first display content when the command image is identified as a preset command, the method further includes: The command images of each participant in the corresponding segmented area are identified according to a preset priority order; wherein the priority order is the order in which the commands are issued by each participant or the order in which the participants are seated.

11. The method for multi-person handwriting collaborative conference according to claim 10, characterized in that: Before identifying the instruction images of the participants in the corresponding segmented areas according to the preset priority order, the method further includes: Distortion correction is performed on the collected images covering the conference desktop.

12. A method for multi-person handwriting collaborative conference, applied to an all-in-one conference machine, characterized in that: include: Receive a request signal and send a first display content to a projection device, so that the projection device projects the first display content to a segmented area corresponding to a participant who issues a command image; wherein the request signal is a signal sent by the projection device when collecting the command images of each participant in the segmented area corresponding to each participant and identifying the command image as a preset command, and the segmented area is formed by the projection device according to the parameters set in the segmentation method; Receive first coordinate point data, convert the first coordinate point data to obtain second coordinate point data suitable for the conference all-in-one machine, and display the second coordinate point data to form written notes, wherein the first coordinate point data is data collected by the projection device and written by the participant who issued the command image on the first display content.

13. A multi-person handwriting collaborative conference system, characterized in that: Including projection equipment and all-in-one conference machines; in The projection device is used to set parameters according to the segmentation method to form segmented areas; it is also used to collect the command images of each participant in the corresponding segmented area, and send a request signal to the conference all-in-one machine when the command image is recognized as a preset command; The all-in-one conference machine is used to receive the request signal and send the first display content to the projection device; The projection device is further used to project the segmented area corresponding to the participant who issued the command image and display the first display content; and is also used to collect the first coordinate point data of the participant who issued the command image writing the first display content and send it to the conference all-in-one machine; The all-in-one conference machine is also used to convert the first coordinate point data to obtain second coordinate point data suitable for the all-in-one conference machine and display the second coordinate point data to form written notes.

14. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 11 is implemented; or When the program is executed by a processor, the method according to claim 12 is implemented.

15. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method according to any one of claims 1 to 11 is implemented; or When the processor executes the program, the method according to claim 12 is implemented.

Images