Laser pointer indication data marking method, device, equipment and computer storage medium

Abstract

The application discloses a laser pointer indicating data marking method, device and equipment and a computer storage medium, and relates to the technical field of display. The method is applied to marking data indicated by a laser pointer on a display device. The display device comprises a light ray sensing device. The method comprises the following steps: positioning a laser point projected on the display device by the laser pointer according to light ray information collected by the light ray sensing device; and marking first display data corresponding to the laser point in the case that the laser point is positioned. The method can enable remote participants to share a presentation position indicated by the laser pointer on the display device, thereby solving the problem of low conference efficiency caused by the fact that remote participants cannot share a current presentation position.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display, in particular to a laser pointer indicating data marking method, device, equipment and computer storage medium. BACKGROUND

[0002] The cloud conference is a conference group created by a conference creator through a local device on a cloud server side. When the cloud conference is carried out, the conference content can be uploaded to a cloud space for processing and storing cloud conference data, and the conference content is presented on a display device through the cloud space. The presenter can indicate the current explanation position on the display device through the laser pointer, so that the conference participants can better grasp the conference progress and improve the conference efficiency.

[0003] At present, the light spot projected on the display device by the laser pointer is usually used to indicate the current explanation position, wherein the position of the light spot corresponds to the conference content on the display device, that is, the current explanation position.

[0004] However, in the above method, the remote conference participants and the presenter are not in the same conference site, and cannot see the light spot projected on the display device by the laser pointer, so that the remote conference participants cannot share the current explanation position in real time, which affects the conference efficiency. SUMMARY

[0005] The embodiments of the present application disclose a laser pointer indicating data marking method, device, equipment and computer storage medium, so as to enable remote conference participants to share the explanation position indicated by the laser pointer on the display device and improve the conference efficiency.

[0006] In a first aspect, the embodiments of the present application provide a laser pointer indicating data marking method, which is applied to marking the data indicated by the laser pointer on a display device, the display device comprising a light sensing device, and the method comprises the following steps:

[0007] According to the light information collected by the light sensing device, the laser point projected on the display device by the laser pointer is located.

[0008] In the case of locating the laser point, the first display data corresponding to the laser point is marked.

[0009] In the embodiment of the present application, since the area corresponding to the laser point projected on the display device by the laser pen has higher brightness compared to other display areas on the display device, the light information collected by the light sensing device in the display device is used to determine the light brightness change on the display device, so that the position of the laser point on the display device can be located. In the case of locating the laser point, the first display data corresponding to the laser point is marked, so that the participants can know the current explanation position through the marked first display data. Compared with the method of directly indicating the current explanation position by the light spot, the present method can make the marked first display data different from other unmarked display data in the display device, so as to support the personnel participating in the meeting remotely using other terminal devices to share the indication position of the laser pen on the display device, so as to facilitate the remote participants to understand the meeting content and conduct remote interaction, and improve the efficiency of the meeting.

[0010] In a possible implementation of the first aspect, the display device comprises an image collection device, and after locating the laser point projected on the display device by the laser pen according to the light information collected by the light sensing device, the method further comprises:

[0011] In the case of not locating the laser point, a first target image collected by the image collection device is obtained, and the first target image records the laser beam emitted by the laser pen;

[0012] According to the visual range of the image collection device and the first target image, a first target indication position indicated by the laser pen on the display device is determined, and second display data corresponding to the first target indication position is marked.

[0013] In the embodiment, for example, if the laser point cannot be located due to environmental factors of the display device or functional limitations of the display device, in this case, the first target image containing the laser beam emitted by the laser pen can be collected by the image collection device in the display device, and the first target indication position corresponding to the laser pen on the display device can be calculated by combining the visual range of the image collection device and the geometric operation method. The second display data corresponding to the first target indication position is marked, so that the participants can know the current explanation position through the marked second display data, and the influence of environmental factors or limitations of the display device itself on determining the current explanation position can be reduced.

[0014] In a possible implementation of the first aspect, after locating the laser point, the method further comprises:

[0015] A second target image collected by the image collection device is obtained, and the second target image records the laser beam emitted by the laser pen when the laser point is located.

[0016] determine a second target indicating position on the display device indicated by the laser pointer according to the visual range of the image acquisition device and the second target image;

[0017] compare the second target indicating position with the position of the laser point located, and determine an error compensation value;

[0018] The determining of the first target indicating position on the display device indicated by the laser pointer according to the visual range of the image acquisition device and the first target image comprises:

[0019] The determining of the first target indicating position on the display device indicated by the laser pointer according to the visual range, the first target image and the error compensation value.

[0020] In the embodiment, since the position of the laser point can be located by the light ray sensing device in the display device, the laser pointer can be calibrated by the located position of the laser point when the laser point is located. Specifically, when the laser point is located, the second target image acquired by the image acquisition device at this time is obtained, and the second target indicating position on the display device indicated by the laser pointer at this time is calculated according to the visual range of the image acquisition device and a geometric calculation method. The second target indicating position is compared with the position of the located laser point, and the error compensation value is determined. The error compensation value is introduced in the subsequent calculation of the first target indicating position, so that the error between the calculated first target indicating position and the actual indicating position of the laser pointer is reduced, and the calculation accuracy is improved.

[0021] In a possible implementation of the first aspect, the determining of the first target indicating position on the display device indicated by the laser pointer according to the visual range, the first target image and the error compensation value comprises:

[0022] establish a three-dimensional rectangular coordinate system according to the visual range and the plane corresponding to the display device;

[0023] determine a function expression of a straight line corresponding to the laser beam recorded in the first target image in the three-dimensional rectangular coordinate system according to the first target image;

[0024] determine the first target indicating position on the display device indicated by the laser pointer according to the function expression and the error compensation value.

[0025] In the embodiment, a three-dimensional coordinate system is established according to a visual range of the display device and a plane where the display device is located, two coordinate points are taken from the laser pen in the first target image, and a function expression corresponding to a straight line of the laser beam in the three-dimensional coordinate system can be calculated by a spatial geometric operation method. Further, the first target indicating position corresponding coordinate value can be calculated by the function expression and the error compensation value, and the position of the laser pen indicated on the display device is determined by the coordinate value, so that the first target indicating position calculated is more accurate.

[0026] In a possible implementation of the first aspect, before the laser point projected by the laser pen on the display device is located according to the light information collected by the light perception device, the method further includes:

[0027] According to a preset division rule, a grid unit is divided in the screen of the display device.

[0028] The laser point projected by the laser pen on the display device is located according to the light information collected by the light perception device, including:

[0029] According to the light information collected by the light perception device, a brightness difference of each grid unit is determined.

[0030] According to the brightness difference, a target grid unit whose brightness satisfies a preset brightness threshold is selected.

[0031] The laser point projected by the laser pen on the display device is located according to the target grid unit.

[0032] In the embodiment, by dividing the grid unit in the screen of the display device, the brightness difference between each grid unit can be determined according to the light information collected by the light perception device, and then the target grid unit whose brightness satisfies the preset brightness threshold is located from the divided grid unit according to the brightness difference, and the laser point can be further located according to the position of the grid unit in the screen of the display device. By determining the grid unit corresponding to the laser point first, the range for locating the laser point is reduced, and the time consumed for locating the laser point is shortened.

[0033] In a possible implementation of the first aspect, the first display data corresponding to the laser point is marked in the case of locating the laser point, including:

[0034] In the case of locating the laser point, the centroid position of the target grid unit is taken as the position of the laser point.

[0035] According to the position of the laser point and the pixel information of the display device, the screen coordinate of the laser point is determined.

[0036] According to the screen coordinates of the laser point and the data information displayed on the display device, the first display data is determined, and the first display data is marked.

[0037] In the embodiment, the screen coordinates correspond to coordinate points in a screen coordinate system of the display device itself, and the position of the mass center of the target grid unit is taken as the position of the laser point, so that the positioning accuracy of the laser point can be improved, and the screen coordinates corresponding to the laser point can be determined in combination with the pixel information of the display device. In addition, a view area for displaying the data information can also be determined in the screen coordinate system, so that the first display data corresponding to the laser point can be more conveniently determined according to the screen coordinates corresponding to the laser point.

[0038] In a possible implementation of the first aspect, before the first display data is marked, the method further includes:

[0039] According to the screen coordinates and the first display data, a target marking area on the display device is determined;

[0040] The marking of the first display data includes:

[0041] The first display data is marked according to the target marking area.

[0042] In the embodiment, since the area corresponding to the screen coordinates on the display device can not cover the corresponding first display data, it is difficult to visually distinguish the marked first display data from other unmarked display data, so after the screen coordinates corresponding to the laser point are located, the size of the target marking area is determined in combination with the first display data, and then the first display data is marked according to the determined target marking area, so that the marked first display data is more visually distinguishable, and the current explanation position can be better presented.

[0043] In the second aspect, the embodiment of the application provides a laser pointer data marking device, which is applied to marking data indicated by the laser pointer on a display device, the display device includes a light sensing device, and the device includes:

[0044] A positioning unit is configured to locate a laser point projected on the display device by the laser pointer according to light information collected by the light sensing device.

[0045] A marking unit is configured to mark first display data corresponding to the laser point when the laser point is located.

[0046] In a possible implementation of the second aspect, the display device comprises an image acquisition device, and the apparatus further comprises:

[0047] an acquisition unit, configured to acquire a first target image captured by the image acquisition device in a case where the laser point is not located, the first target image recording a laser beam emitted by the laser pointer;

[0048] The marking unit is further configured to determine a first target indication position indicated by the laser pointer on the display device according to a visual range of the image acquisition device and the first target image, and mark second display data corresponding to the first target indication position.

[0049] In a possible implementation of the second aspect,

[0050] The acquisition unit is further configured to acquire a second target image captured by the image acquisition device, the second target image recording a laser beam emitted by the laser pointer when the laser point is located;

[0051] The marking unit is further configured to determine a second target indication position indicated by the laser pointer on the display device according to the visual range of the image acquisition device and the second target image.

[0052] The marking unit is further configured to compare the second target indication position and the position of the located laser point, and determine an error compensation value.

[0053] The marking unit is specifically configured to determine the first target indication position indicated by the laser pointer on the display device according to the visual range, the first target image, and the error compensation value.

[0054] In a possible implementation of the second aspect,

[0055] The marking unit is specifically configured to establish a three-dimensional rectangular coordinate system according to the visual range and a plane corresponding to the display device.

[0056] The marking unit is specifically configured to determine, according to the first target image, a function expression corresponding to a straight line corresponding to the laser beam recorded in the first target image in the three-dimensional rectangular coordinate system.

[0057] The marking unit is specifically configured to determine the first target indication position indicated by the laser pointer on the display device according to the function expression and the error compensation value.

[0058] In a possible implementation of the second aspect, the apparatus further comprises:

[0059] The dividing unit is configured to divide a grid unit in a screen of the display device according to a preset dividing rule.

[0060] The positioning unit is further configured to determine a brightness difference of each grid unit according to the light information collected by the light sensing device.

[0061] The positioning unit is further configured to select a target grid unit whose brightness meets a preset brightness threshold according to the brightness difference.

[0062] The positioning unit is further configured to position the laser point projected on the display device by the laser pointer according to the target grid unit.

[0063] In a possible implementation of the second aspect,

[0064] The marking unit is further configured to take a center position of the target grid unit as the position of the laser point when the laser point is positioned.

[0065] The marking unit is further configured to determine a screen coordinate of the laser point according to the position of the laser point and pixel information of the display device.

[0066] The marking unit is further configured to determine the first display data according to the screen coordinate of the laser point and data information displayed on the display device, and mark the first display data.

[0067] In a possible implementation of the second aspect, the device further includes:

[0068] The determining unit is configured to determine a target marking area on the display device according to the screen coordinate and the first display data.

[0069] The marking unit is further configured to mark the first display data according to the target marking area.

[0070] For the technical effects brought by the second aspect and any possible implementation of the second aspect, refer to the introduction of the technical effects corresponding to the first aspect and the corresponding implementation of the first aspect.

[0071] In a third aspect, an embodiment of the present application provides an electronic device, which includes:

[0072] A memory configured to store a program;

[0073] A processor configured to execute the program stored in the memory, and when the program is executed by the processor, the processor performs the method in any possible implementation of the first aspect.

[0074] In a fourth aspect, an embodiment of the present application provides a computer storage medium, and the computer storage medium stores a computer program. The computer program includes program instructions, and the program instructions are executed by a processor to implement the method in the first aspect and any possible implementation of the first aspect.

[0075] In a fifth aspect, an embodiment of the present application provides a computer program product, and the computer program product includes: instructions or a computer program. The instructions or the computer program are executed to implement the method in the first aspect and any possible implementation of the first aspect.

[0076] In a sixth aspect, an embodiment of the present application provides a chip, and the chip includes a processor. The processor is configured to execute instructions. The processor executes the instructions to implement the method in the first aspect and any possible implementation of the first aspect. Optionally, the chip further includes an input / output interface. The input / output interface is configured to receive a signal or send a signal. BRIEF DESCRIPTION OF DRAWINGS

[0077] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments of the present application.

[0078] Figure 1 A flowchart of a laser pointer indicating data marking method provided by an embodiment of the present application;

[0079] Figure 2 An application scenario diagram of a laser pointer indicating data marking method provided by an embodiment of the present application;

[0080] Figure 3 A flowchart of another laser pointer indicating data marking method provided by an embodiment of the present application;

[0081] Figure 4 An application scenario diagram of another laser pointer indicating data marking method provided by an embodiment of the present application;

[0082] Figure 5 A structural diagram of a laser pointer indicating data marking device provided by an embodiment of the present application;

[0083] Figure 6 A structural diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0084] In order to make the purposes, technical solutions and advantages of the present application clearer, the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.

[0085] The terms "first" and "second" and the like in the specification of the present application, claims, and drawings are used to distinguish different objects, rather than to describe a particular order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device, etc. including a series of steps or units is not limited to the listed steps or units, but can optionally include other steps or units not listed, or can optionally include other steps or units inherent to the process, method, product, or device, etc.

[0086] "Embodiments" mentioned herein mean that the specific features, structures or properties described in conjunction with the embodiments can be included in at least one embodiment of the present application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment to other embodiments. Those skilled in the art can explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.

[0087] It should be understood that in the present application, "at least one" means one or more, "multiple" means two or more, "at least two" means two or three and more, and "and / or" is used to describe the relationship between the associated objects, which means that there can be three relationships, for example, "A and / or B" can mean that there are three cases: only A, only B, and A and B at the same time, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects. "At least one of the following" or similar expressions means any combination of these items, including any combination of single or multiple items. For example, at least one of a, b or c can mean a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0088] The present application provides a laser pointer indication data marking method, device, equipment and computer storage medium. In order to more clearly describe the scheme of the present application, some related term definitions will be introduced first.

[0089] Shared content: or conference content, refers to the content information uploaded by the participants of the cloud conference to the cloud space of the cloud conference through the terminal device of the user, such as computer aided design (computer aided design, CAD) drawing file, audio file, video file, local device of the user Split screen mirror, screen recording content, etc.

[0090] The laser pointer pointing data marking method provided in this application relates to the field of display technology, and can be specifically applied to marking the data indicated by the laser pointer on the display device during cloud conferencing.

[0091] Currently, when conducting cloud meetings, the presenter can use a laser pointer to project a spot onto the display device to indicate the current presentation location. However, since remote participants and the presenter are not in the same meeting venue, they cannot see the laser pointer projected onto the display device, which prevents remote participants from sharing the current presentation location and affects the efficiency of the meeting.

[0092] To address the above issues, this application provides a laser pointer indication data marking method, which is applied to mark the laser pointer indication data on a display device. This allows remote participants to share the explanation location indicated by the laser pointer on the display device, thereby improving meeting efficiency.

[0093] The following will refer to the appendices in the embodiments of this application. Figure 1 For an introduction to the laser pointer pointing data marking method described above, please refer to [link / reference]. Figure 1 , Figure 1 This is a flowchart illustrating a laser pointer-guided data marking method provided in an embodiment of this application.

[0094] like Figure 1 As shown, the above-mentioned laser pointer pointing data marking method includes the following steps:

[0095] S101. The display device locates the laser point projected onto the display device by the laser pointer based on the light information collected by the light sensing device.

[0096] In this embodiment, the display device includes a light sensing device, which has the ability to sense light signals and convert them into other types of signals, and can be used to collect light information on the screen of the display device. The light sensing device can be a photosensitive device, such as a photoresistor, and the light information can be used to describe the brightness of the light. For example, the display device can determine the change in light brightness on the screen based on the light information collected by the light sensing device. Since the area corresponding to the laser point has higher brightness, the area with higher brightness can be located based on the change in light brightness on the screen, thereby locating the position of the laser point on the display device.

[0097] S102. When the display device locates the laser point, it marks the first display data corresponding to the laser point.

[0098] In the embodiment of the present application, when the display device is positioned to the laser point, in the case that the position of the laser point is known, the first display data corresponding to the position of the laser point can be determined in combination with the data displayed in the display device, and the first display data is marked, so that the marked first display data is visually distinguished from other unmarked data, and the participants can know the current explanation position through the marked first display data. Compared with the method of directly indicating the current explanation position by the light spot, the participants who use other terminal devices to participate remotely can share the indication position (or explanation position) of the laser pen on the display device, so as to facilitate the remote participants to understand the conference content and conduct remote interaction, and improve the efficiency of the conference.

[0099] In some optional embodiments, the display device comprises an image acquisition device, and after step S101, the method further comprises:

[0100] In step S103, the display device acquires a first target image acquired by the image acquisition device in the case that the display device is not positioned to the laser point, and the first target image records the laser beam emitted by the laser pen.

[0101] In the embodiment, the image acquisition device can be a camera or a scanner, for example. In the case that the display device is affected by environmental factors (such as shadow obstruction or light interference) or is limited by its own function (such as the screen cannot display the light spot or the light sensing device function is abnormal), the display device can not be positioned to the laser point, and in this case, the first target image when the laser beam is emitted by the laser pen can be captured through the image acquisition device contained in the display device, and the image of the laser pen (such as the posture and position of the laser pen) can be recorded in the first target image, so as to determine the indication position of the laser pen through the first target image.

[0102] In step S104, the display device determines a first target indication position indicated by the laser pen on the display device according to the visual range of the image acquisition device and the first target image, and marks the second display data corresponding to the first target indication position.

[0103] In the embodiment, the visual range of the image capturing device can be obtained by the specification information of the image capturing device itself, or can be obtained by testing the image capturing device. For example, in combination with the visual range and the image of the laser pointer recorded in the first target image, a fixed position is selected from the first target image, and the first target indicating position of the laser pointer on the display device can be calculated by a geometric operation method. Further, the second display data corresponding to the first target indicating position is marked, so that the marked second display data can be visually distinguished from other unmarked data on the display device, thereby facilitating the participants to quickly obtain the current presentation position through the marked second display data, and reducing the influence of environmental factors or the limitation of the display device itself on determining the current presentation position.

[0104] In some optional embodiments, after the laser point is located, the laser pointer can be calibrated by the position of the laser point. Optionally, the method can include the following steps:

[0105] In step S1021, the display device obtains the second target image captured by the image capturing device, and the second target image records the laser beam emitted by the laser pointer when the laser point is located.

[0106] In step S1022, the display device determines the second target indicating position of the laser pointer on the display device according to the visual range of the image capturing device and the second target image.

[0107] In the embodiment, the specific implementation of steps S1021 to S1022 can be referred to the related description in the foregoing steps S103 to S104, and will not be described here.

[0108] In step S1023, the display device compares the second target indicating position with the position of the located laser point, and determines an error compensation value.

[0109] In the embodiment, the error compensation value can be the difference between the value corresponding to the second target indicating position and the value corresponding to the position of the laser point, can be a ratio, or can be a result in other forms that can reflect the difference between the two.

[0110] Correspondingly, the step S104 can include:

[0111] In step S1041, the display device determines the first target indicating position of the laser pointer on the display device according to the visual range, the first target image and the error compensation value.

[0112] In the embodiment, the first target indicating position can be calculated by combining the visual range and the first target image, and then adding the error compensation value to the indicating position calculated by the geometric operation method, so as to reduce the error between the calculated first target indicating position and the actual indicating position, and improve the calculation accuracy.

[0113] In some optional embodiments, as an alternative method, the display device can be provided with at least one positioning area, and the method for calibrating the laser pointer in steps S1021 to S1023 can also be the following steps.

[0114] In step S1024, when the laser pointer points to the at least one positioning area in sequence, the display device acquires at least one group of images collected by the image collection device, the images recording the laser beams emitted by the laser pointer, and any one of the at least one group of images matches one of the at least one positioning area.

[0115] In the embodiment, after the laser pointer is started, the at least one positioning area can be displayed on the display device in sequence, or the order corresponding to each positioning area can be embodied on the at least one positioning area, so as to guide the person to point the laser pointer to the at least one positioning area in sequence.

[0116] In step S1025, the display device determines the indicating position corresponding to each group of images according to the visual range and the at least one group of images.

[0117] In the embodiment, the specific implementation of steps S1024 and S1025 can be referred to the related description of steps S103 and S104 in the foregoing embodiments, and will not be described here.

[0118] In step S1026, the display device compares the indicating position corresponding to each group of images with each of the at least one positioning area, and determines the error compensation value.

[0119] In the embodiment, the error compensation value calculated based on the above steps can be the difference between the value corresponding to the indicating position of each group of images and the value corresponding to each of the at least one positioning area, or can be a ratio, or can be a result in other forms that can reflect the difference between the two. By this method, the calibration of the laser pointer and the method of positioning the laser point by changing the light can be decoupled, and the risk of error can be reduced.

[0120] In some optional embodiments, to further improve the accuracy of the calculated first target indication position, the first target indication position can be calculated by establishing a coordinate system. Specifically, step S1041 may include the following steps:

[0121] Step S10411: The display device establishes a three-dimensional rectangular coordinate system based on the above-mentioned visible range and the plane corresponding to the display device.

[0122] Step S10412: The display device determines the function expression of the line corresponding to the laser beam recorded in the first target image in the three-dimensional rectangular coordinate system based on the first target image.

[0123] In this embodiment, since the laser pointer and the laser beam are on the same straight line in space when the laser pointer emits a laser beam, the straight line corresponding to the laser beam is the straight line where the laser pointer is located. For example, in the three-dimensional Cartesian coordinate system, any two coordinate points can be selected from the straight line corresponding to the laser pointer recorded in the first target image. Based on these two coordinate points and the calculation method of the spatial straight line equation, the function expression corresponding to the straight line where the laser beam is located can be determined.

[0124] Step S10413: The display device determines the first target indication position indicated by the laser pointer on the display device according to the above function expression and the above error compensation value.

[0125] In this embodiment, for example, in the three-dimensional rectangular coordinate system, the point where the line containing the laser beam intersects the plane containing the display device corresponds to the first target indication position. Therefore, given the function expression, by combining geometric operations and the error compensation value, the coordinate value corresponding to the first target indication position can be calculated. The position indicated by the laser pen on the display device can be determined by the coordinate value, making the calculated first target indication position more accurate.

[0126] To more clearly illustrate the methods in steps S10411 to S10413 above, this application provides an application scenario diagram of the laser pointer data marking method. Please refer to [link / reference needed]. Figure 2 .

[0127] like Figure 2 As shown in the upper diagram, the presenter 201 controls a laser pointer 203 on a podium 202 to point at the display device 205 and emit a laser beam 204. The podium area in front of the display device 205 is within the field of view of the image acquisition device within the display device 205. At this time, the first target image acquired by the image acquisition device can be as follows: Figure 2 The first target image 206 shown in the lower figure can be found in the following figure.Figure 2 .

[0128] As Figure 2 shown in the lower side view, the first target image 206 records the laser pointer 203, and the lower left vertex of the image is selected as the origin of the three-dimensional rectangular coordinate system, and the three coordinate axes of the three-dimensional rectangular coordinate system are X-axis, Y-axis and Z-axis, wherein the plane corresponding to the display device 205 is the plane corresponding to the X-axis and the Y-axis, and the Z-axis is located in the visible range. It should be noted that the origin of the three-dimensional rectangular coordinate system can also be established at the position corresponding to the image acquisition device, or at the position of the center point of the screen of the display device, which is not limited here.

[0129] For example, two different coordinate points are taken from the straight line corresponding to the laser pointer 203, and the actual coordinate values of the two coordinate points can be determined by measuring the deflection angle of the laser pointer 203 and the distance to the coordinate axis, or by determining the relative position of the other position points in the three-dimensional rectangular coordinate system, which is not limited here. The coordinate points and their respective coordinates can be denoted as A(x1, y1, z1) and B(x2, y2, z2), and for any point C(x, y, z) on the straight line, the formula is obtained. The formula is the function expression corresponding to the straight line.

[0130] Since the first target indication position is located on the plane where the display device 205 is located (the plane corresponding to the X-axis and the Y-axis), and on the straight line corresponding to the laser pointer 203, the corresponding coordinate of the first target indication position in the three-dimensional rectangular coordinate system can be obtained by geometric operation, and the specific calculation process is not described here. It should be noted that in some optional embodiments, the first target image collected by the image acquisition device records the laser beam 204, and the specific implementation of calculating the coordinate of the first target indication position can refer to the related description of Figure 2 , which is not described here.

[0131] In order to further introduce the method provided by the embodiments of the present application, the embodiments of the present application also provide a flowchart of another laser pointer indication data marking method, please refer to Figure 3 .

[0132] As Figure 3 shown, the method can include the following steps:

[0133] Step S301, the display device divides a grid unit in the screen of the display device according to a preset division rule.

[0134] In the embodiment, the division rule can include information indicating the shape or size of the grid unit, and the set of the completed grid units can completely cover the visible area on the screen of the display device, which includes the area displaying the conference content.

[0135] In step S302, the display device determines the brightness difference of each grid unit according to the light information collected by the light sensing device.

[0136] In the embodiment, the brightness difference can be represented by the brightness value corresponding to each grid unit or the average brightness value in the grid unit. The light information collected by the light sensing device can determine the brightness of each grid unit. By comparing the brightness of different grid units, the brightness difference of each grid unit can be determined.

[0137] In step S303, the display device selects a target grid unit whose brightness meets a preset brightness threshold according to the brightness difference.

[0138] In the embodiment, the preset brightness threshold can be obtained by testing the laser emitted by the laser pointer. When the brightness difference is represented by the brightness value corresponding to each grid unit or the average brightness value in the grid unit, the brightness value or the average brightness value can be compared with the preset brightness threshold, and the target grid unit meeting the brightness threshold can be selected from each grid unit on the screen.

[0139] In step S304, the display device locates the laser point projected on the display device by the laser pointer according to the target grid unit.

[0140] In the embodiment, the energy of the laser beam emitted by the laser pointer is higher than that of the ambient light, so the brightness of the laser point on the display device is higher than that of other areas. Further, the position of the laser point can be located by the grid unit. It can be understood that if the divided grid unit is large, the target grid unit can be further divided by the above method.

[0141] In order to more clearly introduce the method in steps S301 to S304, the application further provides another application scenario diagram of the laser pointer indicating data marking method, please refer to Figure 4 .

[0142] As Figure 4As shown, in the leftmost diagram, the outer thick solid line refers to the screen 401 of the display device, the dashed square inside the screen 401 refers to the grid cells 402 divided on the screen 401, and the solid dot refers to the laser point 403. In the middle diagram, the outermost thick dashed square refers to the first target grid cell 404, which is one of the grid cells in the leftmost diagram, and the dashed square inside the first target grid cell 404 refers to the grid cells divided again in the first target grid cell 404. In the rightmost diagram, the dashed square refers to the second target grid cell 405, which is one of the grid cells in the middle diagram.

[0143] In the leftmost diagram, the screen 401 is first divided into 5x6 square grid cells according to a preset division rule, and the brightness difference of each grid cell on the screen 401 can be determined according to the light information collected by the light perception device. Since the grid cell where the laser point 403 is located has higher brightness, this grid cell is selected as the first target grid cell 404.

[0144] In the middle diagram, the first target grid cell 404 is further divided, for example, into 5x5 grid cells according to a preset next-level division rule. Similarly, based on the light information collected by the light perception device, the brightness difference of each grid cell in the first target grid cell 404 is determined, and a second grid cell with higher brightness is selected as the target grid cell 405 as shown in the rightmost diagram.

[0145] For example, when setting the division rule, the pixel information or size of the screen 401 can be determined, and when setting the next-level division rule, the size of the previous-level grid cell can also be determined. If the size of the grid cell corresponding to the laser point 403 meets the preset threshold, the next-level division can be stopped. This method can further reduce the range of positioning the laser point, so as to improve the positioning accuracy of the laser point and shorten the time consumed for positioning the laser point.

[0146] In step S305, the display device determines whether the laser point is positioned. In this embodiment, if the position of the laser point is positioned, step S306 is performed. Optionally, after the position of the laser point is positioned, the laser pen can be calibrated based on the position of the laser point. The specific implementation manner can be referred to the related description of steps S1021 to S1023 in the foregoing embodiment, which will not be described here. If the position of the laser point is not positioned, step S311 is performed.

[0147] In step S306, the display device takes the center position of the target grid unit as the position of the laser point.

[0148] In step S307, the display device determines the screen coordinate of the laser point according to the position of the laser point and the pixel information of the display device.

[0149] In the embodiment, the screen coordinate corresponds to a coordinate point in the screen coordinate system of the display device itself. For example, taking the center position of the target grid unit as the position of the laser point can improve the accuracy of locating the laser point, and the pixel information of the display device can be used to determine the screen coordinate corresponding to the laser point in the screen coordinate system.

[0150] In step S308, the display device determines the first display data according to the screen coordinate of the laser point and the data information displayed on the display device.

[0151] In the embodiment, the view area for displaying the data information can be determined in the screen coordinate system, so that when the screen coordinate corresponding to the laser point is determined, the data information can be searched in the view area according to the screen coordinate, and the first display data corresponding to the laser point can be determined more conveniently.

[0152] In step S309, the display device determines the target marking area on the display device according to the screen coordinate and the first display data.

[0153] In the embodiment, for example, after the first display data is determined, the text or image associated with the first display data around the screen coordinate can be located by performing text analysis or image analysis on the first display data, and the size of the target marking area can be determined based on the length of the associated text or the size of the image, so that the target marking area can better cover the first display data.

[0154] In step S310, the display device marks the first display data according to the target marking area.

[0155] In the embodiment, marking the first display data according to the size of the target marking area can make the marked first display data and other unmarked data on the screen more visually distinguishable, and better present the current explanation position.

[0156] In step S311, the display device acquires a first target image collected by an image collection device. The first target image records the laser beam emitted by the laser pointer.

[0157] In step S312, the display device determines a first target indicating position on the display device indicated by the laser pointer according to the visual range of the image capturing device and the first target image.

[0158] In step S313, the display device marks second display data corresponding to the first target indicating position.

[0159] In this embodiment, the specific implementation of steps S311 to S313 can be referred to the relevant description in the foregoing embodiments, which will not be repeated here. Compared with the method of directly indicating the current explanation position by the light spot, the present method can distinguish the marked first display data from other unmarked display data in the display device, thereby supporting the personnel using other terminal devices to share the indicating position of the laser pointer on the display device, so as to facilitate the remote participants to understand the conference content and conduct remote interaction, and improve the efficiency of the conference.

[0160] The present application also provides a laser pointer indicating data marking device applied to marking the data indicated by the laser pointer on the display device, wherein the display device comprises a light sensing device. The following will be described with reference to the structure of the laser pointer indicating data marking device in the present application. Figure 5 The laser pointer indicating data marking device will be described as follows, please refer to Figure 5 , Figure 5 FIG. 1 is a structure schematic diagram of a laser pointer indicating data marking device provided by the present application.

[0161] As shown in Figure 5 , the laser pointer indicating data marking device 500 comprises:

[0162] A positioning unit 501 configured to position a laser spot projected on the display device by the laser pointer according to light information collected by the light sensing device.

[0163] A marking unit 502 configured to mark first display data corresponding to the laser spot in the case that the laser spot is positioned.

[0164] In an optional embodiment, the display device comprises an image capturing device, and the device 500 further comprises:

[0165] An acquisition unit 503 configured to acquire a first target image collected by the image capturing device in the case that the laser spot is not positioned, wherein the first target image records a laser beam emitted by the laser pointer.

[0166] The marking unit 502 is further configured to determine a first target indication position on the display device indicated by the laser pointer according to the visual range of the image acquisition device and the first target image, and mark second display data corresponding to the first target indication position.

[0167] In an optional embodiment,

[0168] The acquisition unit 503 is further configured to acquire a second target image collected by the image acquisition device, the second target image recording a laser beam emitted by the laser pointer when the laser point is located.

[0169] The marking unit 502 is further configured to determine a second target indication position on the display device indicated by the laser pointer according to the visual range of the image acquisition device and the second target image.

[0170] The marking unit 502 is further configured to compare the second target indication position and the position of the located laser point to determine an error compensation value.

[0171] The marking unit 502 is further configured to determine the first target indication position on the display device indicated by the laser pointer according to the visual range, the first target image, and the error compensation value.

[0172] In an optional embodiment,

[0173] The marking unit 502 is further configured to establish a three-dimensional rectangular coordinate system according to the visual range and the plane corresponding to the display device.

[0174] The marking unit 502 is further configured to determine a function expression corresponding to a straight line corresponding to the laser beam recorded in the first target image in the three-dimensional rectangular coordinate system according to the first target image.

[0175] The marking unit 502 is further configured to determine the first target indication position on the display device indicated by the laser pointer according to the function expression and the error compensation value.

[0176] In an optional embodiment, the device 500 further comprises:

[0177] The dividing unit 504 is configured to divide a screen of the display device into grid units according to a preset division rule.

[0178] The positioning unit 501 is further configured to determine the brightness difference of each grid unit according to the light information collected by the light sensing device.

[0179] The positioning unit 501 is further specifically configured to select a target grid unit with a luminance satisfying a preset luminance threshold according to the luminance difference.

[0180] The positioning unit 501 is further specifically configured to position the laser point projected on the display device by the laser pointer according to the target grid unit.

[0181] In an optional embodiment,

[0182] The marking unit 502 is further specifically configured to take the center position of the target grid unit as the position of the laser point in a case where the laser point is positioned.

[0183] The marking unit 502 is further specifically configured to determine the screen coordinates of the laser point according to the position of the laser point and the pixel information of the display device.

[0184] The marking unit 502 is further specifically configured to determine the first display data according to the screen coordinates of the laser point and the data information displayed on the display device, and mark the first display data.

[0185] In an optional embodiment, the apparatus 500 further includes:

[0186] The determining unit 505 is configured to determine a target marking area on the display device according to the screen coordinates and the first display data.

[0187] The marking unit 502 is further specifically configured to mark the first display data according to the target marking area.

[0188] As to the technical effects brought by the laser pointer indicating data marking apparatus, reference can be made to the introduction of the technical effects of the laser pointer indicating data marking method, which will not be repeated here.

[0189] According to the embodiments of the present application, Figure 5 The units in the apparatus shown in the embodiments of the present application can be respectively or wholly combined into one or more other units to constitute, or some of the units can be further split into a plurality of units with smaller functions to constitute, which can realize the same operation without affecting the realization of the technical effects of the embodiments of the present application. The units are divided based on logical functions. In actual application, the function of one unit can also be realized by a plurality of units, or the functions of a plurality of units are realized by one unit.

[0190] The embodiments of the present application also provide an electronic device, which will be described below with reference to the accompanying drawings of the embodiments of the present application. Figure 6 The electronic device will be described below, please refer to Figure 6 , Figure 6is a structural schematic diagram of an electronic device provided by an embodiment of the present application.

[0191] As shown in Figure 6 The electronic device 600 can include one or more processors 601, one or more memories 602, one or more communication interfaces 603, and a bus 604. The processor 601, the memory 602, and the communication interface 603 are connected through the bus 604. The electronic device can be the laser pointer data marking device 500 described above.

[0192] The memory 602 is configured to store a program, and the processor 601 is configured to execute the program stored in the memory. When the program is executed, the processor 601 performs the method in any possible implementation of the laser pointer data marking method.

[0193] It should be understood that, in the embodiments of the present application, the memory 602 includes but is not limited to a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), or a compact disc read-only memory (CDROM), and an external memory other than a computer memory and a processor cache. Part of the memory 602 can also include a non-volatile random access memory, for example, the memory 602 can also store device type information.

[0194] The processor 601 can be one or more central processing units (CPUs). When the processor 601 is a CPU, the CPU can be a single-core CPU or a multi-core CPU. The processor 601 can also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0195] The steps performed in the foregoing embodiments can be based on the above Figure 6The electronic device 600 shown is implemented such that the processor 601 can execute the implementation described in any optional embodiment of the laser pointer data marking method provided in this application, or it can execute the implementation of the laser pointer data marking device 500 described in this application. Specifically, the processor 601 can implement... Figure 5 The device shown includes the functions of the positioning unit 501, marking unit 502, acquisition unit 503, division unit 504, or determination unit 505. The communication interface 603 enables... Figure 5 Data transmission between the various units in the device shown. The memory 602 can provide a cache when the processor 601 executes the implementation of the laser pointer data marking device 500 described in the embodiments of this application, and can also store the computer programs required by the processor 601 to execute the implementation of the laser pointer data marking device 500 described in the embodiments of this application.

[0196] This application also provides a computer storage medium storing a computer program, the computer program including program instructions, which, when executed by a processor, enable the processor to implement the above-mentioned functions. Figures 1 to 4 The method shown.

[0197] This application also provides a computer program product, which includes: instructions or a computer program; when the instructions or the computer program are executed, the above-mentioned functions can be achieved. Figures 1 to 4 The method shown.

[0198] This application also provides a chip, which includes a processor. The processor executes instructions, enabling the chip to achieve the aforementioned... Figures 1 to 4 The method shown is described above. Optionally, the chip also includes a communication interface for receiving or transmitting signals.

[0199] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by hardware related to computer programs. The computer programs can be stored in computer storage media, and when executed, they can implement the processes of the above method embodiments. The aforementioned computer storage media include various media capable of storing computer program code, such as read-only memory (ROM) or random access memory (RAM), magnetic disks, or optical disks.

Claims

1. A method of marking data with a laser pointer, characterized in that, The application is applied to mark data indicated by the laser pointer on a display device, the display device comprises a light sensing device, and the method comprises: locating a laser point projected on the display device by the laser pointer according to light information collected by the light sensing device; marking first display data corresponding to the laser point when the laser point is located; after locating the laser point projected on the display device by the laser pointer according to the light information collected by the light sensing device, the method further comprises: when the laser point is not located, acquiring a first target image collected by an image collection device, the first target image recording a laser beam emitted by the laser pointer; determining a first target indication position indicated by the laser pointer on the display device according to a visual range of the image collection device and the first target image, and marking second display data corresponding to the first target indication position; after the laser point is located, the method further comprises: acquiring a second target image collected by the image collection device, the second target image recording a laser beam emitted by the laser pointer when the laser point is located; determining a second target indication position indicated by the laser pointer on the display device according to a visual range of the image collection device and the second target image; comparing the second target indication position with the position of the located laser point to determine an error compensation value; the determining of the first target indication position indicated by the laser pointer on the display device according to the visual range of the image collection device and the first target image comprises: determining the first target indication position indicated by the laser pointer on the display device according to the visual range, the first target image and the error compensation value.

2. The method of claim 1, wherein, the determining of the first target indication position indicated by the laser pointer on the display device according to the visual range, the first target image and the error compensation value comprises: establishing a three-dimensional rectangular coordinate system according to the visual range and a plane corresponding to the display device; determining a function expression corresponding to a straight line corresponding to the laser beam recorded in the first target image in the three-dimensional rectangular coordinate system according to the first target image; determining the first target indication position indicated by the laser pointer on the display device according to the function expression and the error compensation value.

3. The method according to claim 1 or 2, characterized in that, before the locating of the laser point projected on the display device by the laser pointer according to the light information collected by the light sensing device, the method further comprises: dividing grid units in a screen of the display device according to a preset division rule; the locating of the laser point projected on the display device by the laser pointer according to the light information collected by the light sensing device comprises: determining brightness differences of the grid units according to the light information collected by the light sensing device; selecting a target grid unit with brightness satisfying a preset brightness threshold according to the brightness differences; locating the laser point projected on the display device by the laser pointer according to the target grid unit.

4. The method of claim 3, wherein, The marking the first display data corresponding to the laser point in the case of locating the laser point comprises: In the case of locating the laser point, taking the center position of the target grid unit as the position of the laser point; According to the position of the laser point and the pixel information of the display device, determining the screen coordinates of the laser point; According to the screen coordinates of the laser point and the data information displayed on the display device, determining the first display data and marking the first display data.

5. The method of claim 4, wherein, Before the marking the first display data, the method further comprises: According to the screen coordinates and the first display data, determining a target marking area on the display device; The marking the first display data comprises: According to the target marking area, marking the first display data.

6. A laser pointer data marking device for performing the method according to any one of claims 1-5, characterized in that, Applied to marking the data indicated by the laser pen on the display device, the display device contains a light ray sensing device, and the device comprises: A positioning unit is configured to locate the laser point projected on the display device by the laser pen according to the light ray information collected by the light ray sensing device; A marking unit is configured to mark the first display data corresponding to the laser point in the case of locating the laser point.

7. An electronic device, comprising: Comprise: A memory is configured to store a program; A processor is configured to execute the program stored in the memory, and in the case that the program is executed by the processor, the processor executes the method according to any one of claims 1 to 5.

8. A computer storage medium, characterized in that The computer storage medium stores a computer program, and the computer program comprises program instructions, and in the case that the program instructions are executed by a processor, the processor executes the method according to any one of claims 1 to 5.

Images