Data labeling method and apparatus, electronic device, and computer storage medium

Abstract

The application discloses a data marking method and device, electronic equipment and computer storage medium, and relates to the technical field of display. The method comprises the following steps: receiving first position information sent by an indicating device, wherein the first position information is used for describing the motion posture of the indicating device and the spatial position of the indicating device relative to a display device; the indicating device comprises a first sensor and a second sensor, the first sensor is used for sensing the motion posture of the indicating device, and the second sensor is used for sensing the spatial position of the indicating device relative to the display device; determining a first marking area indicated by the indicating device on the screen of the display device according to the first position information; and marking target display data corresponding to the first marking area. The method can solve the problem that participants cannot share the explanation position indicated by the indicating device on the display device, and improve the efficiency of the conference.

Description

Technical Field

[0001] This invention relates to the field of display technology, and more particularly to a data tagging method, apparatus, electronic device, and computer storage medium. Background Technology

[0002] During a meeting, the presenter can use a laser pointer to indicate the current position on the screen, allowing participants to better grasp the meeting's progress and improve efficiency.

[0003] Currently, laser pointers are typically used to project a spot of light onto the screen to indicate the current lecturing position. The content corresponding to the location of the spot of light on the screen is the current lecturing position.

[0004] However, because different screen materials reflect laser light differently, the laser pointer's beam may not be visible on the screen, preventing attendees from sharing the location indicated by the laser pointer and affecting the meeting's efficiency. Summary of the Invention

[0005] This application discloses a data marking method, apparatus, electronic device, and computer storage medium, aiming to enable participants to share the explanation position indicated by the pointing device on the display device, thereby improving the efficiency of the meeting.

[0006] In a first aspect, embodiments of this application provide a data tagging method, including:

[0007] The system receives first position information sent by an indicator device, the first position information being used to describe the motion posture of the indicator device and the spatial position of the indicator device relative to the display device; the indicator device includes a first sensor and a second sensor, the first sensor being used to sense the motion posture of the indicator device, and the second sensor being used to sense the spatial position of the indicator device relative to the display device.

[0008] Based on the aforementioned first position information, the first marking area indicated by the aforementioned indicating device on the screen of the aforementioned display device is determined;

[0009] The target display data corresponding to the first marked area is marked.

[0010] In this embodiment, by using the movement posture of the indicating device and its spatial position relative to the display device in the first location information, the first marked area indicated by the indicating device on the display device screen can be located. Then, the target display data corresponding to the first marked area on the display device screen is marked to distinguish the target display data from other unmarked data on the screen, enabling participants to share the presentation location corresponding to the target display data. Compared to methods relying on laser pointers to indicate presentation locations, this method avoids the problem of participants being unable to share the presentation location due to the laser pointer not being able to display on the display device screen, thus improving meeting efficiency.

[0011] In one possible implementation of the first aspect, the display device is provided with a position calibration area, and the method further includes, prior to receiving the first position information sent by the indicating device:

[0012] When the aforementioned indicator device points to the aforementioned position calibration area, the system receives the second position information sent by the aforementioned indicator device and obtains the specification information of the aforementioned display device;

[0013] Based on the second location information and the specification information, a target space model is determined. The target space model is used to describe the mapping relationship between the location information of the indicator device and the marking area on the display device.

[0014] The determination of the first marked area indicated by the indicating device on the screen of the display device based on the first position information includes:

[0015] The first position information is input into the target space model to obtain the first marked area indicated by the indicator device on the screen of the display device.

[0016] In this embodiment, spatial modeling can be performed when the indicator points to the position calibration area. Specifically, by using the motion posture of the indicator and its spatial position relative to the display device in the second position information, as well as the specification information of the display device, and combining mathematical analysis methods, the mapping relationship between the position information of the indicator and the marked area on the display device is derived to obtain the target spatial model. Subsequently, the first position information of the indicator can be input into the target spatial model for calculation, which can more quickly determine the first marked area and facilitate the synchronous execution of the target display data being indicated and marked.

[0017] In one possible implementation of the first aspect, after determining the target space model based on the second location information and the specification information, the method further includes:

[0018] The second location information is input into the target space model to obtain the second marked area indicated by the indicator device on the screen of the display device.

[0019] The position offset is determined based on the second marked area and the position calibration area described above.

[0020] Update the target space model based on the aforementioned position offset.

[0021] In this embodiment, the second location information is input into the established target space model for location verification, and the second marked region corresponding to the second location information is calculated. By comparing the difference between the location verification region and the second marked region, the location offset can be determined. The target space model is updated based on the location offset, which can correct the target space model and make the marked region calculated by the target space model more accurate.

[0022] In one possible implementation of the first aspect, determining the target space model based on the second location information and the specification information includes:

[0023] Based on the second position information mentioned above, determine the position of the intersection point formed by the straight line corresponding to the direction indicated by the indicator device and the plane where the display device is located;

[0024] Based on the above specifications, determine the screen coordinates of the intersection point on the above display device.

[0025] Based on the second location information and the screen coordinates mentioned above, the target space model is determined.

[0026] In this embodiment, by determining the position of the intersection point formed by the straight line corresponding to the direction pointed to by the indicator device and the plane where the display device is located, and then mapping the position of the intersection point onto the display device according to the specification information of the display device, the screen coordinates corresponding to the position of the intersection point are obtained. The screen coordinates are used to locate the marked area on the screen, which can support display devices of different specifications, reduce errors caused by differences in display device specifications, and improve the accuracy of positioning.

[0027] In one possible implementation of the first aspect, the indicating device is provided with an unlocking mechanism, and after the target display data corresponding to the first marked area is marked, the method further includes:

[0028] If the first marked area does not change within a preset time period, the first marked area is locked, and the target display data is continuously marked.

[0029] If the aforementioned unlocking mechanism is triggered, the first marked area will be unlocked, and the display of the marked target data will be stopped.

[0030] In this embodiment, if the first marked area does not change within a preset time period, it means that there is no next area to be marked, that is, the explanation position indicated by the indicator device does not change. At this time, the first marked area is locked and the target display data is continuously marked. The explainer does not need to keep the indicator device in the same position for a long time. Subsequently, the locking of the first marked area and the marking of the target display data can be unlocked through the unlocking mechanism set on the indicator device, thereby improving the operational convenience of the indicator device.

[0031] In one possible implementation of the first aspect, after marking the target display data corresponding to the first marked area, the method further includes:

[0032] Based on the above specifications, establish a coordinate system on the plane where the display device is located;

[0033] Based on the above coordinate system, determine the first coordinate value corresponding to the first marked area and the second coordinate value corresponding to the third marked area, wherein the third marked area is any area marked before the first marked area;

[0034] Based on the first coordinate value and the second coordinate value mentioned above, the first explanation order is determined;

[0035] If the first explanation order is different from the preset second explanation order, mark the explanation trajectory from the third marking area to the first marking area.

[0036] In this embodiment, the first explanation order can be determined by the first coordinate value corresponding to the first marked area and the second coordinate value corresponding to the third marked area that was marked before the first marked area. If the first explanation order is different from the preset second explanation order, it means that the presenter is backtracking. At this time, the explanation trajectory from the third marked area to the first marked area is marked, which helps the participants to better understand the logical relationship between the displayed data corresponding to the two marked areas and improves the meeting efficiency.

[0037] In one possible implementation of the first aspect, before marking the target display data corresponding to the first marked area, the method further includes:

[0038] Obtain the target display window of the aforementioned display device;

[0039] The above-mentioned marking of the target display data corresponding to the first marked area includes:

[0040] When the first marked area is within the visible area of ​​the target display window, the target display data corresponding to the first marked area is determined based on the data object displayed within the visible area, and the target display data is marked.

[0041] In this embodiment, the display device screen may have one or more display windows. The visible area of ​​each display window is the area excluding the border and scroll bar. The target display window may be one or more display windows on the display device screen. If the first marking area is within the visible area of ​​the target display window, the corresponding target display data is determined and marked based on the data object displayed within the visible area; otherwise, no marking is performed. This reduces interference from other unmarked data displayed on the display device screen on the target display data and improves the accuracy of data marking.

[0042] Secondly, embodiments of this application provide a data tagging device, comprising:

[0043] A receiving unit is configured to receive first position information sent by an indicating device, the first position information being used to describe the motion posture of the indicating device and the spatial position of the indicating device relative to a display device; the indicating device includes a first sensor and a second sensor, the first sensor being used to sense the motion posture of the indicating device and the second sensor being used to sense the spatial position of the indicating device relative to the display device.

[0044] The first determining unit is configured to determine, based on the first position information, the first marking area indicated by the indicating device on the screen of the display device;

[0045] The first marking unit is used to mark the target display data corresponding to the first marking area.

[0046] In one possible implementation of the second aspect,

[0047] The receiving unit is further configured to receive second position information sent by the indicating device and obtain specification information of the display device when the indicating device points to the position calibration area.

[0048] The first determining unit is further configured to determine a target space model based on the second position information and the specification information, wherein the target space model is used to describe the mapping relationship between the position information of the indicating device and the marking area on the display device.

[0049] The first determining unit is further specifically used to input the first position information into the target space model to obtain the first marked area indicated by the indicating device on the screen of the display device.

[0050] In one possible implementation of the second aspect,

[0051] The first determining unit is further configured to input the second position information into the target space model to obtain the second marking area indicated by the indicating device on the screen of the display device;

[0052] The first determining unit is further configured to determine the position offset based on the second marking area and the position calibration area.

[0053] The first determining unit is also used to update the target space model based on the position offset.

[0054] In one possible implementation of the second aspect,

[0055] The first determining unit is further specifically used to determine the position of the intersection point formed by the straight line corresponding to the direction pointed to by the indicating device and the plane where the display device is located, based on the second position information.

[0056] The first determining unit is further specifically used to determine the screen coordinates of the intersection point on the display device based on the specification information.

[0057] The first determining unit is further specifically used to determine the target space model based on the second position information and the screen coordinates.

[0058] In a second possible implementation, the aforementioned indicating device is provided with an unlocking mechanism, and the device further includes:

[0059] The locking unit is used to lock the first marking area and continuously mark the target display data when the first marking area does not change within a preset time period.

[0060] The aforementioned locking unit is also used to unlock the aforementioned first marked area and stop marking the aforementioned target display data when the aforementioned unlocking mechanism is triggered.

[0061] In a second possible implementation, the above-described apparatus further includes:

[0062] The establishment unit is used to establish a coordinate system on the plane where the display device is located based on the above-mentioned specification information;

[0063] The second determining unit is used to determine, according to the coordinate system, the first coordinate value corresponding to the first marked area and the second coordinate value corresponding to the third marked area, wherein the third marked area is any area marked before the first marked area.

[0064] The second determining unit is further configured to determine the first explanation order based on the first coordinate value and the second coordinate value.

[0065] The second marking unit is used to mark the explanation trajectory from the third marking area to the first marking area when the first explanation order is different from the preset second explanation order.

[0066] In a second possible implementation, the above-described apparatus further includes:

[0067] The acquisition unit is used to acquire the target display window of the aforementioned display device;

[0068] The first marking unit is further configured to, when the first marking area is within the visible area of ​​the target display window, determine the target display data corresponding to the first marking area based on the data object displayed within the visible area, and mark the target display data.

[0069] For the technical effects of the second aspect and any possible implementation thereof, please refer to the description of the technical effects corresponding to the first aspect and the corresponding implementation thereof.

[0070] Thirdly, embodiments of this application provide an electronic device, which includes:

[0071] Memory, used to store programs;

[0072] A processor is configured to execute the program stored in the memory, wherein, when the program is executed by the processor, the processor performs a method as described in any of the possible implementations of the first aspect.

[0073] Fourthly, embodiments of this application provide a computer storage medium storing a computer program, the computer program including program instructions, and when the program instructions are executed by a processor, the processor performs a method as described in the first aspect and any possible implementation thereof.

[0074] Fifthly, embodiments of this application provide a computer program product, which includes: instructions or a computer program; when the instructions or the computer program are executed, the method as described in the first aspect and any possible implementation thereof is implemented.

[0075] Sixthly, embodiments of this application provide a chip including a processor configured to execute instructions, which, when executed, cause the chip to perform the method as described in the first aspect and any possible implementation thereof. Optionally, the chip further includes an input / output interface configured to receive or transmit signals. Attached Figure Description

[0076] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly described below.

[0077] Figure 1 A flowchart illustrating a data tagging method provided in an embodiment of this application;

[0078] Figure 2 This is a schematic diagram illustrating an application scenario of a data tagging method provided in an embodiment of this application;

[0079] Figure 3 A flowchart illustrating another data tagging method provided in an embodiment of this application;

[0080] Figure 4 This is a schematic diagram illustrating an application scenario of another data tagging method provided in the embodiments of this application;

[0081] Figure 5 This is a schematic diagram of the structure of a data tagging device provided in an embodiment of this application;

[0082] Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0083] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described below with reference to the accompanying drawings.

[0084] The terms "first" and "second," etc., used in the specification, claims, and drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0085] The term "embodiment" as used herein means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0086] It should be understood that in this application, "at least one (item)" means one or more, "more than one" means two or more, "at least two (items)" means two or three or more, and "and / or" is used to describe the relationship between related objects, indicating that there can be three relationships. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0087] This application provides a data tagging method, apparatus, electronic device, and computer storage medium. To more clearly describe the solution of this application, some relevant terms and definitions are introduced below.

[0088] Cloud conferencing: refers to a meeting group created in the cloud by the meeting creator through the user's terminal device (such as a mobile phone, computer or other personal user device) or display device (such as a projection device in a conference room). The cloud refers to the cloud server side with dedicated cloud applications installed, which can support the creation of meeting groups and provide meeting services on the cloud server side.

[0089] Cloud space: refers to the resource space configured in the cloud for processing and storing control plane data and data plane data of cloud meetings. This resource space contains the hardware and software resources required for processing and storing data.

[0090] Shared content, also known as meeting content, refers to the content information uploaded by participants in a cloud meeting to the cloud space of the cloud meeting through their terminal devices, such as computer-aided design (CAD) drawing files, audio files, video files, split-screen mirrors of users' local devices, screen recordings, etc.

[0091] Orientation sensor: Using force-sensitive sensors and gravity sensing technology, the center of gravity of an object changes when its posture changes. The orientation of the object is determined by measuring the magnitude of the component forces of gravity in two orthogonal directions inside the object.

[0092] Magnetic field sensor: Utilizing the inherent directional nature of the Earth's magnetic field, it calculates magnetic inclination and magnetic declination using a geomagnetic field model to determine the spatial attitude angle of an object.

[0093] Attitude Sensor: A high-performance 3D motion attitude measurement system based on micro-electro-mechanical system (MEMS) technology. It includes motion sensors such as a three-axis gyroscope, a three-axis accelerometer, and a three-axis electronic compass. Through an embedded low-power microprocessor, it obtains temperature-compensated 3D attitude and orientation data. Utilizing quaternion-based 3D algorithms and special data fusion techniques, it outputs zero-drift 3D attitude and orientation data in real-time, expressed in quaternions and Euler angles.

[0094] Displacement sensor: also known as a linear sensor, is a type of linear device that uses metal induction. Displacement is a quantity related to the movement of an object during motion. It is used to locate the position of an object by measuring its mechanical displacement, such as positioner-type displacement sensors and magnetostrictive displacement sensors.

[0095] Distance sensors: Sensors that use mechanical waves or electromagnetic waves that can propagate in a direction as rays to measure the distance between two objects, such as ultrasonic distance sensors and ordinary photoelectric distance sensors.

[0096] The data marking method provided in this application relates to the field of display technology, and can be specifically applied to marking the meeting content indicated by the marking device on the display device during a meeting.

[0097] During a meeting, participants can upload and share content using their local devices, which will then be displayed on the screen. The presenter typically uses a laser pointer to project a spot of light onto the screen to indicate the current presentation location, allowing participants to better understand the meeting's progress. However, due to the varying reflectivity of different screen materials, some screens may absorb light, preventing the laser pointer's spot from forming or being fully displayed. This prevents participants from sharing the laser pointer's indicated presentation location, impacting the meeting's efficiency.

[0098] To address the above issues, this application provides a data tagging method that enables participants to share the explanation location indicated by the indicator device on the display device, thereby improving meeting efficiency.

[0099] The following will refer to the appendices in the embodiments of this application. Figure 1 For an introduction to the above data labeling methods, please refer to [link / reference]. Figure 1 , Figure 1 This is a flowchart illustrating a data tagging method provided in an embodiment of this application.

[0100] like Figure 1 As shown, the above data labeling method includes the following steps:

[0101] Step S101: The display device receives the first position information sent by the indicating device.

[0102] In this embodiment, the first position information is used to describe the motion posture of the indicator and its spatial position relative to the display device. The indicator includes a first sensor and a second sensor. The first sensor senses the motion posture of the indicator, and the second sensor senses its spatial position relative to the display device. For example, the first sensor can determine the motion posture of the indicator by sensing attributes such as gravity, geomagnetic field strength, or azimuth angle, such as a direction sensor, magnetic field sensor, or attitude sensor. The second sensor can be a displacement sensor or a ranging sensor.

[0103] Step S102: The display device determines the first marked area indicated by the indicator device on the screen of the display device based on the first position information.

[0104] In this embodiment of the application, by way of example, the motion posture of the indicator device and its spatial position relative to the display device can be determined by the first position information, and by combining geometric calculation methods, the first marking area can be located on the screen of the display device.

[0105] Step S103: The display device marks the target display data corresponding to the first marked area.

[0106] In this embodiment, the marked target display data is visually distinguished from other unmarked display data on the screen. This is achieved by setting font color, background color, or using graphics or symbols to mark the target display data, and these markings are then displayed on the meeting content on the screen. Compared to methods that rely on laser pointers to project light spots to indicate the presentation location, this method avoids the problem of participants being unable to share the presentation location due to screen light absorption, thus improving meeting efficiency. For example, in the case of a cloud meeting, this method can also enable remote participants who are not in the same physical space as the display device to share the marked target display data through other terminal devices, allowing them to keep track of the current meeting progress and further improving meeting efficiency.

[0107] In some optional embodiments, the display device is provided with a position calibration area, and before performing step S101, the method further includes:

[0108] Step S1011: When the indicator device points to the position calibration area, the display device receives the second position information sent by the indicator device and obtains the specification information of the display device.

[0109] In this embodiment, for example, the position calibration area can be located at the center of the screen of the display device. After the indicator device is activated, the display device can display an icon corresponding to the position calibration area on the screen, so that the presenter can control the indicator device to point to the position calibration area. The specifications may include the screen size and screen resolution of the display device.

[0110] Step S1012: The display device determines a target space model based on the second position information and the specification information. The target space model is used to describe the mapping relationship between the position information of the indicator device and the marked area on the display device.

[0111] In this embodiment, for example, the modeling process of the target space model can be as follows: The motion posture and spatial position of the indicator device relative to the display device are determined using the second position information; the screen size and screen resolution included in the specification information are combined; and the mapping relationship between the position information of the indicator device and the marked area on the display device is derived using mathematical analysis methods to obtain the target space model. The modeling process of the target space model can be completed during the initialization phase of the indicator device.

[0112] For example, step S1012 may specifically include:

[0113] Step S10121: Based on the second position information mentioned above, determine the position of the intersection point formed by the straight line corresponding to the direction pointed to by the indicator device and the plane where the display device is located.

[0114] Step S10122: Based on the above specifications, determine the screen coordinates of the intersection point on the display device. For example, the screen coordinates can be calculated using the screen resolution included in the specifications.

[0115] Step S10123: Determine the target spatial model based on the second position information and the screen coordinates. Correspondingly, the second marked area and the screen coordinates are mutually matched.

[0116] To more clearly illustrate the process of determining the target spatial model in step S1012, this embodiment also provides an application scenario diagram of the data labeling method. Please refer to [link / reference]. Figure 2 .

[0117] like Figure 2 As shown, the presenter 201 points the indicator device 202 towards the screen 203. The straight line corresponding to the direction pointed by the indicator device 202 intersects the plane on which the screen 203 is located at point 204. Here, the screen 203 is the screen of the aforementioned display device. The indicator device 202 includes a first sensor and a second sensor. For example, the first sensor and the second sensor are an attitude sensor and a ranging sensor, respectively. The indicator device 202 can be a device capable of emitting electromagnetic waves, such as the laser pointer mentioned above.

[0118] For ease of description, the position of intersection 204 is denoted as endpoint D, and the end of the indicator device 202 pointing to the screen 203 is denoted as endpoint C. Projecting endpoint C onto the screen yields endpoint B. The distance from endpoint C to endpoint B (the vertical distance from the indicator device 202 to the screen 203, denoted as BC) and the distance from endpoint C to endpoint D (the straight-line distance from the indicator device 202 in its pointing direction to the screen 203, denoted as CD) can be measured by the aforementioned ranging sensor. Specifically, on the plane of screen 203, a straight line perpendicular to the ground is drawn through endpoint B, and a straight line parallel to the ground is drawn through endpoint D. The intersection of these two lines yields endpoint A. Therefore, in the triangle formed by endpoints A, C, and D, ∠ACD is the deflection angle of the indicator device 202 relative to the vertical direction, and in the triangle formed by endpoints A, B, and C, ∠ACB is the deflection angle of the indicator device 202 relative to the horizontal direction. These deflection angles in both directions can be measured by the aforementioned attitude sensor.

[0119] For example, a three-dimensional coordinate system is established on the plane where screen 203 is located. Data measured by the attitude sensor and the ranging sensor can locate the spatial position coordinates of the indicating device 202 relative to the screen 203 (corresponding to the second position information). Furthermore, combined with the specifications of the display device, the screen coordinates corresponding to each pixel on screen 203 can be determined. Therefore, based on the spatial position coordinates and the screen coordinates corresponding to each pixel, the pixel corresponding to endpoint D (intersection 204) on the screen and the screen coordinates corresponding to that pixel (corresponding to the second marked area) can be determined. Then, based on the spatial position coordinates and the screen coordinates corresponding to the pixels, a relational expression is constructed to determine the target spatial model.

[0120] In this embodiment, the marked area on the screen is located using screen coordinates, which can support display devices of different specifications, reduce errors caused by differences in display device specifications, and improve the accuracy of positioning.

[0121] Correspondingly, step S102 may specifically include:

[0122] Step S1021: The display device inputs the first position information into the target space model to obtain the first marked area indicated by the indicator device on the screen of the display device.

[0123] In this embodiment, optionally, the modeling process described above can be performed once or multiple times after each activation of the indicator device, depending on actual needs. For example, after modeling is completed, when subsequent target display data is marked, the first position information of the indicator device can be input into the target space model for calculation, which can more quickly determine the first marking area and facilitate the synchronous execution of target display data indication and marking.

[0124] In some optional embodiments, after step S1012, the target spatial model can be calibrated and updated to make the marked region calculated by the target spatial model more accurate. Specifically, the method further includes the following steps:

[0125] Step S1013: The display device inputs the second position information into the target space model to obtain the second marked area indicated by the indicator device on the screen of the display device.

[0126] Step S1014: The display device determines the position offset based on the second marking area and the position calibration area.

[0127] In this embodiment, the aforementioned position offset may be the difference between the second marked area and the position calibration area, or it may be a result that can be expressed in other forms to show the difference between the second marked area and the position calibration area.

[0128] Step S1015: The display device updates the target space model based on the aforementioned position offset.

[0129] In this embodiment, since the calculated second marked area is compared with the actual preset position calibration area, and the corresponding position offset is determined to adjust and update the target space model, the marked area calculated by the target space model is more accurate.

[0130] To further describe the method of the embodiments of this application, the embodiments of this application also provide a flowchart of another data tagging method, please refer to... Figure 3 .

[0131] like Figure 3 As shown, the above method includes the following steps:

[0132] Step S301: The display device receives the first position information sent by the indicating device.

[0133] Step S302: The display device determines the first marked area indicated by the indicator device on the screen of the display device based on the first position information.

[0134] Step S303: The display device marks the target display data corresponding to the first marked area.

[0135] In this embodiment, the specific implementation of steps S301 to S303 can be referred to the relevant descriptions of steps S101 to S103 in the foregoing embodiments, and will not be repeated here.

[0136] Step S304: The display device detects that the first marked area has not changed within a preset time period.

[0137] In this embodiment, if the first marked area does not change, it means that there is no next area that needs to be marked, that is, the explanation position indicated by the indicating device has not changed. At this time, step S305 is executed; otherwise, step S301 is executed.

[0138] Step S305: The display device locks the first marked area and continues to mark the target display data.

[0139] In this embodiment, for example, if the first marked area is locked, the target display data will be continuously marked, without requiring the presenter to keep the indicator device in the same position for a long time. At this time, the display device can stop receiving the location information sent by the indicator device, or instruct the indicator device to stop sending location information, until step S306 is executed.

[0140] Step S306: The display device detects that the unlocking mechanism has been triggered.

[0141] In this embodiment, the aforementioned contact locking mechanism is located on the indicating device. For example, a button or a specific click gesture can be set on the indicating device. When the presenter touches the button or performs the click gesture, the aforementioned unlocking mechanism is triggered. The display device can detect whether the aforementioned unlocking mechanism has been triggered through the communication connection with the indicating device. If the aforementioned unlocking mechanism has been triggered, step S307 is executed; otherwise, step S305 is executed.

[0142] Step S307: The display device unlocks the first marked area and stops marking the target display data.

[0143] In this embodiment, after unlocking, step S301 can be executed to mark the next area. This improves the ease of operation of the indicating device during the data marking process.

[0144] In some optional embodiments, after step S303, the above method may further include:

[0145] Step S3031: The display device establishes a coordinate system on the plane where the display device is located based on the above specifications.

[0146] In this embodiment, for example, the measurement unit of each coordinate axis of the coordinate system, such as centimeters or pixels, can be determined based on the screen size and screen resolution contained in the above specification information.

[0147] Step S3032: The display device determines the first coordinate value corresponding to the first marked area and the second coordinate value corresponding to the third marked area according to the above coordinate system. The third marked area is any area marked before the first marked area.

[0148] In this embodiment, for example, the coordinate value can be the coordinate corresponding to the center point of the marked area, or it can be the coordinate corresponding to a specific position in the marked area other than the center point, such as a vertex of the marked area.

[0149] Step S3033: The display device determines the first explanation order based on the first coordinate value and the second coordinate value.

[0150] In this embodiment, for example, the first explanation order can be determined by comparing the distances from the first coordinate value and the second coordinate value to each coordinate axis.

[0151] Step S3034: When the first explanation order is different from the preset second explanation order, the display device marks the explanation trajectory from the third marking area to the first marking area.

[0152] In this embodiment, for example, when the top-left corner of the screen of the display device is taken as the origin of the coordinate system, the horizontal direction of the screen is taken as the x-axis, and the vertical direction of the screen is taken as the y-axis, the second explanation order can be from top to bottom. If the y-coordinate of the first coordinate value is less than the y-coordinate of the second coordinate value, it indicates that the current first explanation order is from bottom to top, which is different from the second explanation order. The second explanation order can also be from left to right. In this case, if the x-coordinate of the first coordinate value is less than the x-coordinate of the second coordinate value, it indicates that the current first explanation order is from right to left, which is different from the second explanation order. At this time, the explanation trajectory from the third marked area to the first marked area can be marked by graphic markers such as arrows or trailing lines. This allows the presenter to review the meeting content, making it easier for the participants to better understand the logical relationship between the displayed data corresponding to the two marked areas, thus improving the efficiency of the meeting.

[0153] To more clearly illustrate the above-described method for marking and explaining trajectories, this application also provides an application scenario diagram of another data marking method. Please refer to [link / reference]. Figure 4 .

[0154] like Figure 4 As shown, the top left corner of the screen of the aforementioned display device is taken as the origin of the coordinate system, the horizontal direction of the screen is taken as the x-axis, and the vertical direction of the screen is taken as the y-axis. Marked area 1, marked area 2, marked area 3, and marked area 4 are the areas marked successively.

[0155] Among them, marked area 3 is the first marked area mentioned above. The preset second explanation order is the order in which the vertical coordinates increase sequentially (corresponding to the order from top to bottom mentioned above). If the vertical coordinates are the same, then the order in which the horizontal coordinates increase sequentially is (corresponding to the order from left to right mentioned above). The coordinate values ​​corresponding to marked areas 1, 2, 4 and 3 are (x1, y1), (x2, y4), (x4, y2) and (x3, y3) respectively, where x1 < x2 < x3 < x4 and y1 < y2 < y3 < y4.

[0156] When the third marked area is either marked area 1 or marked area 4, since y1 < y2 < y3, the first explanation order is from top to bottom, the same as the second explanation order, and no explanation trajectory needs to be marked. When the third marked area is marked area 2, since y3 < y4, the first explanation order is from bottom to top, different from the second explanation order. In this case, an arrow marker is added from marked area 2 (the third marked area) to marked area 3 (the first marked area) to show the explanation trajectory from the third marked area to the first marked area. This helps participants better understand the logical relationship between the displayed data corresponding to the two marked areas and improves meeting efficiency.

[0157] In an optional embodiment, prior to step S303, the method may further include:

[0158] Step S3035: The display device obtains the target display window of the aforementioned display device.

[0159] In this embodiment, the screen of the aforementioned display device may have one or more display windows, wherein the target display window is one or more display windows used to carry the meeting content.

[0160] Correspondingly, step S303 above may specifically include:

[0161] Step S3036: When the first marked area is within the visible area of ​​the target display window, the display device determines the target display data corresponding to the first marked area based on the data object displayed within the visible area, and marks the target display data.

[0162] In this embodiment, the visible area of ​​each display window is the area excluding the border and scroll bar. The data object is included in the meeting content. If the first marking area is within the visible area of ​​the target display window, the corresponding target display data is determined and marked based on the data object displayed within the visible area; otherwise, no marking is performed. This reduces interference from other unmarked data displayed on the screen of the display device, thereby improving the accuracy of data marking.

[0163] It should be noted that, for any embodiment of this application, the steps performed by the display device may also be performed by a server with data transmission and data processing functions, or by other third-party platforms (such as the cloud space mentioned above) that have control over the display device.

[0164] For example, when the above steps are performed by the server or the third-party platform, the display device can forward the first location information and the second location information sent by the indicating device to the server or the third-party platform, and then the server or the third-party platform can perform the relevant steps of the above data marking method. The specific implementation can be referred to the relevant description in the foregoing embodiments, which will not be repeated here.

[0165] This application also provides a data tagging device, which will be described below with reference to the embodiments of this application. Figure 5 For a description of the above-mentioned device, please refer to [link / reference]. Figure 5 , Figure 5 This is a schematic diagram of the structure of a data tagging device provided in an embodiment of this application.

[0166] like Figure 5 As shown, the data tagging device 500 includes:

[0167] The receiving unit 501 is used to receive first position information sent by the indicating device, the first position information being used to describe the motion posture of the indicating device and the spatial position of the indicating device relative to the display device; the indicating device includes a first sensor and a second sensor, the first sensor being used to sense the motion posture of the indicating device, and the second sensor being used to sense the spatial position of the indicating device relative to the display device.

[0168] The first determining unit 502 is used to determine the first marking area indicated by the indicating device on the screen of the display device based on the first position information.

[0169] The first marking unit 503 is used to mark the target display data corresponding to the first marking area.

[0170] In an optional embodiment,

[0171] The receiving unit is further configured to receive second position information sent by the indicating device and obtain specification information of the display device when the indicating device points to the position calibration area.

[0172] The first determining unit 502 is further configured to determine a target space model based on the second position information and the specification information, wherein the target space model is used to describe the mapping relationship between the position information of the indicating device and the marking area on the display device.

[0173] The first determining unit 502 is further specifically used to input the first position information into the target space model to obtain the first marked area indicated by the indicating device on the screen of the display device.

[0174] In an optional embodiment,

[0175] The first determining unit 502 is further configured to input the second position information into the target space model to obtain the second marking area indicated by the indicating device on the screen of the display device;

[0176] The first determining unit 502 is further configured to determine the position offset based on the second marking area and the position calibration area.

[0177] The first determining unit 502 is also used to update the target space model based on the position offset.

[0178] In an optional embodiment,

[0179] The first determining unit 502 is further specifically used to determine the position of the intersection point formed by the straight line corresponding to the direction pointed to by the indicating device and the plane where the display device is located, based on the second position information.

[0180] The first determining unit 502 is further specifically used to determine the screen coordinates of the intersection point on the display device based on the specification information.

[0181] The first determining unit 502 is further specifically used to determine the target space model based on the second position information and the screen coordinates.

[0182] In an optional embodiment, the above-mentioned indicating device is provided with an unlocking mechanism, and the device 500 further includes:

[0183] The locking unit 504 is used to lock the first marking area and continuously mark the target display data when the first marking area does not change within a preset time period.

[0184] The locking unit 504 is also used to unlock the first marked area and stop marking the target display data when the unlocking mechanism is triggered.

[0185] In an optional embodiment, the device 500 further includes:

[0186] Establishment unit 505 is used to establish a coordinate system on the plane where the display device is located based on the above-mentioned specification information;

[0187] The second determining unit 506 is used to determine, according to the coordinate system, the first coordinate value corresponding to the first marked area and the second coordinate value corresponding to the third marked area, wherein the third marked area is any area marked before the first marked area.

[0188] The second determining unit 506 is further configured to determine the first explanation order based on the first coordinate value and the second coordinate value.

[0189] The second marking unit 507 is used to mark the explanation trajectory from the third marking area to the first marking area when the first explanation order is different from the preset second explanation order.

[0190] In an optional embodiment, the device 500 further includes:

[0191] Acquisition unit 508 is used to acquire the target display window of the aforementioned display device;

[0192] The first marking unit 503 is further configured to, when the first marking area is within the visible area of ​​the target display window, determine the target display data corresponding to the first marking area based on the data object displayed within the visible area, and mark the target display data.

[0193] For the technical effects of the aforementioned data marking device, please refer to the description of the technical effects of the data marking method mentioned above, which will not be repeated here.

[0194] According to the embodiments of this application, Figure 5 The various units in the device shown can be individually or entirely combined into one or more other units, or some of the units can be further divided into multiple functionally smaller units. This can achieve the same operation without affecting the technical effects of the embodiments of this application. The above units are based on logical function division. In practical applications, the function of one unit can also be implemented by multiple units, or the function of multiple units can be implemented by one unit.

[0195] This application also provides an electronic device, which will be described below with reference to the embodiments of this application. Figure 6 For a description of the above electronic devices, please refer to [link / reference]. Figure 6 , Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.

[0196] like Figure 6 As shown, the aforementioned electronic device 600 may include: one or more processors 601, one or more memories 602, one or more communication interfaces 603, and a bus 604, wherein the processors 601, memories 602, and communication interfaces 603 are connected via the bus 604. The aforementioned electronic device may be the data tagging device 500 described above.

[0197] The memory 602 is used to store a program; the processor 601 is used to execute the program stored in the memory. When the program is executed, the processor 601 executes the method in any possible implementation of the data marking method described above.

[0198] It should be understood that, in the embodiments of this application, the memory 602 mentioned above includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or compact disc read-only memory (CDROM), as well as external memory other than computer memory and processor cache. A portion of the memory 602 may also include non-volatile random access memory. For example, the memory 602 may also store device type information.

[0199] The processor 601 described above can be one or more central processing units (CPUs). If the processor 601 is a CPU, it can be a single-core CPU or a multi-core CPU. The processor 601 can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0200] The steps performed in the foregoing embodiments can be based on the above. Figure 6 The electronic device 600 shown is implemented such that the processor 601 can execute any of the optional embodiments of the data marking method provided in this application, as described in the embodiments, or it can execute the implementation of the data marking device 500 described in this application. Specifically, the processor 601 can implement... Figure 5 The device shown includes the functions of the first determining unit 502, the first marking unit 503, the locking unit 504, the establishing unit 505, the second determining unit 506, the second marking unit 507, or the acquiring unit 508. The communication interface 603 can implement... Figure 5The receiving unit 501 in the device shown has the following functions. The memory 602 can provide a cache when the processor 601 executes the implementation of the data marking device 500 described in the embodiments of this application, and can also store the computer programs required by the processor 601 to execute the implementation of the data marking device 500 described in the embodiments of this application.

[0201] This application also provides a computer storage medium storing a computer program, the computer program including program instructions, which, when executed by a processor, enable the processor to implement the above-mentioned functions. Figures 1 to 4 The method shown.

[0202] This application also provides a computer program product, which includes: instructions or a computer program; when the instructions or the computer program are executed, the above-mentioned functions can be achieved. Figures 1 to 4 The method shown.

[0203] This application also provides a chip, which includes a processor. The processor executes instructions, enabling the chip to achieve the aforementioned... Figures 1 to 4 The method shown is described above. Optionally, the chip also includes a communication interface for receiving or transmitting signals.

[0204] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by hardware related to computer programs. The computer programs can be stored in computer storage media, and when executed, they can implement the processes of the above method embodiments. The aforementioned computer storage media include various media capable of storing computer program code, such as read-only memory (ROM) or random access memory (RAM), magnetic disks, or optical disks.

Claims

1. A data tagging method, characterized in that, include: The system receives first position information sent by an indicator device, the first position information being used to describe the motion posture of the indicator device and the spatial position of the indicator device relative to a display device; the indicator device includes a first sensor and a second sensor, the first sensor being used to sense the motion posture of the indicator device, and the second sensor being used to sense the spatial position of the indicator device relative to the display device; Based on the first location information, a first marked area is determined by the indicating device on the screen of the display device; Mark the target display data corresponding to the first marked area; The display device is provided with a position calibration area, and before receiving the first position information sent by the indicating device, the method further includes: When the indicating device points to the position calibration area, the system receives second position information sent by the indicating device and obtains the specification information of the display device. Based on the second location information and the specification information, a target space model is determined, which is used to describe the mapping relationship between the location information of the indicator device and the marked area on the display device. The method further includes: The second location information is input into the target space model to obtain the second marked area indicated by the indicating device on the screen of the display device; The position offset is determined based on the second marked area and the position calibration area; The target space model is updated based on the position offset.

2. The method according to claim 1, characterized in that, Determining the first marked area indicated by the indicating device on the screen of the display device based on the first location information includes: The first location information is input into the target space model to obtain the first marked area indicated by the indicating device on the screen of the display device.

3. The method according to claim 1, characterized in that, The step of determining the target spatial model based on the second location information and the specification information includes: Based on the second position information, determine the position of the intersection point formed by the straight line corresponding to the direction pointed to by the indicator device and the plane where the display device is located; Based on the specifications, determine the screen coordinates of the intersection point on the display device. The target space model is determined based on the second location information and the screen coordinates.

4. The method according to claim 1, characterized in that, The indicating device is equipped with an unlocking mechanism. After marking the target display data corresponding to the first marked area, the method further includes: If the first marked area does not change within a preset time period, the first marked area is locked, and the target display data is continuously marked; When the unlocking mechanism is triggered, the first marked area is unlocked, and the marking of the target display data is stopped.

5. The method according to claim 4, characterized in that, After marking the target display data corresponding to the first marked area, the method further includes: Based on the specifications, establish a coordinate system on the plane where the display device is located; Based on the coordinate system, determine the first coordinate value corresponding to the first marked area and the second coordinate value corresponding to the third marked area, wherein the third marked area is any area marked before the first marked area; The first explanation order is determined based on the first coordinate value and the second coordinate value; If the first explanation order is different from the preset second explanation order, mark the explanation trajectory from the third marking area to the first marking area.

6. The method according to claim 5, characterized in that, Before marking the target display data corresponding to the first marked area, the method further includes: Obtain the target display window of the display device; The step of marking the target display data corresponding to the first marked area includes: When the first marked area is within the visible area of ​​the target display window, the target display data corresponding to the first marked area is determined based on the data object displayed within the visible area, and the target display data is marked.

7. A data tagging device, characterized in that, include: A receiving unit is configured to receive first position information sent by an indicating device, the first position information being used to describe the motion posture of the indicating device and the spatial position of the indicating device relative to a display device; the indicating device includes a first sensor and a second sensor, the first sensor being used to sense the motion posture of the indicating device, and the second sensor being used to sense the spatial position of the indicating device relative to the display device; A determining unit is configured to determine, based on the first position information, the first marking area indicated by the indicating device on the screen of the display device; A marking unit is used to mark the target display data corresponding to the first marking area; The display device is provided with a position calibration area. The receiving unit is further configured to receive second position information sent by the indicating device when the indicating device points to the position calibration area, and obtain the specification information of the display device; and determine a target space model based on the second position information and the specification information, wherein the target space model is used to describe the mapping relationship between the position information of the indicating device and the marked area on the display device. The determining unit is further configured to input the second location information into the target space model to obtain the second marked area indicated by the indicating device on the screen of the display device; The position offset is determined based on the second marked area and the position calibration area; the target space model is updated based on the position offset.

8. An electronic device, characterized in that, include: Memory, used to store programs; A processor for executing the program stored in the memory, wherein, when the program is executed by the processor, the processor performs the method as described in any one of claims 1 to 6.

9. A computer storage medium, characterized in that, The computer storage medium stores a computer program, which includes program instructions that, when executed by a processor, allow the processor to perform the method as described in any one of claims 1 to 6.

Images