Display method, display system, electronic device, storage medium, and program product
Patent Information
- Application Number
- CN202510221429.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-26
- Publication Date
- 2026-08-28
Smart Images
Figure CN122653719A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of screen projection and control technology, and more specifically, to a display method, display system, electronic device, storage medium, and program product. Background Technology
[0002] With the rapid development of display technology, E-ink displays, with their unique electronic ink display principle, are gradually being widely used in office, note-taking, and meeting scenarios.
[0003] The principle of electronic ink display is that the ink screen consists of millions of microcapsules, each containing black and white particles. Based on electrophoretic (EPD) technology, each microcapsule changes color under the action of an electric field, thereby simulating the paper reading experience. Summary of the Invention
[0004] In view of the above, this disclosure provides a display method, a display system, an electronic device, a storage medium, and a program product.
[0005] According to one aspect of this disclosure, a display method is provided, comprising: acquiring intermediate operation data from an e-book terminal, wherein the intermediate operation data is obtained by the e-book terminal processing the first operation data, the first operation data being obtained by marking a target media stream displayed on the e-book terminal, the target media stream being determined based on an original media stream displayed on a display device; and sending second operation data obtained by processing the intermediate operation data to the display device, so that the display device superimposes the second operation data onto the original media stream displayed on the display device.
[0006] According to one aspect of this disclosure, a display method is provided, comprising: acquiring first operation data from an e-book terminal, wherein the first operation data is obtained by marking a target media stream displayed on the e-book terminal, the target media stream being determined based on an original media stream displayed on a display device; and sending the first operation data to the display device, so that the display device processes the first operation data to obtain second operation data, and superimposing the second operation data onto the original media stream displayed on the display device.
[0007] According to another aspect of this disclosure, a display system is provided, comprising: a server for acquiring intermediate operation data from an e-book client, wherein the intermediate operation data is obtained by the e-book client processing first operation data, the first operation data being obtained by marking a target media stream displayed on the e-book client, the target media stream being determined based on an original media stream displayed on a display device; and sending second operation data obtained by processing the target operation data to the display device; the display device being configured to, in response to receiving the second operation data, superimpose the second operation data onto the original media stream.
[0008] According to another aspect of this disclosure, a display system is provided, comprising: a server configured to acquire first operation data from an e-book client, wherein the first operation data is obtained by marking a target media stream displayed on the e-book client, the target media stream being determined based on an original media stream displayed on a display device; and to send the first operation data to the display device; the display device configured to process the first operation data to obtain second operation data; and to superimpose the second operation data onto the original media stream.
[0009] According to another aspect of this disclosure, a computer-readable storage medium is provided having executable instructions stored thereon, which, when executed by a processor, cause the processor to perform the methods described in this disclosure.
[0010] According to another aspect of this disclosure, a computer program product is provided, which includes computer-executable instructions that, when executed, are used to perform the methods described in this disclosure. Attached Figure Description
[0011] The above and other objects, features and advantages of this disclosure will become clearer from the following description of embodiments with reference to the accompanying drawings, in which:
[0012] Figure 1A The system architecture of a display system according to an embodiment of the present disclosure is illustrated schematically;
[0013] Figure 1B The system architecture of a display system according to another embodiment of the present disclosure is illustrated schematically;
[0014] Figure 1C The system architecture of a display system according to yet another embodiment of the present disclosure is illustrated schematically;
[0015] Figure 2A A flowchart illustrating a display method according to an embodiment of the present disclosure is shown schematically;
[0016] Figure 2B A flowchart illustrating a display method according to another embodiment of the present disclosure is shown schematically;
[0017] Figure 3 This illustration schematically shows an example of a process of casting the original media stream displayed on a display device to an e-book terminal according to an embodiment of the present disclosure;
[0018] Figure 4A The illustration shows an example diagram of the training process of a grayscale optimization model according to an embodiment of the present disclosure;
[0019] Figure 4B The illustration shows an example schematic diagram of a process for obtaining a processed media stream according to an embodiment of the present disclosure;
[0020] Figure 5A This schematic diagram illustrates an example of a display process according to an embodiment of the present disclosure;
[0021] Figure 5B This schematically illustrates an example diagram of a display process according to another embodiment of the present disclosure;
[0022] Figure 6 This illustration schematically shows an example diagram of a communication connection disconnection process according to an embodiment of the present disclosure;
[0023] Figure 7 A flowchart illustrating a display method according to another embodiment of this disclosure is shown schematically; and
[0024] Figure 8 A block diagram of an electronic device suitable for implementing a display method according to an embodiment of the present disclosure is shown schematically. Detailed Implementation
[0025] The embodiments of the present disclosure will now be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the disclosure. In the following detailed description, numerous specific details are set forth to provide a thorough understanding of the embodiments of the present disclosure for ease of explanation. However, it will be apparent that one or more embodiments may be practiced without these specific details. Furthermore, descriptions of well-known structures and techniques are omitted in the following description to avoid unnecessarily obscuring the concepts of the present disclosure.
[0026] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit this disclosure. The terms “comprising,” “including,” etc., as used herein indicate the presence of the stated features, steps, operations, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, or components.
[0027] All terms used herein (including technical and scientific terms) have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein are to be interpreted in a manner consistent with the context of this specification, and not in an idealized or overly rigid way.
[0028] When using expressions such as "at least one of A, B, and C", they should generally be interpreted in accordance with the meaning that is commonly understood by a person skilled in the art (e.g., "a system having at least one of A, B, and C" should include, but is not limited to, a system having A alone, a system having B alone, a system having C alone, a system having A and B, a system having A and C, a system having B and C, and / or a system having A, B, and C, etc.).
[0029] In the technical solution of this invention, the user information (including but not limited to user personal information, user image information, user device information, such as location information) and data (including but not limited to data used for analysis, stored data, and displayed data) involved are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, storage, use, processing, transmission, provision, disclosure, and application of related data all comply with relevant laws, regulations, and standards, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entry points for users to choose to authorize or refuse.
[0030] In one example, simple screen mirroring can be achieved via a wired connection. However, due to the limitations of cable length, wired connections can only support basic touchscreen control functions and cannot achieve real-time annotation. Furthermore, due to the device limitations of e-readers, when displaying high refresh rate content on the display device, the frame rate mismatch with the panel can easily lead to choppy visuals, thus affecting the smoothness of operation.
[0031] Therefore, this disclosure provides a display method, display system, electronic device, storage medium, and program product, which can be applied to the field of screen projection and reverse control technology. The display method includes: acquiring intermediate operation data from an e-book terminal, wherein the intermediate operation data is obtained by processing first operation data on the e-book terminal, the first operation data being obtained by marking a target media stream displayed on the e-book terminal, the target media stream being determined based on the original media stream displayed on the display device; and sending second operation data obtained by processing the intermediate operation data to the display device, so that the display device superimposes the second operation data onto the original media stream displayed on the display device.
[0032] Figure 1A The schematic illustration shows the system architecture of a display system according to an embodiment of the present disclosure. It should be noted that... Figure 1AThe examples shown are merely examples of system architectures that can be applied to the embodiments of this disclosure, in order to help those skilled in the art understand the technical content of this disclosure, but do not mean that the embodiments of this disclosure cannot be used in other devices, systems, environments or scenarios.
[0033] like Figure 1A As shown, the display system 100A according to this embodiment may include a display device 110 and a server 120.
[0034] Server 120 can acquire media streams from display device 110 and transmit them to e-book terminal 130. Users can perform marking operations on e-book terminal 130 to obtain control streams. Server 120 can acquire control streams from e-book terminal 130 and transmit them to display device 110. Display device 110 can process the media streams according to the control streams to obtain and display the target media stream.
[0035] It is understood that the above description has described a display system according to an embodiment of the present disclosure, and the following will be combined with... Figure 1B and Figure 1C A further description is given of a display system according to another embodiment of this disclosure.
[0036] Figure 1B The system architecture of a display system according to another embodiment of the present disclosure is illustrated schematically.
[0037] like Figure 1B As shown, the display system 100B according to this embodiment may include a display device 110 and a server 120.
[0038] Server 120 is used to obtain intermediate operation data from e-book client 130. The intermediate operation data is obtained by processing first operation data on e-book client 130. The first operation data is obtained by marking the target media stream displayed on e-book client 130 by user 101. The target media stream is determined based on the original media stream displayed on display device 110. Second operation data obtained by processing the intermediate operation data is then sent to display device 110.
[0039] Display device 110 is configured to overlay the second operation data onto the original media stream in response to receiving the second operation data.
[0040] Figure 1C The system architecture of a display system according to yet another embodiment of the present disclosure is illustrated schematically.
[0041] like Figure 1C As shown, the display system 100C according to this embodiment may include a display device 110 and a server 120.
[0042] Server 120 is used to obtain first operation data from the e-book client. The first operation data is obtained by marking the target media stream displayed on the e-book client 130, and the target media stream is determined based on the original media stream displayed on the display device. The first operation data is then sent to the display device 110.
[0043] Display device 110 is configured to, in response to receiving first operation data, process the first operation data to obtain second operation data, and then overlay the second operation data onto the original media stream.
[0044] It should be noted that in 100B, the step of processing the first operation data to obtain the second operation data is performed by the server 120; in contrast, in 100C, the step of processing the first operation data to obtain the second operation data is performed by the display device 110. The specific execution entity that performs this step can be configured according to actual business needs and is not limited here.
[0045] It should be understood that the number of display devices, servers, and e-book terminals shown in Figure 1 is merely illustrative. Depending on implementation needs, any number of display devices, servers, and e-book terminals can be used.
[0046] It should be noted that the sequence numbers of the operations in the following methods are for descriptive purposes only and should not be considered as indicating the execution order of the operations. Unless explicitly stated otherwise, the method does not need to be executed in the exact order shown.
[0047] Based on the above display system, the present invention also provides a display method applied to a server. In the embodiments of this disclosure, the process of processing first operation data to obtain second operation data in the display method can be performed by the server or by the display device. The following will utilize... Figure 2A This describes method 200A, which involves the server processing first operation data to obtain and display second operation data. Figure 2B This describes a display method 200B in which a display device processes first operation data to obtain second operation data.
[0048] Figure 2A A flowchart illustrating a display method according to an embodiment of the present disclosure is shown schematically.
[0049] like Figure 2A As shown, the display method 200A includes operations S210 to S220.
[0050] In operation S210, intermediate operation data is obtained from the e-book terminal. The intermediate operation data is obtained by the e-book terminal processing the first operation data. The first operation data is obtained by marking the target media stream displayed on the e-book terminal. The target media stream is determined based on the original media stream displayed on the display device.
[0051] In operation S220, the second operation data obtained by processing the intermediate operation data is sent to the display device so that the display device can overlay the second operation data onto the original media stream displayed by the display device.
[0052] The display method 200 can be applied to a server. Before executing the display method 200 provided in this disclosure, a first communication connection and a second communication connection can be established in advance. The specific method of the communication connection can be configured according to actual business needs and is not limited here. For example, the communication connection may include at least one of the following: USB data cable connection, WiFi transmission, web browser transmission, OTG adapter cable transmission, and real-time web communication protocol, etc.
[0053] The display device can display the raw media stream, which can be sent to the server via a second communication connection, and then forwarded to the e-book client via a first communication connection. The raw media stream can include various types of media data such as audio, video, and text. The e-book client can display the raw media stream after the target. The user can mark the displayed raw media stream on the e-book client to obtain first operation data corresponding to the marking. The first operation data represents the positional change data at the marked points on the e-book client; for example, the first operation data can include multiple first coordinates marked by the user on the e-book client.
[0054] After obtaining the first operation data on the e-book client, the server can retrieve the first operation data from the e-book client via a first communication connection. Based on this, the server can convert the first operation data for the e-book client into second operation data for the display device according to the mapping relationship between the e-book client and the display device. The second operation data represents the positional change data of the marking process on the display device. For example, the second operation data may include multiple second coordinates obtained after mapping multiple first coordinates of the marking process on the e-book client to the display device.
[0055] After obtaining the second operation data, the server can send the second operation data to the display device via the second communication connection. After receiving the second operation data, the display device can overlay the second operation data onto the original media stream being displayed, so as to realize real-time screen mirroring between the e-book client and the display device.
[0056] According to embodiments of this disclosure, by obtaining first operation data obtained by marking the original media stream from the e-book terminal and sending the target obtained second operation data to the display device, the display device can overlay the second operation data on the original media stream displayed locally. This improves the synchronization and interactivity of operations on the media stream between different terminals, realizes real-time annotation of the displayed content, and optimizes the user experience.
[0057] Figure 2B A flowchart illustrating a display method according to another embodiment of this disclosure is shown schematically.
[0058] like Figure 2B As shown, the display method 200B includes operations S230 to S240.
[0059] In operation 230, first operation data is obtained from the e-book terminal. The first operation data is obtained by marking the target media stream displayed on the e-book terminal. The target media stream is determined based on the original media stream displayed on the display device.
[0060] In operation 240, the first operation data is sent to the display device so that the display device processes the first operation data to obtain the second operation data and superimposes the second operation data onto the original media stream displayed by the display device.
[0061] For explanations of the original media stream, the first operation data, and the second operation data, please refer to the relevant content of the above display method 200A, which will not be repeated here.
[0062] It should be noted that in the 200A, the step of processing the first operation data to obtain the second operation data is performed by the server; in contrast, in the 200B, the step of processing the first operation data to obtain the second operation data is performed by the display device. The specific execution entity that performs this step can be configured according to actual business needs and is not limited here.
[0063] In one example, the first and second communication connections can be established based on the WebReal-Time Communications (WebRTC) protocol. WebRTC enables web browsers and websites to capture and stream audio or video media and exchange arbitrary data between browsers. WebRTC allows for peer-to-peer data sharing without requiring users to install plugins or any other third-party software.
[0064] Since the web real-time communication protocol itself does not include a signaling mechanism, it needs to exchange signaling information through an external server to coordinate the establishment of peer-to-peer connections. For example, the server may include a signaling server. A first communication connection is used to send and receive arbitrary data between the signaling server and the e-book client, and a second communication connection is used to send and receive arbitrary data between the signaling server and the display device, in order to establish a peer-to-peer connection between the e-book client and the display device.
[0065] According to embodiments of this disclosure, by using the real-time web communication protocol as a medium, compared to the traditional screen projection method based on a local area network, the remote screen projection function across networks is achieved by using a first communication connection and a second communication connection established based on the real-time web communication protocol. This ensures that the push stream on the e-book terminal and the pull stream on the large screen terminal remain synchronized, and even in the case of unstable network conditions, the smoothness of the video can be guaranteed as much as possible, thus expanding the boundaries of application scenarios.
[0066] Before executing the above display method, it is necessary to establish a first communication connection and a second communication connection, and transmit the media stream through these two communication connections. The following will combine... Figure 3 This section will further explain the process of casting the original media stream displayed on the display device to the e-book.
[0067] Figure 3 The illustration shows an example schematic diagram of a process of casting the original media stream displayed on a display device to an e-book terminal according to an embodiment of the present disclosure.
[0068] like Figure 3 As shown in Figure 300, taking the establishment of the first and second communication connections based on a web page real-time communication protocol as an example, the process of casting the original media stream is illustrated. In this case, the establishment process of the casting process may include a verification phase, a first communication connection establishment phase, and a second communication connection establishment phase.
[0069] In one example, the verification phase may include operations S301 to S317.
[0070] When operating S301, the display device can display the raw media stream.
[0071] In operation S302, when the display device initiates a media session for screen mirroring, the display device can send a display request to the server. In one example, the display request may be triggered by a user action on the display device. The specific user action used to trigger the display request can be configured according to actual business needs and is not limited here. For example, the action may include at least one of the following: the user clicks a control via a mouse connected to the display device, the user inputs data via a keyboard connected to the display device, or the user selects a value by touching the touchscreen of the display device.
[0072] In operation S303, in response to receiving a display request, the server can generate verification information based on the device identifier in the display request. The device identifier can be used to uniquely identify the display device. For example, the device identifier may include the device model, serial number, MAC address, etc. The method for generating the verification information can be configured according to actual business needs and is not limited here. For example, the device identifier can be processed using hash functions, encryption algorithms, etc., to obtain the verification information. The verification information may include at least one of the following: a first connection code and a first password.
[0073] When operating S304, the server can send authentication information to the display device.
[0074] When operating the S305, the e-book client can send verification information to the server. The method of inputting the verification information can be configured according to actual business needs and is not limited here. For example, the verification information can be entered via a form displayed on the e-book client. Alternatively, the verification information can also be entered via verification information displayed on a scanning display device. The verification information may include at least one of the following: a second connection code and a second password.
[0075] In operation S306, in response to receiving the information to be verified, the server can verify the information to be verified based on the verification information and obtain a verification result. The specific verification process can be configured according to actual business needs and is not limited here. For example, the server can verify whether the first connection code and the second connection code are the same to obtain the first sub-verification result; verify whether the first password and the second password are the same to obtain the second sub-verification result; if both the first sub-verification result and the second sub-verification result indicate that the verification has passed, a verification result indicating that the information to be verified has passed the verification is determined; if either the first sub-verification result or the second sub-verification result indicates that the verification has failed, a verification result indicating that the information to be verified has failed the verification is determined.
[0076] When operating S307, the server can send the verification result to the e-book client.
[0077] It should be noted that, since the server has not yet established the first communication connection with the e-book client and the second communication connection with the display device during the verification phase, the display request in operation S302 (related to the interaction between the display device and the server), the verification information in operation S304, and the pending verification information in operation S305 (related to the interaction between the server and the e-book client) and the verification result in operation S307 can all be transmitted via HTTP request and response. For example, the e-book client and the display device can use the TCP / IP protocol to establish a connection with the server.
[0078] According to embodiments of this disclosure, by responding to a display request from a display device, verification information is generated using a device identifier, the information to be verified is verified, and when the verification result shows that the information to be verified has passed verification, a first communication connection and a second communication connection are automatically established to ensure that only authorized devices can access the device, thereby achieving efficient and secure communication between the e-book client and the display device.
[0079] In another example, the establishment phase of the second communication connection may include operations S308 to S311.
[0080] During operation S308, the display device can send first communication information to the server. This first communication information includes information related to the media session. For example, the first communication information may be obtained based on the Session Description Protocol (SDP). The information related to the media session may refer to initialization parameters used to describe the streaming media, and may include at least one of the following: session identifier, session metadata, playback status, and control commands. The session identifier is used to uniquely identify the media session. Session metadata may include attribute data of the media stream. Playback status refers to the state of media playback, such as playing, paused, stopped, and buffering.
[0081] In operation S309, in response to receiving the first communication information, the server can forward the first communication information to the web real-time communication service.
[0082] When operating S310, the web real-time communication service can send third-party communication information to the server. For example, the third-party communication information can also be obtained based on a session description protocol.
[0083] When operating S311, the server can forward third communication information to the display device to establish a second communication connection between the server and the display device.
[0084] Through the aforementioned operations S308 to S311, a media stream channel is established between the display device and the real-time web communication service, facilitating subsequent streaming based on this media stream channel. In another example, the establishment phase of the first communication connection may include operations S312 to S315.
[0085] When operating S312, the server can notify the e-book client to pull the stream.
[0086] During operation S313, the e-book client can send second communication information to the server. This second communication information includes response information to the media session. For example, the second communication information can also be obtained based on a session description protocol. The response information to the media session can refer to response parameters used to describe the streaming media, and may include at least one of the following: session identifier, metadata update information, playback status change information, and execution results of control commands, etc.
[0087] When operating S314, the server can forward second communication information to the web real-time communication service.
[0088] In operation S315, the web real-time communication service can send a fourth communication message to the server to establish a first communication connection between the server and the e-book client. For example, the fourth communication message can also be obtained based on a session description protocol.
[0089] Through the above operations S312 to S315, a media stream channel is established between the e-book client and the real-time communication service of the webpage, so that subsequent streaming can be started based on this media stream channel.
[0090] After obtaining the original media stream from the display device using the second communication connection established via operations S308 to S311, and sending the original media stream to the e-book terminal using the first communication connection established via operations S312 to S315, operation S316 can be executed. In operation S316, the e-book terminal can display the original media stream.
[0091] According to embodiments of this disclosure, a second communication connection is established in response to a first communication message sent by a display device, and a first communication connection is established in response to a second communication message sent by an e-book terminal. This achieves dynamic establishment of a bidirectional communication connection, ensuring accurate transmission and processing of the media stream and optimizing the synchronization and interaction process of the media stream.
[0092] It is understood that the process of projecting the original media stream displayed on the display device to the e-book terminal has been described above. In the embodiments of this disclosure, the process of processing the original media stream to obtain the target media stream during the display process can be performed by the server or by the display device.
[0093] In one example, taking the server performing the above operation as an example, the server can obtain the original media stream from the display device, process the original media stream to obtain the target media stream, and then send the target media stream to the e-book client. For example, after receiving the original media stream, the server can directly identify the original media stream as the target media stream. Alternatively, after receiving the original media stream, the server can process the original media stream based on a first method for implementing frame rate conversion, a second method for implementing partial refresh, or a third method for implementing grayscale optimization to obtain the target media stream. The following will combine... Figure 4A and Figure 4B The above methods will be explained.
[0094] Figure 4A The illustration shows an example diagram of the training process of a grayscale optimization model according to an embodiment of the present disclosure.
[0095] like Figure 4A As shown, in the 400A, before processing the original media stream, the server can pre-train a grayscale optimization model for grayscale mapping. Grayscale mapping refers to optimizing the grayscale performance of the e-book by changing the brightness values of different gray levels. In other words, mapping can expand or compress the grayscale range to adapt to specific display content or ambient lighting conditions.
[0096] In one example, the server can input a sample image 401 into the model 402 to be trained, and obtain an output image 403. The sample image 403 includes grayscale images with multiple gray levels, where gray levels represent the brightness levels of the grayscale images. The specific structure of the model 402 to be trained can be configured according to actual business needs and is not limited here, as long as it can learn features of different grayscale levels. For example, the model 402 to be trained can be a convolutional neural network (CNN) model.
[0097] Based on this, the server can use the output image 403 and the image label 404 of the sample image 401 to train the training model 402, obtaining a grayscale optimization model. The output image 403 is a grayscale image that integrates multiple grayscale levels. The image label 404 is the accurate grayscale image corresponding to the sample image 401. By using the output image 403 and the image label 404 to train the grayscale optimization model, the grayscale optimization model can learn to recover a high-resolution output image from a low-resolution input image, compressing multiple grayscale input images into an output image suitable for one-time rendering, so as to adapt to the screen resolution of the e-book terminal, thereby improving the dynamic display quality.
[0098] After obtaining the grayscale optimization model, the original media stream can be processed using this model to obtain the target media stream, thereby improving the details of the dark and bright parts of each frame in the original media stream, reducing banded or stepped grayscale transitions, making each frame look smoother and more natural, and thus achieving more refined grayscale control.
[0099] In another example, gamma correction can be performed on the original media stream before processing it. Gamma correction is the process of adjusting the non-linear relationship between the input signal and the output brightness of the e-book. By adjusting the gamma curve, the grayscale distribution can be made more uniform, improving the details in the dark and bright parts of the image, making each frame look smoother and more natural.
[0100] In one embodiment of this disclosure, the server can select one of the above three methods to process the original media stream to obtain the target media stream. In another embodiment of this disclosure, the server can also combine the above three methods to process the original media stream to obtain the target media stream, which will be discussed below. Figure 4B Further explanation is needed.
[0101] Figure 4B The illustration shows an example schematic diagram of a process for obtaining a target media stream according to an embodiment of the present disclosure.
[0102] like Figure 4B As shown in 400B, before sending the original media stream 405 to the e-book client for display, the server can process the original media stream 405 to obtain the target media stream 409.
[0103] In one example, the server may perform frame rate conversion on the original media stream 405 based on a first method for implementing frame rate conversion, in order to match the e-ink screen refresh rate while ensuring smooth playback, resulting in a first intermediate media stream 406, whereby the frame rate of the first intermediate media stream 406 is greater than the frame rate of the original media stream 405. For example, the frame rate conversion process may include at least one of the following operations: keyframe selection processing, intelligent frame rate reduction processing, and smooth transition processing.
[0104] Keyframe selection processing refers to using motion estimation to identify keyframes (i.e., frames with significant content changes) in the original media stream, retaining these keyframes, and discarding other non-keyframes to reduce the total number of frames in the original media stream. Intelligent frame reduction processing involves analyzing the drastic changes between frames based on motion vectors. For consecutive frames with minor changes, it selectively merges or retains one frame, while using motion compensation algorithms to predict and synthesize the transitions between these frames to reduce visual discontinuity caused by directly dropping frames. Smooth transition processing refers to the inverse process of reducing the frame rate by applying motion compensation interpolation technology. Through prediction and interpolation, it generates smoother transition frames, maintaining the continuity of video content while reducing the frame rate and minimizing visual stuttering.
[0105] After obtaining the first intermediate media stream 406, the server can perform a partial refresh process on a portion of the first intermediate media stream 406 based on a second method for implementing partial refresh, resulting in a second intermediate media stream 407. For example, the partial refresh process can include at least one of the following operations: Local Full Refresh and Partial Update. By performing a partial refresh on a specified area, changed pixels can be updated more precisely, thereby reducing flicker and optimizing the visual experience, further minimizing the scope of the refresh's impact.
[0106] After obtaining the second intermediate media stream 407, the server can input the second intermediate media stream 407 into the trained grayscale optimization model 408 based on the third method used to implement grayscale optimization, so that the grayscale optimization model 408 can perform grayscale optimization processing on the second intermediate media stream 407 to obtain the target media stream 409.
[0107] After obtaining the target media stream 409, the high-efficiency hardware decoding chip integrated into the e-book terminal decodes the target media stream 409 and adapts it to the refresh rate of the e-book terminal. The screen with optimized black and white display effect is then displayed on the e-book terminal, making it convenient for users to perform functions such as operation and annotation.
[0108] It should be noted that in 400B, the server simultaneously uses a first method for frame rate conversion, a second method for partial refresh, and a third method for grayscale optimization to process the original media stream to obtain the target media stream. The specific method(s) the server employs, and the order in which they are used, can be configured according to actual business needs and are not limited here.
[0109] In one example, the server can use only the first method for frame rate conversion to obtain the target media stream, making the frame rate of the original media stream higher than that of the target media stream. Alternatively, the server can use only the second method for partial refresh to partially refresh a portion of the original media stream to obtain the target media stream. Alternatively, the server can use only the third method for grayscale optimization to process the original media stream to obtain the target media stream.
[0110] In another example, the server can first use a first method to achieve frame rate conversion, then a second method to achieve partial refresh, or vice versa, to process the original media stream to obtain the target media stream. Alternatively, the server can first use the second method to achieve partial refresh, then a third method to achieve grayscale optimization, or vice versa, to process the original media stream to obtain the target media stream.
[0111] According to embodiments of this disclosure, a target media stream is generated by processing the original media stream using a preset processing method. This preset processing method includes a combination of hardware and software algorithms such as frame rate conversion, partial refresh, and grayscale optimization, which not only improves the adaptability of the media stream and the smoothness of the playback, but also ensures the clarity of the picture.
[0112] In another example, taking the display device performing the above operations as an example, the display device can process the original media stream to obtain the target media stream, and the server can obtain the target media stream from the display device and send it to the e-book client. For example, the display device can directly determine the original media stream as the target media stream. Alternatively, the display device can process the original media stream based on a first method for implementing frame rate conversion, a second method for implementing partial refresh, or a third method for implementing grayscale optimization to obtain the target media stream.
[0113] In one embodiment of this disclosure, the display device can select one of the above three methods to process the original media stream to obtain the target media stream. In another embodiment of this disclosure, the display device can also combine the above three methods to process the original media stream to obtain the target media stream. The following also describes how to combine... Figure 4B Further explanation is needed.
[0114] For example, the display device may perform frame rate conversion processing on the original media stream 405 based on a first method for implementing frame rate conversion, so as to match the e-ink screen refresh rate while ensuring smooth picture, to obtain a first intermediate media stream 406, that is, the frame rate of the first intermediate media stream 406 is greater than the frame rate of the original media stream 405. For example, the frame rate conversion processing may include at least one of the following operations: keyframe selection processing, intelligent frame reduction processing, and smooth transition processing.
[0115] After obtaining the first intermediate media stream 406, the display device can perform a partial refresh process on a portion of the first intermediate media stream 406 based on a second method for implementing partial refresh, to obtain the second intermediate media stream 407. For example, the partial refresh process can include at least one of the following operations: partial full refresh and "local refresh". By performing a partial refresh on a specified area, the changing pixels can be updated more accurately, thereby reducing flicker and optimizing the viewing experience, further reducing the range of refresh impact.
[0116] After obtaining the second intermediate media stream 407, the display device can input the second intermediate media stream 407 into the trained grayscale optimization model 408 based on a third method for achieving grayscale optimization, so that the grayscale optimization model 408 can perform grayscale optimization processing on the second intermediate media stream 407 to obtain the target media stream 409.
[0117] It should be noted that the above embodiments simultaneously employ a first method for frame rate conversion, a second method for partial refresh, and a third method for grayscale optimization to process the original media stream to obtain the processed target media stream. The specific method(s) used, and the order in which they are applied, can be configured according to actual business needs and are not limited here.
[0118] In one example, the display device may use only a first method for frame rate conversion to obtain the target media stream, such that the frame rate of the original media stream is greater than that of the target media stream. Alternatively, the display device may use only a second method for partial refresh to partially refresh a portion of the original media stream to obtain the target media stream. Alternatively, the display device may use only a third method for grayscale optimization to process the original media stream to obtain the target media stream.
[0119] In another example, the display device can first use a first method to achieve frame rate conversion, then use a second method to achieve partial refresh, or vice versa, to process the original media stream to obtain the target media stream. Alternatively, the display device can first use the second method to achieve partial refresh, then use a third method to achieve grayscale optimization, or vice versa, to process the original media stream to obtain the target media stream.
[0120] It is understood that the above description explains the process of processing the original media stream to obtain the target media stream. In this embodiment of the disclosure, after obtaining the target media stream, the user can mark it on the target media stream displayed on the e-book terminal.
[0121] In this embodiment of the disclosure, the process of processing the first operation data to obtain the second operation data during the display process can be performed by a server or by a display device. The following will utilize... Figure 5A This describes method 500A, which involves the server processing the first operation data to obtain the second operation data for display. Figure 5B This describes a display method 500B in which a display device processes first operation data to obtain second operation data.
[0122] Figure 5A The illustration shows an example schematic diagram of a display process according to an embodiment of the present disclosure.
[0123] like Figure 5A As shown in the diagram, in the 500A, taking an e-book terminal including multiple touch units and multiple first display units, and a display device including multiple second display units as an example, the display process is explained. The display process may include a stage for processing operation data and a stage for processing media streams.
[0124] In one example, since there is a correspondence between each touch unit and the first display unit, touching a touch unit can change the pixel value of the corresponding first display unit. Furthermore, since there is a correspondence between each first display unit and the second display unit, the pixel value change of the second display unit can be determined based on the pixel value change of the first display unit. It should be noted that the correspondence can be configured according to actual business needs and is not limited here. For example, the correspondence can include at least one of the following: one-to-one correspondence, one-to-many correspondence, and many-to-many correspondence.
[0125] The correspondence between the aforementioned touch unit and the first display unit can be determined through hardware mapping and software calibration. For example, hardware mapping refers to directly mapping the touch unit and the first display unit in the hardware design using coordinates during e-book design, thereby obtaining the correspondence between the coordinates of the touch unit and the pixel position of the first display unit. Alternatively, software calibration involves calibrating the correspondence between the touch position and the displayed content through a calibration program, thereby adjusting the coordinate mapping between the touch unit and the first display unit to obtain the correspondence between the coordinates of the touch unit and the pixel position of the first display unit.
[0126] The correspondence between the first display unit and the second display unit can be determined through resolution adaptation and user settings. For example, the correspondence between the first display unit and the second display unit can be obtained by ensuring content adaptation based on the resolution of the e-book reader and the resolution of the display device. Alternatively, the user can manually adjust the correspondence between the first display unit and the second display unit by selecting a specific area for projection or adjusting the display ratio.
[0127] It should be noted that the correspondence between the aforementioned touch unit and the first display unit can be obtained by the server from the e-book client after establishing a first communication connection with the e-book client. Similarly, the correspondence between the aforementioned first display unit and the second display unit can be obtained by the server from the display device after establishing a second communication connection with the display device.
[0128] In one example, the data processing phase may include operations S501 to S503.
[0129] During operation S501, the e-reader can perform marking processing on the displayed raw media stream to obtain first operation data. By marking the raw media stream, the touch unit of the e-reader will collect the user's touch position information, such as the coordinates of the touch point, touch pressure, and touch duration. The first operation data includes multiple raw positions arranged in the order of marking processing, and the raw positions represent the positions of the touch units involved in the marking processing within the touch area.
[0130] In operation S502, the first operation data is transmitted to the web real-time communication service based on the media stream channel between the e-book client and the web real-time communication service.
[0131] In one example, the server can process first operation data to obtain second operation data. For example, the first operation data can be processed based on the correspondence between the touch unit and the first display unit to obtain intermediate operation data. For example, the intermediate operation data may include multiple first positions arranged in chronological order, each first position representing the position of the first display unit used for the touch unit in the first display area. The intermediate operation data can be processed based on the correspondence between the first display unit and the second display unit to obtain the second operation data. The method of obtaining the second operation data can be configured according to actual business needs and is not limited here. For example, for each first position, a second position corresponding to that first position can be determined based on the correspondence, and this second position represents the position of the second display unit in the second display area.
[0132] In operation S503, based on the media stream channel between the display device and the web real-time communication service, the second operation data obtained by processing the first operation data is sent to the display device.
[0133] In one example, the media stream processing phase may include operation S504.
[0134] When operating S504, the display device can overlay second operational data onto the original media stream being displayed.
[0135] According to embodiments of this disclosure, by converting first operation data into intermediate operation data based on the correspondence between the touch unit and the first display unit, the responsiveness of touch operations is increased, providing users with a smooth user experience. Furthermore, by converting intermediate operation data into second operation data based on the mapping relationship between the first display area and the second display area, the conversion process of media streams across different terminals is optimized, improving the flexibility and accuracy of media stream processing and reducing latency in real-time control stream data transmission.
[0136] In another example, the display device can capture the target image and transmit it to the e-book reader via a second and a first communication connection. Users can then annotate the image or text on the e-book reader using a smart pen or handwritten annotations. The annotated target image is then mirrored on both the display device and the e-book reader for a more intuitive and convenient display. For example, the display device can display the original color target image, while the e-book reader can display the grayscale version. Figure 5B An example schematic diagram illustrating a display process according to another embodiment of this disclosure is shown.
[0137] like Figure 5BAs shown in the diagram, in the 500B, taking an e-book terminal including multiple touch units and multiple first display units, and a display device including multiple second display units as an example, the display process is explained. The display process may include a stage for processing operation data and a stage for processing media streams.
[0138] In one example, the data processing phase may include operations S505 to S508.
[0139] When operating the S505, the e-book client can mark and process the displayed raw media stream to obtain the first operation data.
[0140] In operation S506, the first operation data is transmitted to the web real-time communication service via the media stream channel between the e-book client and the web real-time communication service.
[0141] In operation S507, the first operation data is sent to the display device based on the media stream channel between the display device and the real-time web communication service.
[0142] When operating S508, the display device can process the first operation data to obtain the second operation data.
[0143] In one example, the media stream processing phase may include operation S509.
[0144] In operation S509, the display device can overlay second operational data onto the original media stream being displayed.
[0145] It should be noted that in the 500A, the step of processing the first operation data to obtain the second operation data is performed by the server; in contrast, in the 500B, the step of processing the first operation data to obtain the second operation data is performed by the display device. The specific execution entity that performs this step can be configured according to actual business needs and is not limited here.
[0146] It is understood that the process of displaying the marked content on the display device in real time has been described above. In this embodiment of the disclosure, after the display process is completed, the first communication connection and the second communication connection can be disconnected. The following will be combined with... Figure 6 The process of disconnecting the communication connection is explained.
[0147] Figure 6 The illustration shows an example schematic diagram of a communication connection disconnection process according to an embodiment of the present disclosure.
[0148] like Figure 6 As shown, in 600, the process of disconnecting the communication connection may include operations S601 to S606.
[0149] When operating the S601, the e-book client detects that the media session has ended and can send a message to the server to disconnect the real-time web communication service.
[0150] When operating S602, the e-book client can disconnect the first communication connection with the server. The disconnection process can be configured according to actual business needs and is not limited here. For example, the disconnection process may include stopping media streaming playback, releasing media resources, updating the media session state, and clearing session data.
[0151] In operation S603, in response to detecting that the first communication connection has been disconnected, the server can send a notification message to the e-book client.
[0152] When operating S604, the server can send notification messages to the display device. These notification messages are used to send a disconnect signal.
[0153] When operating S605, in response to receiving a notification message, the display device can send a message to the server to disconnect the real-time web communication service.
[0154] When operating S606, the display device can disconnect the second communication connection.
[0155] According to embodiments of this disclosure, when the e-book terminal recognizes that the media session has ended, it automatically disconnects the first communication connection, avoiding unnecessary data transmission and resource occupation, and ensuring timely release of resources and optimization of communication efficiency.
[0156] The above are merely exemplary embodiments, but are not limited thereto. Other display methods known in the art may also be included, as long as they can achieve real-time annotation of the displayed content.
[0157] Based on the above display system, the present invention also provides another display method applied to a display device. The following will be combined with... Figure 7 The method is described in detail.
[0158] Figure 7 A flowchart illustrating a display method according to another embodiment of this disclosure is shown schematically.
[0159] like Figure 7 As shown, the display method 700 includes operation S710.
[0160] During operation of S710, the second operation data is superimposed onto the original media stream.
[0161] Display method 700 can be applied to a display device. The second operation data can be obtained using display method 200A or display method 200B. After receiving the second operation data, the display device can overlay the second operation data onto the original media stream to facilitate real-time screen mirroring between the e-book client and the display device.
[0162] According to embodiments of this disclosure, after obtaining the second operation data, the display device can convert the user's marking operations on the e-book terminal into data suitable for display on the display device by superimposing the second operation data onto the original media stream, making the control and annotation operations smoother.
[0163] The above are merely exemplary embodiments, but are not limited thereto. Other display methods known in the art may also be included, as long as they can make the control and annotation operations smoother.
[0164] It should be noted that in the embodiments of the present invention, certain software, components, models and other existing solutions in the industry may be mentioned. These should be regarded as exemplary and are only intended to illustrate the feasibility of implementing the technical solution of the present invention. However, they do not mean that the present invention has used or necessarily used such solutions.
[0165] Figure 8 A block diagram of an electronic device suitable for implementing a display method according to an embodiment of the present disclosure is shown schematically. Figure 8 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.
[0166] like Figure 8 As shown, a computer electronic device 800 according to an embodiment of the present disclosure includes a processor 801, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage portion 809 into a random access memory (RAM) 803. The processor 801 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or an associated chipset and / or a special-purpose microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 801 may also include onboard memory for caching purposes. The processor 801 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.
[0167] RAM 803 stores various programs and data required for the operation of electronic device 800. Processor 801, ROM 802, and RAM 803 are interconnected via bus 804.
[0168] According to embodiments of this disclosure, the electronic device 800 may further include an input / output (I / O) interface 805, which is also connected to a bus 804. The electronic device 800 may also include one or more of the following components connected to the input / output (I / O) interface 805: an input section 806 including a keyboard, mouse, etc.; an output section 807 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 808 including a hard disk, etc.; and a communication section 809 including a network interface card such as a LAN card, modem, etc. The communication section 809 performs communication processing via a network such as the Internet. A drive 810 is also connected to the input / output (I / O) interface 805 as needed. A removable medium 811, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on the drive 810 as needed so that computer programs read from it can be installed into the storage section 808 as needed.
[0169] This disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or it may exist independently and not assembled into the device / apparatus / system. The computer-readable storage medium carries one or more programs, which, when executed, implement the display method according to the embodiments of this disclosure.
[0170] In this disclosure, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
[0171] Embodiments of this disclosure also include a computer program product comprising a computer program containing program code for performing the methods provided in the embodiments of this disclosure. When the computer program product is run on an electronic device, the program code is used to enable the electronic device to implement the display methods provided in the embodiments of this disclosure.
[0172] When the computer program is executed by the processor 801, it performs the functions defined in the system / apparatus of this disclosure embodiments. According to embodiments of this disclosure, the systems, apparatuses, modules, units, etc., described above can be implemented by computer program modules.
[0173] According to embodiments of this disclosure, program code for executing computer programs provided in embodiments of this disclosure can be written in any combination of one or more programming languages.
[0174] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. It should also be noted that in some alternative implementations, the functions indicated in the boxes may occur in a different order than those shown in the drawings.
[0175] The embodiments of this disclosure have been described above. However, these embodiments are for illustrative purposes only and are not intended to limit the scope of this disclosure. Although various embodiments have been described above, this does not mean that the measures in the various embodiments cannot be used advantageously in combination. The scope of this disclosure is defined by the appended claims and their equivalents. Various substitutions and modifications can be made by those skilled in the art without departing from the scope of this disclosure, and all such substitutions and modifications should fall within the scope of this disclosure.
Claims
1. A display method, comprising: Intermediate operation data is obtained from the e-book client, wherein the intermediate operation data is obtained by processing first operation data on the e-book client. The first operation data is obtained by marking a target media stream displayed on the e-book client, and the target media stream is determined based on the original media stream displayed on the display device. The second operation data obtained by processing the intermediate operation data is sent to the display device so that the display device can overlay the second operation data onto the original media stream displayed by the display device.
2. The method according to claim 1, wherein, The e-book terminal includes multiple touch units and multiple first display units, and the display device includes multiple second display units; The second operation data is obtained in the following way: Based on the correspondence between each of the first display unit and the second display unit, the intermediate operation data is processed to obtain the second operation data, wherein the intermediate operation data is obtained by the e-book terminal processing the first operation data based on the correspondence between the touch unit and the first display unit.
3. The method according to claim 2, wherein, The intermediate operation data includes multiple first positions arranged in chronological order; The intermediate operation data is processed based on the correspondence between each of the two display units to obtain the second operation data, including: Based on the correspondence, the second position of each of the first positions is determined, and the second operation data is obtained.
4. The method according to any one of claims 1 to 3, further comprising, before obtaining intermediate operation data from the e-book terminal: In response to receiving a display request from a display device, a second communication connection is established with the display device based on the display request, wherein... The display request is triggered by the user's operation on the display device; In response to the verification of the information to be verified from the e-book client, a first communication connection is established with the e-book client; The original media stream is obtained from the display device via the second communication connection; as well as The target media stream, determined based on the original media stream, is sent to the e-book terminal via the first communication connection, so that the e-book terminal can perform tagging processing on the target media stream according to the tagging request for the target media stream to obtain the first operation data.
5. The method according to claim 4, wherein, The display request includes the device identifier of the display device; The step of establishing a first communication connection with the e-book client in response to the successful verification of the information to be verified from the e-book client includes: In response to receiving the display request, verification information is generated based on the device identifier; In response to receiving the information to be verified, the information to be verified is verified based on the verification information to obtain a verification result; and In response to the verification result indicating that the information to be verified has passed verification, the first communication connection is established.
6. The method according to claim 5, wherein, Establishing the first communication connection and the second communication connection includes: In response to receiving first communication information from the display device, a second communication connection is established, wherein the first communication information includes information related to a media session; and In response to receiving second communication information from the e-book client, the first communication connection is established, wherein the second communication information includes response information to the media session.
7. The method according to claim 1, further comprising: The original media stream obtained from the display device is processed based on at least one of a first method for implementing frame rate conversion, a second method for implementing partial refresh, and a third method for implementing grayscale optimization to obtain the target media stream; The target media stream is sent to the e-book client.
8. The method according to claim 7, wherein, The process of obtaining the target media stream based on the first method for implementing frame rate conversion includes: The original media stream is subjected to frame rate conversion to obtain the target media stream, wherein the frame rate of the original media stream is greater than the frame rate of the target media stream.
9. The method according to claim 7, wherein, The method of obtaining the target media stream based on the second approach for achieving partial refresh includes: The target media stream is obtained by partially refreshing a portion of the original media stream.
10. The method according to claim 7, wherein, The method for achieving grayscale optimization, which yields the target media stream, includes: The original media stream is input into the grayscale optimization model to obtain the target media stream; The grayscale optimization model is trained in the following way: A sample image is input into the model to be trained to obtain an output image. The sample image comprises multiple grayscale levels, each representing a brightness level of the grayscale image. The output image is an image that integrates the multiple grayscale levels. Using the image labels of the output image and the sample image, the model to be trained is trained to obtain the grayscale optimization model.
11. The method according to claim 4, wherein, The first communication connection and the second communication connection are established based on the web real-time communication protocol.
12. A display method, comprising: First operation data is obtained from the e-book client, wherein the first operation data is obtained by marking the target media stream displayed on the e-book client, and the target media stream is determined based on the original media stream displayed on the display device; and The first operation data is sent to the display device so that the display device processes the first operation data to obtain the second operation data, and then superimposes the second operation data onto the original media stream displayed by the display device.
13. The method according to claim 12, wherein, The e-book terminal includes multiple touch units and multiple first display units, and the display device includes multiple second display units; The second operation data is obtained by the display device processing intermediate operation data based on the correspondence between each of the first display unit and the second display unit; the intermediate operation data is obtained by the display device processing the first operation data based on the correspondence between the touch unit and the first display unit.
14. The method of claim 12, further comprising: The target media stream obtained from the display device is sent to the e-book terminal, wherein the target media stream is obtained by the display device processing the original media stream based on at least one of a first method for achieving frame rate conversion, a second method for achieving partial refresh, and a third method for achieving grayscale optimization.
15. The method according to claim 14, wherein, The first method for implementing frame rate conversion includes: performing frame rate conversion on the original media stream, wherein the frame rate of the original media stream is greater than the frame rate of the target media stream.
16. The method of claim 14, wherein, The second method for achieving partial refresh includes: performing partial refresh on a portion of the original media stream.
17. The method according to claim 14, wherein, The third method for achieving grayscale optimization includes: inputting the original media stream into the grayscale optimization model; The grayscale optimization model is trained in the following way: A sample image is input into the model to be trained to obtain an output image. The sample image comprises multiple grayscale levels, each representing a brightness level of the grayscale image. The output image is an image that integrates the multiple grayscale levels. Using the image labels of the output image and the sample image, the model to be trained is trained to obtain the grayscale optimization model.
18. The method according to claim 12, wherein, The first operation data is obtained based on a first communication connection with the e-book terminal, and the second operation data is sent based on a second communication connection with the display device. The first and second communication connections are established based on a web real-time communication protocol.
19. A display method, comprising: The second operational data is superimposed onto the original media stream, wherein the second operational data is obtained using the method of any one of claims 1 to 18.
20. A display system, comprising: A server is configured to acquire intermediate operation data from an e-book client, wherein the intermediate operation data is obtained by the e-book client processing first operation data, the first operation data being obtained by marking a target media stream displayed on the e-book client, the target media stream being determined based on the original media stream displayed on a display device; and to send second operation data obtained by processing the intermediate operation data to the display device. The display device is configured to, in response to receiving the second operation data, superimpose the second operation data onto the original media stream.
21. A display system, comprising: A server is configured to acquire first operation data from an e-book client, wherein the first operation data is obtained by marking a target media stream displayed on the e-book client, the target media stream being determined based on the original media stream displayed on a display device; and to send the first operation data to the display device. The display device is configured to process the first operation data to obtain second operation data; and to superimpose the second operation data onto the original media stream.
22. A computer-readable storage medium having a computer program or instructions stored thereon, characterized in that, When the computer program or instructions are executed by a processor, they implement the steps of the method according to any one of claims 1 to 19.
23. A computer program product, comprising a computer program or instructions, characterized in that, When the computer program or instructions are executed by a processor, they implement the steps of the method according to any one of claims 1 to 19.