Information processing method and device, electronic equipment and storage medium

Abstract

The invention provides an information processing method and device, electronic equipment and a storage medium, relates to the technical field of image processing, and can be used for application scenes such as generative search, intelligent document editing, intelligent assistants, virtual assistants and intelligent e-commerce. The specific implementation scheme is as follows: selecting a live broadcast material, and determining a first coordinate of the live broadcast material on a canvas after the live broadcast material is moved; converting the first coordinate to obtain a second coordinate of the live broadcast material on the canvas before the live broadcast material moves; and sending the live broadcast material, the moving information of the live broadcast material and the second coordinate to a digital human live broadcast end.

Description

Technical Field

[0001] The present disclosure relates to the field of image processing technology, and in particular to an information processing method, device, electronic device and storage medium. Background Art

[0002] In the prior art, the editor will adjust the materials used for live broadcast and send the coordinates of the adjusted materials to the digital human live broadcast platform. If the digital human live broadcast platform is not compatible with the editor's canvas, it may cause display abnormalities. Summary of the invention

[0003] The present disclosure provides an information processing method, device, electronic device and storage medium.

[0004] According to one aspect of the present disclosure, an information processing method is provided, comprising: selecting a live broadcast material, and determining a first coordinate of the live broadcast material on a canvas after the live broadcast material is moved; converting the first coordinate to obtain a second coordinate of the live broadcast material on the canvas before the live broadcast material is moved; and sending the live broadcast material, the movement information of the live broadcast material, and the second coordinate to a digital human live broadcast terminal.

[0005] According to one aspect of the present disclosure, another information processing method is provided, including: receiving the live broadcast material and the movement information and second coordinates of the live broadcast material sent by the editor; converting the second coordinates according to the movement information to obtain the first coordinates of the live broadcast material after moving on the canvas of the editor; acquiring the attribute information of the display screen of the digital human live broadcast terminal, and processing the first coordinates based on the attribute information of the display screen to obtain the target coordinates on the display screen of the live broadcast material.

[0006] According to another aspect of the present disclosure, an information processing device is provided, including: a determination module, used to select a live broadcast material and determine a first coordinate of the live broadcast material on the canvas after the live broadcast material is moved; a conversion module, used to convert the first coordinate to obtain a second coordinate of the live broadcast material on the canvas before the live broadcast material is moved; and a sending module, used to send the live broadcast material, the movement information of the live broadcast material and the second coordinate to a digital human live broadcast terminal.

[0007] According to another aspect of the present disclosure, another information processing device is provided, including: a receiving module, used to receive the live broadcast material and the movement information and second coordinates of the live broadcast material sent by the editor; a conversion module, used to convert the second coordinates according to the movement information to obtain the first coordinates of the live broadcast material after moving on the canvas of the editor; a processing module, used to obtain the attribute information of the display screen of the digital human live broadcast end, and process the first coordinates based on the attribute information of the display screen to obtain the target coordinates on the display screen of the live broadcast material.

[0008] According to another aspect of the present disclosure, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the information processing method described in the above-mentioned one aspect embodiment.

[0009] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, on which a computer program / instructions are stored, and the computer instructions are used to enable the computer to execute the information processing method described in the above-mentioned embodiment.

[0010] According to another aspect of the present disclosure, a computer program product is provided, including a computer program / instruction, wherein when the computer program / instruction is executed by a processor, the information processing method described in the above-mentioned embodiment is implemented.

[0011] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0013] Figure 1 A flowchart of an information processing method provided by an embodiment of the present disclosure;

[0014] Figure 2a A schematic diagram of a live broadcast material provided in an embodiment of the present disclosure after being rotated in a canvas;

[0015] Figure 2b A schematic diagram of a live broadcast material in a canvas before rotation provided by an embodiment of the present disclosure;

[0016] Figure 3 A flowchart of another information processing method provided by an embodiment of the present disclosure;

[0017] Figure 4 A flowchart of another information processing method provided by an embodiment of the present disclosure;

[0018] Figure 5 A flowchart of another information processing method provided by an embodiment of the present disclosure;

[0019] Figure 6 A flowchart of another information processing method provided by an embodiment of the present disclosure;

[0020] Figure 7 An interactive schematic diagram of an information processing method provided by an embodiment of the present disclosure;

[0021] Figure 8 A schematic diagram of the structure of an information processing device provided by an embodiment of the present disclosure;

[0022] Fig. 9 A schematic diagram of the structure of another information processing device provided by an embodiment of the present disclosure;

[0023] Fig.10 The present invention is a block diagram of an electronic device for implementing the information processing method according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0024] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0025] Image processing refers to the technology of using computers to analyze images to achieve the desired results. Image processing generally refers to digital image processing. Digital images refer to a large two-dimensional array obtained by shooting with industrial cameras, video cameras, scanners and other equipment. The elements of the array are called pixels, and their values ​​are called grayscale values. Image processing technology generally includes three parts: image compression, enhancement and restoration, matching, description and recognition.

[0026] The information processing method proposed in the embodiments of the present disclosure can be used in application scenarios such as generative search, intelligent document editing, intelligent assistants, virtual assistants, and intelligent e-commerce.

[0027] The following describes the information processing method, device, electronic device, and storage medium according to the embodiments of the present disclosure with reference to the accompanying drawings.

[0028] Figure 1A flowchart of an information processing method provided by an embodiment of the present disclosure.

[0029] like Figure 1 As shown, the information processing method may include:

[0030] S101, select a live broadcast material, and determine the first coordinate of the live broadcast material on the canvas after it is moved.

[0031] It should be noted that the execution subject of the information processing method in the embodiment of the present disclosure may be a hardware device with data processing capabilities and / or the necessary software required to drive the hardware device to work. Optionally, the execution subject may include a user terminal and other intelligent devices. Optionally, the user terminal includes but is not limited to a mobile phone, a computer, an intelligent voice interaction device, etc. The embodiment of the present disclosure is not specifically limited.

[0032] It is understood that live broadcast materials refer to various content elements used for display, playback or interaction during live broadcast, wherein the types of live broadcast materials include but are not limited to: video materials, audio materials, picture materials, text materials, etc. Optionally, picture materials can be used as live broadcast materials to explain the method provided in the embodiment of the present disclosure.

[0033] In some implementations, any material can be selected from a material library as live broadcast material, and / or publicly available material can be downloaded from the Internet as live broadcast material, and / or material created by a user through software or work can be used as live broadcast material.

[0034] In some implementations, the live broadcast material can be moved in the canvas of the editor, and the first coordinates of the live broadcast material after the movement in the canvas are determined. Optionally, the moving operation includes operations such as rotation and translation. Optionally, a spatial rectangular coordinate system can be established based on the canvas, and the first coordinates of the live broadcast material in the canvas can be determined according to the position of the live broadcast material after the movement.

[0035] S102, converting the first coordinate to obtain a second coordinate on the canvas before the live broadcast material is moved.

[0036] It is understandable that after the live broadcast material is moved on the canvas, the original coordinates of the live broadcast material, that is, the second coordinates before the move, will be overwritten, so it is necessary to infer the second coordinates before the move based on the first coordinates after the move.

[0037] In some implementations, the movement operation of the live broadcast material can be tracked and monitored to determine the movement amount corresponding to the movement operation, and the first coordinate is inversely transformed according to the movement amount to obtain the second coordinate before the live broadcast material moves.

[0038] For example, if a rotation operation is performed on a live broadcast material, the rotation angle of the live broadcast material can be determined, and the rotation angle is used as the movement amount corresponding to the move operation, and the first coordinate is reversely rotated based on the rotation angle to obtain the second coordinate. For example, Figure 2a The figure shows the schematic diagram of the live broadcast material after rotation in the canvas. The first coordinates are: (x1', y1'), (x2', y2'), (x3', y3'), (x4', y4'). Figure 2b The figure shows the schematic diagram of the live broadcast material in the canvas before rotation. The second coordinates are (x1, y1), (x2, y2), (x3, y3), and (x4, y4). Taking (x1', y1') as an example, by performing a reverse rotation on (x1', y1'), we can get (x1, y1), and then Figure 2a By reversely rotating the first coordinate of each vertex in Figure 2b The second coordinate of each vertex in .

[0039] S103, sending the live broadcast material, the movement information of the live broadcast material and the second coordinate to the digital human live broadcast terminal.

[0040] In some implementations, the editor obtains the second coordinate by inferring the first coordinate, and sends the live broadcast material, the movement information of the live broadcast material, and the second coordinate to the digital human live broadcast end based on the communication link between the editor and the digital live broadcast end, so that the digital human live broadcast end can determine the target coordinates displayed on the live broadcast end based on the live broadcast material, the movement information of the live broadcast material, and the second coordinate.

[0041] In some implementations, the user operates the live material by dragging the mouse, using keyboard shortcuts, etc. to move it on the canvas, and the editor can track and monitor the operation to determine the movement information of the live material. Optionally, the movement information includes but is not limited to: movement direction, movement distance, etc.

[0042] According to the information processing method provided by the embodiment of the present disclosure, the first coordinate of the live broadcast material in the canvas after the movement is obtained, and the second coordinate before the movement is inferred based on the first coordinate. By tracking and monitoring the movement operation of the live broadcast material, the movement information of the live broadcast material is obtained, and then the live broadcast material, the movement information of the live broadcast material and the second coordinate can be sent to the digital human live broadcast end, and the digital human live broadcast end performs synchronous movement of the live broadcast material to achieve synchronization of the display screen, and make the display effect of the live broadcast end the same as the effect after editing by the editor, avoiding the abnormal display problem of the live broadcast material during the live broadcast.

[0043] Figure 3 A flowchart of an information processing method provided by an embodiment of the present disclosure.

[0044] like Figure 3As shown, the information processing method may include:

[0045] S301, selecting live broadcast material.

[0046] The relevant contents of step S301 can be found in the above embodiment and will not be described again here.

[0047] S302, obtaining the layout position of the live broadcast material on the canvas.

[0048] In some implementations, the position where the mouse is clicked on the canvas can be used as the layout position of the live broadcast material. For example, after determining the live broadcast material, the live broadcast material can be added to the canvas by copying and pasting, and a position is clicked on the canvas in advance as the layout position of the live broadcast material on the canvas.

[0049] That is to say, after selecting the live broadcast material, you can use the editor to move the live broadcast material. Before the move operation, you can pre-determine the layout position of the live broadcast material on the canvas, and then determine the first coordinates of the live broadcast material after moving according to the layout position.

[0050] S303: Track the movement operation of the live broadcast material to determine the movement information of the live broadcast material.

[0051] Optionally, you can use the mouse to drag and rotate the live material on the canvas to move the live material, and by tracking and monitoring the triggering events of the mouse, you can obtain the movement information of the live material. The movement information includes: movement direction, movement distance, etc.

[0052] S304, determining the first coordinates of the live broadcast material on the canvas after the live broadcast material is moved according to the movement information, the layout position and the attribute information of the live broadcast material.

[0053] In some implementations, the attribute information of the live broadcast material may be physical information of the live broadcast material, such as the height and width of the live broadcast material. Optionally, the attribute information of the live broadcast material may also be identification information of the live broadcast material, and the height and width of the live broadcast material may be determined based on the identification information.

[0054] In some implementations, the original position coordinates of the live broadcast material on the canvas can be determined based on the layout position and attribute information of the live broadcast material, and then the movement direction and distance can be determined based on the movement information, and the original position coordinates can be mathematically calculated to obtain the first coordinates of the live broadcast material on the canvas after movement.

[0055] By way of example, the margin between the live broadcast material and the canvas and other information can be determined based on the layout position of the live broadcast material, and then the width and height of the live broadcast material can be determined based on the attribute information of the live broadcast material. Based on the margin, width and height, the original position coordinates of the live broadcast material on the canvas can be calculated, and the first coordinate can be calculated based on the moving direction and moving distance.

[0056] Optionally, if a rotation operation is performed on the live broadcast material, by determining the rotation matrix, the first coordinate can be calculated based on the original position coordinate and the rotation matrix.

[0057] S305: Convert the first coordinate to obtain the second coordinate of the live broadcast material on the canvas before it is moved.

[0058] S306, sending the live broadcast material, the movement information of the live broadcast material and the second coordinate to the digital human live broadcast terminal.

[0059] The relevant contents of steps S305-S306 can be found in the above embodiment and will not be repeated here.

[0060] According to the information processing method provided by the embodiment of the present disclosure, by determining the layout position of the live broadcast material on the canvas and monitoring the movement information of the live broadcast material, the first coordinate of the live broadcast material in the canvas after the movement is determined according to the layout position and the movement information, and the second coordinate before the movement is inferred based on the first coordinate. By tracking and monitoring the movement operation of the live broadcast material, the movement information of the live broadcast material is obtained, and then the live broadcast material, the movement information of the live broadcast material and the second coordinate can be sent to the digital human live broadcast end, and the digital human live broadcast end performs synchronous movement of the live broadcast material to achieve synchronization of the display screen, and makes the display effect of the live broadcast end the same as the effect after editing by the editor, avoiding the abnormal display problem of the live broadcast material during the live broadcast.

[0061] Figure 4 A flowchart of an information processing method provided by an embodiment of the present disclosure.

[0062] like Figure 4 As shown, the information processing method may include:

[0063] S401, selecting a live broadcast material, and determining a first coordinate of the live broadcast material on the canvas after it is moved.

[0064] The relevant contents of step S401 can be found in the above embodiment and will not be described again here.

[0065] S402: Determine the center coordinates of the first center point of the live broadcast material after it is moved according to the first coordinates.

[0066] In some implementations, taking picture material as an example, the central intersection of the picture material in the horizontal and vertical directions can be used as the center point, and the center coordinates of the first center point after the live broadcast material is moved can be determined based on the first coordinates, so that the first coordinates can be moved in reverse according to the center coordinates to obtain the second coordinates.

[0067] Optionally, multiple reference points of the live broadcast material may be determined, and the center coordinates of the first center point may be determined according to the first coordinates of the multiple reference points. Figure 2a As shown, the four vertices of the live broadcast material after the move can be used as reference points, and the reference points are averaged to obtain the center coordinates of the first center point. The coordinates of the reference points of the live broadcast material are (x1', y1'), (x2', y2'), (x3', y3'), (x4', y4'), and the center point coordinates are (x1'+x2'+x3'+x4' / 4, y1'+y2'+y3'+y4' / 4).

[0068] Optionally, the central coordinates of the first center point can be determined by determining the attribute information of the live broadcast material and the first coordinates of the target reference point, and according to the attribute information and the first coordinates of the target reference point. For example, the target reference point can be determined from a plurality of candidate reference points, and the width and height of the live broadcast material can be obtained from the attribute information, and the central coordinates can be calculated based on the first coordinates of the target reference point and the width and height of the live broadcast material.

[0069] S403: According to the center coordinate of the first center point, the first coordinate is converted to obtain the second coordinate of the live broadcast material on the canvas.

[0070] In some implementations, the first coordinate is converted according to the center coordinate, so that the accuracy and consistency of the coordinates can be ensured during the conversion process to avoid errors. Optionally, the rotation angle of the live material can be determined according to the movement information, and the rotation matrix can be determined based on the rotation angle. For example, if the rotation angle is θ, the rotation matrix is ​​(sinθ, cosθ).

[0071] Furthermore, the target reference point in the live broadcast material is determined, and the first coordinate of the target reference point of the live broadcast material is transformed according to the rotation matrix and the center coordinates to determine the second coordinate of the target reference point on the canvas before it moves. In other words, the first coordinates of multiple different target reference points in the live broadcast material are transformed to obtain the second coordinate of the live broadcast material on the canvas.

[0072] Optionally, the third coordinate of the target reference point may be obtained according to the first coordinate and the center coordinate of the target reference point, and the third coordinate of the target reference point may be rotated based on the rotation matrix to obtain the fourth coordinate of the target reference point.

[0073] Furthermore, by determining the translation amount of the live broadcast material and translating the fourth coordinate of the target reference point based on the translation amount, the second coordinate of the target reference point on the canvas before the movement is obtained.

[0074] For example, if the first coordinate of the target reference point is (x1', y1'), and the center coordinate is (cx, cy), then the third coordinate of the target reference point is (x1'-cx, y1'-cy). If the rotation matrix is ​​(sinθ, cosθ), then the abscissa of the fourth coordinate of the target reference point is (x1'-cx)cosθ-(y1'-cy)sinθ, and the ordinate is (x1'-cx)sinθ+(y1'-cy)cosθ.

[0075] Optionally, in order to clarify the moving distance, that is, the translation amount, of the live broadcast material, the translation amount of the live broadcast material may be determined based on the movement information, or the translation amount of the live broadcast material may be determined based on the center coordinates.

[0076] Based on the above example, the center coordinates can be used as the translation amount of the moving material, then the second coordinates (x, y) of the target reference point are: x = (x1'-cx)cosθ-(y1'-cy)sinθ+cx; y = (x1'-cx)sinθ+(y1'-cy)cosθ+cy.

[0077] S404, sending the live broadcast material, the movement information of the live broadcast material and the second coordinate to the digital human live broadcast terminal.

[0078] The relevant contents of step S404 can be found in the above embodiment and will not be described again here.

[0079] According to the information processing method provided by the embodiment of the present disclosure, by obtaining the first coordinate of the live broadcast material in the canvas after the movement, and determining the center coordinate of the live broadcast material based on the first coordinate, the first coordinate can be converted according to the center coordinate to determine the second coordinate before the movement, so as to improve the accuracy of the conversion process. By tracking and monitoring the movement operation of the live broadcast material, the movement information of the live broadcast material can be obtained, and then the live broadcast material, the movement information of the live broadcast material and the second coordinate can be sent to the digital human live broadcast end, and the digital human live broadcast end can perform synchronous movement of the live broadcast material to achieve synchronization of the display screen, and make the display effect of the live broadcast end the same as the effect after editing by the editor, so as to avoid the abnormal display problem of the live broadcast material during the live broadcast.

[0080] Figure 5 A flowchart of an information processing method provided by an embodiment of the present disclosure.

[0081] like Figure 5 As shown, the information processing method may include:

[0082] S501, receiving the live broadcast material, the movement information of the live broadcast material and the second coordinate sent by the editor.

[0083] It should be noted that the execution subject of the information processing method in the embodiment of the present disclosure may be a hardware device with data processing capabilities and / or the necessary software required to drive the hardware device to work. Optionally, the execution subject may include a user terminal. Optionally, the user terminal includes but is not limited to a mobile phone, a computer, an intelligent voice interaction device, a live broadcast terminal, etc. The embodiment of the present disclosure is not specifically limited.

[0084] In some implementations, the digital human live broadcast terminal can receive the live broadcast material, the movement information of the live broadcast material, and the second coordinates sent by the editor based on the communication link between it and the editor, so as to determine the first coordinates of the live broadcast material after movement according to the movement information and the second coordinates.

[0085] S502: Convert the second coordinate according to the movement information to obtain the first coordinate of the live broadcast material after the movement on the canvas of the editor.

[0086] In some implementations, the accuracy of the conversion process can be ensured. The center coordinates of the live broadcast material can be determined based on the second coordinates, and the second coordinates can be converted based on the center coordinates and movement information to obtain the first coordinates of the live broadcast material on the editor's canvas.

[0087] S503, obtaining the attribute information of the display screen of the digital human live broadcast terminal, and processing the first coordinate based on the attribute information of the display screen to obtain the target coordinate on the live broadcast material display screen.

[0088] In some implementations, the first coordinates can be scaled according to the screen ratio of the digital human live broadcast terminal to obtain the target coordinates of the live broadcast material that adapts to the display screen of the digital human live broadcast terminal, so that the display effect of the digital human live broadcast terminal is the same as the editing effect of the editor.

[0089] Optionally, the width value of the display screen can be determined according to the attribute information of the display screen, and the horizontal coordinate value in the first coordinate can be adjusted based on the width value of the display screen to obtain the horizontal coordinate value in the target coordinate, and then the height value of the display screen can be determined according to the attribute information, and the horizontal coordinate value in the first coordinate can be adjusted based on the height value of the display screen to obtain the vertical coordinate value in the target coordinate.

[0090] For example, let the first coordinate of the live broadcast material be (x1, y1), the width of the display screen of the digital human live broadcast terminal be canvasW, and the height be canvasH, then the target coordinate is (x1 / canvasW, y1 / canvasH).

[0091] In some implementations, after obtaining the target coordinates of the live broadcast material on the display screen, the live broadcast material can be laid out on the display screen according to the target coordinates of the live broadcast material, and the live broadcast material and the digital human can be synthesized to generate a live video frame for playback on the live broadcast end, thereby achieving synchronization between the live broadcast end and the editor.

[0092] According to the information processing method provided by the embodiment of the present disclosure, by receiving the live broadcast material, the movement information of the live broadcast material and the second coordinate, and converting the second coordinate according to the movement information, the first coordinate after moving on the canvas of the editor is obtained, and then according to the display ratio of the digital human live broadcast end, the first coordinate is adjusted to obtain the target coordinate, so as to achieve synchronization of the display screen, and make the display effect of the live broadcast end the same as the effect after editing by the editor, so as to avoid the abnormal display problem of the live broadcast material during the live broadcast.

[0093] Figure 6 A flowchart of an information processing method provided by an embodiment of the present disclosure.

[0094] like Figure 6 As shown, the information processing method may include:

[0095] S601, receiving the live broadcast material, the movement information of the live broadcast material and the second coordinate sent by the editor.

[0096] The relevant contents of step S601 can be found in the above embodiment and will not be repeated here.

[0097] S602: Determine the center coordinates of the second center point of the live broadcast material according to the second coordinates.

[0098] In some implementations, in order to ensure the accuracy and consistency of the coordinates during the conversion process and avoid conversion errors, the center coordinates of the second center point of the live material before moving can be determined. Optionally, the center coordinates of the second center point can be determined by determining multiple reference points of the live material and according to the second coordinates of the multiple reference points. Figure 2b As shown, the four vertices of the live broadcast material before moving can be used as reference points, and the reference points are averaged to obtain the center coordinates of the second center point. Figure 2b The coordinates of the reference points of the live broadcast material are (x1, y1), (x2, y2), (x3, y3), and (x4, y4), respectively, so the coordinates of the center point are (x1+x2+x3+x4 / 4, y1+y2+y3+y4 / 4).

[0099] Optionally, the central coordinates of the second center point can be determined by determining the attribute information of the live broadcast material and the second coordinates of the target reference point, and according to the attribute information and the second coordinates of the target reference point. For example, the target reference point can be determined from a plurality of candidate reference points, and the width and height of the live broadcast material can be obtained from the attribute information. Based on the second coordinates of the target reference point and the width and height of the live broadcast material, the central coordinates of the second center point can be calculated.

[0100] S603: Determine the rotation angle of the live broadcast material according to the movement information.

[0101] In some implementations, the movement information is obtained by monitoring the movement operation of the live material, and the translation direction, translation distance, rotation direction, rotation angle and other information of the live material can be determined from the movement information. In other words, by parsing the movement information, the rotation angle of the live material can be determined. If the movement information carries the rotation angle, it is determined that the live material has been rotated.

[0102] S604: Determine the first coordinates of the live broadcast material based on the rotation angle, the second coordinates and the center coordinates of the second center point.

[0103] In some implementations, the target reference point of the live broadcast material can be determined, and the target reference point is reversely rotated around the second center point to obtain the first coordinate of the target reference point. For example, the rotation angle is 30 degrees, the second coordinate of the target reference point is (px, py), the center coordinate of the second center point is (ox, oy), and (px, py) is reversely rotated 30 degrees around (ox, oy) to obtain the first coordinate of the target reference point.

[0104] Optionally, a rotation matrix may be determined based on the rotation angle, and the second coordinate may be transformed based on the rotation matrix to obtain the first coordinate.

[0105] S605, obtaining the attribute information of the display screen of the digital human live broadcast terminal, and processing the first coordinate based on the attribute information of the display screen to obtain the target coordinate on the live broadcast material display screen.

[0106] The relevant contents of step S605 can be found in the above embodiment and will not be repeated here.

[0107] According to the information processing method provided by the embodiment of the present disclosure, by receiving the live broadcast material, the movement information of the live broadcast material and the second coordinate, and determining the center coordinate of the second center point of the live broadcast material according to the second coordinate, and then determining the rotation angle according to the movement information, the second coordinate is converted according to the rotation angle and the center coordinate to obtain the first coordinate after moving on the canvas of the editor, and then according to the display ratio of the digital human live broadcast end, the first coordinate is adjusted to obtain the target coordinate to achieve synchronization of the display screen, and make the display effect of the live broadcast end the same as the effect after editing of the editor, so as to avoid abnormal display of the live broadcast material during live broadcast.

[0108] Figure 7 Shown is an interactive schematic diagram of the information processing method.

[0109] like Figure 7 As shown, the information processing method may include:

[0110] S701, the editor determines the first coordinate of the live broadcast material on the canvas after being moved.

[0111] S702: The editor converts the first coordinates to obtain the second coordinates of the live broadcast material on the canvas before it is moved.

[0112] S703, the editor sends the live broadcast material, the movement information of the live broadcast material and the second coordinate to the digital human live broadcast terminal.

[0113] S704, the digital human live broadcast terminal converts the second coordinate according to the movement information to obtain the first coordinate of the live broadcast material after it is moved on the canvas of the editor.

[0114] S705, the digital human live broadcast terminal processes the first coordinate based on the attribute information of the display screen to obtain the target coordinate on the live broadcast material display screen.

[0115] According to the information processing method provided by the embodiment of the present disclosure, the first coordinate of the live broadcast material in the canvas after the movement is obtained, and the second coordinate before the movement is inferred based on the first coordinate. By tracking and monitoring the movement operation of the live broadcast material, the movement information of the live broadcast material is obtained, and then the live broadcast material, the movement information of the live broadcast material and the second coordinate can be sent to the digital human live broadcast end, and the digital human live broadcast end performs synchronous movement of the live broadcast material to achieve synchronization of the display screen, and make the display effect of the live broadcast end the same as the effect after editing by the editor, avoiding the abnormal display problem of the live broadcast material during the live broadcast.

[0116] Corresponding to the information processing methods provided in the above-mentioned embodiments, an embodiment of the present disclosure further provides an information processing device. Since the information processing device provided in the embodiment of the present disclosure corresponds to the information processing methods provided in the above-mentioned embodiments, the implementation methods of the above-mentioned information processing methods are also applicable to the information processing device provided in the embodiment of the present disclosure and will not be described in detail in the following embodiments.

[0117] Figure 8 A schematic diagram of the structure of an information processing device provided in an embodiment of the present disclosure.

[0118] like Figure 8 As shown, the information processing device 800 of the embodiment of the present disclosure includes a determination module 801, a conversion module 802 and a sending module 803.

[0119] The determination module 801 is used to select a live broadcast material and determine a first coordinate of the live broadcast material on the canvas after the live broadcast material is moved;

[0120] A conversion module 802, configured to convert the first coordinate to obtain a second coordinate on the canvas before the live broadcast material is moved;

[0121] The sending module 803 is used to send the live broadcast material, the movement information of the live broadcast material and the second coordinate to the digital human live broadcast terminal.

[0122] In one embodiment of the present disclosure, the determination module 801 is further used to: obtain the layout position of the live broadcast material on the canvas; track the movement operation of the live broadcast material to determine the movement information of the live broadcast material; and determine the first coordinate of the live broadcast material on the canvas after the movement according to the movement information, the layout position and the attribute information of the live broadcast material.

[0123] In one embodiment of the present disclosure, the conversion module 802 is further used to: determine the center coordinates of the first center point of the live broadcast material after the movement according to the first coordinates; and convert the first coordinates according to the center coordinates of the first center point to obtain the second coordinates of the live broadcast material on the canvas.

[0124] In one embodiment of the present disclosure, the conversion module 802 is also used to: determine multiple reference points of the live broadcast material, and determine the center coordinates of the first center point based on the first coordinates of the multiple reference points; or determine the attribute information of the live broadcast material and the first coordinates of the target reference point, and determine the center coordinates of the first center point based on the attribute information and the first coordinates of the target reference point.

[0125] In one embodiment of the present disclosure, the conversion module 802 is also used to: determine the rotation angle of the live broadcast material according to the movement information, and determine the rotation matrix based on the rotation angle; transform the first coordinate of the target reference point of the live broadcast material according to the rotation matrix and the center coordinates, and determine the second coordinate of the target reference point on the canvas before moving.

[0126] In one embodiment of the present disclosure, the conversion module 802 is also used to: obtain a third coordinate of the target reference point based on the first coordinate of the target reference point and the center coordinate; rotate the third coordinate of the target reference point based on the rotation matrix to obtain a fourth coordinate of the target reference point; determine the translation amount of the live broadcast material, and translate the fourth coordinate of the target reference point based on the translation amount to obtain the second coordinate of the target reference point on the canvas before the movement.

[0127] In one embodiment of the present disclosure, the conversion module 802 is further used to: determine the translation amount of the live broadcast material according to the movement information; or determine the translation amount of the live broadcast material according to the center coordinates.

[0128] According to the information processing device provided by the embodiment of the present disclosure, the first coordinate of the live broadcast material in the canvas after the movement is obtained, and the second coordinate before the movement is inferred based on the first coordinate. By tracking and monitoring the movement operation of the live broadcast material, the movement information of the live broadcast material is obtained, and then the live broadcast material, the movement information of the live broadcast material and the second coordinate can be sent to the digital human live broadcast end, and the digital human live broadcast end performs synchronous movement of the live broadcast material to achieve synchronization of the display screen, and make the display effect of the live broadcast end the same as the effect after editing by the editor, avoiding the abnormal display problem of the live broadcast material during the live broadcast.

[0129] Fig. 9 A schematic diagram of the structure of an information processing device provided in an embodiment of the present disclosure.

[0130] like Fig. 9 As shown, the information processing device 900 of the embodiment of the present disclosure includes a receiving module 901, a conversion module 902 and a processing module 903.

[0131] A receiving module 901 is used to receive the live broadcast material and the movement information and second coordinates of the live broadcast material sent by the editor;

[0132] A conversion module 902, configured to convert the second coordinate according to the movement information to obtain a first coordinate of the live broadcast material after the live broadcast material is moved on the canvas of the editor;

[0133] The processing module 903 is used to obtain the attribute information of the display screen of the digital human live broadcast terminal, and process the first coordinate based on the attribute information of the display screen to obtain the target coordinate on the live broadcast material display screen.

[0134] In one embodiment of the present disclosure, the processing module 903 is also used to: determine the width value of the display screen according to the attribute information of the display screen, and adjust the horizontal coordinate value in the first coordinate based on the width value of the display screen to obtain the horizontal coordinate value in the target coordinate; determine the height value of the display screen according to the attribute information, and adjust the horizontal coordinate value in the first coordinate based on the height value of the display screen to obtain the vertical coordinate value in the target coordinate.

[0135] In one embodiment of the present disclosure, the conversion module 902 is also used to: determine the center coordinates of the second center point of the live broadcast material according to the second coordinates; determine the rotation angle of the live broadcast material according to the movement information; and determine the first coordinates of the live broadcast material based on the rotation angle, the second coordinates and the center coordinates of the second center point.

[0136] In one embodiment of the present disclosure, the conversion module 902 is also used to: determine multiple reference points of the live broadcast material, and determine the center coordinates of the second center point based on the second coordinates of the multiple reference points; or determine the attribute information of the live broadcast material and the second coordinates of the target reference point, and determine the center coordinates of the second center point based on the attribute information and the second coordinates of the target reference point.

[0137] In one embodiment of the present disclosure, the processing module 903 is further used to: layout the live broadcast material on the display screen according to the target coordinates of the live broadcast material, and synthesize the live broadcast material and the digital human to generate a picture frame of the live broadcast video.

[0138] According to the information processing device provided by the embodiment of the present disclosure, by receiving the live broadcast material, the movement information of the live broadcast material and the second coordinate, and converting the second coordinate according to the movement information, the first coordinate after moving on the canvas of the editor is obtained, and then according to the display ratio of the digital human live broadcast end, the first coordinate is adjusted to obtain the target coordinate, so as to achieve synchronization of the display screen and make the display effect of the live broadcast end the same as the effect after editing by the editor, so as to avoid the abnormal display problem of the live broadcast material during the live broadcast.

[0139] In the technical solution disclosed herein, the acquisition, storage and application of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0140] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0141] Fig.10 A schematic block diagram of an example electronic device 1000 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0142] like Fig.10 As shown, the device 1000 includes a computing unit 1001, which can perform various appropriate actions and processes according to a computer program / instruction stored in a read-only memory (ROM) 1002 or a computer program / instruction loaded from a storage unit 1006 to a random access memory (RAM) 1003. In the RAM 1003, various programs and data required for the operation of the device 1000 can also be stored. The computing unit 1001, the ROM 1002, and the RAM 1003 are connected to each other via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0143] A number of components in the device 1000 are connected to the I / O interface 1005, including: an input unit 1006 such as a keyboard, a mouse, etc.; an output unit 1007 such as various types of displays, speakers, etc.; a storage unit 1008 such as a disk, an optical disk, etc.; and a communication unit 1009 such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1009 allows the device 1000 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0144] The computing unit 1001 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 1001 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1001 performs the various methods and processes described above, such as information processing methods. For example, in some embodiments, the information processing method may be implemented as a computer software program, which is tangibly included in a machine-readable medium, such as a storage unit 1006. In some embodiments, part or all of the computer program / instructions may be loaded and / or installed on the device 1000 via the ROM 1002 and / or the communication unit 1009. When the computer program / instructions are loaded into the RAM 1003 and executed by the computing unit 1001, one or more steps of the information processing method described above may be performed. Alternatively, in other embodiments, the computing unit 1001 may be configured to execute the information processing method in any other appropriate manner (eg, by means of firmware).

[0145] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs / instructions that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0146] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0147] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0148] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0149] The systems and techniques described herein can be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), the Internet, and a blockchain network.

[0150] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs / instructions running on respective computers and having a client-server relationship with each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.

[0151] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in the disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in the disclosure can be achieved, and this document does not limit them here.

[0152] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. An information processing method, wherein: The method comprises: Selecting a live broadcast material, and determining a first coordinate of the live broadcast material on the canvas after the live broadcast material is moved; Converting the first coordinate to obtain a second coordinate of the live broadcast material on the canvas before it is moved; The live broadcast material, the movement information of the live broadcast material and the second coordinate are sent to the digital human live broadcast terminal.

2. The method according to claim 1, wherein: The determining of the first coordinate of the live broadcast material on the canvas after the movement also includes: Obtaining the layout position of the live broadcast material on the canvas; Tracking the movement operation of the live broadcast material to determine the movement information of the live broadcast material; According to the movement information, the layout position and the attribute information of the live broadcast material, the first coordinates of the live broadcast material on the canvas after the movement are determined.

3. The method according to claim 1, wherein: The converting the first coordinate to obtain the second coordinate of the live broadcast material on the canvas before the live broadcast material is moved includes: Determine the center coordinates of a first center point of the live broadcast material after the movement according to the first coordinates; According to the center coordinates of the first center point, the first coordinates are converted to obtain second coordinates of the live broadcast material on the canvas.

4. The method according to claim 3, wherein: Determining the center coordinates of the first center point of the live broadcast material after the movement according to the first coordinates includes: Determine a plurality of reference points of the live broadcast material, and determine the center coordinates of the first center point according to the first coordinates of the plurality of reference points; or, Determine the attribute information of the live broadcast material and the first coordinates of the target reference point, and determine the center coordinates of the first center point according to the attribute information and the first coordinates of the target reference point.

5. The method according to claim 3, wherein: The converting the first coordinate according to the center coordinate of the first center point to obtain the second coordinate of the live broadcast material on the canvas includes: Determine a rotation angle of the live broadcast material according to the movement information, and determine a rotation matrix based on the rotation angle; According to the rotation matrix and the center coordinates, the first coordinates of the target reference point of the live broadcast material are transformed to determine the second coordinates of the target reference point on the canvas before it moves.

6. The method according to claim 5, wherein: The converting the first coordinate of the target reference point of the live broadcast material according to the rotation matrix and the center coordinate to determine the second coordinate of the target reference point on the canvas before the movement includes: Obtaining a third coordinate of the target reference point according to the first coordinate of the target reference point and the center coordinate; Rotate the third coordinate of the target reference point based on the rotation matrix to obtain a fourth coordinate of the target reference point; The translation amount of the live broadcast material is determined, and the fourth coordinate of the target reference point is translated based on the translation amount to obtain the second coordinate of the target reference point on the canvas before the movement.

7. The method according to claim 6, wherein: The determining the translation amount of the live broadcast material includes: Determine the translation amount of the live broadcast material according to the movement information; or, The translation amount of the live broadcast material is determined according to the center coordinates.

8. An information processing method, wherein: The method comprises: Receiving the live broadcast material, the movement information of the live broadcast material and the second coordinate sent by the editor; The second coordinate is converted according to the movement information to obtain a first coordinate of the live broadcast material after the live broadcast material is moved on the canvas of the editor; The attribute information of the display screen of the digital human live broadcast terminal is obtained, and the first coordinate is processed based on the attribute information of the display screen to obtain the target coordinate on the live broadcast material display screen.

9. The method according to claim 8, wherein: The processing of the first coordinates based on the attribute information of the display screen to obtain the target coordinates on the live material display screen includes: Determine a width value of the display screen according to the attribute information of the display screen, and adjust the horizontal coordinate value in the first coordinate based on the width value of the display screen to obtain the horizontal coordinate value in the target coordinate; According to the attribute information, the height value of the display screen is determined, and based on the height value of the display screen, the horizontal coordinate value in the first coordinate is adjusted to obtain the vertical coordinate value in the target coordinate.

10. The method according to claim 9, wherein: The converting the second coordinate according to the movement information to obtain the first coordinate of the live broadcast material after the movement on the canvas of the editor includes: Determine the center coordinates of the second center point of the live broadcast material according to the second coordinates; Determining a rotation angle of the live broadcast material according to the movement information; Based on the rotation angle, the second coordinates and the center coordinates of the second center point, the first coordinates of the live broadcast material are determined.

11. The method according to claim 10, wherein: Determining the center coordinates of the second center point of the live broadcast material according to the second coordinates includes: Determine a plurality of reference points of the live broadcast material, and determine the center coordinates of the second center point according to the second coordinates of the plurality of reference points; or, Determine the attribute information of the live broadcast material and the second coordinates of the target reference point, and determine the center coordinates of the second center point based on the attribute information and the second coordinates of the target reference point.

12. The method according to any one of claims 8 to 11, characterized in that After the first coordinates are processed based on the attribute information of the display screen to obtain the target coordinates on the live material display screen, the method further includes: According to the target coordinates of the live broadcast material, the live broadcast material is laid out on the display screen, and the live broadcast material and the digital human are synthesized to generate a picture frame of the live broadcast video.

13. An information processing device, wherein: The device comprises: A determination module, used for selecting a live broadcast material and determining a first coordinate of the live broadcast material on the canvas after being moved; A conversion module, used for converting the first coordinate to obtain a second coordinate of the live broadcast material on the canvas before it is moved; The sending module is used to send the live broadcast material, the movement information of the live broadcast material and the second coordinate to the digital human live broadcast terminal.

14. The device according to claim 13, wherein: The determining module is further used for: Obtaining the layout position of the live broadcast material on the canvas; Tracking the movement operation of the live broadcast material to determine the movement information of the live broadcast material; According to the movement information, the layout position and the attribute information of the live broadcast material, the first coordinates of the live broadcast material on the canvas after the movement are determined.

15. The device according to claim 13, wherein: The conversion module is further used for: Determine the center coordinates of a first center point of the live broadcast material after the movement according to the first coordinates; According to the center coordinates of the first center point, the first coordinates are converted to obtain second coordinates of the live broadcast material on the canvas.

16. The device according to claim 15, wherein: The conversion module is further used for: Determine a plurality of reference points of the live broadcast material, and determine the center coordinates of the first center point according to the first coordinates of the plurality of reference points; or, Determine the attribute information of the live broadcast material and the first coordinates of the target reference point, and determine the center coordinates of the first center point according to the attribute information and the first coordinates of the target reference point.

17. The device according to claim 15, wherein: The conversion module is further used for: Determine a rotation angle of the live broadcast material according to the movement information, and determine a rotation matrix based on the rotation angle; According to the rotation matrix and the center coordinates, the first coordinates of the target reference point of the live broadcast material are transformed to determine the second coordinates of the target reference point on the canvas before it moves.

18. The device according to claim 17, wherein: The conversion module is further used for: Obtaining a third coordinate of the target reference point according to the first coordinate of the target reference point and the center coordinate; Rotate the third coordinate of the target reference point based on the rotation matrix to obtain a fourth coordinate of the target reference point; The translation amount of the live broadcast material is determined, and the fourth coordinate of the target reference point is translated based on the translation amount to obtain the second coordinate of the target reference point on the canvas before the movement.

19. The device according to claim 18, wherein: The conversion module is further used for: Determine the translation amount of the live broadcast material according to the movement information; or, The translation amount of the live broadcast material is determined according to the center coordinates.

20. An information processing device, wherein: The device comprises: A receiving module, used for receiving the live broadcast material and the movement information and the second coordinates of the live broadcast material sent by the editor; A conversion module, used for converting the second coordinate according to the movement information to obtain a first coordinate of the live broadcast material after the movement on the canvas of the editor; The processing module is used to obtain the attribute information of the display screen of the digital human live broadcast terminal, and process the first coordinate based on the attribute information of the display screen to obtain the target coordinate on the live broadcast material display screen.

21. The device according to claim 20, wherein: The processing module is further used for: Determine a width value of the display screen according to the attribute information of the display screen, and adjust the horizontal coordinate value in the first coordinate based on the width value of the display screen to obtain the horizontal coordinate value in the target coordinate; According to the attribute information, the height value of the display screen is determined, and based on the height value of the display screen, the horizontal coordinate value in the first coordinate is adjusted to obtain the vertical coordinate value in the target coordinate.

22. The device according to claim 21, wherein The conversion module is further used for: Determine the center coordinates of the second center point of the live broadcast material according to the second coordinates; Determining a rotation angle of the live broadcast material according to the movement information; Based on the rotation angle, the second coordinates and the center coordinates of the second center point, the first coordinates of the live broadcast material are determined.

23. The device according to claim 22, wherein: The conversion module is further used for: Determine a plurality of reference points of the live broadcast material, and determine the center coordinates of the second center point according to the second coordinates of the plurality of reference points; or, Determine the attribute information of the live broadcast material and the second coordinates of the target reference point, and determine the center coordinates of the second center point based on the attribute information and the second coordinates of the target reference point.

24. The device according to any one of claims 20 to 23, characterized in that The processing module is further used for: According to the target coordinates of the live broadcast material, the live broadcast material is laid out on the display screen, and the live broadcast material and the digital human are synthesized to generate a picture frame of the live broadcast video.

25. An electronic device comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 12.

26. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-12.

27. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instructions are executed by a processor, the method according to any one of claims 1 to 12 is implemented.

Images