Role-based information interaction methods, devices, storage media, and program products
By capturing and synthesizing video footage and adding special effects props, the problem of monotonous character information interaction in online games has been solved, enhancing the game's fun and user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-08
- Publication Date
- 2026-03-13
AI Technical Summary
The information interaction between different characters in existing online games is too simplistic, failing to present rich content to users and affecting the game's fun and user experience.
It captures video footage for facial recognition, loads special effects props, synthesizes and displays multiple character images, and provides rich information interaction methods by loading special effects onto facial information in the footage.
It enhances the game's fun and user experience by receiving real-time video feeds and loading effects from other users, providing richer interactive content.
Smart Images

Figure CN116077946B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of communication technology, and in particular to a role information interaction method, device, storage medium, and program product. Background Technology
[0002] Playing online games is a common way for people to relax and relieve stress. Games may involve multiple characters, and the design of information interaction between different characters is an important factor affecting game quality and user experience.
[0003] In existing technologies, different characters in games typically interact with each other using voice or text.
[0004] However, the above solutions only use voice or text to facilitate communication between characters, which is too simplistic and fails to provide users with rich content, thus affecting the fun of the game and resulting in a poor user experience. Summary of the Invention
[0005] This disclosure provides a method, device, storage medium, and program product for character information interaction, in order to overcome the problem that in existing online games, the interaction between different characters is limited to a single form, failing to present rich content to users, thus affecting the fun of the game and resulting in a poor user experience.
[0006] In a first aspect, embodiments of this disclosure provide a role information interaction method applied to a terminal device, the method comprising:
[0007] The system captures video footage and performs facial recognition on the video footage to obtain the user's facial information.
[0008] Retrieve the special effects props corresponding to the target character selected by the user, and apply special effects to the portrait information according to the special effects props to obtain the user's first character image, and send the first character image to the server;
[0009] Retrieve at least one second character image sent by another user from the server, combine the second character image with the first character image, and push the combined image to the display interface for display.
[0010] Secondly, embodiments of this disclosure provide a role information interaction device, including:
[0011] The recognition module is used to capture video footage and perform facial recognition on the video footage to obtain the user's facial information;
[0012] The loading module is used to retrieve the special effects props corresponding to the target character selected by the user, and to load the special effects onto the portrait information according to the special effects props to obtain the user's first character image, and send the first character image to the server.
[0013] The composite display module is used to retrieve at least one second character image sent by another user from the server, composite the second character image with the first character image, and push the composite image to the display interface for display.
[0014] Thirdly, embodiments of this disclosure provide an electronic device, including a vision sensor, a processor, a memory, a display, and a transceiver;
[0015] The vision sensor, the processor, the memory, the display, and the transceiver circuit are interconnected;
[0016] The memory stores computer-executed instructions; the vision sensor is used to capture video images; the transceiver is used to send and receive data with the server; and the display is used to display the composite image.
[0017] The processor executes computer execution instructions stored in the memory, causing the processor to perform the role information interaction method as described in the first aspect and various possible designs of the first aspect.
[0018] Fourthly, embodiments of this disclosure provide a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the role information interaction method described in the first aspect and various possible designs of the first aspect.
[0019] Fifthly, embodiments of this disclosure provide a computer program product, including a computer program that, when executed by a processor, implements the role information interaction method described in the first aspect and various possible designs of the first aspect.
[0020] This embodiment provides a method, device, storage medium, and program product for character information interaction. The method includes capturing video footage and performing facial recognition on the video footage to obtain the user's facial information; retrieving special effects props corresponding to the user-selected target character; applying special effects to the facial information based on the special effects props to obtain a first character image; sending the first character image to a server; retrieving at least one second character image sent by another user from the server; merging the second character image and the first character image; and pushing the merged image to a display interface for display. This character information interaction method allows users to receive real-time video footage from other users, and by adding special effects to the facial information in the footage, it provides users with richer information, thereby increasing the game's fun and improving the user experience. Receiving real-time video footage from other users and adding special effects to the facial information in the footage provides users with richer information, thereby increasing the game's fun and improving the user experience. Attached Figure Description
[0021] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0022] Figure 1 This is a schematic diagram illustrating an application scenario of the role information interaction method provided in the embodiments of this disclosure;
[0023] Figure 2 Flowchart of the role information interaction method provided in this embodiment of the disclosure Figure 1 ;
[0024] Figure 3 A schematic diagram of the character screen after loading special effects, provided in an embodiment of this disclosure;
[0025] Figure 4 A schematic diagram of a face shape provided for an embodiment of this disclosure;
[0026] Figure 5 Flowchart of the role information interaction method provided in this embodiment of the disclosure Figure 2 ;
[0027] Figure 6 A schematic diagram of a display interface provided in an embodiment of this disclosure;
[0028] Figure 7 This is a schematic diagram of an online murder mystery game process provided by an embodiment of the present disclosure;
[0029] Figure 8 This is a schematic diagram illustrating the display of a template list in a display interface provided in an embodiment of this disclosure;
[0030] Figure 9 This is a schematic diagram of the display frame position swapping method in the display interface provided in the embodiments of this disclosure. Figure 1 ;
[0031] Figure 10 This is a schematic diagram of the display frame position swapping method in the display interface provided in the embodiments of this disclosure. Figure 2 ;
[0032] Figure 11 This is a schematic diagram of the reminder processing of the speaker display box in the display interface provided by an embodiment of the present disclosure. Figure 1 ;
[0033] Figure 12 This is a schematic diagram of the reminder processing of the speaker display box in the display interface provided by an embodiment of the present disclosure. Figure 2 ;
[0034] Figure 13 This is a schematic diagram of the closing process of the speaker display box in the display interface provided by an embodiment of this disclosure. Figure 1 ;
[0035] Figure 14 This is a schematic diagram of the closing process of the speaker display box in the display interface provided by an embodiment of this disclosure. Figure 2 ;
[0036] Figure 15 This is a schematic diagram of the archiving process of the screen corresponding to the display frame in the display interface provided in the embodiments of this disclosure. Figure 1 ;
[0037] Figure 16 This is a schematic diagram of the archiving process of the screen corresponding to the display frame in the display interface provided in the embodiments of this disclosure. Figure 2 ;
[0038] Figure 17 This is a structural block diagram of the role information interaction device provided in the embodiments of this disclosure;
[0039] Figure 18 A structural block diagram of an electronic device provided in an embodiment of this disclosure. Detailed Implementation
[0040] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.
[0041] Playing online games is a common way for people to relax and relieve stress. Games may involve multiple characters, and the design of information interaction between these characters is a crucial factor affecting game quality and user experience. In existing technologies, different game characters typically interact via voice or text. However, the aforementioned solutions rely solely on voice or text for communication, resulting in a limited and monotonous format that fails to provide users with rich content, diminishing the game's enjoyment and leading to a poor user experience.
[0042] To address the aforementioned technical problems, the inventors discovered that players can interact by sharing video feeds, and that character-based special effects can be applied to the portraits in the feed to enhance the richness of the interaction. Based on this, this disclosure provides a character-based information interaction method that not only allows users to receive real-time video feeds from other users, but also provides richer information by adding special effects to the portrait information in the feed, thereby increasing the game's fun and improving the user experience. Receiving real-time video feeds from other users and adding special effects to the portrait information in the feed provides users with richer information, thereby increasing the game's fun and improving the user experience.
[0043] refer to Figure 1 , Figure 1 This is a schematic diagram illustrating an application scenario of the role information interaction method provided in this embodiment of the disclosure. For example... Figure 1 As shown, in this application scenario, terminal device 1, terminal device 2, ..., terminal device N are connected to the server for communication. The role-based information interaction method is illustrated using terminal device 1 as an example. Terminal device 1 may specifically include a visual sensor, a display, a processor, and a transceiver.
[0044] In the specific implementation process, it is assumed that the script includes N characters, each user corresponds to one character and one terminal device. The visual sensor of terminal device 1 captures the video image of the corresponding user and sends it to the processor. The processor performs facial recognition on the video image to obtain the user's facial information. Then, it retrieves the special effects props corresponding to the target character selected by the user, and applies special effects to the facial information according to the special effects props to obtain the user's first character image. The first character image is sent to the server through a transceiver. The terminal devices of other users (terminal device 2, ..., terminal device N) respectively obtain the corresponding second character images and send them to the server through their respective transceivers. Terminal device 1 can retrieve at least one second character image sent by another user from the server through the transceiver, and the processor combines the second character image and the first character image, and pushes the combined image to the display interface of the monitor for display. The character information interaction method provided in this embodiment enables users to receive real-time video images of other users, and by adding special effects to the facial information in the image, it provides users with richer information, thereby improving the fun of the game and enhancing the user experience. The game receives real-time video feeds from other users and adds special effects to the images of people, providing users with richer information, thus increasing the fun of the game and improving the user experience.
[0045] The technical solutions of this application will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.
[0046] refer to Figure 2 , Figure 2 Flowchart of the role information interaction method provided in this embodiment of the disclosure Figure 1 The method of this embodiment can be applied in a terminal device. This role information interaction method includes:
[0047] 201. Capture video footage and perform facial recognition on the video footage to obtain the user's facial information.
[0048] In this embodiment, there are several opportunities to capture video footage. It could be at the end of the previous game segment and during the player discussion segment, for example, such as... Figure 1The third step, reading the story, or the sixth step, the second round of evidence gathering, can be completed. Alternatively, it can be triggered by the user. For example, a video capture confirmation interface can be automatically pushed to the user at the start of the player discussion. The user can then trigger a confirmation operation through this interface. For instance, this confirmation operation could be a click on the confirmation control within the video capture confirmation interface. Of course, a cancellation control can also be included in the video capture confirmation interface, allowing the user to disable video capture. Furthermore, to facilitate the user's ability to easily re-enable the video capture confirmation interface, a video switching control can be provided, allowing the user to touch the video switching control to re-enable the video capture confirmation interface and confirm the video capture. All of the above methods are acceptable, and this embodiment does not limit the specific method used.
[0049] 202. Retrieve the special effects props corresponding to the target character selected by the user, and apply special effects to the portrait information according to the special effects props to obtain the user's first character image, and send the first character image to the server.
[0050] In this embodiment, the special effects props corresponding to the target character can include various types, such as headwear effects, makeup effects, and clothing effects. Each type of effect can have multiple styles. For example, in headwear effects, there can be multiple hat styles to choose from for the hat effect, and each style is based on the character's settings. If the character is a nurse, then the character's hat style will always be a nurse's cap, not a police cap.
[0051] 203. Retrieve at least one second character image sent by another user from the server, combine the second character image with the first character image, and push the combined image to the display interface for display.
[0052] In this embodiment, if there are N characters in the script, then in one possible design, the second character screens corresponding to N-1 other characters (excluding the first character's own screen) can be retrieved from the server. In another possible design, the user can retrieve a portion of the N-1 second character screens from the server according to their needs. This embodiment does not limit this.
[0053] As described above, the character information interaction method provided in this embodiment includes capturing video footage and performing facial recognition on the video footage to obtain the user's facial information; retrieving special effects props corresponding to the target character selected by the user, and applying special effects to the facial information according to the special effects props to obtain the user's first character image, and sending the first character image to the server; retrieving at least one second character image sent by another user from the server, compositing the second character image and the first character image, and pushing the composite image to the display interface for display. The character information interaction method provided in this embodiment enables users to receive real-time video footage from other users, and by adding special effects to the facial information in the footage, it provides users with richer information, thereby increasing the fun of the game and improving the user experience. Receiving real-time video footage from other users and adding special effects to the facial information in the footage provides users with richer information, thereby increasing the fun of the game and improving the user experience.
[0054] In one embodiment of this disclosure, in the above Figure 2 Based on the illustrated embodiment, this embodiment provides a detailed description of the special effects loading method. Step 202 of the above embodiment specifically includes: loading headdress and / or makeup onto the head in the portrait information; and / or loading clothing onto the torso in the portrait information.
[0055] Specifically, such as Figure 3 As shown, character 1 is a nurse, character 2 is a fairy, character 3 is a police officer, and character 4 is a worker. Correspondingly, different special effects props can be used for different characters. For character 1, a nurse's hat and corresponding work clothes can be added. For character 2, hair accessories and corresponding fairy clothing and makeup can be added. For character 3, a police hat and police uniform can be added. For character 4, a worker's safety helmet can be added.
[0056] As can be seen from the above description, adding special effects props based on portrait information can enhance the richness of the picture, increase the recognizability of the character, improve the fun of the game, and improve the user experience.
[0057] In one embodiment of this disclosure, in the above Figure 3 Based on the previous embodiment, to improve the portrait processing effect, this embodiment adds facial shape correction processing before special effects loading. Specifically, step 202 of the previous embodiment includes: correcting the face shape of the person in the portrait information according to the facial features of the target character to obtain the face-corrected portrait information; and loading headwear and / or makeup onto the head in the face-corrected portrait information.
[0058] Specifically, such as Figure 4As shown, face shapes can include round, oval, long, and square faces. Different characters are often configured with different face shapes to highlight their personality traits. For example, to emphasize the fortitude of a police officer, a square face is usually used. If the user choosing that character has a round or pointed face, the face shape can be corrected first before adding other special effects items.
[0059] As can be seen from the above description, by correcting the user's face shape in the picture, it can be closer to the character, enhance the richness of the picture, thereby increasing the fun of the game and improving the user experience.
[0060] refer to Figure 5 , Figure 5 Flowchart of the role information interaction method provided in this embodiment of the disclosure Figure 2 This embodiment provides a detailed description of how the synthesized image is displayed on the display interface. The character information interaction method includes:
[0061] 501. Capture video footage and perform facial recognition on the video footage to obtain the user's facial information.
[0062] 502. Retrieve the special effects props corresponding to the target character selected by the user, and apply special effects to the portrait information according to the special effects props to obtain the user's first character image, and send the first character image to the server.
[0063] 503. Retrieve at least one second character image sent by another user from the server, and combine the second character image with the first character image.
[0064] Steps 501 to 503 in this embodiment are similar to steps 201 to 203 in the above embodiment, and will not be repeated here.
[0065] 504. The display interface includes a display frame group, which includes at least two display frames. Different display frames correspond to different characters. The first character's image and at least one second character's image are displayed in their respective display frames in the display interface.
[0066] In this embodiment, the display frame can have various styles, including regular shapes such as circular frames, square frames, and diamond frames, as well as irregular shapes. This embodiment does not limit the style of the display frame.
[0067] Furthermore, there are multiple ways to determine the correspondence between each display frame in the display frame group and each character in the script. For example, the display frames in the display frame group are numbered in order from left to right and top to bottom. Figure 6As shown, the display interface includes three display frames, numbered 1, 2, and 3 respectively. In one possible design, characters appearing earlier in the script can be arranged in display frames with lower numbers. For example, display frame number 1 could be used to play the scene of the first character to appear. In another possible design, the number can be determined based on the importance of the characters in the script, such as the amount of screen time. For example, the scene of the main protagonist could be played in display frame number 1. This embodiment does not limit this approach.
[0068] The following combination Figure 7 The implementation process of the character information interaction method provided in this embodiment is illustrated by using an online script murder mystery game.
[0069] refer to Figure 7 , Figure 7 This is a schematic diagram of an online murder mystery game process provided as an embodiment of this disclosure. Figure 7 As shown, taking a script with five characters as an example, the game can include the following steps: First, players enter a room after selecting a script. Second, players choose one character from the five characters in the script. Third, players read the storyline corresponding to their chosen character. Fourth, players hold their first round of discussion, which may include taking turns introducing themselves and discussing their deductions about the plot. Fifth, players conduct their first round of evidence gathering. Sixth, players conduct their second round of evidence gathering. Seventh, players hold their second round of discussion, specifically asking questions of suspected characters based on the collected clues and listening to their answers. Eighth, players vote, specifically voting on suspected characters, selecting the murderer, and revealing the truth. From the above game process, it can be seen that the player discussion in steps four and seven is a crucial step for players to interact with other players, deduce the plot, and find the real murderer. It is also an important part of enhancing player immersion and showcasing the game's fun.
[0070] The character information interaction method provided in this embodiment can be applied during player discussion. For example, in the specific implementation, in response to the end command of the previous game segment or the confirmation operation triggered by the user through the video capture confirmation interface, video footage is captured and facial recognition is performed on the video footage to obtain the user's facial information. The modification effects (e.g., police hat, clothing) corresponding to the user's selected target character (e.g., a police officer) are retrieved, and the facial information is loaded with these effects to obtain the user's first character image, which is then sent to the server. At least one corresponding second character image sent by another user is retrieved from the server, and the second character image and the first character image are combined. The display interface includes a display frame group, which includes at least two display frames, each corresponding to a different character. The first character image and at least one second character image are displayed in their respective display frames within the display interface. Thus, the user can obtain more information based on the loaded effects, such as quickly identifying the character selected by other users. This format enhances the game's fun and improves the user experience.
[0071] As can be seen from the above description, by assigning different characters to different display frames in this embodiment, the screen of each character can be clearly displayed, and it is convenient to make different settings for the character screen in different display frames.
[0072] In one embodiment of this disclosure, in the above Figure 5 Based on the illustrated embodiment, this embodiment provides a detailed description of the method for obtaining the display frame group. In step 504 of the above embodiment, the display frame group includes multiple templates. In response to the user's selection of a style template, the first character screen and at least one second character screen are displayed in the template of the display frame group selected by the user.
[0073] For example, such as Figure 8 As shown, a template selection control can be set in the display interface. In response to the user's touch operation on the template selection control, a template selection list is pushed. In response to the selection operation in the template selection list, the selected template replaces the current template.
[0074] As can be seen from the above description, in this embodiment, by changing the style of the display box group in the form of a template, users can be provided with a variety of choices, and the operation is convenient.
[0075] In one embodiment of this disclosure, in the above Figure 5Based on the illustrated embodiment, after step 504, the method may further include: adjusting the position of the first target display box in the display interface in response to a user's dragging operation on the first target display box in the at least two display boxes.
[0076] In one possible implementation, adjusting the position of the first target display box in the display interface in response to a user's drag operation on the first target display box in the at least two display boxes includes: in response to a user's drag operation starting from the initial position coordinates of the first target display box, monitoring the distance information between the current position coordinates of the first target display box and the position coordinates of each of the other display boxes; and in response to the distance information being less than a preset value, swapping the positions of the first target display box and the display box corresponding to the distance information less than the preset value.
[0077] For example, such as Figure 9 As shown, the coordinates of the center point of the display frame can be used as the position coordinates of the display frame. The distance between the position coordinates of two display frames is used as the distance between the two display frames. If display frame 1 (numbered 1) is dragged, the processor monitors the distance d2 between display frame 1 and display frame 2 (numbered 2), and the distance d1 between display frame 1 and display frame 3 (numbered 3). If either d1 or d2 is less than a preset value, for example, if d1 is less than the preset value, then the positions of display frame 3 and display frame 1 corresponding to d1 are swapped. In practical applications, if the two display frames to be swapped are the same size, they can be swapped directly. If they are different, the corresponding images can be scaled according to the size ratio of the two display frames before swapping.
[0078] In another possible implementation, adjusting the position of the first target display frame in the display interface in response to a user's drag operation on the first target display frame in the at least two display frames includes: in response to a user's drag operation on the first target display frame in the at least two display frames, monitoring the overlapping area of the first target display frame with each of the other display frames; and in response to the release of the user's drag operation, swapping the positions of the first target display frame with the display frame corresponding to the maximum value of the overlapping areas.
[0079] like Figure 10As shown, if display frame 1 (numbered 1) is dragged, the processor monitors the overlap area S2 between display frame 1 and display frame 2 (numbered 2), and the overlap area S1 between display frame 1 and display frame 3 (numbered 3). When the user releases the drag operation, the processor determines the maximum value between S1 and S2, and swaps the display frame corresponding to the maximum value with display frame 1. If S1 is greater than S2, then display frame 3 can be swapped with display frame 1. In practical applications, if the two display frames being swapped are the same size, they can be swapped directly; if they are different, the corresponding screens can be scaled according to the size ratio of the two display frames before swapping.
[0080] As can be seen from the above description, by changing the position of the display boxes, the display order of the display boxes can be adjusted, and if the size of the display boxes is different, the display size of the screen can be changed as the position of the display boxes is changed.
[0081] In one embodiment of this disclosure, in the above Figure 5 Based on the embodiment shown, after step 504, the method may further include: both the first character screen and the second character screen include voice information, and the voice information corresponding to each display frame in the at least two display frames is monitored; if there is a second target display frame whose voice information volume is greater than a preset value, then the second target display frame is alerted.
[0082] During user discussions, to avoid interference from multiple speakers, the speaker can be highlighted to remind other users that someone is already speaking and they can wait before speaking to avoid conflict.
[0083] In one possible implementation, the step of providing a reminder to the second target display box includes: performing at least one of the following processing on the second target display box: making it bold, highlighting it, or changing its color; and / or adding a reminder icon to the second target display box.
[0084] like Figure 11 As shown, if the character corresponding to display box 3 is speaking, the border of display box 3 can be thickened, or a speaker icon (e.g., speaker 1101) can be added inside display box 3. These methods can also be used simultaneously; this embodiment does not limit this approach.
[0085] In another possible implementation, the display interface includes a floating display area; the floating display area is located above the display frame group, and the step of reminding the second target display frame includes: enlarging the image corresponding to the second target display frame in the floating display area.
[0086] like Figure 12As shown, the floating display area 1201 is located above each display frame. The floating display area 1201 can be shown or turned off according to user needs. The touch operation to show or turn it off can be achieved by touching specific controls or the display interface, such as tapping with two knuckles or drawing a circle with one finger. The display area of the floating display area 1201 is larger than the display area of any display frame in the display frame group. In order to simultaneously observe the images in other display frames, in one possible design, the position of the floating display area 1201 can be dragged and moved.
[0087] As can be seen from the above description, this embodiment can remind other users to wait by displaying a reminder box on the screen of the currently speaking character, so as not to miss the speaker's information.
[0088] In one embodiment of this disclosure, in the above Figure 5 Based on the illustrated embodiment, this embodiment adds a function to close the display frame. After step 504, it may further include: in response to the user's touch operation on the switch control, closing the display of the screen corresponding to the third target display frame selected by the user from the at least two display frames.
[0089] like Figure 13 As shown, during gameplay, if a user leaves the game or is online but not actively playing, the corresponding screen in display box 2 can be turned off using the switch control 1301 within display box 2. This is to avoid affecting the gaming experience of other users. Display box 2 can be retained for later reopening.
[0090] In one embodiment of this disclosure, in the above Figure 5 Based on the illustrated embodiment, after step 504, the method may further include: responding to a user's touch operation on the switch control, turning off the display of the screen corresponding to the third target display frame selected by the user from the at least two display frames; the display interface includes a function area and a screen display area; the display frame group is displayed in the screen display area; the switch control is located in the function area; hiding the third target display frame; calculating the difference between the total area of the screen display area and the display area of the third target display frame; and, based on the difference, replanning each of the fourth target display frames other than the third target display frame in the at least two display frames to enlarge the screen corresponding to each fourth target display frame.
[0091] like Figure 14As shown, assuming display box 1 displays the screen of character 1, display box 2 displays the screen of character 2, and display box 3 displays the screen of character 3, during the game, character 2 has been ruled out by the user. Display box 2 can be hidden by the switch control 1402 in the function area 140, and the remaining display boxes 1 and 2 can be reorganized to increase the display area.
[0092] As can be seen from the above description, in this embodiment, by setting a switch control, the screen of some characters can be easily turned off to improve the flexibility of operation and enhance the gaming experience.
[0093] In one embodiment of this disclosure, in the above Figure 5 Based on the embodiment shown, after step 504, the method may further include: in response to the user's touch operation on the archive control, archiving and recording the screen corresponding to the fifth target display box selected by the user from the at least two display boxes, and obtaining an archive file.
[0094] In this embodiment, the archiving control may include at least one of the following: a video recording control, a voice recording control, and a voice-to-text control.
[0095] like Figure 15 As shown, each display box can be equipped with an archive control. Taking display box 3 as an example, display box 3 has three archive controls: a video recording control 1501, a voice recording control 1502, and a voice-to-text control 1503. If video recording of the screen corresponding to display box 3 is required, the video recording control 1501 can be touched to obtain a video archive file. If voice recording of the screen corresponding to display box 3 is required, the voice recording control 1502 can be touched to obtain a voice archive file. If voice-to-text recording of the screen corresponding to display box 3 is required, the voice-to-text control 1503 can be touched to obtain a text archive file.
[0096] In one possible implementation, after the step of archiving the screen corresponding to the fifth target display frame selected by the user from the at least two display frames in response to the user's touch operation on the archive control, it may further include: in response to the user's touch operation on the playback control, playing and displaying the archived file selected by the user within the display frame corresponding to the first character screen. In response to the user's touch operation on the area where the display frame corresponding to the first character screen is located, switching the playback display of the archived file to the playback display of the first character screen.
[0097] As described above, the archiving control provided in this embodiment allows users to easily record the statements of suspected individuals and obtain corresponding archive files. These archives can then be reviewed in subsequent discussions or analyses, or presented to other users to persuade them. During the presentation, a corresponding display box can be used for playback to avoid obstructing observation of other users' emotions and facial expressions. Furthermore, touch controls allow for quick switching between the playback screen and the user's own video.
[0098] For other users' terminals, evidence can be played back using the corresponding display frame of each user, and the playback screen can be quickly switched with the user's own video via touch operation, which is beneficial for real-time observation of the emotions and expressions of users other than oneself.
[0099] In one embodiment of this disclosure, in the above Figure 5 Based on the illustrated embodiment, after step 504, the following may be included: the display interface includes an archive area and a screen display area; the display frame group is displayed in the screen display area; in response to the user's drag operation on the fifth target display frame, the position coordinates of the fifth target display frame are monitored; in response to the current position coordinates of the fifth target display frame falling into the area where the archive area is located, the fifth target display frame is displayed in the archive area; the archive area is configured to archive and record the screens corresponding to each display frame in the area to obtain an archive file.
[0100] like Figure 16 As shown, the display interface includes a screen display area 1601 containing display frames 1, 2, and 3, and an archive area 1602 with archiving functionality. If a user needs to archive the screen corresponding to a particular display frame or several display frames, they can drag the corresponding display frame from the screen display area 1601 into the archive area 1602. There is no need to separately set up or operate the archiving controls for each display frame. Figure 16 As shown, users need to save records for display frames 1 and 2. They can drag display frames 1 and 2 into the save area 1602. Optionally, specific save functions can be configured using the save controls within the save area 1602. During this process, the display area of each display frame can be adaptively replanned; this embodiment does not limit this.
[0101] In one embodiment of this disclosure, in the above Figure 2Based on the illustrated embodiment, before step 201, the process may further include: in response to a user's selection operation input through the character selection interface, assigning a corresponding target character to the user; in response to a user's selection operation input through the real-person avatar switching interface, pushing an avatar effects loading interface to the user, and displaying the user's real-person avatar and a list of special effects props corresponding to the target character in the avatar effects loading interface; in response to the user's selection operation on the list of special effects props, loading the target special effects selected by the user from the list of special effects props onto the real-person avatar to obtain the user's custom character avatar; and merging the custom character avatar with the human body image of the animated character corresponding to the target character in the game interface to obtain an updated game interface and pushing it to the user according to a preset order.
[0102] Corresponding to the role information interaction method in the above embodiments, Figure 17 This is a structural block diagram of a role information interaction device provided in an embodiment of this disclosure. For ease of explanation, only the parts relevant to the embodiments of this disclosure are shown. (Refer to...) Figure 17 The device includes: an identification module 1701, a loading module 1702, and a composite display module 1703.
[0103] The recognition module 1701 is used to capture video footage and perform facial recognition on the video footage to obtain the user's facial information.
[0104] The loading module 1702 is used to retrieve the special effects props corresponding to the target character selected by the user, and load the special effects onto the portrait information according to the special effects props to obtain the user's first character image, and send the first character image to the server.
[0105] The composite display module 1703 is used to retrieve at least one second character image sent by another user from the server, composite the second character image with the first character image, and push the composite image to the display interface for display.
[0106] In one embodiment of this disclosure, the loading module 1702 is specifically used to load headdresses and / or makeup onto the head in the portrait information; and / or to load clothing onto the torso in the portrait information.
[0107] In one embodiment of this disclosure, the loading module 1702 is specifically used to correct the face shape of the person in the portrait information according to the facial features of the target character, thereby obtaining the face-corrected portrait information. Headwear and / or makeup are loaded onto the head in the face-corrected portrait information; and / or, clothing is loaded onto the torso in the face-corrected portrait information.
[0108] In one embodiment of this disclosure, the composite display module 1703 is specifically used to display the first character image and at least one second character image in corresponding display frames of the display interface. The display interface includes a group of display frames, each group comprising at least two display frames, with different display frames corresponding to different characters.
[0109] In one embodiment of this disclosure, the composite display module 1703 is specifically used to display the first character image and at least one second character image in the template of the display frame group selected by the user in response to the user's selection operation of the style template.
[0110] In one embodiment of this disclosure, the device further includes: an adjustment module, configured to adjust the position of the first target display frame in the display interface in response to a user's dragging operation on the first target display frame in the at least two display frames.
[0111] In one embodiment of this disclosure, the adjustment module is specifically configured to, in response to a user's dragging operation starting from the initial position coordinates of the first target display box, monitor the distance information between the current position coordinates of the first target display box and the position coordinates of each other display box; and, in response to the distance information being less than a preset value, swap the positions of the first target display box and the display box corresponding to the distance information less than the preset value.
[0112] In one embodiment of this disclosure, the adjustment module is specifically configured to, in response to a user's drag operation on a first target display frame in the at least two display frames, monitor the overlapping area of the first target display frame with each of the other display frames; and, in response to the release of the user's drag operation, swap the positions of the first target display frame with the display frame corresponding to the maximum value among the overlapping areas.
[0113] In one embodiment of this disclosure, the device further includes: a reminder module, used to monitor the voice information corresponding to each of the at least two display frames; if there is a second target display frame with a voice information volume greater than a preset value, then the second target display frame is reminded.
[0114] In one embodiment of this disclosure, the reminder module is specifically used to perform at least one of the following processing on the second target display box: thickening, highlighting, and color changing; or, to add a reminder icon to the second target display box.
[0115] In one embodiment of this disclosure, the display interface includes a floating display area; the floating display area is located above the display frame group, and the reminder module is specifically used to enlarge and display the image corresponding to the second target display frame in the floating display area.
[0116] In one embodiment of this disclosure, the device further includes: a shutdown module, configured to shut down the display of the screen corresponding to a third target display frame selected by the user from the at least two display frames in response to a user's touch operation on the switch control.
[0117] In one embodiment of this disclosure, the device further includes: a replanning module for hiding the third target display frame; calculating the difference between the total area of the screen display area and the display area of the third target display frame; and replanning each of the fourth target display frames other than the third target display frame in the at least two display frames according to the difference, so as to enlarge the screen corresponding to each fourth target display frame.
[0118] In one embodiment of this disclosure, the device further includes: a first archiving module, configured to, in response to a user's touch operation on the archiving control, archive and record the screen corresponding to the fifth target display frame selected by the user from the at least two display frames, and obtain an archive file.
[0119] In one embodiment of this disclosure, the archiving control includes at least one of the following: a video recording control, a voice recording control, and a voice-to-text control.
[0120] In one embodiment of this disclosure, the device further includes: a playback module, configured to, in response to a user's touch operation on the playback control, play and display the archived file selected by the user in the display box corresponding to the first character screen.
[0121] In one embodiment of this disclosure, the device further includes: a switching module, configured to switch the playback display of the archived file to the playback display of the first character screen in response to a user's touch operation on the area where the display frame corresponding to the first character screen is located.
[0122] In one embodiment of this disclosure, the device further includes: a second archiving module, configured to monitor the position coordinates of the fifth target display frame in response to a user's dragging operation on the fifth target display frame; and to display the fifth target display frame in the archiving area in response to the current position coordinates of the fifth target display frame falling into the area where the archiving area is located; the archiving area is configured to archive and record the screens corresponding to each display frame in the area to obtain an archive file.
[0123] In one embodiment of this disclosure, the device further includes: a fusion module, configured to: assign a corresponding target character to the user in response to a selection operation input by the user through a character selection interface; push an avatar effects loading interface to the user in response to a selection operation input by the user through a real-person avatar switching interface, and display the user's real-person avatar and a list of special effects props corresponding to the target character in the avatar effects loading interface; load the target special effects selected by the user from the list of special effects props onto the real-person avatar in response to a selection operation by the user, thereby obtaining the user's custom character avatar; and fuse the custom character avatar with the human body image of the animated character corresponding to the target character in the game interface to obtain an updated game interface and push it to the user according to a preset order.
[0124] The device provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effect are similar, and will not be described again here.
[0125] To implement the above embodiments, this disclosure also provides an electronic device.
[0126] refer to Figure 18 The diagram illustrates a structural schematic of an electronic device 1800 suitable for implementing embodiments of the present disclosure. The electronic device 1800 can be a terminal device. The terminal device can include, but is not limited to, mobile terminals such as mobile phones, laptops, digital radio receivers, personal digital assistants (PDAs), portable Android devices (PADs), portable media players (PMPs), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 18 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.
[0127] like Figure 18As shown, electronic device 1800 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 1801, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 1802 or a program loaded from storage device 1808 into random access memory (RAM) 1803. RAM 1803 also stores various programs and data required for the operation of electronic device 1800. Processing unit 1801, ROM 1802, and RAM 1803 are interconnected via bus 1804. Input / output (I / O) interface 1805 is also connected to bus 1804.
[0128] Typically, the following devices can be connected to I / O interface 1805: input devices 1806 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 1807 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1808 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1809. Communication device 1809 allows electronic device 1800 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 18 An electronic device 1800 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.
[0129] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 1809, or installed from a storage device 1808, or installed from a ROM 1802. When the computer program is executed by a processing device 1801, it performs the functions defined in the methods of embodiments of this disclosure.
[0130] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.
[0131] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.
[0132] The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to perform the methods shown in the above embodiments.
[0133] Computer program code for performing the operations of this disclosure can be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, and C++, and conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0134] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.
[0135] The units described in the embodiments of this disclosure can be implemented in software or in hardware. The name of a unit does not necessarily limit the unit itself; for example, the first acquisition unit can also be described as "a unit that acquires at least two Internet Protocol addresses".
[0136] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.
[0137] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
[0138] In a first aspect, according to one or more embodiments of this disclosure, a role information interaction method is provided, comprising:
[0139] The system captures video footage and performs facial recognition on the video footage to obtain the user's facial information.
[0140] Retrieve the special effects props corresponding to the target character selected by the user, and apply special effects to the portrait information according to the special effects props to obtain the user's first character image, and send the first character image to the server;
[0141] Retrieve at least one second character image sent by another user from the server, combine the second character image with the first character image, and push the combined image to the display interface for display.
[0142] According to one or more embodiments of this disclosure, the step of acquiring video footage and performing facial recognition on the video footage to obtain the user's facial information includes:
[0143] In response to the end command of the previous game segment or the confirmation operation triggered by the user through the video capture confirmation interface, the video screen is captured and facial recognition is performed on the video screen to obtain the user's facial information.
[0144] According to one or more embodiments of this disclosure, the step of applying special effects to the portrait information based on the special effects prop includes:
[0145] Based on the facial features of the target character, the face in the portrait information is corrected to obtain the face-corrected portrait information;
[0146] Add headdress and / or makeup to the head of the face-corrected portrait information; and / or add clothing to the torso of the face-corrected portrait information.
[0147] According to one or more embodiments of this disclosure, the display interface includes a display frame group, the display frame group including at least two display frames, different display frames corresponding to different roles, and the step of pushing the composited image to the display interface for display includes:
[0148] The first character's image and at least one second character's image are displayed in their respective display boxes on the display interface.
[0149] According to one or more embodiments of this disclosure, the display frame group includes multiple templates, and the step of pushing the composited image to the display interface for display includes:
[0150] In response to the user's selection of a style template, the first character screen and at least one second character screen are displayed in the template of the display box group selected by the user.
[0151] According to one or more embodiments of this disclosure, after pushing the synthesized image to the display interface for display, the method further includes:
[0152] In response to a user's dragging operation on a first target display box in the at least two display boxes, the position of the first target display box in the display interface is adjusted.
[0153] According to one or more embodiments of this disclosure, adjusting the position of the first target display frame in the display interface in response to a user's dragging operation on the first target display frame of the at least two display frames includes:
[0154] In response to a user's dragging operation starting from the initial position coordinates of the first target display box, the system monitors the distance information between the current position coordinates of the first target display box and the position coordinates of each other display box; in response to a distance information less than a preset value, the system swaps the positions of the first target display box and the display box corresponding to the distance information less than the preset value.
[0155] According to one or more embodiments of this disclosure, adjusting the position of the first target display frame in the display interface in response to a user's dragging operation on the first target display frame of the at least two display frames includes:
[0156] In response to a user's dragging operation on a first target display frame in the at least two display frames, the overlapping area of the first target display frame with each of the other display frames is monitored.
[0157] In response to the release of the user's drag operation, the positions of the first target display box and the display box corresponding to the maximum value of the overlapping areas are swapped.
[0158] According to one or more embodiments of this disclosure, both the first character screen and the second character screen include voice information. After pushing the synthesized image to the display interface for display, the method further includes:
[0159] The voice information corresponding to each display frame in the at least two display frames is monitored;
[0160] If a second target display box exists with a voice message volume greater than a preset value, then the second target display box will be alerted.
[0161] According to one or more embodiments of this disclosure, the step of providing a reminder to the second target display box includes:
[0162] The second target display box is processed by at least one of the following: thickening, highlighting, and color changing.
[0163] or,
[0164] Add a reminder icon to the second target display box.
[0165] According to one or more embodiments of this disclosure, the display interface includes a floating display area; the floating display area is located above the display frame group, and the step of reminding the second target display frame includes:
[0166] The image corresponding to the second target display frame is enlarged and displayed in the floating display area.
[0167] According to one or more embodiments of this disclosure, after pushing the synthesized image to the display interface for display, the method further includes:
[0168] In response to the user's touch operation on the switch control, the screen corresponding to the third target display box selected by the user from the at least two display boxes is turned off.
[0169] According to one or more embodiments of this disclosure, the display interface includes a function area and a screen display area; the display frame group is displayed in the screen display area; the switch control is disposed in the function area; after turning off the display of the screen corresponding to the third target display frame selected by the user from the at least two display frames, the method further includes:
[0170] Hide the third target display box;
[0171] Calculate the difference between the total area of the screen display area and the display area of the third target display frame;
[0172] Based on the difference, each of the fourth target display frames other than the third target display frame in the at least two display frames is replanned to enlarge the screen corresponding to each fourth target display frame.
[0173] According to one or more embodiments of this disclosure, after pushing the synthesized image to the display interface for display, the method further includes:
[0174] In response to the user's touch operation on the archive control, the screen corresponding to the fifth target display box selected by the user from the at least two display boxes is archived and recorded to obtain an archive file.
[0175] According to one or more embodiments of this disclosure, the archiving control includes at least one of the following: a video recording control, a voice recording control, and a voice-to-text control.
[0176] According to one or more embodiments of this disclosure, after archiving the screen corresponding to the fifth target display frame selected by the user from the at least two display frames in response to the user's touch operation on the archiving control, the method further includes:
[0177] In response to the user's touch operation on the playback control, the archive file selected by the user is played and displayed in the display box corresponding to the first character's screen.
[0178] According to one or more embodiments of this disclosure, after displaying the user-selected archive file in the display frame corresponding to the first character screen, the method further includes:
[0179] In response to a user's touch operation on the area of the display box corresponding to the first character's screen, the playback display of the archived file is switched to the playback display of the first character's screen.
[0180] According to one or more embodiments of this disclosure, the display interface includes an archive area and a screen display area; the display frame group is displayed in the screen display area; after pushing the composited screen to the display interface for display, the method further includes:
[0181] In response to the user's drag operation on the fifth target display box, the position coordinates of the fifth target display box are monitored;
[0182] In response to the current position coordinates of the fifth target display frame falling into the area where the archive area is located, the fifth target display frame is displayed in the archive area; the archive area is set to archive and record the screens corresponding to each display frame in the area to obtain an archive file.
[0183] According to one or more embodiments of this disclosure, before acquiring video footage and performing facial recognition on the video footage, the method further includes:
[0184] In response to the user's selection operation through the role selection interface, the corresponding target role is assigned to the user;
[0185] In response to the user's selection operation input through the real avatar switching interface, the avatar effect loading interface is pushed to the user, and the user's real avatar and the list of special effect props corresponding to the target character are displayed in the avatar effect loading interface;
[0186] In response to the user's selection operation on the list of special effects props, the target special effects selected by the user from the list of special effects props are loaded onto the real person's avatar to obtain the user's custom character avatar;
[0187] The custom character avatar is merged with the human body image of the animated character corresponding to the target character in the game interface to obtain an updated game interface, which is then pushed to the user in a preset order.
[0188] Secondly, according to one or more embodiments of this disclosure, a role information interaction device is provided, comprising:
[0189] The recognition module is used to capture video footage and perform facial recognition on the video footage to obtain the user's facial information;
[0190] The loading module is used to retrieve the special effects props corresponding to the target character selected by the user, and to load the special effects onto the portrait information according to the special effects props to obtain the user's first character image, and send the first character image to the server.
[0191] The composite display module is used to retrieve at least one second character image sent by another user from the server, composite the second character image with the first character image, and push the composite image to the display interface for display.
[0192] According to one or more embodiments of this disclosure, the recognition module is specifically used to capture video footage and perform facial recognition on the video footage in response to the end command of the previous game segment or the confirmation operation triggered by the user through the video capture confirmation interface, thereby obtaining the user's facial information.
[0193] According to one or more embodiments of this disclosure, the loading module is specifically used to load headdresses and / or makeup onto the head in the portrait information; and / or to load clothing onto the torso in the portrait information.
[0194] According to one or more embodiments of this disclosure, the loading module is specifically configured to correct the face shape of the person in the portrait information based on the facial features of the target character, thereby obtaining the face-corrected portrait information. A headdress and / or makeup are loaded onto the head in the face-corrected portrait information; and / or, clothing is loaded onto the torso in the face-corrected portrait information.
[0195] According to one or more embodiments of this disclosure, the composite display module is specifically used to display the first character image and at least one second character image in corresponding display frames of the display interface. The display interface includes a group of display frames, each group comprising at least two display frames, with different display frames corresponding to different characters.
[0196] According to one or more embodiments of this disclosure, the composite display module is specifically used to display the first character image and at least one second character image in the template of the display frame group selected by the user in response to the user's selection operation of the style template.
[0197] According to one or more embodiments of this disclosure, the device further includes: an adjustment module, configured to adjust the position of the first target display frame in the display interface in response to a user's dragging operation on the first target display frame in the at least two display frames.
[0198] According to one or more embodiments of this disclosure, the adjustment module is specifically configured to, in response to a user's dragging operation starting from the initial position coordinates of the first target display box, monitor the distance information between the current position coordinates of the first target display box and the position coordinates of each other display box; and, in response to the distance information being less than a preset value, swap the positions of the first target display box and the display box corresponding to the distance information less than the preset value.
[0199] According to one or more embodiments of this disclosure, the adjustment module is specifically configured to, in response to a user's drag operation on a first target display frame in the at least two display frames, monitor the overlapping area of the first target display frame with each of the other display frames; and, in response to the release of the user's drag operation, swap the positions of the first target display frame with the display frame corresponding to the maximum value among the overlapping areas.
[0200] According to one or more embodiments of this disclosure, the device further includes: a reminder module, configured to monitor the voice information corresponding to each of the at least two display frames; if there is a second target display frame with a voice information volume greater than a preset value, then the second target display frame is reminded.
[0201] According to one or more embodiments of this disclosure, the reminder module is specifically used to perform at least one of the following processing on the second target display box: thickening, highlighting, and color changing; or, to add a reminder icon to the second target display box.
[0202] According to one or more embodiments of this disclosure, the display interface includes a floating display area; the floating display area is located above the display frame group, and the reminder module is specifically used to enlarge and display the image corresponding to the second target display frame in the floating display area.
[0203] According to one or more embodiments of this disclosure, the device further includes: a shutdown module, configured to shut down the display of the screen corresponding to a third target display frame selected by the user from the at least two display frames in response to a user's touch operation on the switch control.
[0204] According to one or more embodiments of this disclosure, the device further includes: a replanning module for hiding the third target display frame; calculating the difference between the total area of the screen display area and the display area of the third target display frame; and replanning each of the fourth target display frames other than the third target display frame in the at least two display frames according to the difference, so as to enlarge the screen corresponding to each fourth target display frame.
[0205] According to one or more embodiments of this disclosure, the device further includes: a first archiving module, configured to, in response to a user's touch operation on the archiving control, archive and record the screen corresponding to the fifth target display frame selected by the user from the at least two display frames, and obtain an archive file.
[0206] According to one or more embodiments of this disclosure, the archiving control includes at least one of the following: a video recording control, a voice recording control, and a voice-to-text control.
[0207] According to one or more embodiments of this disclosure, the device further includes: a playback module, configured to play and display the archived file selected by the user in the display box corresponding to the first character screen in response to a user's touch operation on the playback control.
[0208] According to one or more embodiments of this disclosure, the device further includes: a switching module, configured to switch the playback display of the archived file to the playback display of the first character screen in response to a user's touch operation on the area where the display frame corresponding to the first character screen is located.
[0209] According to one or more embodiments of this disclosure, the device further includes: a second archiving module, configured to monitor the position coordinates of the fifth target display frame in response to a user's dragging operation on the fifth target display frame; and to display the fifth target display frame in the archiving area in response to the current position coordinates of the fifth target display frame falling into the area where the archiving area is located; the archiving area is configured to archive and record the screens corresponding to each display frame in the area to obtain an archive file.
[0210] According to one or more embodiments of this disclosure, the device further includes: a fusion module, configured to: assign a corresponding target character to a user in response to a selection operation input by the user through a character selection interface; push an avatar effects loading interface to the user in response to a selection operation input by the user through a real-person avatar switching interface, and display the user's real-person avatar and a list of special effects props corresponding to the target character in the avatar effects loading interface; load the target special effects selected by the user from the list of special effects props onto the real-person avatar in response to a selection operation by the user, thereby obtaining a user's custom character avatar; and fuse the custom character avatar with the human body image of the animated character corresponding to the target character in the game interface to obtain an updated game interface and push it to the user according to a preset order.
[0211] Thirdly, according to one or more embodiments of the present disclosure, an electronic device is provided, including: a vision sensor, a processor, a memory, a display, and a transceiver;
[0212] The vision sensor, the processor, the memory, the display, and the transceiver circuit are interconnected;
[0213] The memory stores computer-executed instructions; the vision sensor is used to capture video images; the transceiver is used to send and receive data with the server; and the display is used to display the composite image.
[0214] The processor executes computer execution instructions stored in the memory, causing the processor to perform the role information interaction method as described in the first aspect and various possible designs of the first aspect.
[0215] Fourthly, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, wherein computer-executable instructions are stored therein, and when a processor executes the computer-executable instructions, the role information interaction method described in the first aspect and various possible designs of the first aspect is implemented.
[0216] Fifthly, according to one or more embodiments of this disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the role information interaction method described in the first aspect and various possible designs of the first aspect.
[0217] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.
[0218] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.
[0219] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.
Claims
1. A character information interaction method, characterized in that, The method is applied to a terminal device and comprises the following steps: In response to an end instruction of a previous game session or a confirmation operation triggered by a user through a video collection confirmation interface, a video picture is collected and portrait recognition is performed on the video picture to obtain portrait information of the user; A special effect prop corresponding to a target character selected by the user is called, the special effect prop corresponding to the target character including a headwear special effect, a face makeup special effect and a clothing special effect, and each type of special effect including multiple styles; If a face in the portrait information is different from a face feature of the target character, face feature correction is performed on the face in the portrait information according to the face feature of the target character to obtain portrait information after face feature correction; different characters correspond to different face features; A headwear and / or face makeup is loaded on a head part in the portrait information after face feature correction; and / or a clothing is loaded on a trunk part in the portrait information after face feature correction to obtain a first character picture of the user, and the first character picture is sent to a server; A second character picture sent by at least one other user is pulled from the server, the second character picture and the first character picture are synthesized, and the synthesized picture is pushed to a display interface for display.
2. The method of claim 1, wherein, The display interface includes a display frame group, the display frame group including at least two display frames, different display frames corresponding to different characters, and the synthesized picture being pushed to the display interface for display including: The first character picture and the at least one second character picture are displayed in corresponding display frames in the display interface, respectively.
3. The method of claim 2, wherein, The display frame group includes multiple templates, and the synthesized picture being pushed to the display interface for display including: In response to a selection operation of a style template by the user, the first character picture and the at least one second character picture are displayed in a template of the display frame group selected by the user.
4. The method of claim 2, wherein, After the synthesized picture is pushed to the display interface for display, the method further includes: In response to a drag operation of a first target display frame in the at least two display frames by the user, a position of the first target display frame in the display interface is adjusted.
5. The method of claim 4, wherein, The position of the first target display frame in the display interface being adjusted in response to the drag operation of the first target display frame in the at least two display frames by the user including: In response to the drag operation of the first target display frame by the user with an initial position coordinate of the first target display frame as a starting point, distance information between a current position coordinate of the first target display frame and position coordinates of other display frames is monitored, and in response to the distance information being less than a preset value, the first target display frame and a display frame corresponding to the distance information less than the preset value are positionally exchanged.
6. The method of claim 4, wherein, The position of the first target display frame in the display interface being adjusted in response to the drag operation of the first target display frame in the at least two display frames by the user including: In response to the drag operation of the first target display frame in the at least two display frames by the user, overlapping areas of the first target display frame and other display frames are monitored; In response to a release of the drag operation by the user, the first target display frame and a display frame corresponding to a maximum value in the overlapping areas are positionally exchanged.
7. The method of claim 2, wherein, The first role picture and the second role picture both include voice information, and after the synthesized picture is pushed to the display interface for display, the following further includes: Monitoring voice information corresponding to each display box in the at least two display boxes; If there is a second target display box in which the volume of voice information is greater than a preset value, the second target display box is processed for prompting.
8. The method of claim 7, wherein, The second target display box is processed for prompting, including: At least one of the following processing is performed on the second target display box: bold processing, highlighting processing, and color changing processing; Or, An alert identifier is added to the second target display box.
9. The method of claim 7, wherein, The display interface includes a floating layer display area; the floating layer display area is located above the display box group, and the second target display box is processed for prompting, including: The picture corresponding to the second target display box is enlarged and displayed in the floating layer display area.
10. The method of claim 2, wherein, After the synthesized picture is pushed to the display interface for display, the following further includes: In response to a touch operation of a user on the switch control, the picture corresponding to a third target display box selected by the user from the at least two display boxes is closed.
11. The method of claim 10, wherein, The display interface includes a function area and a picture display area; the display box group is displayed in the picture display area; the switch control is arranged in the function area; after the picture corresponding to the third target display box selected by the user from the at least two display boxes is closed, the following further includes: The third target display box is hidden; A difference between a total area of the picture display area and a display area of the third target display box is calculated; According to the difference, each fourth target display box in the at least two display boxes except the third target display box is re-planned to enlarge and display the picture corresponding to each fourth target display box.
12. The method of claim 1, wherein, Before the video picture is collected and the video picture is subjected to portrait recognition, the following further includes: In response to a selection operation of a user input through a role selection interface, a target role corresponding to the user is assigned; In response to a selection operation of a user input through a real person head portrait switching interface, a head portrait special effect loading interface is pushed to the user, and a real person head portrait of the user and a special effect prop list corresponding to the target role are displayed in the head portrait special effect loading interface; In response to a selection operation of a user on the special effect prop list, a target special effect selected by the user from the special effect prop list is loaded onto the real person head portrait, and a custom role head portrait of the user is obtained; The custom role head portrait is fused with a human body image of an animated person corresponding to the target role in a game interface, an updated game interface is obtained, and the updated game interface is pushed to the user according to a preset order.
13. A character information interaction device, characterized by comprising: It includes: The identification module is configured to, in response to an end instruction of a previous game link or a confirmation operation triggered by a user through a video collection confirmation interface, collect a video picture and perform portrait recognition on the video picture to obtain portrait information of the user. The loading module is configured to call a special effect prop corresponding to a target character selected by the user, the special effect prop corresponding to the target character including a headwear special effect, a face makeup special effect, and a clothing special effect, each type of special effect including multiple styles; if a face in the portrait information is different from a face feature of the target character, the face feature of the target character is used to correct the face in the portrait information to obtain portrait information after face correction; Different characters correspond to different face features; The head of the portrait information after the face correction is loaded with headwear and / or face makeup; and / or, the torso of the portrait information after the face correction is loaded with clothing to obtain a first character screen of the user, and the first character screen is sent to a server; The synthesis display module is configured to pull a second character screen sent by at least one other user from the server, synthesize the second character screen and the first character screen, and push the synthesized screen to a display interface for display.
14. An electronic device, comprising: Comprise: a visual sensor, a processor, a memory, a display, and a transceiver; The visual sensor, the processor, the memory, the display, and the transceiver are electrically interconnected; The memory stores computer execution instructions; the visual sensor is configured to collect a video screen; The transceiver is configured to transmit and receive data with a server; the display is configured to display a synthesized screen; The processor executes the computer execution instructions stored in the memory, so that the processor executes the character information interaction method according to any one of claims 1 to 12.
15. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer execution instructions, and when the processor executes the computer execution instructions, the character information interaction method according to any one of claims 1 to 12 is realized.
16. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to realize the character information interaction method according to any one of claims 1 to 12.
Citation Information
Patent Citations
Videoconferencing system providing virtual physical context
CN104221366A
Video processing method and apparatus thereof
CN106303690A
Information interaction method and device, storage medium and electronic device
CN110339570A
Game role information processing method and device, equipment and storage medium
CN113144604A