Card punching button display method and device, electronic equipment and readable storage medium

Abstract

The invention provides a clock-in button display method and device, electronic equipment and a readable storage medium, which act on mobile terminal equipment and display at least part of a virtual interaction scene in a graphical user interface of the mobile terminal equipment. A first virtual role module controlled by a first user and a second virtual role module controlled by other users are arranged in the virtual interaction scene; a clock-in button is displayed in the graphical user interface; the method comprises the following steps: acquiring current external data in real time, wherein the external data comprises one or more of position data, environment data and motion data; determining a display mode of the virtual doll according to the external data; and updating the display mode of the virtual doll in the graphical user interface according to the display mode so as to prompt the current state of the first user. Through the method, the information validity of the main interface and the function density of the clock-in button can be improved, and meanwhile, a user is effectively prompted.

Description

Technical Field

[0001] This application relates to the field of AR technology, and in particular to a method, device, electronic device, and readable storage medium for displaying a check-in button. Background Technology

[0002] With technological advancements and societal progress, social media offers users increasingly diverse avenues for self-expression. Users can post their statuses through social media apps, allowing others to see and interact with them. Furthermore, users can engage with each other in a variety of ways within these apps.

[0003] The check-in function is a major feature in social media apps. Generally, the check-in button is a regular button displayed in the graphical user interface, and users can check in by touching the check-in button. Summary of the Invention

[0004] In view of this, the purpose of this application is to provide a method, device, electronic device and readable storage medium for displaying a check-in button, so as to improve the effectiveness of information on the main interface and the functional density of the check-in button, while also providing effective prompts to the user.

[0005] In a first aspect, embodiments of this application provide a method for displaying a check-in button, which operates on a mobile terminal device. The graphical user interface of the mobile terminal device displays at least a portion of a virtual interactive scene. The virtual interactive scene includes a first virtual character module controlled by a first user and a second virtual character module controlled by other users. A check-in button is also displayed in the graphical user interface, comprising a virtual avatar set by the first user. The check-in button is floating on the virtual interactive scene. The method for displaying the check-in button includes:

[0006] Real-time acquisition of current external data, including one or more of the following: location data, environmental data, and motion data;

[0007] Based on the external data, determine the display method of the virtual avatar;

[0008] The display method of the virtual avatar in the graphical user interface is updated according to the display method to indicate the current status of the first user.

[0009] In conjunction with the first aspect, this application provides a first possible implementation of the first aspect, wherein the environmental data includes one or more of the following: weather data, volume data, voice data, brightness data, temperature data, and time data; and the motion data includes one or more of the following: posture data, speed data, acceleration data, and historical movement data.

[0010] In conjunction with the first aspect, this application provides a second possible implementation of the first aspect, wherein the step of determining the display method of the virtual avatar based on the external data includes:

[0011] Based on the external data, the display method corresponding to the external data is found by querying a table pre-stored in the mobile terminal device.

[0012] In conjunction with the first aspect, this application provides a third possible implementation of the first aspect, wherein the image display method includes: updating the virtual doll's motion animation, updating the virtual doll's expression, updating the virtual doll's clothing, updating the virtual doll's accessories, and updating the virtual doll's status information.

[0013] Secondly, embodiments of this application also provide a check-in button display device, which operates on a mobile terminal device. The device displays at least a portion of a virtual interactive scene in the graphical user interface of the mobile terminal device. The virtual interactive scene includes a first virtual character module controlled by a first user and a second virtual character module controlled by other users. A check-in button is also displayed in the graphical user interface. The check-in button includes a virtual avatar set by the first user, and the check-in button is floating on the virtual interactive scene. The check-in button display device includes:

[0014] The acquisition module is used to acquire current external data in real time, including one or more of the following: location data, environmental data, and motion data;

[0015] The determination module is used to determine the display method of the virtual avatar based on the external data;

[0016] The update module is used to update the display method of the virtual avatar in the graphical user interface according to the display method, so as to indicate the current status of the first user.

[0017] In conjunction with the second aspect, this application provides a first possible implementation of the second aspect, wherein the environmental data includes one or more of the following: weather data, volume data, voice data, brightness data, temperature data, and time data; and the motion data includes one or more of the following: posture data, speed data, acceleration data, and historical movement data.

[0018] In conjunction with the second aspect, this application provides a second possible implementation of the second aspect, wherein the determining module, when used to determine the display method of the virtual avatar based on the external data, is specifically used for:

[0019] Based on the external data, the display method corresponding to the external data is found by querying a table pre-stored in the mobile terminal device.

[0020] In conjunction with the second aspect, this application provides a third possible implementation of the second aspect, wherein the image display method includes: updating the virtual doll's motion animation, updating the virtual doll's expression, updating the virtual doll's clothing, updating the virtual doll's accessories, and updating the virtual doll's status information.

[0021] Thirdly, embodiments of this application also provide an electronic device, including: a processor, a memory, and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor communicates with the memory via the bus, and when the machine-readable instructions are executed by the processor, the steps in any of the possible implementations of the first aspect described above are performed.

[0022] Fourthly, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, performs the steps in any of the possible implementations of the first aspect described above.

[0023] This application provides a method, device, electronic device, and readable storage medium for displaying a check-in button. When using an APP, the mobile terminal can acquire external data in real time and adjust the display method of the virtual avatar on the check-in button on the main interface according to the external data. This allows the virtual avatar to provide prompts to the user, improving the effectiveness of information on the main interface and the functional density of the check-in button, while also providing effective prompts to the user.

[0024] To make the above-mentioned objectives, features and advantages of this application more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0025] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0026] Figure 1 A schematic diagram of a graphical user interface of a mobile terminal provided in an embodiment of this application is shown;

[0027] Figure 2This illustration shows the content displayed in the graphical user interface when switching to an AR scene, as provided in an embodiment of this application.

[0028] Figure 3 A flowchart illustrating a method for displaying a check-in button according to an embodiment of this application is shown;

[0029] Figure 4 This illustration shows a schematic diagram of a virtual avatar updated according to a determined display method, as provided in an embodiment of this application.

[0030] Figure 5 This illustration shows the state of a virtual doll in other frames according to an embodiment of this application;

[0031] Figure 6 This illustration shows the state of the second type of virtual doll provided in the embodiments of this application in other frames;

[0032] Figure 7 This illustration shows the state of the third type of virtual doll provided in the embodiments of this application in other frames;

[0033] Figure 8 This illustration shows a schematic diagram of displaying semantic recognition results in an AR interface, as provided in an embodiment of this application.

[0034] Figure 9 A schematic diagram of the background portion in the graphical user interface provided in the embodiments of this application is shown;

[0035] Figure 10 A schematic diagram of the complete check-in process provided in the embodiments of this application is shown;

[0036] Figure 11 This illustration shows the group state after check-in is completed, as provided in an embodiment of this application.

[0037] Figure 12 This illustration shows a structural schematic diagram of a check-in button display device provided in an embodiment of this application;

[0038] Figure 13 A schematic diagram of the structure of an electronic device provided in an embodiment of this application is shown. Detailed Implementation

[0039] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. The components of the embodiments of this application described and shown in the accompanying drawings can generally be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely represents selected embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0040] In related technologies, users on social media apps primarily post information about themselves in text form when checking in. More advanced technologies allow users to add images, GIFs, or videos. The text portion of the check-in is mainly manually entered by the user, while images, GIFs, and videos are uploaded from their local devices. After uploading, posting the content completes the check-in.

[0041] like Figure 1 The diagram shows the graphical user interface of the mobile terminal provided in this application. The graphical user interface displays at least a portion of the virtual interactive scene. The virtual interactive scene includes a first virtual character module controlled by a first user and a second virtual character module controlled by other users. The graphical user interface also displays a check-in button, which includes a virtual avatar set by the first user. The check-in button is floating on the virtual interactive scene.

[0042] The first virtual character module can be a virtual character module named "Youzi" as shown in the figure, while the other virtual character modules in the figure are second virtual character modules controlled by other users. Generally, the position of each virtual character module in this virtual interactive scene can be determined based on the real-time movement of the virtual character by the user in the virtual interactive scene, or it can be determined based on the user's position in the real scene (that is, the user's position in the Earth coordinate system).

[0043] When the virtual character module's position in the virtual interactive scene is determined based on the user's position in the real scene, the user needs to activate the location function of their mobile terminal (the mobile terminal logged in with the virtual character). The mobile terminal obtains its current location in real time and uploads it to the server. The server can then update the position of the virtual character controlled by the user in the virtual scene based on each user's actual location information in the Earth coordinate system. In other words, the position of the virtual character controlled by the user in the virtual scene is a mapping of the user (mobile terminal) in the Earth coordinate system.

[0044] Users can adjust the area of ​​the virtual interactive scene displayed in the graphical user interface (GUI) by swiping their fingers. The distance and speed of the swipe affect the content of the virtual interactive scene displayed in the GUI. For example, if a user swipes their finger to the right, the left-hand side of the virtual interactive scene (currently...) will be displayed in the GUI. Figure 1 All virtual character modules will move to the right.

[0045] In the graphical user interface, the three buttons on the lower right are the AR toggle button, refresh button, and repositioning button. The AR toggle button is used to switch between two virtual interactive scenes (a purely virtual scene created by the server and an augmented reality (AR) scene). Figure 2 The image shows the content displayed in the graphical user interface when switching to the AR scene. In this AR scene interface, the circular button at the bottom is the check-in button, the camera button to the right of the check-in button is used to trigger the photo-taking function, and the back arrow button to the left of the check-in button is used to return to the pure virtual scene. Users can click the camera button to publish the real-time photo as check-in information.

[0046] The check-in button in the graphical user interface is located at Figure 1 The button in the lower middle section. The circular button in the center with a virtual avatar is the main check-in button. Users can trigger the check-in button by clicking, double-clicking, multiple clicks, or long-pressing. The two circular buttons to the left and right of the check-in button are other function buttons; for example, the button on the left can be used for searching, and the button on the right can be used to post text messages.

[0047] The check-in button in the relevant technology is merely a functional control that only displays words such as "Check-in Button," but the applicant believes that due to the browsing interface (such as...) Figure 1 and Figure 2 The main interface shown is the primary interface used by users when operating the app (the interface where users spend the most time). Therefore, the main interface should be fully utilized for information display. Consequently, the solution provided in this application achieves the information display function through the following steps: Figure 3 As shown, the method for displaying the check-in button includes the following steps:

[0048] S101, acquire current external data in real time, the external data including one or more of the following: location data, environmental data, motion data;

[0049] S102, Determine the display method of the virtual doll based on the external data;

[0050] S103, update the appearance of the virtual avatar in the graphical user interface according to the display method to indicate the current status of the first user.

[0051] Location data primarily reflects the current location of the user (the mobile device they are using), and this data can be obtained through various positioning methods. Common positioning methods include:

[0052] Satellite positioning: GPS / BeiDou positioning. This positioning method mainly uses signals emitted by multiple satellites in Earth orbit for positioning. The advantages of this positioning method are high accuracy and wide coverage, but the disadvantage is that it is easily affected by weather and terrain.

[0053] Base station positioning: This method determines location through communication between mobile devices and multiple base stations. It works well in densely populated areas like cities, but its accuracy is lower in remote areas.

[0054] WiFi location: This method determines location by scanning the signal strength of surrounding Wi-Fi hotspots and matching them with a database. It is suitable for indoor environments or environments with weak GPS signals.

[0055] Bluetooth positioning: This method uses the signal strength of Bluetooth devices for location tracking, typically requiring the deployment of a certain number of Bluetooth beacons in the target area. It is suitable for short-range positioning needs.

[0056] Generally speaking, WiFi positioning and Bluetooth positioning can accurately determine the user's altitude information. Therefore, for certain functions, WiFi positioning and Bluetooth positioning must be used or combined to achieve the corresponding function.

[0057] Location data can be presented in two ways: direct location and location information such as schools, hospitals, hotels, etc.

[0058] Environmental data includes one or more of the following:

[0059] Weather data, volume data, voice data, brightness data, temperature data, time data;

[0060] Weather data is primarily obtained through weather forecasts. Weather data can include types such as rain, snow, and hail, and different weather types can be further subdivided into different levels.

[0061] Volume data mainly refers to the ambient volume detected by the mobile terminal. Specifically, after completing real-time recording of the environment, the mobile terminal can directly assess the ambient volume using the recording data; alternatively, it can filter the recording data before assessing the ambient volume. During filtering, the user's voice (or normal human conversation) can be filtered out, and only the volume of ambient noise can be detected.

[0062] Voice data refers to audio data obtained through recording. After acquiring the audio data, the user's spoken content and emotional content can be obtained through speech recognition or semantic recognition (the results of semantic recognition can analyze the user's current mood and other emotional content). There are two sources of audio data: one is the recording of the user's operation on the main interface (the user can turn this function on or off), and the other is the recording of the user's check-in content via voice input.

[0063] Brightness data can also be detected using the photosensitive element of a mobile terminal.

[0064] There are two types of temperature data: regional temperature and the temperature of the user's current environment. Regional temperature can be found through weather forecasts, while the temperature of the user's current environment needs to be obtained through the mobile terminal's detection element or detection devices in the Internet of Things (IoT). (For example, if the mobile terminal is connected to the IoT in the user's area and there are temperature detection devices in the IoT, the mobile terminal can directly obtain the temperature value through those devices after they complete the temperature detection.)

[0065] Regarding time data, mobile terminals can directly obtain network time or the time recorded by an internal timer.

[0066] Motion data includes one or more of the following:

[0067] Attitude data, velocity data, acceleration data, historical movement data.

[0068] Attitude data mainly reflects the current attitude of the mobile terminal and can be obtained through a triaxial sensor or similar device.

[0069] There are two types of velocity data: linear velocity data and angular velocity data. Linear velocity data can be calculated by combining position data with time data, as mentioned earlier, while angular velocity data needs to be calculated by combining attitude data with time data.

[0070] Similarly, acceleration data can be of two types: linear acceleration data and angular acceleration data. Linear acceleration data can be calculated by combining position data with time data, as mentioned earlier, while angular acceleration data needs to be calculated by combining attitude data with time data.

[0071] Historical movement data mainly includes the following categories: historical movement trajectory (including historical location), historical steps, and historical speed (including historical speed changes).

[0072] The display methods can be divided into two types: image display and sound display. Sound display refers to playing voice prompts to the user, while image display refers to prompting the user by changing the appearance of the virtual avatar. Here, the virtual avatar can be a 2D avatar, or... Figure 1 The image shows a 3D avatar, which can be preset in the system and selected by the user.

[0073] Specifically, the image display methods include: updating the virtual avatar's motion animation, updating the virtual avatar's expression, updating the virtual avatar's clothing, updating the virtual avatar's accessories, and updating the virtual avatar's status information.

[0074] The motion animation of a virtual avatar refers to the physical movements that the virtual avatar can perform, such as raising a hand, yawning, running, etc. These movements correspond to semantic recognition results. For example, if the current time is midnight, the virtual avatar can display a yawning animation. When the user's step count is continuously increasing and the user's movement speed reaches running speed, the virtual avatar can switch to running. If the running time is too long, the virtual avatar will show sweating, and the amount of sweat will increase as the running time lengthens. Alternatively, after running for a certain period of time, the virtual avatar can display an animation indicating thirst, prompting the user to drink water.

[0075] The expressions of virtual avatars are mainly used to carry more emotional information. For example, if semantic recognition detects that the user is in a sad state, a sighing animation can be displayed.

[0076] The clothing of a virtual avatar mainly refers to the clothes that affect the appearance of the virtual character. The accessories of a virtual avatar refer to items worn on the body and pets that are led around, which are non-character objects that can display status to the user, in addition to clothing.

[0077] Clothing can also be generated based on external data. For example, if the user's location information shows they are on a beach, the virtual avatar can wear beachwear; if it shows they are near their workplace, the avatar can wear a suit. If environmental information shows the user is in the rain, outdoors in the rain, or if the voice data shows the sound of raindrops, an umbrella can be used as an accessory. If the user's location shows they are in their own neighborhood after get off work, and the voice data detects the sound of a dog barking, then the user can be equipped with loungewear and a dog to indicate they are walking their dog.

[0078] It should be noted that the above data can work individually (influencing the determination of the display method) or in combination. For example, in snowy weather, if the location information shows that the user is outdoors, the virtual avatar can wear a down jacket and hold an umbrella; if in snowy weather, if the location information shows that the user is indoors, the virtual avatar can watch TV and warm itself by a fire indoors.

[0079] After the display method is determined in step S102, the virtual avatar can be updated in step S103 according to the determined display method, such as... Figure 4 As shown, it can be seen Figure 4 The virtual avatar in the video is in a state of listening to music, which is consistent with... Figure 1 The virtual puppets are clearly different from those standing in a standing position. Figure 4 The display method can be either showing the user's location information (e.g., being at a concert) or displaying sound data indicating nearby music playback. For example... Figures 5-7 As shown, it displays Figure 4 The state of the virtual puppet in other frames can be used to form the motion animation of the virtual puppet by continuously viewing multiple frames.

[0080] After the virtual avatar's display method is updated, the first user's graphical user interface will directly show the updated virtual avatar's movements and sounds. Furthermore, other users can also see the first user's updated virtual avatar display method when they open the social media app, allowing them to know the first user's status.

[0081] The proposed method for displaying the check-in button in this application has the following advantages:

[0082] 1. Tool Value: A vivid "environmental detector"

[0083] When users see the virtual avatar, they can intuitively feel the surrounding environment and vividly see how these environmental factors affect "me," that is, the "avatar," rather than just cold, hard data.

[0084] The performance of virtual mascots can subconsciously influence and stimulate users, bringing out their desire to express themselves to a certain extent. Just like how most people would say, "It's so cold today," when users see the movements of a 3D mascot, they can naturally click to express themselves, "It's so cold today."

[0085] 2. Emotional Value: The Second "Self"

[0086] The clothing, styling, and appearance of virtual avatars are all customizable and editable by users. Based on this:

[0087] Virtual avatars can be replicas of users, used in the virtual world to represent the real me;

[0088] Virtual avatars can represent another side of a user, using the virtual world to showcase a different, alternative version of themselves.

[0089] Virtual avatars can be companions for users. Just like conversations, users can completely treat virtual avatars as another character, expressing their own voices, which is a kind of companionship in another sense.

[0090] The following are some specific examples to illustrate the implementation process of this solution:

[0091] If the location data shows that the user is in a commercial street, the virtual avatar will appear to be walking and carrying shopping bags;

[0092] If location data shows that the user is in a hospital, the virtual avatar will appear to be in a state of seeking medical treatment.

[0093] If location data shows that the user is at school, the virtual avatar will appear to be doing homework;

[0094] If the weather data shows that the user is in a rainy or snowy weather, the virtual avatar will appear to be holding an umbrella, or running in the rain / snow while holding an umbrella.

[0095] If the weather data shows that the user is in a sunny day, a sun icon will appear above the virtual avatar's head (the sun can be considered an accessory);

[0096] When the temperature at the user's location exceeds a predetermined value, the virtual avatar will appear to be sweating.

[0097] When the temperature at the user's location is lower than a predetermined value, the virtual avatar will appear cold and shivering.

[0098] When the posture data shows that the user is shaking or rotating, the virtual avatar will appear to be rotating; (this may be in the subway or bus).

[0099] If the activity data shows that the user has taken a lot of steps or consumed a lot of energy today, the virtual avatar will appear to be in a "power walking" state.

[0100] When the sound data shows that the surrounding environment is noisy, the virtual avatar will cover its ears.

[0101] In addition to the above-described method for displaying the check-in button, this embodiment also provides a check-in method based on the check-in button.

[0102] With the development of technology, some social media software has developed more and more products in terms of "helping users express and present themselves", including text, images, videos and even more immersive VR / AR interaction methods. Each new expression tool has unique advantages and corresponding disadvantages.

[0103] In related technologies, users primarily post information about themselves in text form to check in. More advanced technologies allow users to add images, GIFs, or videos. The text portion of the check-in is mainly manually entered by the user, while images, GIFs, and videos are uploaded from their local devices. After uploading, posting the content completes the check-in.

[0104] However, the applicant found that this check-in method was not very accurate or convenient. Therefore, the applicant requested a different check-in method, such as... Figure 1 The diagram shows the graphical user interface of the mobile terminal provided in this application. The graphical user interface displays at least a portion of the virtual interactive scene. The virtual interactive scene includes a first virtual character module controlled by a first user and a second virtual character module controlled by other users. The graphical user interface also displays a check-in button, which is floating on the virtual interactive scene.

[0105] The first virtual character module can be a virtual character module named "Youzi" as shown in the figure, while the other virtual character modules in the figure are second virtual character modules controlled by other users. Generally, the position of each virtual character module in this virtual interactive scene can be determined based on the real-time movement of the virtual character by the user in the virtual interactive scene, or it can be determined based on the user's position in the real scene (that is, the user's position in the Earth coordinate system).

[0106] When the virtual character's position in the virtual interactive scene is determined based on the user's position in the real scene, the user needs to activate the mobile terminal's (the mobile terminal logged into with the virtual character) location function. The mobile terminal obtains its current location in real time and uploads it to the server. The server can then update the position of the user-controlled virtual character in the virtual scene based on each user's actual location information in the Earth coordinate system. In other words, the position of the user-controlled virtual character in the virtual scene is a mapping of the user (mobile terminal) in the Earth coordinate system.

[0107] Users can adjust the area of ​​the virtual interactive scene displayed in the graphical user interface (GUI) by swiping their fingers. The distance and speed of the swipe affect the content of the virtual interactive scene displayed in the GUI. For example, if a user swipes their finger to the right, the left-hand side of the virtual interactive scene (currently...) will be displayed in the GUI. Figure 1 All virtual character modules will move to the right.

[0108] In the graphical user interface, the three buttons on the lower right are the AR toggle button, refresh button, and repositioning button. The AR toggle button is used to switch between two virtual interactive scenes (a purely virtual scene created by the server and an augmented reality (AR) scene). Figure 2 The image shows the content displayed in the graphical user interface when switching to the AR scene. In this AR scene interface, the circular button at the bottom is the check-in button, the camera button to the right of the check-in button is used to trigger the photo-taking function, and the back arrow button to the left of the check-in button is used to return to the pure virtual scene. Users can click the camera button to publish the real-time photo as check-in information.

[0109] The check-in button in the graphical user interface is located at Figure 1 The button in the lower middle section. The circular button in the center, displaying a virtual character, is the main button for checking in. Users can trigger the check-in button by clicking, double-clicking, multiple clicks, or long-pressing. The two circular buttons to the left and right of the check-in button are other function buttons; for example, the left button is for querying information, and the right button is for posting text messages.

[0110] The check-in method includes the following steps:

[0111] S201, responding to the first touch operation of the check-in button, collects voice information in real time to generate voice collection data;

[0112] S202, perform semantic recognition on the voice acquisition data to determine the semantic recognition result of the voice acquisition data;

[0113] S203, determine the update strategy for the first virtual character module based on the semantic recognition result;

[0114] S204, the first virtual character module is updated according to the determined update strategy so that the update result can be displayed in the graphical user interface of the first user and other users.

[0115] In step S101, the first touch operation has two usage methods: long press for voice input and short press for voice input.

[0116] When using long press for voice input, step S201 can be implemented as follows:

[0117] In response to the press of the check-in button, voice information collection begins;

[0118] In response to the release operation after the check-in button is pressed, the collection of voice information ends, and the voice information acquired after the start and before the end is used as voice collection data.

[0119] A single press and an adjacent release complete a full long press operation. Voice recording begins after the user presses the button (using an audio capture device on the mobile device, such as a phone's microphone) and stops after the user releases the button. The voice information collected during the long press of the check-in button is used as the voice data.

[0120] When using short presses for voice input, step S201 can be implemented as follows:

[0121] Upon first touch of the check-in button, it begins real-time collection of voice information and timing.

[0122] When the timer reaches the predetermined duration, the collection of voice information ends, and the voice information acquired after the start and before the end is used as voice collection data.

[0123] In this scenario, the user only needs to press the check-in button once to complete the voice information collection. Specifically, the timer can start when the check-in button is clicked and stop after a predetermined duration. The voice information collected during the time interval between the start and end of the timer is used as the voice data. For example, clicking the check-in button could start the timer for 10 seconds, 20 seconds, or one minute, then stop the timer and terminate the voice information collection.

[0124] The timing method can also be as follows: Timing begins when the check-in button is clicked, and the duration of no valid voice information received is calculated in real time (if the collected voice information does not contain the user's voice, it is considered that no valid voice information has been received). Once the predetermined time for no valid voice information has been received, timing stops, and voice information collection ceases. Specifically, if the user stops speaking 5 seconds after pressing the check-in button, and the system detects 2 seconds of no valid voice information received after 7 seconds, then timing stops, and voice information collection ceases (2 seconds is the predetermined duration of no valid voice information received).

[0125] In addition to voice input, you can also trigger a check-in button to input text (usually a single click to input text).

[0126] When using triggers for text input, the above method may also include the following steps:

[0127] In response to a second touch operation on the check-in button, a virtual character input control is displayed in the graphical user interface;

[0128] The semantic recognition result is generated in response to a touch operation on the virtual character input control.

[0129] The second touch operation is usually a single click, but it can also be a double click, multiple clicks, or other touch methods to trigger text input (such as swiping or triggering a specified gesture graphic).

[0130] After the user issues a second touch operation, a virtual character input control (soft keyboard) will be displayed in the graphical user interface. The user can then input text information using this virtual character input control. The input text information can then be directly used as the semantic recognition result for further message publishing in subsequent steps.

[0131] In step S202, the recognition performed is semantic recognition, not speech recognition, which is one of the main features of this solution. Speech recognition can only convert the user's input speech content into text, but semantic recognition can identify the emotional information of the user's input speech, such as whether the user is in a depressed state, a happy state, etc., and this state information cannot be displayed by speech recognition alone. When performing semantic recognition, it is preferable to use a local model. However, since the size of the semantic recognition model used in the mobile terminal is limited (mainly due to insufficient computing power of the mobile terminal), the accuracy and precision of recognition are limited. Therefore, a dual recognition method can be adopted, that is, first perform recognition using a small semantic recognition model in the mobile terminal. If the recognition result is not ideal, then perform recognition using a large semantic recognition model in the server, thereby ensuring the efficiency and accuracy of recognition.

[0132] In other words, step S202 can be implemented as follows:

[0133] Step 2021: Perform the first semantic recognition on the voice collection data through the current user terminal;

[0134] Step 2022: If the first semantic recognition is successful, then generate the semantic recognition result of the voice acquisition data based on the result of the first semantic recognition.

[0135] Step 2023: If the first semantic recognition fails, the voice collection data is sent to the cloud server for a second semantic recognition.

[0136] Step 2024: If the second semantic recognition is successful, then generate the semantic recognition result of the voice acquisition data based on the result of the second semantic recognition.

[0137] In step 2021, the first semantic recognition is performed using a mobile terminal. The model used for the first semantic recognition is a small model stored in the mobile terminal.

[0138] If the result of the first semantic recognition is unsatisfactory, in step 2023, the voice data can be sent to the server for recognition by a large semantic recognition model. If the result of the first semantic recognition is satisfactory, the result of that semantic recognition can be directly output. Conversely, if the result of the second semantic recognition is successful, the result of the second semantic recognition can be directly used as the semantic recognition result of the voice data.

[0139] It should be noted that both the model used for the first semantic recognition (first semantic recognition model) and the model used for the second semantic recognition (second semantic recognition model) are trained before use. During use, you only need to input the voice collection data into the first semantic recognition model or the second semantic recognition model, and the corresponding semantic recognition model can directly output the semantic recognition result.

[0140] The computing power required to run the first semantic recognition model is less than that required to run the second semantic recognition model, or in other words, the space occupied by the first semantic recognition model is less than that occupied by the second semantic recognition model.

[0141] If the second semantic recognition fails, a prompt message indicating the failure can be directly sent to the user. This prompt message can be displayed as text on the graphical user interface, or it can be sent to the user via voice or other means.

[0142] Generally, whether the first or second semantic recognition fails, the possible reasons may be the same or different, but they can be broadly categorized into two types: the first is insufficient effective speech information, and the second is the inability to analyze the semantic result. In the first case, the most common cause is that the user's voice is too soft or the environment is noisy. In such situations, the model cannot effectively extract speech information, leading to recognition failure. In the second case, the most common cause is that the speech duration is particularly short, or the speech content contains illogical parts.

[0143] Therefore, in response to the above two situations, the solution provided in this application can perform a data validity check before the first speech recognition or before sending the voice data to the cloud server. Validity check can include: signal-to-noise ratio (SNR) judgment, effective speech duration judgment, etc. If any of these judgments fail, a prompt message can be directly returned to the user indicating speech recognition failure and requesting re-entry of the voice. Generally, if the SNR is too low, it indicates excessive noise. In this case, even with noise reduction, the result is difficult to perform semantic recognition, so a prompt message can be directly returned to the user requesting re-entry of the voice. Similarly, if the effective speech duration is too short, a prompt message can also be directly returned to the user requesting re-entry of the voice.

[0144] Furthermore, when generating semantic recognition results, besides relying solely on the user's input voice information and corresponding semantic recognition results, other user information can also be combined for semantic recognition. This information can include user reference information, such as the user's location, the images posted by the user, environmental information about the user's location, and the user's identity information. The reason for using these methods to assist in generating semantic recognition results is that this information can also carry information expressing the user's thoughts. For example, through the user's location information, we can understand the user's current location. The information expressed by users will inevitably differ in different locations, and there are patterns in the information expressed by users in specific types of locations. For instance, in tourist areas, the information expressed by users is more related to relaxation or promotional messages. In workplaces, the information expressed is more work-related. Similarly, the images posted by users (such as those posted for check-ins) can also carry similar directional information. If the check-in image is related to the workplace, the posted voice information will likely be work-related. Environmental information can include weather conditions, time information, user's physical condition, etc. This information can also reflect what the user is thinking, and therefore all contribute to the generation of semantic recognition results.

[0145] Similarly, the above-mentioned information can complement each other. For example, if the time information shows that it is late on a weekday, and the posted picture and / or location shows that the user is in the office, it can be determined that the user is working overtime. Therefore, the semantic recognition result can be generated in the direction of working overtime at the company at night.

[0146] In other words, in the solution provided in this application, the step of generating semantic recognition results of the voice collection data based on the results of the first semantic recognition can be performed as follows:

[0147] Based on the results of the initial semantic recognition and the user's reference information, a semantic recognition result for the voice collection data is generated. The user's reference information includes at least one of the following: the user's location information, the images posted by the user, and environmental information about the user's location.

[0148] Correspondingly, in the solution provided in this application, the step of generating semantic recognition results of the voice collection data based on the results of the first semantic recognition can be performed as follows:

[0149] Based on the results of the second semantic recognition and the user's reference information, a semantic recognition result for the voice collection data is generated. The user's reference information includes at least one of the following: the user's location information, the images posted by the user, and environmental information of the user's location.

[0150] In addition to providing the above functions, the system records the user's location information after each check-in. Therefore, the system can create a footprint map to record where the user has been, and the user can also actively view the footprint map.

[0151] In order to fully express the semantic recognition results, the solution provided in this application sets up a variety of different expression methods for the first virtual character module, that is, the update strategy of the first virtual character module, including at least one of the following:

[0152] The animation of the first virtual character model, the expression of the first virtual character model, the clothing of the first virtual character model, the accessories corresponding to the first virtual character model, the semantic recognition result corresponding to the first virtual character model, and the state information of the first virtual character model.

[0153] Among them, the animation action of the first virtual character model refers to the physical actions that the first virtual character can perform, such as raising hands, yawning, running, etc. These actions also correspond to the semantic recognition results. For example, if the voice collection data shows that the user is expressing content related to exercise, and the semantic recognition result shows that the user is breathing heavily, it can be determined that the user is engaged in vigorous exercise. Then the animation action of the first virtual character model can be running or certain specified sports (the specific sports can be determined based on the semantic recognition results).

[0154] The facial expressions of the first virtual character model are primarily used to reflect the emotional information in the semantic recognition results, which is also the main difference between semantic recognition and speech recognition. Through semantic recognition, the user's current emotional state can be identified. For example, if a user says "I'm happy" but their tone is melancholic, a fake smile can be used as the facial expression for the first virtual character model.

[0155] The clothing of the first virtual character model mainly refers to the clothes that affect the appearance of the virtual character. The accessories corresponding to the first virtual character model refer to items worn on the body and pets walked by, etc., which are non-character objects that can display the user's status, apart from clothing.

[0156] Clothing can also be generated based on semantic recognition results. Besides semantic recognition, clothing can also be generated based on the user's reference information mentioned earlier. For example, if the user's location information shows they are on a beach, the virtual character can wear beachwear; if the location information shows they are near their workplace, the virtual character can wear a suit. If the environment information shows the user is in the rain or outdoors in the rain, an umbrella can be used as an accessory. If the user's posted picture shows them at a barbecue stall, the virtual character can be equipped with barbecue skewers and casual wear. If the user's location shows they are in their own neighborhood after get off work, and the semantic recognition results detect the sound of a dog barking, the user can be equipped with loungewear and a dog to indicate they are walking their dog.

[0157] The semantic recognition results for the first virtual character model are primarily displayed in character form. These characters are divided into two types: text and symbols. Text is simply the textual content of the semantic recognition result, while symbols can display the emotional state of the user's speech. For example, if the user is excited, more exclamation marks can be used; if the user is questioning, question marks can be used. Or, for instance, if the user's identity is that of a rock music enthusiast, special rock-themed characters can be used to display the semantic recognition results. Figure 2 In this example, the words "mushroom" above the virtual character's head are a display of the semantic recognition results. If the time indicates Halloween, or if the user's current location is related to Halloween, a Halloween pumpkin head can be displayed on the image. For example... Figure 8 As shown, this is how semantic recognition results are displayed in the AR interface.

[0158] The first virtual character model's state information consists of the state information posted by the user. In this state information, the user can display their current state, such as... Figure 1 In the image, the "love" symbol above the pomelo's head indicates its status. Among the three people in the upper left corner of the pomelo, "drinking tea" indicates their status.

[0159] The voice information corresponding to the voice acquisition data is actually the voice emitted by the user. This voice can be the original recording, the original voice after noise reduction, or a virtual voice (such as a cartoon voice) that plays the text content after semantic / speech recognition of the user's voice through specific virtual sound effects. Alternatively, based on the user's voice, the timbre information can be determined and the corresponding virtual voice can be played using the timbre information.

[0160] It should be noted that the above update strategy is generally automatically output by the trained model. In other words, the model can automatically output the update strategy based on the semantic recognition results.

[0161] After the update strategy is determined, step S204 can be executed to update the first virtual character module according to the determined update strategy, so that the update result can be displayed in the graphical user interface of the first user and other users.

[0162] After the update is completed, the update result is directly displayed in the first user's graphical user interface (the refresh is completed automatically). Other users need to refresh the interface by timed refresh, manual refresh, or other refresh methods before they can see the updated result of the first user in the first virtual character module.

[0163] Generally, users update their information to display their own information. Therefore, after the first user completes the check-in (executes step S204), the surrounding virtual characters can be gathered together so that the user can see the status of other users (see the status of the virtual characters controlled by other users in the graphical user interface), thereby enhancing interactivity.

[0164] Furthermore, to improve user interaction efficiency, after performing step S204, the solution of this application may also include the following steps:

[0165] Based on the content of the update strategy, a second virtual character module that is similar to the updated first virtual character module is queried as the target virtual character module.

[0166] The target virtual character module is highlighted and restricted to the current graphical user interface.

[0167] The module for finding other similar second virtual characters aims to let the first user know who else is similar to them (similar users are more likely to interact). For example, users who are both working overtime or eating are more likely to communicate. In fact, the update strategy and the semantic recognition result have a certain mapping relationship. Therefore, using either the semantic recognition result or the update strategy for querying in this step is equivalent.

[0168] Specifically, to determine which second virtual character modules are similar to the first virtual character module, a direct comparison can be made based on various information in the update strategy or semantic recognition results.

[0169] There are two ways to highlight a virtual character. One is to prominently display the target virtual character module without hiding the non-target virtual character modules (e.g., through highlighting or enlarging). The second is to hide the secondary virtual character modules of the non-target virtual character modules, so that the user can only see the target virtual character modules that are similar to themselves. When highlighting, a clustered display method can be used to improve the user's viewing efficiency. Specifically, this can be achieved by zooming in or out of the virtual interactive scene space displayed in the graphical user interface to ensure that the number of target virtual character modules displayed in the graphical user interface reaches a predetermined number.

[0170] To ensure that users clearly understand what they are saying, the solution provided in this application also includes the following:

[0171] like Figure 9 As shown, the background of this graphical user interface displays the text currently being entered by the user. By showing this text, the user can see what they have said and what they haven't finished saying, making it easier for them to decide what to say next. The "37°46'N 122°25W" above the text in the graphical user interface represents the user's current latitude and longitude.

[0172] like Figure 10 As shown, the complete process of clocking in is illustrated. Figure 10 The first image shows the user's state in the graphical user interface before triggering the check-in button. In this image, the first virtual character module controlled by the first user is named "Youzi," and the other virtual character modules surrounding Youzi are the second virtual character modules. The circular button with a cartoon character at the bottom of the image is the check-in button.

[0173] After the user clicks the check-in button, they are redirected to... Figure 10In the second image, the user hasn't yet pressed and held the speak button (the circular button with a microphone icon at the bottom of the image) to start speaking, so no text is displayed on the background. After the user starts speaking, the screen jumps to the third image, where the background displays the text corresponding to the user's current words. The fourth image shows the user having finished speaking; the user clicked the cancel button to the left of the speak button but hasn't lifted their hand. The fifth image shows the user manually correcting their previous statement or re-entering the text to check in. The seventh image shows the check-in information before publication, allowing the user to confirm beforehand. During this process, any adjustments to the update strategy can be made. After confirmation, the screen moves to the eighth image, where the first virtual character module is updated according to the update strategy. An animation effect is then displayed; since the image is static, only a single frame of the animation is shown. In this animation, the first virtual character module is singing and dancing, while the surrounding target virtual character modules are highlighted (the second virtual character module, which is not a target virtual character module, is hidden). The image in Chapter 9 shows the state after the animation has finished playing, and the overall state has returned to that of the first image (only the content updated according to the update strategy has been retained).

[0174] like Figure 11 As shown, the group's status after completing the check-in is displayed. Figure 11 The first image in the document is an example of an image used when checking in (the interface before step S101). The second and third images show the changes in the interface before and after step S104. As you can see, in the third image, the second virtual character module displayed in the graphical user interface has changed significantly, meaning that it has been filtered. Also, in the third image, the displayed area has been enlarged.

[0175] Overall, the solution provided in this application has the following characteristics:

[0176] In terms of expression, this solution retains the advantages of traditional Chinese and image-based expression tools, while increasing the weight of expression in the voice dimension and adding sufficient fun. It allows users to have the basic advantages of text and images when expressing themselves, as well as a more novel experience and expression, quickly "speaking out" and "talking" anytime, expressing themselves in a more natural and direct way.

[0177] In terms of the expression of results, this solution breaks through the WYSIWYG user experience. Compared to the filters, background music, or special effects commonly used in traditional expression tools, this solution uses a more vivid approach—the rich emotions and movements of the puppet. Depending on the content being expressed, the user's puppet will react differently, including changes in emotion and movement, more realistically and directly mapping the user's expression onto the puppet, making the puppet express itself more vividly and realistically. At the same time, the addition of the user's input voice ensures that the puppet doesn't detach itself from reality. The vivid performance after intelligent analysis, combined with the user's authentic and direct voice, creates the unique result of this expression tool.

[0178] Additional information on unique features:

[0179] Unique Action Performance: In this solution, everything from subtle emotions like facial expressions and lip movements to auxiliary expressions like actions and props is presented in a unique way. It doesn't simply replicate the emotions or actions users would make in real life, but rather processes them, presenting them in a more exaggerated, surreal, humorous, or whimsical manner. For example, the voice input "I give up" is a common expression among many users. In this solution, a similar presentation is "I float," where the entire puppet floats up, along with surrounding objects, using a homophone to express the feeling of "I give up," and visually conveying a sense of "uncontrollable helplessness."

[0180] Unique Understanding and Analysis: In this solution, users don't need to manually select corresponding actions; they simply need to speak or type. Based on the user's expression, the solution will select emotions and actions that match the user's mood. This precise understanding of the user's intended message is a unique feature of this solution. It comprehensively judges the user's expression based on tone, context, environment, time, and even location, giving the user a clear and authentic experience.

[0181] The solution provided in this application also has the following value:

[0182] 1. Tool value: A simple, direct, versatile, accurate, vivid, and effective expression tool.

[0183] Simple and direct: Users only need to say a sentence or type a paragraph to complete their expression, and a fun Bondee performance can be generated quickly.

[0184] Rich in features: In each expression, users can adjust their voice effects, change their puppet's movements, modify the description of images and text, and even customize the expression of props at any time.

[0185] Accurate and vivid: Understand the user's tone and context, combine the user's time / location, fully analyze the user's expression, and select the emotions and actions that best match the user's expression.

[0186] Rich in effects: It has the basic effects of traditional graphic expression tools, as well as 3D, dynamic puppet performances, and the support of sound performance, forming a rich visual and auditory expression effect.

[0187] 2. Emotional value: Discover other users similar to the user.

[0188] Understanding You: Every "Boop!" expression from a user is recorded in the app. Through continuous expression, the "Boop!" tool learns more and more about the user's language, expression style, and common tone, thus selecting the most suitable emotions and actions to express the user. It personalizes every user experience, understanding both E-people and i-people, and catering to various styles such as trendy, street, home, and Y2K!

[0189] Record Your Moments: Every "Boop!" is stored on a footprint map within the app. The location of each "Boop!" is recorded on this map, allowing users to easily review their thoughts at any given time and place. It also allows for management and adjustment, truly recording each user's moments at different times and locations.

[0190] Connect with more "you"s similar to you: In the final stage of "Boop!", if there are "Boop!"s around you with similar content, these people will also appear around you, like an echo "Echo". After each "Boop!", you connect with every echo similar to you and resonate with others.

[0191] 3. Social and community value: A genuine, fun, and warm community atmosphere.

[0192] Authenticity: When a user posts a "Boop!", the text, images, and voice are all unique and authentic. The location where a "Boop!" appears is also unique and authentic. Every authentic "Boop!" makes up an authentic Bondee.

[0193] Fun: The actions and emotions during each "Boop!" are ever-changing, and the unique outfits of each person make Bondee's "Boop!" content fun and unique.

[0194] Warm Resonance: Each "Boop!" is accompanied by a unique Echo, and the "Boop!" dolls in the same area will gather together, creating a lively and warm atmosphere.

[0195] Based on the same technical concept, this application also provides a check-in button display device, which operates on a mobile terminal device. The device displays at least a portion of a virtual interactive scene in the graphical user interface of the mobile terminal device. The virtual interactive scene includes a first virtual character module controlled by a first user and a second virtual character module controlled by other users. A check-in button is also displayed in the graphical user interface. The check-in button includes a virtual avatar set by the first user, and the check-in button is floating on the virtual interactive scene. Figure 12 As shown, the device includes:

[0196] The acquisition module 1201 is used to acquire current external data in real time, the external data including one or more of the following: location data, environmental data, and motion data;

[0197] The determining module 1202 is used to determine the display method of the virtual avatar based on the external data;

[0198] The update module 1203 is used to update the display mode of the virtual avatar in the graphical user interface according to the display mode, so as to indicate the current status of the first user.

[0199] Optionally, environmental data may include one or more of the following: weather data, volume data, voice data, brightness data, temperature data, and time data; motion data may include one or more of the following: posture data, speed data, acceleration data, and historical movement data.

[0200] Optionally, when determining the display method of the virtual avatar based on the external data, the determining module 1202 is specifically used for:

[0201] Based on the external data, the display method corresponding to the external data is found by querying a table pre-stored in the mobile terminal device.

[0202] Optionally, the image display methods include: updating the virtual avatar's motion animation, updating the virtual avatar's expression, updating the virtual avatar's clothing, updating the virtual avatar's accessories, and updating the virtual avatar's status information.

[0203] Figure 13 A schematic diagram of an electronic device provided in this application embodiment includes: a processor 1301, a memory 1302, and a bus 1303. The memory 1302 stores machine-readable instructions executable by the processor 1301. When the electronic device runs the above-described information processing method, the processor 1301 and the memory 1302 communicate through the bus 1303. The processor 1301 executes the machine-readable instructions to perform the method steps described in Embodiment 1.

[0204] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, performs the steps described in Embodiment 1.

[0205] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the devices, electronic devices, and computer-readable storage media described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0206] In the several embodiments provided in this application, it should be understood that the disclosed methods, apparatuses, electronic devices, and computer-readable storage media can be implemented in other ways. The apparatus embodiments described above are merely illustrative. For example, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. Furthermore, multiple modules or components may be combined or integrated into another system, or some features may be ignored or not executed. Additionally, the displayed or discussed mutual couplings, direct couplings, or communication connections may be through some communication interfaces; indirect couplings or communication connections between devices or modules may be electrical, mechanical, or other forms.

[0207] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0208] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0209] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a processor-executable, non-volatile, computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0210] Finally, it should be noted that the above-described embodiments are merely specific implementations of this application, used to illustrate the technical solutions of this application, and not to limit them. The scope of protection of this application is not limited thereto. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features, within the scope of the technology disclosed in this application. Such modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of protection of the claims.

Claims

1. A punch button display method characterized by, Acting on a mobile terminal device, at least part of a virtual interaction scene is displayed in a graphical user interface of the mobile terminal device, the virtual interaction scene has a first virtual role module controlled by a first user and a second virtual role module controlled by other users; a punch card button is also displayed in the graphical user interface, the punch card button includes a virtual doll set by the first user, and the punch card button is displayed floating on the virtual interaction scene; The punch card button display method comprises: Real-time acquisition of current external data, the external data comprising one or more of the following: position data, environment data, motion data; According to the external data, determine the display mode of the virtual doll; According to the display mode, update the display mode of the virtual doll in the graphical user interface to prompt the current state of the first user.

2. The method of claim 1, wherein, The environment data comprises one or more of the following: weather data, volume data, voice data, brightness data, temperature data, and time data; the motion data comprises one or more of the following: posture data, speed data, acceleration data, and historical movement data.

3. The method of claim 1, wherein, The step of determining the display mode of the virtual doll according to the external data comprises: According to the external data, the display mode corresponding to the external data is found by querying a table pre-stored in the mobile terminal device.

4. The method of claim 1, wherein, The image display mode comprises updating the action animation of the virtual doll, updating the expression of the virtual doll, updating the clothing of the virtual doll, updating the ornament of the virtual doll, and updating the state information of the virtual doll.

5. A punch button display device, characterized by Acting on a mobile terminal device, at least part of a virtual interaction scene is displayed in a graphical user interface of the mobile terminal device, the virtual interaction scene has a first virtual role module controlled by a first user and a second virtual role module controlled by other users; a punch card button is also displayed in the graphical user interface, the punch card button includes a virtual doll set by the first user, and the punch card button is displayed floating on the virtual interaction scene; The punch card button display device comprises: An acquisition module configured to acquire real-time external data, the external data comprising one or more of the following: position data, environment data, and motion data; A determination module configured to determine the display mode of the virtual doll according to the external data; An update module configured to update the display mode of the virtual doll in the graphical user interface according to the display mode to prompt the current state of the first user.

6. The apparatus of claim 5, wherein The environment data comprises one or more of the following: weather data, volume data, voice data, brightness data, temperature data, and time data; the motion data comprises one or more of the following: posture data, speed data, acceleration data, and historical movement data.

7. The apparatus of claim 5 wherein, When the determination module is used to determine the display mode of the virtual doll according to the external data, it is specifically configured to: According to the external data, the display mode corresponding to the external data is found by querying a table pre-stored in the mobile terminal device.

8. The apparatus of claim 5, wherein, The image display mode includes: updating action animation of the virtual figure, updating expression of the virtual figure, updating dressing of the virtual figure, updating ornament of the virtual figure, and updating state information of the virtual figure.

9. An electronic device, comprising: Comprise: A processor, a memory and a bus, the memory stores machine readable instructions executable by the processor, when the electronic device is running, the processor and the memory communicate through the bus, the machine readable instructions are executed by the processor to execute the steps of the method as claimed in any one of claims 1 to 4.

10. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, and the computer program is executed by the processor to execute the steps of the method as claimed in any one of claims 1 to 4.

Images