Method and device for inputting in virtual environment, equipment and storage medium
Through the combination of virtual avatar gestures and guidance elements, the problem of low-efficiency of virtual keyboard input in virtual reality environments is solved, and faster and more accurate input operations are achieved.
Patent Information
- Application Number
- CN202310525076.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-10
- Publication Date
- 2024-11-12
AI Technical Summary
In a virtual reality environment, the traditional virtual keyboard input method has poor accuracy due to the long distance between the pinyin letters, and high-frequency operations lead to user fatigue and low input efficiency.
The input element is determined through the gesture actions of the virtual avatar to the virtual keyboard, and the guide element is used to guide the user to select candidate input elements, reducing the memory of the virtual keyboard elements and shortening the input path.
It improves the speed and efficiency of input in the virtual environment, reduces user fatigue, and simplifies the input operation process.
Smart Images

Figure CN118939107A_ABST
Abstract
Description
Technical Field
[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for input in a virtual environment. Background Art
[0002] In the future, the way humans interact will shift from 2D interaction to more efficient 3D interaction. The 3D visual interaction system depends on the development of virtual reality (VR), augmented reality (AR) and mixed reality (MR), which are collectively referred to as "extended reality" (XR). In the XR scenario, users can input Chinese characters through a virtual keyboard presented in the virtual environment. Summary of the invention
[0003] In a first aspect of the present disclosure, a method for inputting in a virtual environment is provided. The method comprises: determining a first input element selected on a virtual keyboard presented in the virtual environment based on a gesture action of a virtual avatar with respect to the virtual keyboard; presenting a first guide element associated with the first input element, the first guide element at least indicating a first group of candidate input elements that can be combined with the first input element; determining a second input element selected from the first group of candidate input elements based on the gesture action; and causing at least one target object to be presented in the virtual environment, the at least one target object being determined based at least on a combination of the first input element and the second input element.
[0004] In a second aspect of the present disclosure, a device for inputting in a virtual environment is provided. The device comprises: a first input element determination module configured to determine a first input element selected on a virtual keyboard presented in the virtual environment based on a gesture action of a virtual avatar on the virtual keyboard; an indication module configured to present a first guide element in association with the first input element, the first guide element at least indicating a first input element that can be associated with the first input element
[0005] a first group of candidate input elements for the combination of the first input element and the second input element; a second input element determination module, configured to determine a second input element selected from the first group of candidate input elements based on the gesture action; and a presentation module, configured to cause at least one target object to be presented in the virtual environment, the at least one target object being determined based on at least a combination of the first input element and the second input element.
[0006] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect.
[0007] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.
[0008] It should be understood that the contents described in the summary of the present invention are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:
[0010] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;
[0011] Figure 2 A schematic diagram showing a method of selecting an initial consonant pinyin element on a virtual keyboard in a virtual scene according to some embodiments of the present disclosure is shown;
[0012] Figure 3A A schematic diagram showing a display style of a first guide element according to some embodiments of the present disclosure;
[0013] Figure 3B A schematic diagram showing a first guiding element presented in a virtual scene according to some embodiments of the present disclosure is shown;
[0014] Figure 3C A schematic diagram showing the selection of a monosyllabic vowel and a pinyin element guided by a first guiding element in a virtual scene according to some embodiments of the present disclosure is shown;
[0016] Figure 4A A schematic diagram showing a display style of a second guide element according to some embodiments of the present disclosure;
[0017] Figure 4B A schematic diagram showing a second guide element presented in a virtual scene according to some embodiments of the present disclosure is shown;
[0018] Figure 4CA schematic diagram showing the selection of a vowel pinyin element in a subsequent pinyin element guided by a second guiding element in a virtual scene according to some embodiments of the present disclosure;
[0019] Figure 4D A schematic diagram showing the selection of a vowel pinyin element in a subsequent pinyin element guided by a second guiding element in a virtual scene according to some embodiments of the present disclosure;
[0020] Figure 5 A schematic diagram showing a display style of trajectory information from a first guide element to a second guide element according to some embodiments of the present disclosure;
[0021] Figure 6 A schematic diagram showing a display style of a third gesture guide element according to some embodiments of the present disclosure;
[0022] Figure 7 A schematic diagram showing display styles of a first guide element and a second guide element according to some other embodiments of the present disclosure;
[0023] Figure 8 A flowchart showing a process of inputting in a virtual environment according to some embodiments of the present disclosure;
[0024] Fig. 9 A block diagram showing an apparatus for inputting in a virtual environment according to some embodiments of the present disclosure; and
[0025] Fig.10 A block diagram of a device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION
[0026] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0027] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "to
[0028] Based in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.
[0029] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.
[0030] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.
[0031] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information, so that the user can independently choose whether to provide personal information to software or hardware such as electronic devices, applications, servers or storage media that execute operations of the technical solution of the present disclosure based on the prompt message.
[0032] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information is sent to the user in a manner such as a pop-up window, in which the prompt information can be presented in text form. In addition, the pop-up window can also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.
[0033] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.
[0034] As briefly mentioned above, in the XR scene, users can input Chinese characters through a virtual keyboard presented in a virtual environment. In the traditional input method, on the one hand, the mobile input method is used, that is, the user uses rays or touch to click on the mobile virtual keyboard to input Chinese characters. On the other hand, the physical keyboard is migrated to the XR scene in the form of a virtual keyboard, and the user uses rays or touch to click on the virtual keyboard in the XR scene to type. However, these two input methods are different in the use of click operation input for the virtual keyboard.
[0035] When typing Chinese characters, the distance between pinyin letters is long, resulting in poor accuracy in inputting Chinese characters. High-frequency operation can cause user fatigue, and users need to keep their attention on the virtual keyboard interface, resulting in low input efficiency.
[0036] Embodiments of the present disclosure propose a scheme for inputting in a virtual environment. According to various embodiments of the present disclosure, a virtual keyboard (e.g., an initial consonant keyboard) is presented in a virtual environment, and the first input element (e.g., an initial consonant pinyin element) selected on the virtual keyboard is determined based on the gesture action of the virtual avatar on the virtual keyboard. And a first guide element (e.g., a guide element that displays subsequent pinyin elements) is presented, and the first guide element at least indicates a first group of candidate input elements (e.g., multiple subsequent pinyin elements) that can be combined with the first input element.
[0037] Further, the second input element selected from the first group of candidate input elements (e.g., the target subsequent pinyin element) may be determined, and at least one target object (e.g., words, emoticons, symbols, etc. in various languages) may be presented, wherein the at least one target object is determined based on at least a combination of the first input element and the second input element.
[0038] In this way, when inputting in a virtual environment, there is no need to memorize the input elements on the virtual keyboard, which shortens the input operation path in the XR scene and improves the speed and efficiency of input.
[0039] The embodiments of the present disclosure are described below in conjunction with the accompanying drawings. It will be understood from the following description that according to the embodiments of the present disclosure, a solution for inputting Chinese characters in a virtual environment is provided for users.
[0040] Figure 1 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. In the environment 100, an XR device has at least one user 130 in the example environment 100. The user 130 can wear an XR device 110.
[0041] The computing device 120 constructs a virtual scene for at least one user or merges virtual content with a real scene. For example, the XR device 110 communicates with the computing device 120 to reconstruct a virtual scene for the user 130 or merge virtual content with a real scene. In some embodiments, the virtual scene reconstructed by the computing device 120 based on VR technology, and the scene merged with virtual content and a real scene based on AR technology or MR technology, are collectively referred to as a virtual scene 150.
[0042] XR device 110 may be a head-mounted or wearable near-eye display device, such as a head-mounted display, smart glasses, etc., supporting VR, AR, MR and other technologies.
[0043] The system may include an image generation component and an optical display component for reconstructing a virtual scene 150 and displaying virtual objects in a monocular or binocular field of view. Virtual objects may include three-dimensional virtual objects and / or two-dimensional virtual objects. A two-dimensional virtual object may include a two-dimensional window without thickness for presenting various contents in the virtual scene 150 similar to an electronic screen. For example, a two-dimensional virtual object may include a virtual screen for displaying a target object (e.g., Chinese characters). A three-dimensional virtual object may include various virtual avatars corresponding to users. For example, a user 130 may present a corresponding virtual avatar in a virtual scene 150 by wearing an XR device 110. A three-dimensional virtual object may also include a virtual keyboard.
[0044] In some embodiments, the computing device 120 may determine the relative position between the hand of the user 130 (or its corresponding virtual hand) and the virtual object. The computing device 120 may be a separate device capable of communicating with the XR device 110 and / or other image capture devices, such as a server, computing node, etc. for image or data processing, or may be integrated with the XR device 110 and / or other image capture devices. In some embodiments, the computing device 120 may be implemented as an XR device 110, that is, in this case, the XR device 110 may implement all the functions of the computing device 120. It should be understood that the above description of the computing device 120 is merely exemplary and non-restrictive, and the computing device 120 may be implemented as devices of various forms, structures or categories, and the embodiments of the present disclosure are not limited thereto.
[0045] It should be understood that the structure and functionality of environment 100 are described for exemplary purposes only and does not imply any limitation on the scope of the present disclosure.
[0046] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.
[0047] Selection and confirmation of input elements
[0048] As discussed above, the computing device 120 constructs a virtual keyboard in the virtual scene 150. The user 130 can input elements through the virtual keyboard, and at least part of the input elements are displayed in the display area in the virtual scene 150. Such input elements include, for example, any appropriate elements for completing the input of appropriate objects in the virtual environment. For example, such input elements may include pinyin input elements in the Chinese input environment, letter input elements in the English input environment, hiragana input elements in the Japanese input environment, code input elements in the expression input environment, and the like.
[0050] Accordingly, the target object may be an input object determined based on one or more input elements inputted, and such input objects may include, for example, text input items (e.g., characters, words, sentences, etc. in any appropriate language), expression input items (e.g., picture expressions or character expressions, etc.), symbol input items (e.g., punctuation marks or special symbols, etc.). It should be understood that such a target object may be determined by an input application running on the computing device 120, and the present disclosure is not intended to limit the determination process and presentation manner of the target object.
[0051] For the convenience of description, the Chinese input environment will be used as an example below to describe the Chinese input process in the virtual environment with reference to the pinyin element. However, it should be understood that the present disclosure is also applicable to the input process of other appropriate objects without violating the spirit of the present disclosure.
[0052] Considering that when the virtual avatar inputs through the virtual keyboard, it is necessary to continuously select multiple input elements on the virtual keyboard. For example, the selected input element can be a pinyin element. As an example, the computing device 120 determines one or more candidate Chinese characters based on at least one selected pinyin element, and displays the candidate Chinese characters in the virtual scene 150. The computing device 120 receives the Chinese characters selected for the multiple candidate Chinese characters and determines the Chinese characters that need to be input. The computing device 120 displays the Chinese characters that need to be input in a display area (e.g., a virtual screen) in the virtual scene 150.
[0053] In some embodiments, the first input element selected on the virtual keyboard is determined based on a gesture action of the virtual avatar with respect to the virtual keyboard presented in the virtual environment. Figure 1 , the operation method of selecting and confirming the first input element is described in detail. Figure 2 A schematic diagram of selecting a first input element on a virtual keyboard in a virtual scene according to some embodiments of the present disclosure is shown.
[0054] In some embodiments, the virtual keyboard may be, for example, an initial consonant keyboard, and the first input element includes a target initial consonant pinyin element determined from a group of initial consonant pinyin elements presented on the virtual keyboard. Figure 2 As shown, the computing device 120 constructs a virtual keyboard 210 as shown in the figure in the virtual scene 150.
[0055] In some embodiments, the virtual keyboard 210 may be an initial consonant keyboard. For example, the initial consonant keyboard displays all initial consonant elements in Chinese Pinyin, q, w, r, t, y, b, p, m, f, d...x, z / zh, s / sh, c / ch. The layout of all initial consonant elements may refer to the arrangement of characters in a physical keyboard.
[0057] In some embodiments, the virtual keyboard includes a multi-element key, and multiple initial consonant pinyin elements with the same initial pinyin element are presented on the multi-element key. For example, initial consonant pinyin elements "z" and "zh" with the same initial pinyin element "z" are presented on key 201; initial consonant pinyin elements "s" and "sh" with the same initial pinyin element "s" are presented on key 203, and initial consonant pinyin elements "c" and "ch" with the same initial pinyin element "c" are presented on key 205.
[0058] The computing device 120 may also construct a virtual avatar (not shown) for the user 130 in the virtual scene 150, so that the virtual avatar selects the first input element presented in the virtual scene 150. For example, Figure 2 As shown, the computing device 120 draws the hand of the virtual avatar, that is, the virtual hand 230 , for the user 130 in the virtual scene 150 . The computing device 120 receives a selection of the first input element on the virtual keyboard 210 presented in the virtual scene 150 by the virtual hand 230 .
[0059] In the VR scene, the computing device 120 may draw a virtual hand for representing the user 130. Such a virtual hand may be drawn based on tracking the hand of the user 130, so that the gestures made by the user 130 may be detected and represented by the movement of the virtual hand in the virtual scene 150. It should be understood that any appropriate method such as image recognition, sensor positioning, etc. may be used to detect the hand movements of the operator, and the present disclosure is not intended to be limited thereto.
[0060] It is understandable that in an AR scene, the virtual hand may not be drawn, and the user 130 may directly interact with the virtual keyboard 210 in the virtual scene 150 through the hand.
[0061] It is understandable that in a VR scene, the virtual hand may not be drawn, and the user 130 may use other appropriate input devices to interact with the virtual keyboard 210 in the virtual scene 150. For example, the computing device 120 may interact through an interactive device such as a communicatively coupled joystick or handle.
[0062] In some embodiments, the computing device 120 may receive a user operation on the first input element and activate the first input element so that the first input element is in a selectable state.
[0063] Alternatively or additionally, two fingers of the user's hand or virtual hand are pinched (e.g., index finger and thumb) to form a pinch gesture for activating the first input element, and the pinch gesture is moved
[0064] to the position of the option for the first input element to activate the first input element.
[0065] As an example, as Figure 2 shown, the pinching gesture of the index finger and thumb moves to the (near) position of the option of the initial consonant pinyin element (e.g., w), and the identifier of the pinching gesture indicates the first input element to be input. For example, the first input element is the determined target initial consonant pinyin element (e.g., w). At this time, the target initial consonant pinyin element (e.g., w) is highlighted and presented to the user to indicate that the target initial consonant pinyin element (e.g., w) is in an activated state, so that the target initial consonant pinyin element (e.g., w) is in a selectable state.
[0066] Alternatively or additionally, the computing device 120 receives a pressing operation of the user on the handle button, and moves the handle to the (near) position of the option of the input element to activate the first input element.
[0067] In some embodiments, the computing device 120 may receive a user operation for releasing the activation state of the first input element to determine the selection of the first input element.
[0068] Alternatively or additionally, the computing device 120 may receive an operation of releasing the pinching gesture of the user's hand or virtual hand, for example, releasing the pinching of the index finger and thumb, to determine the selected first input element.
[0069] Alternatively or additionally, the computing device 120 may receive a pressing and releasing operation of the user on the handle button to determine the selected first input element.
[0070] In some embodiments, in response to determining the selection of the first input element (e.g., the target initial consonant pinyin element), the computing device 120 may also present a Chinese character representation of the first input element in the virtual scene 150 to indicate multiple candidate Chinese characters. Exemplarily, as Figure 2 shown, in response to determining the selection of the target initial consonant pinyin element "w", the computing device 120 may also present the Chinese character representation 250 of the target initial consonant pinyin element "w" in the virtual scene 150. The Chinese character representation 250 indicates multiple candidate Chinese characters such as "我 (wǒ)", "问 (wèn)", "为 (wèi)", etc.
[0071] In the embodiments of the present disclosure, the computing device 120 may select and confirm subsequent input elements based on the above-discussed operation methods for selecting and confirming the first input element. For example, in the case of continuously selecting multiple subsequent input elements, the computing device 120 may receive the movement trajectory of the pinching gesture, and one or more subsequent input elements are activated, so that one or more
[0072] subsequent input elements are in a selected state.
[0073] For example, computing device 120 may receive an operation of releasing the pinch gesture to determine the selected subsequent input element.
[0074] Based on the above discussion, this operation method of selecting and confirming input elements on the virtual keyboard can simplify user operations and thus improve input speed and efficiency.
[0075] Presentation of guide elements
[0076] In the present disclosure, the first guide element and the second guide element are used to guide the user to select one or more subsequent input elements, and trajectory information corresponding to the gesture movement is formed during the selection process (described in detail below), so that the user does not need to remember the position of the input elements on the virtual keyboard, further improving the input speed and efficiency.
[0077] In some embodiments, the computing device 120 presents a first guide element in association with the first input element, and the first guide element at least indicates a first group of candidate input elements that can be combined with the first input element. Based on the gesture action, the second input element selected from the first group of candidate input elements is determined. As an example, if the first input element is a target initial consonant pinyin element, then the first group of candidate input elements can be a final pinyin element that can be appropriately combined with the target initial consonant pinyin element as a subsequent input element. For example, such a first group of candidate input elements can be a plurality of monophthong and final pinyin elements. In other words, the selected second input element can be a target monophthong and final pinyin element selected from a plurality of monophthong and final pinyin elements.
[0078] Considering that the display styles of the first guide element may be different, specifically, the first group of candidate input elements may be displayed in a variety of arrangement styles on the first guide element. The following describes an example of displaying the first group of candidate input elements on the first guide element.
[0079] In some embodiments, the first guide element includes a first portion and a second portion surrounding the first portion, the first portion indicates the selected first input element, and the second portion indicates at least a first group of candidate input elements. Figure 3A Schematic diagram of the display style of the first guide element according to some embodiments of the present disclosure. The first guide element includes a first part 313 and a second part 315. The first part 313 indicates the selected first input element, for example, an initial consonant pinyin element (not shown), and the second part at least indicates a first group of candidate input elements.
[0080] The candidate input elements include, for example, monophthong pinyin elements: a, u, i, e, o, ü.
[0081] In some embodiments, the distribution of the first group of candidate input elements in the second portion is determined based on the number of the first group of candidate input elements. For example, the first group of candidate input elements may be evenly distributed in the second portion based on the number of the first group of candidate input elements.
[0082] As an example, the computing device 120 may pre-set that the first group of candidate input elements indicated by the first guide element are arranged according to the number of the first group of candidate input elements and a predetermined arrangement. For example, each candidate input element in the first group of candidate input elements (e.g., monophthong pinyin elements: a, u, i, e, o, ü) has a predetermined position associated with the first guide element on the second part 315, and these predetermined positions are arranged around the first part 313. Figure 3A As shown, the display style of the first guide element is a hexagonal turntable, and the hexagonal turntable is arranged with monophthong vowel pinyin elements: a, i, u, e, o, ü. It should be understood that Figure 3A The display style of the first guide element shown is only an example, and the display style of the first guide element may also be other styles. For example, the display style of the first guide element may also be concentric rings, and the present disclosure does not make specific limitations in this regard.
[0083] Figure 3B A schematic diagram showing a first guiding element presented in a virtual scene according to some embodiments of the present disclosure is shown; Figure 3C A schematic diagram of guiding the selection of a monosyllabic vowel pinyin element by a first guiding element in a virtual scene according to some embodiments of the present disclosure is shown. Figure 1 , combined with Figure 3B , Figure 3C The process of the first guiding element guiding the user to select the first group of candidate input elements is described.
[0084] In some embodiments, the computing device 120 receives the selection of the initial consonant pinyin element on the virtual keyboard presented in the virtual environment by the virtual avatar, and presents the first guiding element. Figure 3B As shown, the computing device 120 receives the operation of the pinching gesture of the virtual hand 230 approaching the initial consonant pinyin element (e.g., w), activates the initial consonant pinyin element (e.g., w), makes the initial consonant pinyin element (e.g., w) in a selectable state, and presents the first guide element 310 at the same time. Here, the selected initial consonant pinyin element is also called the target initial consonant pinyin element. The computing device 120 superimposes the first guide element 310 on the selected initial consonant pinyin element (e.g., w). The position of the first part 313 of the first guide element 310 corresponds to the position of the selected initial consonant pinyin element (e.g., w).
[0085] In some embodiments, the first set of candidate input elements may be in the first guide element
[0086] Highlight. Take the example that the first group of candidate input elements includes multiple preset pinyin elements for specific explanation. Based on the spelling rules, the computing device 120 determines at least one subsequent pinyin element that can be combined with the selected initial consonant pinyin element from the multiple preset pinyin elements. The at least one subsequent pinyin element is highlighted in the first guide element. For example, one or more subsequent pinyin elements that meet the spelling rules, that is, can be combined with the selected initial consonant pinyin element, are displayed as available forms, and subsequent pinyin elements that do not meet the spelling rules are displayed as unavailable forms.
[0087] For example, continue to refer to Figure 3B , the computing device 120 highlights the monosyllable and vowel pinyin elements that can be combined with the selected initial pinyin element on the second part 315 of the first guide element 310 in the virtual scene 150 as visible. For example, the monosyllable and vowel pinyin elements a, u, e, and o that can be combined with the selected initial pinyin element "w" are displayed in a highlighted state. The monosyllable and vowel pinyin elements i and ü that cannot be combined with the selected initial pinyin element "w" are displayed as invisible.
[0088] In some embodiments, the selected initial consonant pinyin element (also referred to as the target initial consonant pinyin element) is displayed in a semi-transparent style in the first guide element.
[0089] For example, Figure 3B As shown, in addition to the monosyllabic and final Pinyin elements a, u, e, and o that can be combined with the selected initial Pinyin element "w" are highlighted (highlighted state) on the first guide element 310, the selected initial Pinyin element "w" is also displayed in a semi-transparent style (low-brightness state) in front of each monosyllabic and final Pinyin element.
[0090] The above describes that a first group of candidate input elements that can be combined with a first input element is indicated by a first guide element, and the first group of candidate input elements are displayed at a predetermined position associated with the first input element, thereby guiding the user to conveniently and quickly select the desired input element from the first group of candidate input elements.
[0091] In some embodiments, computing device 120 receives a motion trajectory of a gesture of the avatar, such as a motion trajectory of a pinch gesture, and computing device 120 selects one from the first set of candidate input elements according to the motion trajectory of the gesture of the avatar.
[0092] The virtual hand of the avatar moves from the position of the selected first input element to the position of the second input element selected from the first group of candidate input elements combined with the first input element, thereby forming a gesture motion trajectory.
[0094] In some embodiments, the computing device 120 highlights a second input element. The second input element may be a target single-vowel Chinese phonetic alphabet element selected from single-vowel Chinese phonetic alphabet elements. Exemplarily, as Figure 3C shown, the computing device 120 receives the movement trajectory of the pinching gesture of the virtual hand 230. For example, the movement trajectory of the pinching gesture moving from a selected initial consonant Chinese phonetic alphabet element (e.g., w) to a position near the target single-vowel Chinese phonetic alphabet element (e.g., e) to be selected on the first guiding element 310, thereby activating the target single-vowel Chinese phonetic alphabet element (e.g., e) and making the target single-vowel Chinese phonetic alphabet element (e.g., e) in a selectable state. Meanwhile, the computing device 120 highlights the target single-vowel Chinese phonetic alphabet element (e.g., e). For example, a partial area of the selected single-vowel Chinese phonetic alphabet element (e.g., e) is displayed in a highlighted state.
[0095] The computing device 120 also displays, in the virtual scene 150, a plurality of candidate Chinese characters represented by the combination of the selected initial consonant Chinese phonetic alphabet element and the selected single-vowel Chinese phonetic alphabet element. For example, as Figure 3C shown, the representation 253 of the candidate Chinese characters corresponding to the selected Chinese phonetic alphabet elements "we", such as the Chinese characters "为", "未", "位", "问", "文".
[0096] The display style of the first guiding element is introduced above. Next, the display style of the second guiding element of the computing device 120 in the virtual scene 150 is introduced.
[0097] In some embodiments, in response to determining that the second input element corresponds to a second set of candidate input elements, the computing device 120 presents a second guiding element associated with the second input element, and the second guiding element at least indicates the second set of candidate input elements, where the second input element is a component of the second set of candidate input elements, and the second set of candidate input elements can be combined with the first input element. As an example, if the first input element includes an initial consonant Chinese phonetic alphabet element and the first set of candidate input elements includes single-vowel Chinese phonetic alphabet elements, then the second set of candidate input elements may include subsequent Chinese phonetic alphabet elements associated with the single-vowel Chinese phonetic alphabet elements.
[0098] In some embodiments, determining the second set of candidate input elements includes a first candidate input element and a second candidate input element, the first candidate input element is a component of the second candidate input element, and presenting the second guiding element such that the first candidate input element and the second candidate input element are presented associatively. As an example, the first candidate input element may be a Chinese phonetic alphabet element of an ending, and the second candidate input element may be an additional Chinese phonetic alphabet element of an ending associated with the first candidate input element.
[0100] Exemplarily, the second candidate input element is presented adjacent to the first candidate input element, and a distance from the second candidate input element to the second input element is greater than a distance from the first candidate input element to the second input element.
[0101] Figure 4A A schematic diagram showing a display style of a second guide element according to some embodiments of the present disclosure is shown. For example, Figure 4A In the example, the second guide element includes second guide elements 410, 430, 450, 470, and 490. After the second input element in the first guide element 310 is selected, the corresponding second guide element 410 is presented. In addition to the second input element, the second guide element 410 also includes a second group of candidate input elements. The second input element is a component of the second group of candidate input elements, and the second group of candidate input elements can be combined with the first input element.
[0102] Exemplarily, after the second input element, such as the target monophthong vowel pinyin element "a", is selected, the corresponding second guide element 410 is presented. In addition to the target monophthong vowel pinyin element "a", the second guide element 410 also includes a second group of candidate input elements associated with the target monophthong vowel pinyin element "a". The first candidate input element in the second group of candidate input elements includes, for example, the vowel pinyin elements "an", "ai", "ao". The second candidate input element includes, for example, the additional vowel pinyin element "ang", which is presented adjacent to the vowel pinyin element "an".
[0103] Similarly, after the second input element, such as the target monophthong pinyin element "i", is selected, the corresponding second guide element 430 is presented. The second guide element 430 includes a second group of candidate input elements associated with the target monophthong pinyin element "i". The first candidate input element in the second group of candidate input elements includes, for example, the final pinyin elements "ia", "ian", "iu", "ie", "in", "iong". The second candidate input elements include, for example, the additional final pinyin elements "iang", "ing", "iao" and are presented adjacent to the final pinyin elements "ian", "in", "ia", respectively.
[0104] Similarly, after the second input element, such as the target monophthong pinyin element "u", is selected, the corresponding second guide element 450 is presented. The second guide element 450 includes a second group of candidate input elements associated with the target monophthong pinyin element "u". The first candidate input element in the second group of candidate input elements includes, for example, the final pinyin elements "ua", "uan", "ui", "ue", "uo", "un". The second candidate input elements include, for example, the additional final pinyin elements "uai", "uang" respectively adjacent to the final pinyin elements "ua", "uan" and are presented.
[0105] Similarly, after the second input element, such as the target monosyllabic vowel pinyin element "e", is selected, the corresponding second guide element 470 is presented. The second guide element 470 includes a second group of candidate input elements associated with the target monosyllabic vowel pinyin element "e". The first candidate input element in the second group of candidate input elements includes, for example, the vowel pinyin elements "ei" and "en". The second candidate input element includes, for example, the additional vowel pinyin element "eng" and is presented.
[0106] Similarly, after the second input element, such as the target monosyllabic final pinyin element "o", is selected, the corresponding second guide element 490 is presented. The second guide element 490 includes a second group of candidate input elements associated with the target monosyllabic final pinyin element "o". The first candidate input element in the second group of candidate input elements, for example, includes the final pinyin elements "ong" and "ou".
[0107] In some embodiments, while presenting the first guide element, a second guide element is presented, and the second guide element has a display style different from the first guide element. Exemplarily, the first part of the second guide element can indicate the second input element that has been selected, such as the monophthong vowel pinyin elements a, u, i, e, o. The second part indicates that the second input element corresponds to the second group of candidate input elements. The first candidate input element, for example, includes a vowel pinyin element combined with the second input element, and the second candidate input element, for example, includes a vowel pinyin element combined with the second input element.
[0108] The computing device 120 may preset the second group of candidate input elements indicated by the second guide element to be arranged according to the number of the second group of candidate input elements and a predetermined arrangement. For example, the first candidate input element and the second candidate input element in the second group of candidate input elements have predetermined positions associated with the second guide element on the second part, and these predetermined positions are arranged around the first part. As an example, Figure 4AAs shown, the display style of the second guide element is a hexagonal turntable, and the second group of candidate input elements as exemplified above are arranged on the hexagonal turntable. The hexagonal turntable is composed of small hexagons and large hexagons. The first part 401 may include the part corresponding to the small hexagon in the hexagonal turntable, and the second part 402 may include the other parts of the large hexagon except the small hexagon. The second group of candidate input elements arranged in the second part 402 has been described above and will not be repeated here.
[0110] It should be understood that Figure 4A The display style of the second guide element is only an example. The display style of the second guide element may also be other types of display styles, such as concentric rings, etc. The present disclosure does not make specific limitations in this regard.
[0111] Figure 4B A schematic diagram showing a second guide element presented in a virtual scene according to some embodiments of the present disclosure is shown; Figure 4C A schematic diagram is shown of guiding the selection of a second group of candidate input elements in a virtual scene through a second guiding element according to some embodiments of the present disclosure. Figure 4D A schematic diagram showing how to guide the selection of a second group of candidate input elements in a virtual scene through a second guide element according to some embodiments of the present disclosure is shown. Figure 1 , combined with Figure 4B , Figure 4C , Figure 4D The process of the second guiding element guiding the user to select the second group of candidate input elements is described.
[0112] In some embodiments, the second guide element has a higher display priority than the first guide element. For example, the second guide element is displayed overlaid on the first guide element. Figure 4B As shown, the second guide element 470 is displayed superimposed on the first guide element 310 .
[0113] In some embodiments, the computing device 120 determines at least one candidate input element from the second group of candidate input elements that can be combined with the selected first input element based on the spelling rule. The second guide element indicates the second group of candidate input elements, such as the final pinyin element and the additional final pinyin element, and at least part of the second group of candidate input elements is highlighted in the second guide element.
[0114] As an example, the finals / added ...
[0115] like Figure 4B As shown, the computing device 120 highlights the final Pinyin elements that can be combined with the selected initial Pinyin element on the second guide element 470 in the virtual scene 150 as visible. For example, the final Pinyin elements "en" and "ei" that can be combined with the initial Pinyin element "w" are displayed in a highlighted state, and the additional final Pinyin element "eng" is also displayed.
[0116] In some embodiments, the first input element is displayed in a semi-transparent style in the second guide element. Figure 4B As shown, in addition to the final Pinyin elements en and ei that can be combined with the initial Pinyin element "w" highlighted (highlighted state) on the second guide element 470, the selected initial Pinyin element "w" is also displayed in a semi-transparent style (low-brightness state) in front of each final Pinyin element ("en", "eng", "ei").
[0117] In some embodiments, the computing device 120 displays the selected final pinyin element / additional final pinyin element in the first portion of the second guide element 470. For example, Figure 4B and Figure 4C In the example, the first part of the second guide element 470 displays the selected monophthong pinyin element "e".
[0118] In some embodiments, computing device 120 receives a motion trajectory of a virtual avatar's gesture, such as a motion trajectory of a pinch gesture, and selects one of a plurality of final pinyin elements combined with the selected initial pinyin element according to the motion trajectory of the virtual avatar's gesture.
[0119] For example, Figure 4CAs shown, the computing device 120 receives the movement trajectory of the pinching gesture of the virtual hand 230. For example, the movement trajectory of the pinching gesture from the already selected single-vowel phonetic element (e.g., "e") to the position near the target phonetic element to be selected (e.g., "en") on the second guiding element 470, thereby activating the target phonetic element (e.g., "en") and making the target phonetic element (e.g., "en") in a selectable state. At the same time, the computing device 120 highlights the target phonetic element (e.g., "en"). For example, a partial area of the already selected phonetic element (e.g., "en") is displayed in a highlighted state.
[0120] The computing device 120 also displays a plurality of candidate Chinese characters represented by the combination of the already selected initial consonant phonetic elements and the already selected final consonant phonetic elements in the virtual scene 150. For example, as Figure 4C shown, the representation 453 of the candidate Chinese characters corresponding to the already selected phonetic element "wen", such as the Chinese characters "稳", "吻", "温", "文", "闻".
[0121] In some embodiments, the computing device 120 may receive an operation of releasing the pinching gesture to determine the subsequent phonetic element to be selected. At the same time, the computing device 120 also displays the representation 458 of the Chinese character formed by the combination of the already determined initial consonant phonetic element and the already selected final consonant phonetic element in the virtual scene 150. For example, as Figure 4D shown, the computing device 120 may receive
[0122] the operation of releasing the pinching gesture 480 to determine the final consonant phonetic element "wen". At the same time, the representation 458 of the Chinese character formed by the combination of the already determined initial consonant phonetic element and the already selected final consonant phonetic element is also displayed, for example, the phonetic element "wen" and its corresponding Chinese character "问".
[0123] Thus, by presenting the first guiding element and the second guiding element to guide the user to select the phonetic element, this solution can effectively shorten the operation path for inputting Chinese characters.
[0124] Figure 5 shows a schematic diagram of the trajectory information corresponding to the gesture action from the first guiding element to the second guiding element according to some embodiments of the present disclosure.
[0125] As Figure 5As shown, the computing device 120 receives the selection of the initial consonant pinyin element (e.g., "l") on the virtual keyboard in the virtual scene 150 by the virtual avatar, and presents the first guide element 510. Further, the computing device 120 selects one (e.g., "u") from the monophthong and vowel pinyin elements displayed by the first guide element 510 according to the gesture motion trajectory of the virtual avatar. The computing device 120 displays the second guide element 530 according to the target monophthong and vowel pinyin element (e.g., "u"). Then, the computing device 120 selects one (e.g., "uo") from the vowel pinyin elements displayed by the second guide element 530 according to the gesture motion trajectory of the virtual avatar.
[0126] In some embodiments, the computing device 120 displays trajectory information from the first guiding element to the second guiding element in the virtual scene 150 .
[0127] The second guide element is displayed superimposed on the first guide element, and the first guide element is displayed in a virtual form. Since the computing device 120 receives the motion change information of the gesture, the display position of the second guide element changes based on the display position of the first guide element. The change information of the display from the first guide element to the second guide element in the virtual scene 150 by the computing device 120 is also the trajectory information.
[0128] For example, Figure 5 As shown, the computing device 120 displays the second guide element 530 and blurs the first guide element 510. For example, the second guide element 530 is superimposed on the lower right corner "u" of the first guide element 510 that is blurred and displayed in a hexagonal form. For example, the second guide element 530 is also displayed in a hexagonal form. The computing device 120 displays the change information from the first guide element 510 to the second guide element 530, that is, the trajectory information.
[0129] The user can more intuitively see the operation of the previously selected pinyin element through the trajectory information from the first guide element to the second guide element, thereby improving the user operation experience.
[0130] The above discussion describes a method for inputting a single Chinese character in the virtual scene 150. Usually, the user needs to input Chinese text composed of multiple Chinese characters. Therefore, in the process of inputting Chinese text, other characters such as punctuation marks, brackets, etc. can also be input according to the above discussion process.
[0131] Figure 6 FIG. 1 is a schematic diagram showing a display style of a third guide element according to some embodiments of the present disclosure. Figure 6 As shown, for the convenience of description, the third guide element is individually or collectively referred to as the third guide element 610. For example, Figure 6The gesture guide element 610-1 in the display style is a hexagonal turntable with multiple punctuation marks arranged in a predetermined arrangement. Figure 6 The gesture guide element 610-3 in the display style is a hexagonal turntable with multiple bracket symbols arranged in a predetermined arrangement.
[0132] Based on the above discussion, the display styles of the first guide element 310 and the second guide element 470 can make it more convenient for the user to directly view the selected initial consonant pinyin element and the subsequent pinyin element, and at the same time, improve the convenience of selecting the subsequent pinyin element, shorten the operation path of inputting Chinese characters in the virtual environment, and improve the speed and efficiency of inputting Chinese characters. Another example of the guide element is introduced below.
[0133] In some embodiments, in response to determining that a target candidate input element in the first group of candidate input elements corresponds to a third group of candidate input elements, computing device 120 may present a third guide element in association with the target candidate input element while presenting the second guide element, the third guide element at least indicating the third group of candidate input elements, wherein the target candidate input element is a component of the third group of candidate input elements, and the third group of candidate input elements can be combined with the first input element. As an example, the second guide element and the third guide element are presented in a list style.
[0134] Figure 7 A schematic diagram showing display styles of a second guide element and a third guide element according to some embodiments of the present disclosure is shown.
[0135] like Figure 7 As shown, the computing device 120 receives the selection of the initial consonant pinyin element (e.g., "z") on the virtual keyboard presented in the virtual environment by the virtual avatar, and presents the second guide element 710. The second guide element 710 displays the first group of candidate input elements. The first group of candidate input elements, for example, includes one or more monophthong pinyin elements (e.g., a, u, i, e, o, ü), and these monophthong pinyin elements are displayed in a vertical linear arrangement.
[0136] For example, on the right side of the selected initial consonant pinyin element (such as z), a fixed position vertically linearly arranged monophthong final pinyin element is introduced.
[0137] In some embodiments, computing device 120 highlights a first group of candidate input elements that are combined with the already selected initial consonant pinyin element in the virtual environment.
[0138] Exemplarily, the final Pinyin elements that meet the spelling rules, that is, can be combined with the selected initial Pinyin elements, are displayed as available forms. For example, the first group of candidate input elements (such as i, a, e, o, u) combined with the selected initial Pinyin elements (such as z) are highlighted to facilitate the user to select from the highlighted monosyllabic final Pinyin elements. Monosyllabic final Pinyin elements that do not meet the spelling rules (such as ü) are displayed as unavailable forms.
[0139] In some embodiments, the computing device 120 selects a target candidate input element from the first group of candidate input elements according to the gesture motion trajectory of the virtual avatar, for example, selecting a target single vowel ...
[0140] The computing device 120 displays the third guide element 730 according to the selected monophthong and vowel pinyin element, and simultaneously displays the trajectory information from the second guide element 720 to the third guide element 730. The display style of the third guide element 720 is to arrange one or more vowel pinyin elements in a horizontal linear arrangement after the monophthong and vowel pinyin element of the second guide element.
[0141] For example, Figure 7 As shown, the computing device 120 displays the third guide element 730 according to the selected monophthong pinyin element (e.g., "a"), and displays the trajectory information from the second guide element 710 to the third guide element 730. In other words, the information of the display change from the first guide element 710 to the second guide element 730 is the trajectory information. For example, the previously selected "a" in the second guide element 710 is displayed in a virtualized manner.
[0142] In addition, the computing device 120 displays the determined pinyin elements in the input box 740 presented in the virtual scene 150 .
[0143] Based on the above discussion, the display styles of the second guide element 710 and the third guide element 730 can enable users to more conveniently and directly view the selected initial consonant pinyin elements and subsequent pinyin elements. At the same time, it improves the convenience of selecting subsequent pinyin elements, shortens the operation path of inputting Chinese characters in the virtual environment, and improves the speed and efficiency of inputting Chinese characters.
[0144] Example Process
[0145] Figure 8 FIG. 8 is a flowchart of a process 800 for inputting Chinese characters in a virtual environment according to some embodiments of the present disclosure. The process 800 may be implemented at the computing device 120. Figure 1 Process 800 is described.
[0146] In block 810 , the computing device 120 determines a first input element selected on the virtual keyboard based on a gesture action of the avatar with respect to the virtual keyboard presented in the virtual environment.
[0147] At block 820 , the computing device 120 presents, in the virtual scene, a first guide element in association with the first input element, the first guide element indicating at least a first group of candidate input elements that can be combined with the first input element.
[0148] At block 830 , the computing device 120 determines a second input element selected from the first set of candidate input elements based on the gesture action.
[0149] At block 840 , the computing device 120 causes, in the virtual scene, at least one target object to be presented in the virtual environment, the at least one target object being determined based on at least a combination of the first input element and the second input element.
[0150] In some embodiments, in response to determining that the second input element corresponds to a second group of candidate input elements, the computing device 120, in a virtual scene: presents a second guide element associated with the second input element, the second guide element at least indicating a second group of candidate input elements, wherein the second input element is a component of the second group of candidate input elements, and the second group of candidate input elements can be combined with the first input element.
[0151] In some embodiments, computing device 120 determines a third input element in the second set of candidate input elements based on the gesture action, such that at least one target object is determined based on a combination of the first input element and the third input element.
[0152] In some embodiments, presenting a second guide element in association with a second input element includes: the computing device 120 determines that a second group of candidate input elements includes a first candidate input element and a second candidate input element, the first candidate input element being a constituent part of the second candidate input element; and presenting the second guide element so that the first candidate input element and the second candidate input element are presented in association.
[0153] In some embodiments, the computing device 120 presents the second candidate input element adjacent to the first candidate input element in the virtual scene, and the second candidate input element is adjacent to the first candidate input element.
[0154] The distance of the input element is greater than the distance from the first candidate input element to the second input element.
[0155] In some embodiments, presenting the second guide element in association with the second input element includes: the computing device 120 presents the second guide element in the virtual scene while presenting the first guide element, the second guide element having a display style different from that of the first guide element.
[0156] In some embodiments, the second guide element has a higher display priority than the first guide element.
[0157] In some embodiments, in response to determining that a target candidate input element in the first group of candidate input elements corresponds to a third group of candidate input elements, the computing device 120, in a virtual scene: presents a third guide element in association with the target candidate input element while presenting the second guide element, the third guide element at least indicating a third group of candidate input elements, wherein the target candidate input element is a component of the third group of candidate input elements, and the third group of candidate input elements can be combined with the first input element.
[0158] In some embodiments, the second guide element and the third guide element are presented in a list style.
[0159] In some embodiments, the first guide element includes a first portion and a second portion surrounding the first portion, the first portion indicates the selected first input element, and the second portion indicates at least a first group of candidate input elements.
[0160] In some embodiments, the distribution of the first set of candidate input elements in the second portion is determined based on the number of the first set of candidate input elements.
[0161] In some embodiments, the second portion has a group of display elements corresponding to a preset distribution, and at least one display element in the group of display elements corresponding to the first group of candidate input elements has a display style different from other display elements to indicate that at least one display element is selectable.
[0162] In some embodiments, the second portion indicates a group of combined elements determined based on the first input element and the first group of candidate input elements, wherein the first input element and corresponding candidate input elements in the combined elements have different display styles.
[0163] In some embodiments, the computing device 120 presents trajectory information corresponding to the gesture action in the virtual scene.
[0164] In some embodiments, the first input element includes a set of voices presented from a virtual keyboard.
[0165] The target initial consonant pinyin element is determined among the initial pinyin elements.
[0166] In some embodiments, the target object includes at least one of the following: a text input item, a symbol input item, and an expression input item.
[0167] Example devices and equipment
[0168] Fig. 9 A schematic structural block diagram of an apparatus 900 for inputting Chinese characters in a virtual environment according to some embodiments of the present disclosure is shown. The apparatus 900 may be implemented as or included in a computing device 120. Each module / component in the apparatus 900 may be implemented by hardware, software, firmware, or any combination thereof.
[0169] As shown in the figure, the device 900 includes a first input element determination module 910, which is configured to determine the first input element selected on the virtual keyboard based on the gesture action of the virtual avatar on the virtual keyboard presented in the virtual environment. An indication module 920 is configured to present a first guide element associated with the first input element, and the first guide element at least indicates a first group of candidate input elements that can be combined with the first input element. A second input element determination module 930 is configured to determine the second input element selected from the first group of candidate input elements based on the gesture action; and a presentation module 940 is configured to cause at least one target object to be presented in the virtual environment, and the at least one target object is determined based on at least a combination of the first input element and the second input element.
[0170] In some embodiments, a second guide element presentation module is configured to present a second guide element in association with the second input element in response to determining that the second input element corresponds to a second group of candidate input elements, the second guide element at least indicating the second group of candidate input elements, wherein the second input element is a component of the second group of candidate input elements, and the second group of candidate input elements can be combined with the first input element.
[0171] In some embodiments, the third input element determination module is configured to determine a third input element in the second group of candidate input elements based on a gesture action, so that at least one target object is determined based on a combination of the first input element and the third input element.
[0172] In some embodiments, the second guide element presentation module is further configured to determine that the second group of candidate input elements includes a first candidate input element and a second candidate input element, the first candidate input element is a component of the second candidate input element; and present the second guide element,
[0173] The first candidate input element and the second candidate input element are caused to be presented in association.
[0174] In some embodiments, the second candidate input element is presented adjacent to the first candidate input element, and a distance from the second candidate input element to the second input element is greater than a distance from the first candidate input element to the second input element.
[0175] In some embodiments, the second guide element presentation module is configured to present a second guide element while presenting the first guide element, and the second guide element has a display style different from that of the first guide element.
[0176] In some embodiments, the second guide element has a higher display priority than the first guide element.
[0177] In some embodiments, a third guide element presentation module is configured to present a third guide element in association with the target candidate input element while presenting the second guide element in response to determining that a target candidate input element in the first group of candidate input elements corresponds to a third group of candidate input elements, the third guide element at least indicating the third group of candidate input elements, wherein the target candidate input element is a component of the third group of candidate input elements, and the third group of candidate input elements can be combined with the first input element.
[0178] In some embodiments, the second guide element and the third guide element are presented in a list style.
[0179] In some embodiments, the first guide element includes a first portion and a second portion surrounding the first portion, the first portion indicates the selected first input element, and the second portion indicates at least a first group of candidate input elements.
[0180] In some embodiments, the distribution of the first set of candidate input elements in the second portion is determined based on the number of the first set of candidate input elements.
[0181] In some embodiments, the second portion has a group of display elements corresponding to a preset distribution, and at least one display element in the group of display elements corresponding to the first group of candidate input elements has a display style different from other display elements to indicate that at least one display element is selectable.
[0182] In some embodiments, the second portion indicates a group of combined elements determined based on the first input element and the first group of candidate input elements, wherein the first input element and corresponding candidate input elements in the combined elements have different display styles.
[0184] In some embodiments, the trajectory information presentation module is configured to present trajectory information corresponding to the gesture action.
[0185] In some embodiments, the first input element includes a target initial consonant pinyin element determined from a group of initial consonant pinyin elements presented on the virtual keyboard.
[0186] In some embodiments, the target object includes at least one of the following: a text input item, a symbol input item, and an expression input item.
[0187] Fig.10 1 shows a block diagram of a computing device 1000 in which one or more embodiments of the present disclosure may be implemented. It should be understood that Fig.10 The computing device 1000 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein.
[0188] like Fig.10 As shown, computing device 1000 is in the form of a general-purpose computing device. Components of computing device 1000 may include, but are not limited to, one or more processors or processing units 1010, memory 1020, storage device 1030, one or more communication units 1040, one or more input devices 1050, and one or more output devices 1060. Processing unit 1010 may be an actual or virtual processor and is capable of performing various processes according to a program stored in memory 1020. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to increase the parallel processing capabilities of computing device 1000.
[0189] The computing device 1000 typically includes a plurality of computer storage media. Such media may be any accessible media that is accessible to the computing device 1000, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 1020 may be a volatile memory (e.g., a register, a cache, a random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 1030 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data (e.g., training data for training) and may be accessed within the computing device 1000.
[0190] The computing device 1000 may further include additional removable / non-removable, volatile / non-volatile storage media. Fig.10 As shown in FIG. 1 , a disk drive for reading from or writing to a removable, nonvolatile disk (e.g., a "floppy disk") and a disk drive for reading from or writing to a removable, nonvolatile disk (e.g., a "floppy disk") may be provided.
[0191] The memory 1020 may include a computer program product 1025 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.
[0192] The communication unit 1040 enables communication with other computing devices via a communication medium. Additionally, the functions of the components of the computing device 1000 can be implemented in a single computing cluster or multiple computing machines that can communicate via a communication connection. Therefore, the computing device 1000 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.
[0193] Input device 1050 may be one or more input devices, such as a mouse, keyboard, tracking ball, etc. Output device 1060 may be one or more output devices, such as a display, a speaker, a printer, etc. Computing device 1000 may also communicate with one or more external devices (not shown) through communication unit 1040 as needed, such as storage devices, display devices, etc., communicate with one or more devices that allow a user to interact with computing device 1000, or communicate with any device that allows computing device 1000 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).
[0194] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.
[0195] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.
[0196] These computer-readable program instructions can be provided to a general-purpose computer, a special-purpose computer, or a
[0197] The instructions may be executed by a processing unit of a computer or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by a processing unit of a computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions may also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0198] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0199] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.
[0200] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.
Claims
1. A method for inputting in a virtual environment, comprising: Determining a first input element selected on the virtual keyboard based on a gesture action of the virtual avatar with respect to the virtual keyboard presented in the virtual environment; presenting a first guide element in association with the first input element, the first guide element at least indicating a first group of candidate input elements that can be combined with the first input element; Based on the gesture action, determining a second input element selected from the first group of candidate input elements; as well as At least one target object is caused to be presented in the virtual environment, the at least one target object being determined based on at least a combination of the first input element and the second input element.
2. The method according to claim 1, further comprising: In response to determining that the second input element corresponds to a second group of candidate input elements, a second guide element is presented in association with the second input element, the second guide element at least indicating the second group of candidate input elements, wherein the second input element is a component of the second group of candidate input elements, and the second group of candidate input elements can be combined with the first input element.
3. The method according to claim 2, further comprising: Based on the gesture action, a third input element in the second group of candidate input elements is determined, so that the at least one target object is determined based on a combination of the first input element and the third input element.
4. The method of claim 2, wherein presenting a second guidance element in association with the second input element comprises: Determining that the second group of candidate input elements includes a first candidate input element and a second candidate input element, the first candidate input element being a component of the second candidate input element; as well as The second guide element is presented so that the first candidate input element and the second candidate input element are presented in association. 5 . The method of claim 4 , wherein the second candidate input element is presented adjacent to the first candidate input element, and a distance from the second candidate input element to the second input element is greater than a distance from the first candidate input element to the second input element.
6. The method of claim 2, wherein presenting a second guidance element in association with the second input element comprises: While presenting the first guide element, the second guide element is presented, and the second guide element has a display style different from that of the first guide element. The method according to claim 6 , wherein the second guide element has a higher display priority than the first guide element.
8. The method according to claim 2, further comprising: In response to determining that a target candidate input element in the first group of candidate input elements corresponds to a third group of candidate input elements, a third guide element is presented in association with the target candidate input element while presenting the second guide element, the third guide element at least indicating the third group of candidate input elements, wherein the target candidate input element is a component of the third group of candidate input elements, and the third group of candidate input elements can be combined with the first input element. 9 . The method according to claim 8 , wherein the second guide element and the third guide element are presented in a list style.
10. The method according to claim 1, wherein the first guide element comprises a first portion and a second portion surrounding the first portion, the first portion indicating the selected first input element, and the second portion indicating at least the first group of candidate input elements. The method according to claim 10 , wherein the distribution of the first set of candidate input elements in the second portion is determined based on the number of the first set of candidate input elements.
12. The method according to claim 10, wherein the second part has a group of display elements corresponding to a preset distribution, and at least one display element in the group of display elements corresponding to the first group of candidate input elements has a display style different from that of other display elements to indicate that the at least one display element is in a selectable state.
13. The method according to claim 10, wherein the second part indicates a group of combined elements determined based on the first input element and the first group of candidate input elements, wherein the first input element and corresponding candidate input elements in the combined elements have different display styles.
14. The method according to claim 1, further comprising: The trajectory information corresponding to the gesture action is presented.
15. The method according to claim 1, wherein the first input element comprises a target initial consonant pinyin element determined from a group of initial consonant pinyin elements presented on the virtual keyboard.
16. The method according to claim 1, wherein the target object comprises at least one of the following: a text input item, a symbol input item, and an expression input item.
17. An apparatus for inputting in a virtual environment, comprising: A first input element determination module is configured to determine a first input element selected on the virtual keyboard based on a gesture action of the virtual avatar with respect to the virtual keyboard presented in the virtual environment; an indication module, configured to present a first guide element in association with the first input element, wherein the first guide element at least indicates a first group of candidate input elements that can be combined with the first input element; A second input element determination module is configured to determine a second input element selected from the first group of candidate input elements based on the gesture action; as well as The presentation module is configured to cause at least one target object to be presented in the virtual environment, wherein the at least one target object is determined based on at least a combination of the first input element and the second input element.
18. An electronic device, comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 16 when executed by the at least one processing unit.
19. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 16.
