Virtual object display method and device, vehicle, medium and program product
By enabling voice control for selecting and editing virtual objects, the problem of manual operation in editing virtual objects is solved, improving convenience and driving safety.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- XIAOMI EV TECH CO LTD
- Filing Date
- 2026-03-06
- Publication Date
- 2026-04-28
AI Technical Summary
In existing technologies, editing virtual objects requires manual operation by the user, which is inconvenient and poses security risks.
Voice-triggered control operations enable functions such as selecting, editing, switching, adding, and deleting virtual objects, enhancing convenience.
No manual editing is required, which improves the convenience of editing virtual objects, and especially enhances safety during vehicle driving.
Smart Images
Figure CN121927293A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to fields such as artificial intelligence and smart cockpits, and in particular to a method, apparatus, vehicle, medium, and program product for displaying virtual objects. Background Technology
[0002] As vehicles become increasingly intelligent, human-computer interaction features are being widely applied in the automotive field. Virtual objects displayed on vehicle screens (such as electronic pets) are applications that combine artificial intelligence with the vehicle's infotainment system. Users can interact with these virtual objects, providing companionship and interaction while the vehicle is in motion. However, currently, editing these virtual objects requires manual intervention, which presents an inconvenience. Summary of the Invention
[0003] To overcome the problems existing in related technologies, this disclosure provides a virtual object display method, apparatus, vehicle, medium, and program product.
[0004] According to a first aspect of the present disclosure, a method for displaying virtual objects is provided. The method includes: displaying a virtual object editing page, wherein a display area on the virtual object editing page displays multiple virtual objects; selecting a target virtual object in the display area in response to a voice-triggered control operation; and displaying the target virtual object on the virtual object display page. Users do not need to manually edit; they can edit virtual objects via voice, thus improving the convenience of virtual object editing.
[0005] In some possible implementations, displaying the virtual object editing page includes: displaying the virtual object editing page in response to a voice-triggered page on / off switch on the desktop. Thus, triggering the process via voice eliminates the need for manual editing, improving the convenience of editing virtual objects.
[0006] In some possible implementations, the virtual object display method further includes: editing the name of the selected target virtual object in response to a voice-triggered name editing operation; and interacting with the target virtual object based on its name. Thus, editing via voice eliminates the need for manual editing, improving the convenience of editing virtual objects.
[0007] In some possible implementations, the number of virtual object display pages includes at least one, and displaying the target virtual object on the virtual object display page includes: acquiring a user's voice signal and recognizing the control intent in the voice signal, the control intent being used to determine the virtual object display interface to be controlled; and displaying the target virtual object on the virtual object display page controlled by the intent. Thus, control is performed via voice, eliminating the need for manual editing and improving the convenience of editing virtual objects.
[0008] In some possible implementations, the number of virtual object display pages includes at least one, and the editing area of the virtual object editing page displays at least one page selection control. The page selection control is used to select the corresponding virtual object display page. Displaying the target virtual object on the virtual object display page includes: responding to a voice-triggered selection operation of the page selection control in the editing area, and displaying the target virtual object on the selected virtual object display page. Thus, selection via voice eliminates the need for manual editing, improving the convenience of editing virtual objects.
[0009] In some possible implementations, the editing area of the virtual object editing page displays a return control. Displaying the target virtual object on the virtual object display page includes: responding to a voice-triggered operation on the return control in the editing area, switching from displaying the virtual object editing page to displaying the virtual object display page, which is used to display the target virtual object. Thus, triggering via voice eliminates the need for manual editing, improving the convenience of editing virtual objects.
[0010] In some possible implementations, the editing area of the virtual object editing page displays an add control for adding new virtual objects. The virtual object display method further includes: responding to a voice-triggered trigger operation on the add control in the editing area, adding the new virtual object to the display area. Thus, triggering via voice eliminates the need for manual editing, improving the convenience of virtual object editing.
[0011] In some possible implementations, the virtual object display method further includes: deleting the corresponding virtual object from the display area in response to a voice-triggered deletion operation on a virtual object in the display area. Thus, deletion via voice eliminates the need for manual editing, improving the convenience of editing virtual objects.
[0012] In some possible implementations, the virtual object display method further includes: switching the selected target virtual object in the display area in response to a voice-triggered switching operation. Thus, switching via voice eliminates the need for manual editing, improving the convenience of editing virtual objects.
[0013] In some possible implementations, there are multiple virtual objects arranged sequentially. The switching of the selected target virtual object in the display area in response to a voice-triggered switching operation includes: in response to the voice-triggered switching operation, selecting the next virtual object in the sequentially arranged array of virtual objects as the new target virtual object. Thus, switching via voice eliminates the need for manual editing, improving the convenience of editing virtual objects.
[0014] In some possible implementations, the virtual object display method further includes: displaying a preset device in a first display area of the virtual object display page; the step of displaying the target virtual object in the virtual object display page includes: displaying the virtual object in a second display area of the virtual object display page.
[0015] In some possible implementations, the desktop includes multiple sequentially arranged display pages, and the virtual object display method further includes: adjusting the position of the virtual object display page among the multiple display pages on the desktop in response to a voice-triggered page adjustment operation. Thus, adjustment via voice eliminates the need for manual editing, improving the convenience of editing virtual objects.
[0016] According to a second aspect of the present disclosure, a virtual object display device is provided, the virtual object display device comprising: a first display module configured to display a virtual object editing page, wherein a display area in the virtual object editing page displays a plurality of virtual objects; a selection module configured to select a target virtual object in the display area in response to a voice-triggered control operation; and a second display module configured to display the target virtual object in the virtual object display page.
[0017] In some possible implementations, the virtual object display device further includes: The switching module is configured to switch the selected target virtual object in the display area in response to a voice-triggered switching operation.
[0018] In some possible implementations, the number of virtual objects is multiple, and the multiple virtual objects are arranged sequentially. The virtual object display device further includes a switching module, specifically configured as follows: In response to the voice-triggered switching operation, the next virtual object of the target virtual object among a plurality of sequentially arranged virtual objects is taken as the new target virtual object.
[0019] In some possible implementations, the number of virtual object display pages includes at least one, and the second display module is specifically configured as follows: Acquire the user's voice signal and identify the control intent in the voice signal, the control intent being used to determine the virtual object display interface to be controlled; The target virtual object is displayed on the virtual object display page that is intended to be controlled.
[0020] In some possible implementations, the number of virtual object display pages includes at least one, and the editing area of the virtual object editing page displays at least one page selection control, which is used to select the virtual object display page corresponding to it. The second display module is specifically configured as follows: In response to a voice-triggered selection operation of a page selection control in the editing area, the target virtual object is displayed in the selected virtual object display page.
[0021] In some possible implementations, the editing area of the virtual object editing page displays a return control, and the second display module is specifically configured as follows: In response to a voice-triggered operation on the return control in the editing area, the display of the virtual object editing page is switched to the display of the virtual object display page, which is used to display the target virtual object.
[0022] According to a third aspect of the present disclosure, a vehicle is provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the steps of the method described in the first aspect when executing the instructions.
[0023] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided that stores computer program instructions thereon, which, when executed by a processor, implement the steps of the method provided in the first aspect of the present disclosure.
[0024] According to a fifth aspect of the present disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps of the method described in the first aspect.
[0025] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0026] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.
[0027] Figure 1 This is a flowchart illustrating a virtual object display method according to an exemplary embodiment.
[0028] Figure 2 This is a schematic diagram illustrating a virtual object editing page according to an exemplary embodiment.
[0029] Figure 3 This is a schematic diagram of a virtual object editing page according to another exemplary embodiment.
[0030] Figure 4 This is a schematic diagram of a virtual object editing page according to another exemplary embodiment.
[0031] Figure 5 This is a schematic diagram of a virtual object editing page according to another exemplary embodiment.
[0032] Figure 6 This is a block diagram illustrating a virtual object display device according to an exemplary embodiment.
[0033] Figure 7 This is a block diagram illustrating a vehicle according to an exemplary embodiment. Detailed Implementation
[0034] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.
[0035] It should be noted that all actions involving the acquisition of signals, information, or data in this disclosure are carried out in accordance with the relevant data protection laws and policies of the country where the location is situated, and with the authorization granted by the owner of the relevant device.
[0036] Currently, users can manually edit virtual objects on the display screen. These virtual objects can interact with users, providing companionship and interaction while the vehicle is in motion. However, the current requirement for manual editing presents an inconvenience. Especially while driving, manually editing virtual objects not only presents inconvenience but also poses safety hazards.
[0037] Therefore, this disclosure provides a method for displaying virtual objects; please refer to [link / reference]. Figure 1 The virtual object display method can be applied to devices with displays. Figure 6 The virtual object display device 300 shown Figure 7 The vehicle 600, computer program product, and computer-readable storage medium shown are included. For example, a device with a display screen may be... Figure 7 The examples shown include vehicles (600), mobile phones, tablets, and laptops. The following example uses a vehicle as an example. The following section will address... Figure 1 The process shown will be described in detail. The virtual object display method may include the following steps: Step S110: Display the virtual object editing page, wherein the display area of the virtual object editing page displays multiple virtual objects.
[0038] Display a virtual object editing page on the vehicle's in-vehicle screen, such as Figure 2 As shown, the display area 211 in the virtual object editing page displays multiple virtual objects such as a kitten, puppy, bird, rabbit, and groundhog, which can be selected by the user.
[0039] It should be noted that, Figure 2 The types and quantities of virtual objects mentioned are merely examples; they can be of other types, or there can be more or fewer of them. No restrictions are imposed here.
[0040] Step S120: In response to a voice-triggered control operation, select the target virtual object in the display area.
[0041] The vehicle's cabin is equipped with a voice pickup device. Users in the cabin express their control intentions via voice, and the device captures their voice signals. In response to the voice-triggered control operation, a target virtual object is selected in the display area. For example, the sound signal is acquired, and the user's control intention is identified within the sound signal; this control intention represents a control operation on the virtual object. Following the control operation represented by the control intention, the target virtual object is selected and displayed in the display area.
[0042] To make it easier for users to view the selected virtual object, the size of the virtual object can be enlarged. For example, if the user's voice signal is "select the bird," then... Figure 3 As shown, the target virtual object, the bird, is enlarged and displayed in the display area. For example, if the user's voice signal is "select the rabbit," then... Figure 4As shown, the target virtual object, the rabbit, is enlarged and displayed in the display area. The target virtual object can be displayed at a preset position in the display area; for example, the preset position could be the middle position of multiple virtual objects arranged in sequence. If the target virtual object is already in the preset position, simply enlarge it. Figure 3 As shown. If the target virtual object is not in the preset position, move it to the preset position and then enlarge it for display, as shown. Figure 5 As shown.
[0043] Step S130: Display the target virtual object on the virtual object display page.
[0044] The virtual object will be redirected from the virtual object editing page to the virtual object display page, where the target virtual object will be displayed.
[0045] The virtual object display method provided in this embodiment displays a virtual object editing page, in which a display area shows multiple virtual objects; in response to a voice-triggered control operation, a target virtual object is selected in the display area; and the target virtual object is displayed on the virtual object display page. Users do not need to edit manually; they can edit virtual objects through voice, thus improving the convenience of editing virtual objects.
[0046] Optionally, the virtual object display method further includes: switching the selected target virtual object in the display area in response to a voice-triggered switching operation.
[0047] For example, the virtual object located at a preset position is the target virtual object, such as... Figure 3 As shown, the display area can show five virtual objects. The virtual object in the third position from the middle is the target virtual object, i.e., the bird. Based on a voice-triggered switching operation, the virtual object in the preset position is switched, thereby switching the target virtual object. For example, the voice could be "next," combined with... Figure 3 The virtual object "Rabbit" appears after the virtual bird at a preset position, and the virtual rabbit at the preset position is the target virtual object. For example, the voice could also be "Select Rabbit," "Previous," etc.
[0048] In this embodiment, switching the virtual object display page is done via voice, eliminating the need for manual switching and improving the convenience of switching virtual objects. This is especially beneficial for driving safety when switching via voice while driving.
[0049] In one approach, the number of virtual objects is multiple, and the multiple virtual objects are arranged sequentially. In response to the voice-triggered switching operation, the next virtual object of the target virtual object among the multiple virtual objects arranged sequentially is taken as the new target virtual object.
[0050] Each virtual object is adjacent to two other virtual objects: the preceding virtual object and the following virtual object. The order of the virtual objects remains unchanged when switching between them. For example, if there are N virtual objects, and the display area can display N virtual objects, and these N virtual objects are arranged in order, with the first and Nth virtual objects being adjacent in order, then the positions of the other virtual objects in the display area will change accordingly when switching between them, as the order of the virtual objects remains constant.
[0051] For example, such as Figure 3 As shown, the virtual objects arranged in sequence are a kitten, a puppy, a bird, a rabbit, and a groundhog. Since each virtual object has two adjacent virtual objects, the kitten and the groundhog are adjacent. The target virtual object is... Figure 3 The virtual bird shown responds to the user's voice command "next," triggering a toggle operation. The virtual rabbit, the next virtual object after the bird, is moved to a preset position (the third position) as the target virtual object. Since the order remains unchanged, the positions of other virtual objects on the display area will also change accordingly, such as... Figure 5 As shown.
[0052] In this embodiment, virtual objects are switched via voice, eliminating the need for manual switching and improving the convenience of switching virtual objects. This is especially beneficial for driving safety when switching via voice while driving.
[0053] In one implementation, step S110 includes: displaying the virtual object editing page in response to a voice-triggered trigger operation on a page switch on the desktop.
[0054] The page toggle can be an icon corresponding to a virtual object application.
[0055] For example, an audio signal is acquired, such as "I want to set up my pet" or "Open the pet app," and the user's control intent in the audio signal is identified. This control intent represents a trigger operation to open or close the page. Based on the trigger operation represented by the control intent, the page is opened and displayed as shown... Figure 2 The virtual object editing page shown is an example of this. Editing via voice eliminates the need for manual editing, freeing up the user's hands and improving the convenience of virtual object editing. This is especially beneficial during driving, enhancing driving safety.
[0056] In one embodiment, the number of virtual object display pages includes at least one. Step S130 includes: acquiring a user's voice signal and identifying a control intent in the voice signal, the control intent being used to determine the virtual object display interface to be controlled; and displaying the target virtual object in the virtual object display page controlled by the intent.
[0057] In one scenario, there is only one virtual object display page, located on a vehicle display screen, such as the main control screen or rear armrest screen. When the virtual object editing page is displayed on the screen, the user's voice information is collected via a microphone in the cabin. Intent recognition is performed on the voice information to determine the control intent. This control intent is used to determine the virtual object display interface to be controlled, and the target virtual object is displayed on the virtual object display page on that screen.
[0058] In another scenario, there can be multiple virtual object display pages, such as two or three. Each virtual object display page is located on a different display screen, which may include the main control screen, rear armrest screens, etc. When a virtual object editing page is displayed on a screen, the user's voice information is collected via a microphone in the cabin. Intent recognition is performed on the voice information to determine the control intent, which is used to determine the virtual object display interface to be controlled. If the virtual object display page to be controlled is located on that screen, the target virtual object is displayed directly on that screen. For example, on that screen, the displayed virtual object editing page is switched to the virtual object display page. If the virtual object display page to be controlled is located on another display screen, the display information is sent to that other display screen, and the target virtual object is displayed on the virtual object display page on that other display screen.
[0059] For example, the sound message could be "Show cute pets," which doesn't mention screen settings. In this case, the display screen the intent-controlled screen is on could be the screen where the virtual object is being edited—that is, the screen where the virtual object editing page is located. As another example, the sound message could be "Show it in the back row," and the display screen the intent-controlled screen is on the rear armrest. If the display screen where the virtual object editing page is located is the main control screen, then it can be assumed that the display screen where the intent-controlled virtual object display page is located is different from the display screen where the virtual object editing page is located.
[0060] In this embodiment, the settings for the virtual object display page are configured via voice, eliminating the need for manual editing and improving the convenience of editing virtual objects. This is especially beneficial for driving safety when voice editing is performed while driving.
[0061] In another embodiment, the number of virtual object display pages includes at least one, and each virtual object display page is located on a different display screen. The vehicle's display screen may include the main control screen, the rear armrest screen, etc. The virtual object editing page also includes an editing area, which displays at least one page selection control. The number of virtual object display pages may be the same as the number of page selection controls; for example, if there is one virtual object display page, there is correspondingly one page selection control. As another example, if there are two virtual object display pages, there are correspondingly two page selection controls. For instance, Figures 2-5 The page selection controls in the editing area 212 include a "Driving Desktop" control and a "Rear Armrest Screen" control. The "Driving Desktop" control is used to control the display of the target virtual object on the virtual object display page of the main control screen, and the "Rear Armrest Screen" control is used to control the display of the target virtual object on the virtual object display page of the rear armrest screen. Step S130 includes: in response to a voice-triggered selection operation of any page selection control in the editing area, displaying the target virtual object on the selected virtual object display page.
[0062] For example, if the user's voice command is "select the car desktop," then the target virtual object will be displayed on the virtual object display page of the car desktop. If the user's voice command is "select all screens," or "select the car desktop and the rear armrest screen," then the target virtual object will be displayed on both the car desktop and the rear armrest screen.
[0063] In this embodiment, the settings for the virtual object display page are configured via voice, eliminating the need for manual editing and improving the convenience of editing virtual objects. This is especially beneficial for driving safety when voice editing is performed while driving.
[0064] In another implementation, the editing area of the virtual object editing page displays a return control, such as... Figures 2-5 As shown, a "back" control is displayed in the display area. Step S130 includes: in response to a voice-triggered operation on the back control in the editing area, switching from displaying the virtual object editing page to displaying the virtual object display page, the virtual object display page being used to display the target virtual object.
[0065] For example, when the virtual object editing page is displayed, if the user's voice command is "back", the virtual object display page will switch to the virtual object display page in response to this triggering action.
[0066] In this embodiment, the settings for the virtual object display page are configured via voice, eliminating the need for manual editing and improving the convenience of editing virtual objects. This is especially beneficial for driving safety when voice editing is performed while driving.
[0067] Optionally, the virtual object display method further includes: editing the name of the selected target virtual object in response to a voice-triggered name editing operation; and interacting with the target virtual object based on the name of the target virtual object.
[0068] For example, in Figure 4 The virtual object editing page shown allows users to say things like, "Edit the rabbit's name, call it Little Dumb." During subsequent interactions with the target virtual object, users can interact with it by its name. For example, if the user says, "Little Dumb, jump up," the target virtual object will display a jumping action on its screen to interact with the user.
[0069] In this embodiment, users can interact with virtual objects via voice, eliminating the need for manual editing and improving the convenience of editing virtual objects. In particular, voice interaction during vehicle driving enhances driving safety.
[0070] Optionally, the editing area of the virtual object editing page displays an add control, which is used to add new virtual objects. The method further includes: responding to a voice-triggered trigger operation on the add control in the editing area to add the new virtual object to the display area.
[0071] For example, the icon for adding a control could be Figures 2-5 The plus sign on the editing area 212 can include a text description of the control, such as "Create Virtual Object," under the "Add Control" option. The voice prompt for triggering the "Add Control" operation can be "Create Virtual Object" or "I want to add a new virtual object." In response to the "Add Control" operation, an image can be selected from the vehicle's local storage or from other devices connected to the vehicle. A new virtual object is then generated based on the image and added to the display area.
[0072] It should be noted that due to the limited size of the display area, the number of virtual objects that can be displayed is also limited; for example, at most N virtual objects can be displayed, where N is a positive integer. If N virtual objects are displayed sequentially, the new virtual object will be collapsed. Based on the user's swipe, if the previous virtual object is displayed at position N-1, the new virtual object will be displayed at position N.
[0073] In this embodiment, the controls are edited via voice, eliminating the need for manual editing and improving convenience. In particular, voice editing during vehicle driving enhances driving safety.
[0074] Optionally, the virtual object display method further includes: in response to a voice-triggered deletion operation of a virtual object in the display area, deleting the corresponding virtual object from the display area.
[0075] For example, the voice command could be "Delete bird," which removes the virtual bird object from the display area or display list.
[0076] In this embodiment, virtual objects are deleted via voice, eliminating the need for manual deletion and improving the convenience of deleting virtual objects. In particular, voice deletion during vehicle driving enhances driving safety.
[0077] Optionally, the virtual object display page includes a first display area and a second display area. The first display area may be located in the upper half of the virtual object display page, and the second display area may be located in the lower half of the virtual object display page. The virtual object display method further includes displaying preset devices in the first display area of the virtual object display page. For example, preset devices may include one of the following: weather devices, clock devices, remaining battery power devices, remaining fuel power devices, etc. Preset devices can be set according to user needs; for example, the user can delete the weather device displayed in the first display area.
[0078] Based on this, step S330 includes: displaying the virtual object in the second display area of the virtual object display page.
[0079] The content displayed on the second display area can also be customized according to user needs; for example, a compass can also be displayed.
[0080] In this embodiment, the virtual object display page is set via voice, eliminating the need for manual editing and improving the convenience of editing virtual objects. This is especially beneficial for voice editing while driving, enhancing driving safety.
[0081] Optionally, the desktop includes multiple sequentially arranged display pages, and the virtual object display method further includes: adjusting the position of the virtual object display page among the multiple display pages on the desktop in response to a voice-triggered page adjustment operation.
[0082] For example, the desktop includes a first display page, a second display page, and a third display page arranged sequentially. The first display page is used to display vehicle information, the second display page is used to display navigation information, and the third display page can be used to display a target virtual object. When displaying a target virtual object, the virtual object display page is displayed on the third display page by default. The virtual object display page can be displayed on either the first or second display page in response to a voice-triggered page adjustment operation. Since the first and second display pages are originally used to display other information (such as vehicle information or navigation information), the display of the target virtual object can be stopped after a preset duration (such as 2 seconds, 3 seconds, etc.) on the first or second display page, and the original information can be displayed instead. This avoids excessive consumption of display resources for the target virtual object and ensures normal vehicle operation.
[0083] In this embodiment, the virtual object display page is adjusted via voice, eliminating the need for manual adjustment and improving ease of operation. In particular, voice adjustment during vehicle driving enhances driving safety.
[0084] It should be noted that the above-mentioned voice-triggered operations can also be triggered manually by the user. Users can choose the appropriate triggering method according to their own circumstances. For example, while driving, to ensure driving safety, a user can trigger the editing of virtual objects via voice.
[0085] Based on the same inventive concept, this disclosure also provides a virtual object display device 300, please refer to [link to relevant documentation]. Figure 6 The virtual object display device 300 includes: The first display module 310 is configured to display a virtual object editing page, wherein the display area of the virtual object editing page displays multiple virtual objects; Select module 320 is configured to select a target virtual object in the display area in response to a voice-triggered control operation. The second display module 330 is configured to display the target virtual object in the virtual object display page.
[0086] In one possible implementation, the first display module 310 is specifically configured to display the virtual object editing page in response to a voice-triggered trigger operation on a page switch on the desktop.
[0087] In one possible implementation, the virtual object display device 300 further includes: The response module is configured to edit the name of the selected target virtual object in response to a voice-triggered name editing operation on the target virtual object. The interaction module is configured to interact with the target virtual object based on the name of the target virtual object.
[0088] In one possible implementation, the number of virtual object display pages includes at least one, and the selection module 320 is specifically configured as follows: Acquire the user's voice signal and identify the control intent in the voice signal, the control intent being used to determine the virtual object display interface to be controlled; The target virtual object is displayed on the virtual object display page that is intended to be controlled.
[0089] In one possible implementation, the number of virtual object display pages includes at least one, and the editing area of the virtual object editing page displays at least one page selection control, which is used to select the corresponding virtual object display page. The selection module 320 is specifically configured to display the target virtual object on the virtual object display page. In response to a voice-triggered selection operation of a page selection control in the editing area, the target virtual object is displayed in the selected virtual object display page.
[0090] In one possible implementation, the editing area of the virtual object editing page displays a return control, and the selected module 320 is specifically configured as follows: In response to a voice-triggered operation on the return control in the editing area, the display of the virtual object editing page is switched to the display of the virtual object display page, which is used to display the target virtual object.
[0091] In one possible implementation, the editing area of the virtual object editing page displays an add control for adding new virtual objects, and the virtual object display device 300 further includes: The module is configured to add a new virtual object to the display area in response to a voice-triggered operation on the add control in the editing area.
[0092] In one possible implementation, the virtual object display device 300 further includes: The deletion module is configured to delete the corresponding virtual object from the display area in response to a voice-triggered deletion operation on a virtual object in the display area.
[0093] In one possible implementation, the virtual object display device 300 further includes: The switching module is configured to switch the selected target virtual object in the display area in response to a voice-triggered switching operation.
[0094] In one possible implementation, the number of virtual objects is multiple, and the multiple virtual objects are arranged sequentially. The switching module is specifically configured to respond to the switching operation triggered by voice, and to take the next virtual object of the target virtual object among the multiple virtual objects arranged sequentially as the new target virtual object.
[0095] In one possible implementation, the virtual object display device 300 further includes: The preset device display module is configured to display a preset device in the first display area of the virtual object display page; The second display module 330 is specifically configured to display the virtual object in the second display area of the virtual object display page.
[0096] In one possible implementation, the virtual object display device 300 further includes: The adjustment module is configured to adjust the position of the virtual object display page among multiple display pages on the desktop in response to a voice-triggered page adjustment operation.
[0097] Regarding the virtual object display device 300 in the above embodiments, the specific methods by which each module performs operations have been described in detail in the embodiments related to the method, and will not be elaborated here.
[0098] This disclosure also provides a computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, implement the steps of the virtual object display method provided in this disclosure.
[0099] Figure 7 This is a block diagram illustrating a vehicle 600 according to an exemplary embodiment. For example, vehicle 600 may be a hybrid vehicle, a non-hybrid vehicle, an electric vehicle, a fuel cell vehicle, or other types of vehicle. Vehicle 600 may have driver assistance functions.
[0100] Please refer to Figure 7 The vehicle 600 may include various subsystems, such as an infotainment system 610, a perception system 620, a decision control system 630, a drive system 640, and a computing platform 650. The vehicle 600 may also include more or fewer subsystems, and each subsystem may include multiple components. Furthermore, each subsystem and each component of the vehicle 600 can be interconnected via wired or wireless means.
[0101] In some embodiments, the infotainment system 610 may include a communication system, an entertainment system, and a navigation system, etc.
[0102] The perception system 620 may include several sensors for sensing information about the environment surrounding the vehicle 600. For example, the perception system 620 may include a global positioning system (which may be GPS, BeiDou, or other positioning systems), an inertial measurement unit (IMU), lidar, millimeter-wave radar, ultrasonic radar, and a camera device.
[0103] The decision control system 630 may include a computing system, a vehicle controller, a steering system, a throttle, and a braking system.
[0104] The drive system 640 may include components that provide powered motion to the vehicle 600. In one embodiment, the drive system 640 may include an engine, an energy source, a transmission system, and wheels. The engine may be one or a combination of internal combustion engines, electric motors, and compressed air engines. The engine is capable of converting energy provided by the energy source into mechanical energy.
[0105] Some or all of the functions of vehicle 600 are controlled by computing platform 650. Computing platform 650 may include at least one processor 651 and memory 652, processor 651 can execute instructions 653 stored in memory 652.
[0106] Processor 651 can be any conventional processor, such as a commercially available CPU. The processor may also include, for example, a Graphic Processing Unit (GPU), a Field Programmable Gate Array (FPGA), a System on Chip (SOC), an Application Specific Integrated Circuit (ASIC), or a combination thereof.
[0107] The memory 652 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.
[0108] In addition to instruction 653, memory 652 can also store data, such as road maps, route information, vehicle position, direction, speed, and other data. The data stored in memory 652 can be used by computing platform 650.
[0109] In this embodiment of the disclosure, processor 651 may execute instruction 653 to complete all or part of the steps of the virtual object display method described above.
[0110] The intelligent driving described in this disclosure can also be called autonomous driving or assisted driving. All intelligent driving-related technologies in this disclosure are designed in accordance with the relevant laws and regulations of the country where the vehicle is located. For example, intelligent driving requires the driver's hands to remain on the steering wheel.
[0111] Specifically, with the development of sensing technology and the improvement of chip capabilities, intelligent driving provides people with more and more rich driving functions, gradually realizing different levels of driving experience. The Society of Automotive Engineers (SAE) provides a driving automation classification standard, including driving levels L0 to L5, where L0 is no automation, and the human driver has full control of the car. During driving, the driver can receive warnings or assistance from the driving system, such as automatic emergency braking (AEB), blind spot monitoring (BSM), or lane departure warning (LDW). Level 1 is driver assistance, where driving operations are jointly performed by the human driver and the driving system. The driving system provides driving support based on the driving environment, such as steering wheel inputs or acceleration / deceleration. Other driving operations are performed by the human driver, such as adaptive cruise control (ACC) or lane keep assistance / support (LKA / LKS). Level 2 is partial automation, providing driving support based on the driving environment, including steering wheel inputs and acceleration / deceleration. Other driving actions are performed by the human driver, such as a combination of adaptive cruise control (ACC) and lane keep assist. Level 0 to Level 2 are driving systems that primarily support the driver, who still needs to monitor the driving process and perform actions such as steering, braking, or acceleration as needed for safety. Levels 0 to 2 primarily provide support to the driver, who still needs to supervise the driving process and perform actions such as steering, braking, or acceleration as needed. Levels 3 to 5 can replace the driver in performing all driving operations. At Level 3, the driver must be prepared to take over driving. Levels 4 and 5 allow for partial and full driving under certain conditions, with the driver having the option to take over. Level 4 is highly automated, where the driving system can perform all driving operations, and the driver may not need to respond to requests from the system, for example, under suitable road and environmental conditions (such as closed parks, highways, city roads, or fixed routes). Level 5 is fully automated, where the driving system can autonomously perform all driving operations under various road and environmental conditions that a human driver can handle.
[0112] Vehicles can roam based on high-precision maps, including changing lanes, changing driving direction, passing intersections, and changing some navigation strategies during navigation driving based on high-precision maps. It can also include autonomous driving processes performed by vehicles based on high-precision map information and their understanding of the surrounding road structure when no specific destination is set.
[0113] It should be understood that there is some semantic overlap among the aforementioned concepts (passing an intersection, changing lanes, changing local navigation strategies, and changing driving direction). For example, there is some semantic overlap between "changing lanes" and "changing driving direction" because in some situations, such as when a vehicle changes from a straight lane to a right-turn lane, not only does the driving lane change, but the driving direction also changes. This application lists these concepts for the purpose of clarity and completeness.
[0114] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory including instructions that can be executed by a processor of the device to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.
[0115] In another exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program executable by a programmable device, the computer program having a code portion for performing the methods described above when executed by the programmable device.
[0116] Those skilled in the art will also understand that the various illustrative logical blocks and steps listed in the embodiments of this application can be implemented by electronic hardware, computer software, or a combination of both. Whether such functionality is implemented through hardware or software depends on the specific application and the overall system design requirements. Those skilled in the art can implement the described functionality using various methods for each specific application, but such implementation should not be construed as exceeding the scope of protection of the embodiments of this application.
[0117] Furthermore, the term “exemplary” is used herein to mean serving as an example, instance, or illustration. Any aspect or design described herein as “exemplary” is not necessarily to be construed as advantageous compared to other aspects or designs. Rather, the use of the term “exemplary” is intended to present the concept in a concrete manner. As used herein, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or.” That is, unless otherwise specified or clear from the context, “X applies A or B” is intended to mean any of the natural inclusive arrangements. That is, “X applies A or B” satisfies any of the foregoing instances if X applies A; X applies B; or both X applies A and B. Additionally, unless otherwise specified or clear from the context to refer to the singular form, the articles “a” and “an” as used in this application and the appended claims are generally understood to mean “one or more.”
[0118] Similarly, although this disclosure has been shown and described with respect to one or more implementations, equivalent variations and modifications will occur to those skilled in the art upon reading and understanding this specification and the accompanying drawings. This disclosure includes all such modifications and variations and is limited only by the scope of the claims. In particular, with respect to the various functions performed by the components described above (e.g., elements, resources, etc.), unless otherwise indicated, the terminology used to describe such components is intended to correspond to any component (functionally equivalent) that performs the specific function of the described component, even if structurally not equivalent to the disclosed structure. Furthermore, although specific features of this disclosure may have been disclosed with respect to only one of several implementations, such features may be combined with one or more other features of other implementations, as may be desired and advantageous to any given or particular application. Moreover, with regard to the terms “comprising,” “owning,” “having,” “having,” or variations thereof as used in the detailed description or claims, such terms are intended to be inclusive in a manner similar to the term “including.”
[0119] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the appended claims.
[0120] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.
Claims
1. A method for displaying virtual objects, characterized in that, The virtual object display method includes: Display a virtual object editing page, wherein the display area of the virtual object editing page displays multiple virtual objects; In response to a voice-triggered control operation, the target virtual object is selected in the display area; The target virtual object is displayed on the virtual object display page.
2. The virtual object display method according to claim 1, characterized in that, The virtual object display method further includes: In response to a voice-triggered switching operation, the selected target virtual object in the display area is switched.
3. The virtual object display method according to claim 2, characterized in that, The number of virtual objects is multiple, and the multiple virtual objects are arranged sequentially. The switching operation triggered by voice, which switches the selected target virtual object in the display area, includes: In response to the voice-triggered switching operation, the next virtual object of the target virtual object among a plurality of sequentially arranged virtual objects is taken as the new target virtual object.
4. The virtual object display method according to claim 1, characterized in that, The virtual object editing page includes: In response to a voice-triggered operation that switches a page on the desktop, the virtual object editing page is displayed.
5. The virtual object display method according to claim 1, characterized in that, The virtual object display method further includes: In response to a voice-triggered name editing operation on the selected target virtual object, the name of the target virtual object is edited; Interact with the target virtual object based on its name.
6. The virtual object display method according to claim 1, characterized in that, The number of virtual object display pages includes at least one, and displaying the target virtual object in the virtual object display page includes: Acquire the user's voice signal and identify the control intent in the voice signal, the control intent being used to determine the virtual object display interface to be controlled; The target virtual object is displayed on the virtual object display page that is intended to be controlled.
7. The virtual object display method according to claim 1, characterized in that, The number of virtual object display pages includes at least one, and the editing area of the virtual object editing page displays at least one page selection control. The page selection control is used to select the corresponding virtual object display page. Displaying the target virtual object in the virtual object display page includes: In response to a voice-triggered selection operation of a page selection control in the editing area, the target virtual object is displayed in the selected virtual object display page.
8. The virtual object display method according to claim 1, characterized in that, The editing area of the virtual object editing page displays a return control, and displaying the target virtual object on the virtual object display page includes: In response to a voice-triggered operation on the return control in the editing area, the display of the virtual object editing page is switched to the display of the virtual object display page, which is used to display the target virtual object.
9. The virtual object display method according to claim 1, characterized in that, The editing area of the virtual object editing page displays an add control, which is used to add new virtual objects. The virtual object display method further includes: In response to a voice-triggered operation to add a control in the editing area, a new virtual object is added to the display area.
10. The virtual object display method according to claim 1, characterized in that, The virtual object display method further includes: In response to a voice-triggered deletion operation on a virtual object in the display area, the corresponding virtual object is deleted from the display area.
11. The virtual object display method according to claim 1, characterized in that, The virtual object display method further includes: A preset device is displayed in the first display area of the virtual object display page; Displaying the target virtual object on the virtual object display page includes: The virtual object is displayed in the second display area of the virtual object display page.
12. The virtual object display method according to claim 1, characterized in that, The desktop includes multiple sequentially arranged display pages, and the virtual object display method further includes: In response to a voice-triggered page adjustment operation, the position of the virtual object display page among multiple display pages on the desktop is adjusted.
13. A virtual object display device, characterized in that, The virtual object display device includes: The first display module is configured to display a virtual object editing page, wherein the display area of the virtual object editing page displays multiple virtual objects; The selected module is configured to respond to voice-triggered control operations by selecting a target virtual object in the display area; The second display module is configured to display the target virtual object in the virtual object display page.
14. The virtual object display device according to claim 13, characterized in that, The virtual object display device further includes: The switching module is configured to switch the selected target virtual object in the display area in response to a voice-triggered switching operation.
15. The virtual object display device according to claim 14, characterized in that, The number of virtual objects is multiple, and the multiple virtual objects are arranged sequentially. The switching module is specifically configured as follows: In response to the voice-triggered switching operation, the next virtual object of the target virtual object among a plurality of sequentially arranged virtual objects is taken as the new target virtual object.
16. The virtual object display device according to claim 13, characterized in that, The number of virtual object display pages includes at least one, and the second display module is specifically configured as follows: Acquire the user's voice signal and identify the control intent in the voice signal, the control intent being used to determine the virtual object display interface to be controlled; The target virtual object is displayed on the virtual object display page that is intended to be controlled.
17. The virtual object display device according to claim 13, characterized in that, The number of virtual object display pages includes at least one, and the editing area of the virtual object editing page displays at least one page selection control, which is used to select the corresponding virtual object display page. The second display module is specifically configured as follows: In response to a voice-triggered selection operation of a page selection control in the editing area, the target virtual object is displayed in the selected virtual object display page.
18. The virtual object display device according to claim 13, characterized in that, The editing area of the virtual object editing page displays a return control, and the second display module is specifically configured as follows: In response to a voice-triggered operation on the return control in the editing area, the display of the virtual object editing page is switched to the display of the virtual object display page, which is used to display the target virtual object.
19. A vehicle, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to implement the steps of the method according to any one of claims 1 to 12 when executing the instruction.
20. A computer-readable storage medium having a computer program stored thereon, characterized in that, When executed by a processor, the computer program implements the steps of the method described in any one of claims 1 to 12.
21. A computer program product, characterized in that, It includes a computer program that, when executed by a processor, implements the steps of the method according to any one of claims 1 to 12.