Interaction method, electronic device and computer-readable storage medium

Abstract

The present application is applicable to the technical field of terminals, and particularly relates to an interaction method, an electronic device and a computer-readable storage medium. In the method, on the basis of an interaction instruction of a user, when it is necessary to display first content in a display interface of a vehicle-mounted device, the current state of a vehicle can be determined; if the current state is a parking state, a first component can be displayed in the display interface of the vehicle-mounted device, so that, when the vehicle is in the parking state, the first content is presented by means of the first component, which is larger, and thus a user can conveniently and quickly acquire a large amount of information; and if the current state is a driving state, a second component can be displayed in the display interface of the vehicle-mounted device, so that, when the vehicle is in the driving state, the first content is presented by means of the second component, which is smaller, that is, the first content can be displayed in a smaller mode, which prevents the attention of a driver during driving being affected due to too much content being displayed in the display interface, thereby improving the driving safety.

Description

Interaction method, electronic device, and computer-readable storage medium

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on November 28, 2023, with application number 202311615702.6 and application name “Interactive Method, Electronic Device and Computer-readable Storage Medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application belongs to the field of terminal technology, and in particular relates to an interaction method, an electronic device, and a computer-readable storage medium. Background Art

[0003] With the development of vehicle intelligence, voice interaction systems (also known as voice assistants) are widely used in vehicles. After the user wakes up the voice assistant through the specified wake-up word, he can interact with the voice assistant through voice to use the required functions. At present, the voice interaction performed by the voice assistant is generally based on a streaming pop-up type visual interface, that is, when the voice assistant performs voice interaction, it generally returns a large amount of text content for the user to view through the display interface, such as displaying a window in the display interface to return a large amount of text content to the user through the window. This method of returning a large amount of text content through a window can easily cause the driver to lose concentration and affect driving safety.

[0004] Summary of the Invention

[0005] The embodiments of the present application provide an interaction method, an electronic device, and a computer-readable storage medium, which can improve driving safety when displaying content in a driving state.

[0006] In a first aspect, an embodiment of the present application provides an interaction method, including:

[0007] Upon receiving a first interaction instruction from the user, determining a current state of the vehicle;

[0008] If the current state is the parking state, displaying the first component in the display interface;

[0009] If the current state is a driving state, displaying a second component in the display interface;

[0010] The second component is smaller than the first component, and the first content displayed by the first component or the second component is content in response to the first interaction instruction.

[0011] In the interaction method provided above, when the user's first interaction instruction is obtained, the current state of the vehicle can be determined. If the current state is a parking state, a first component can be displayed in the display interface of the vehicle-mounted device. If the current state is a driving state, a second component can be displayed in the display interface of the vehicle-mounted device. Among them, the second component is smaller than the first component, and the first content displayed by the first component or the second component can be the content in response to the first interaction instruction, so that when the vehicle is in a parking state, the first content can be presented through the larger first component, which is convenient for the user to quickly obtain a large amount of information. When the vehicle is in a driving state, the first content can be presented through the smaller second component to minimize the display of the first content, avoid displaying too much content in the display interface, affect the driver's driving attention, and improve driving safety.

[0012] In a possible implementation, displaying the first component on the display interface includes:

[0013] determining a first position of the user in the vehicle;

[0014] The first component is displayed in the display interface according to the first position.

[0015] In the interaction method provided by this implementation, when the current state of the vehicle is the parking state, the user who needs to interact with the voice assistant by voice can be determined, and the first component can be displayed at a position close to the user in the display interface, which can facilitate the interaction between the user and the first component, and can facilitate the user to view the first content displayed in the first component, thereby improving the efficiency of the user in viewing the first content and enhancing the user experience.

[0016] Optionally, displaying the first component in the display interface according to the first position includes:

[0017] When the first position is the main driving position, the first component is displayed on the left side of the display interface;

[0018] When the first position is not the main driving position, the first component is displayed on the right side of the display interface.

[0019] In the interaction method provided by this implementation, when the vehicle is currently parked, if it is determined that the user who needs to interact with the voice assistant is the user in the primary driver's seat, a first component can be displayed on the left side of the display interface to facilitate interaction between the primary driver's seat user and the first component. If it is determined that the user who needs to interact with the voice assistant is not the primary driver's seat user, the first component can be displayed on the right side of the display interface to facilitate interaction between the first component and users in the passenger seat or other seats. This can also reduce the impact of the first component displayed on the display interface on the primary driver's seat user, thereby improving driving safety.

[0020] Exemplarily, the user's first position in the vehicle may be determined based on a sound zone corresponding to the first interaction instruction or a sound zone corresponding to the wake-up instruction.

[0021] In another possible implementation, displaying the first component on the display interface includes:

[0022] Determining a second position of the target toolbar in the display interface;

[0023] According to the second position, the first component is displayed in the display interface, and the first component does not overlap with the target toolbar.

[0024] In the interactive method provided by this implementation, when it is necessary to display the target toolbar in the display interface or the target toolbar is already displayed in the display interface, the second position of the target toolbar in the display interface can be determined, and the size of the first component can be adjusted according to the second position of the target toolbar in the display interface, so that the first component and the target toolbar do not overlap, avoiding mutual obstruction between the first component and the target toolbar, thereby improving the display effect.

[0025] For example, when the target toolbar needs to be displayed at the bottom of the display interface or is already displayed at the bottom of the display interface, the height of the first component can be adjusted upward to shrink the first component upward. For example, when the target toolbar needs to be displayed at the top of the display interface or is already displayed at the top of the display interface, the height of the first component can be adjusted downward to shrink the first component downward. For example, when the target toolbar needs to be displayed on the left edge of the display interface or is already displayed on the left edge of the display interface, and the first component also needs to be displayed on the left side of the display interface, the width of the first component can be adjusted to the right to shrink the first component to the right. For example, when the target toolbar needs to be displayed on the right edge of the display interface or is already displayed on the right edge of the display interface, and the first component also needs to be displayed on the right side of the display interface, the width of the first component can be adjusted to the left to shrink the first component to the left.

[0026] Optionally, when the size of the first component is adjusted, the first content displayed by the first component can be adjusted synchronously. For example, when the height of the first component needs to be adjusted upward, the first content displayed by the first component can be moved upward. For example, when the height of the first component needs to be adjusted downward, the first content displayed by the first component can be moved downward.

[0027] In another possible implementation, displaying the first component on the display interface includes:

[0028] determining a type of the first content;

[0029] When the type of the first content includes a target type, the first component is displayed according to a width of the first content.

[0030] In the interactive method provided by this implementation, the size of the first component displayed on the display interface can be adaptively adjusted based on the first content. That is, when the type of the first content includes the target type, the width of the first content can be determined. When the width of the first content is greater than the default width of the first component, the width of the first component can be adjusted based on the width of the first content. For example, the width of the first component can be adjusted to be greater than or equal to the width of the first content, so that the first component can fully display the first content, making it easier for users to view and improving the user experience.

[0031] Optionally, the target type is a chart type.

[0032] In a possible implementation, after displaying the first component on the display interface, the method further includes:

[0033] Obtaining a second interaction instruction, where the second interaction instruction is an instruction to open the first application;

[0034] According to the second interaction instruction, the first component is reduced.

[0035] In the interaction method provided by this implementation, after the first component is displayed in the display interface, a second interaction instruction can also be detected. The second interaction instruction can be an instruction to open the first application. When the second interaction instruction is detected, it can be determined that the user currently wants to view the content of the first application. At this time, the first component can be reduced, for example, the first component can be reduced to a voice bar to avoid blocking the application interface corresponding to the first application while maintaining the sound reception, making it easier for the user to view the content of the first application.

[0036] In another possible implementation, if the current state is the parking state, after displaying the first component on the display interface, the method further includes:

[0037] When it is detected that the current state is switched from the parking state to the driving state, the first component displayed in the display interface is switched to the second component.

[0038] In the interactive method provided by this implementation, when the first component is displayed on the display interface, the current state of the vehicle can be obtained in real time. When the current state of the vehicle is detected to change from parking to driving, the larger first component displayed on the display interface can be switched to a smaller second component to avoid the impact of excessive content displayed on the display interface on driving behavior and improve driving safety.

[0039] Exemplarily, displaying the second component in the display interface includes:

[0040] The second component is displayed in the middle position of the display interface.

[0041] In the interactive method provided in this example, if the current state of the vehicle is the driving state, the second component can be displayed in the middle position of the display interface, that is, the first content can be displayed through the smaller second component in the middle position, and the first content can be visually minimized to reduce the impact of the content displayed by the second component on the driver's driving attention, thereby improving driving safety.

[0042] Optionally, due to the smaller size of the second component and the limited amount of content it can display, when displaying the first content through the second component, the first content can be displayed in a streaming manner. That is, during the generation of the first content, the generated first content can be dynamically displayed through the second component, and the generated first content can also be broadcasted through voice playback. In other words, the second component can display the dynamic process of the first content to ensure the efficient delivery of the first content.

[0043] In one example, after displaying the second component in the display interface, the method further includes:

[0044] Upon acquiring a third interaction instruction, determining a first position of the user in the vehicle, wherein the third interaction instruction is an instruction to display content in the second component;

[0045] When the first position is the main driver's seat, outputting a prompt message, wherein the prompt message is used to indicate that the content in the second component cannot be displayed;

[0046] When the first position is not the main driving position, the second component is switched to the first component, and the first component is displayed on the right side of the display interface.

[0047] In the interactive method provided in this example, while the second component is displayed on the display interface, a third interactive instruction for the second component may be detected. The third interactive instruction may be an instruction to display detailed content within the second component. When the third interactive instruction is detected, a determination may be made as to whether to deploy the second component based on the user's first position in the vehicle. This prevents deployment of the second component from impacting the driving behavior of the user in the driver's seat, thereby improving driving safety.

[0048] Optionally, when the first position is the primary driver's seat, that is, the user currently interacting with the voice assistant is the user in the primary driver's seat, to avoid the impact of expanding too much content on driving behavior, the second component may not be expanded, and a prompt message may be output. The prompt message can be used to remind the user that the content in the second component is currently unavailable, so as to prompt the user to concentrate on driving. When the first position is not the primary driver's seat, that is, the user currently interacting with the voice assistant is not the user in the primary driver's seat, the second component can be switched to the first component, and the second component can be displayed on the right side of the display interface to facilitate user interaction.

[0049] In a possible implementation, the method further includes:

[0050] During the process of generating the first content, if a fourth interaction instruction is obtained, a response is made to the fourth interaction instruction while generating the first content.

[0051] In the interactive method provided by this implementation, a new interactive instruction (i.e., a fourth interactive instruction) may be detected during the process of generating the first content for display on the first component or the second component. The fourth interactive instruction may be an interactive instruction corresponding to a new voice request. Upon detecting the fourth interactive instruction, the fourth interactive instruction may be executed concurrently during the process of synchronously generating the first content for display on the first component or the second component, so as to respond to the fourth interactive instruction while continuing to generate the first content, without interrupting the current content generation state.

[0052] For example, after the concurrent execution of the fourth interactive instruction, the execution status of the fourth interactive instruction may not be voice broadcast, that is, during the execution of the fourth interactive instruction and after the execution of the fourth interactive instruction is completed, the generation of the first content can continue, and the first content can be voice broadcast so as not to interrupt the generation and broadcast status of the first content.

[0053] Optionally, when the fourth interaction instruction is an interaction instruction for adjusting the interface form of the first component or the second component, or when the fourth interaction instruction is an interaction instruction for adjusting the display method of the first content, in the process of generating the first content to be displayed on the first component or the second component, the fourth interaction instruction can be executed concurrently, and after the fourth interaction instruction is executed, the execution status of the fourth interaction instruction may not be voice broadcast, that is, the first content may always be voice broadcast.

[0054] In another possible implementation, the method further includes:

[0055] After the first content is displayed in the second component, the second content is displayed in the second component, where the second content is content determined based on the first content, or the second content is content that provides feedback on the execution of the first interactive instruction.

[0056] In the interaction method provided by this implementation, after the second component completes displaying the first content, for example, after displaying the first content via streaming text, the second component can display the second content. The second content can be a summary of the displayed first content or feedback on the execution of the first interaction instruction, which can help users understand the execution status of the first interaction instruction and enhance the user experience.

[0057] Exemplarily, the first content is content generated based on first data corresponding to the vehicle, the first data is data generated during the use of the vehicle, and the first data is obtained based on the first interaction instruction.

[0058] In the interaction method provided in this example, when generating the first content according to the first interaction instruction, relevant data of the vehicle (i.e., the first data) can be obtained, and the first content responding to the first interaction instruction can be generated based on the relevant data of the vehicle, thereby ensuring the accuracy of the first content and improving the user experience.

[0059] Optionally, the first component is a window.

[0060] Optionally, the second component is a card.

[0061] In a second aspect, an embodiment of the present application provides an interactive device, including:

[0062] A state determination module, configured to determine the current state of the vehicle upon receiving the first interaction instruction from the user;

[0063] A first display module, configured to display a first component on a display interface if the current state is a parking state;

[0064] a second display module, configured to display a second component in the display interface if the current state is a driving state;

[0065] The second component is smaller than the first component, and the first content displayed by the first component or the second component is content in response to the first interaction instruction.

[0066] In a possible implementation, the first display module is used to determine a first position of the user in the vehicle; and display the first component in the display interface according to the first position.

[0067] Optionally, the first display module is also used to display the first component on the left side of the display interface when the first position is the main driving position; and to display the first component on the right side of the display interface when the first position is not the main driving position.

[0068] In another possible implementation, the first display module is further configured to determine a second position of the target toolbar in the display interface; and display the first component in the display interface according to the second position, wherein the first component does not overlap with the target toolbar.

[0069] In another possible implementation, the first display module is further configured to determine a type of the first content; and when the type of the first content includes a target type, display the first component according to a width of the first content.

[0070] Optionally, the target type is a chart type.

[0071] In a possible implementation, the apparatus further includes:

[0072] A first instruction acquisition module is used to acquire a second interaction instruction, where the second interaction instruction is an instruction to open the first application;

[0073] A component reduction module is used to reduce the first component according to the second interaction instruction.

[0074] In another possible implementation, the apparatus further includes:

[0075] The first component switching module is configured to switch the first component displayed in the display interface to the second component when detecting that the current state is switched from the parking state to the driving state.

[0076] Exemplarily, the second display module is used to display the second component in the middle position of the display interface.

[0077] In one example, the apparatus further comprises:

[0078] a second instruction acquisition module, configured to determine a first position of the user in the vehicle upon acquiring a third interaction instruction, wherein the third interaction instruction is an instruction to display content in the second component;

[0079] a prompt information output module, configured to output a prompt information when the first position is the main driver's position, wherein the prompt information is used to indicate that the content in the second component cannot be displayed;

[0080] The second component switching module is used to switch the second component to the first component when the first position is not the main driving position, and display the first component on the right side of the display interface.

[0081] In a possible implementation, the apparatus further includes:

[0082] The synchronous response module is configured to, if a fourth interaction instruction is obtained during the process of generating the first content, respond to the fourth interaction instruction while generating the first content.

[0083] In another possible implementation, the second display module is further used to display second content in the second component after completing the display of the first content in the second component, where the second content is content determined based on the first content, or the second content is content that provides feedback on the execution of the first interactive instruction.

[0084] Exemplarily, the first content is content generated based on first data corresponding to the vehicle, the first data is data generated during the use of the vehicle, and the first data is obtained based on the first interaction instruction.

[0085] Optionally, the first component is a window.

[0086] Optionally, the second component is a card.

[0087] In a third aspect, an embodiment of the present application provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the electronic device implements the interaction method described in any one of the first aspects above.

[0088] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program. When the computer program is executed by a computer, the computer implements the interaction method described in any one of the first aspects above.

[0089] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when executed on an electronic device, enables the electronic device to execute any one of the interaction methods described in the first aspect above.

[0090] It can be understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0091] FIG1 is a schematic diagram of the structure of an electronic device to which the interaction method provided in an embodiment of the present application is applicable;

[0092] FIG2 is a schematic diagram of a software architecture to which the interactive method provided in an embodiment of the present application is applicable;

[0093] FIG3 is a flow chart of an interaction method provided in an embodiment of the present application;

[0094] FIG4 is a schematic diagram of an application scenario provided in an embodiment of the present application;

[0095] FIG5 is a second schematic diagram of an application scenario provided by an embodiment of the present application;

[0096] FIG6 is a third schematic diagram of an application scenario provided by an embodiment of the present application;

[0097] FIG7 is a fourth schematic diagram of an application scenario provided by an embodiment of the present application;

[0098] Figures 8 and 9 are schematic diagrams of application scenarios provided in the embodiment of the present application;

[0099] FIG10 is a sixth schematic diagram of an application scenario provided in an embodiment of the present application. DETAILED DESCRIPTION

[0100] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.

[0101] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0102] As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0103] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0104] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof all mean "including but not limited to," unless otherwise specifically emphasized.

[0105] In addition, the “plurality” mentioned in the embodiments of the present application should be interpreted as two or more.

[0106] The steps involved in the interactive method provided in the embodiments of the present application are merely examples. Not all steps are mandatory, nor are all information or messages required. These steps can be added or removed as needed during use. The same step or steps or messages with the same function in different embodiments of the present application can be referenced and learned from each other.

[0107] The business scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Ordinary technicians in this field will know that with the evolution of network architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0108] With the development of vehicle intelligence, voice interaction systems (also known as voice assistants) are widely used in vehicles. After the user wakes up the voice assistant through the specified wake-up word, he can interact with the voice assistant through voice to use the required functions. At present, the voice interaction performed by the voice assistant is generally based on a streaming pop-up type visual interface, that is, when the voice assistant performs voice interaction, it generally returns a large amount of text content for the user to view through the display interface, such as displaying a window in the display interface to return a large amount of text content to the user through the window. This method of returning a large amount of text content through a window can easily cause the driver to lose concentration and affect driving safety.

[0109] To solve the above problems, an embodiment of the present application provides an interaction method, an electronic device, and a computer-readable storage medium. In this method, when a user's first interaction instruction is obtained, the electronic device can determine the current state of the vehicle. If the current state is the parking state, the electronic device can display a first component on the display interface of the electronic device. If the current state is the driving state, the electronic device can display a second component on the display interface of the electronic device. The second component is smaller than the first component, and the first content displayed by the first component or the second component can be the content in response to the first interaction instruction. That is, in an embodiment of the present application, when it is necessary to display the first content on the display interface, if the vehicle is in the parking state, the electronic device can present the first content through the larger first component to facilitate the user to quickly identify and obtain a large amount of information. When the vehicle is in the driving state, the electronic device can present the first content through the smaller second component to minimize the display of the first content, avoid displaying too much content on the display interface, and affect the driver's driving attention, improve driving safety, and have strong ease of use and practicality.

[0110] In the embodiments of the present application, the electronic device may be an in-vehicle device, a mobile phone, a tablet computer, a wearable device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a desktop computer, or other electronic device with a display interface and supporting voice interaction. The embodiments of the present application do not impose any restrictions on the specific type of the electronic device.

[0111] The following first introduces the electronic device involved in the embodiment of the present application. Please refer to Figure 1, which shows a schematic structural diagram of an electronic device 100.

[0112] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, an antenna 1, an antenna 2, a mobile communication module 140, a wireless communication module 150, an audio module 160, a speaker 160A, a receiver 160B, a microphone 160C, an earphone interface 160D, a sensor module 170, and a display screen 180. The sensor module 170 may include a pressure sensor 170A, a gyroscope sensor 170B, an acceleration sensor 170C, a distance sensor 170D, a temperature sensor 170E, and a touch sensor 170F.

[0113] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0114] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0115] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0116] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0117] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, and / or a universal serial bus (USB) interface.

[0118] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can be coupled to the touch sensor 170F via the I2C interface, enabling communication between the processor 110 and the touch sensor 170F via the I2C bus interface, thereby enabling touch functionality of the electronic device 100.

[0119] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 160 via the I2S bus to enable communication between the processor 110 and the audio module 160. In some embodiments, the audio module 160 can transmit audio signals to the wireless communication module 150 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.

[0120] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 160 and the wireless communication module 150 can be coupled via a PCM bus interface. In some embodiments, the audio module 160 can also transmit audio signals to the wireless communication module 150 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0121] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 150. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 150 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 160 can transmit audio signals to the wireless communication module 150 via the UART interface, enabling the function of playing music through Bluetooth headphones.

[0122] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 180 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the camera function of the electronic device 100. The processor 110 and the display 180 communicate via the DSI interface to implement the display function of the electronic device 100.

[0123] The GPIO interface can be configured through software. The GPIO interface can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the display 180, the wireless communication module 150, the audio module 160, the sensor module 170, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0124] USB interface 130 is an interface that complies with USB standards and specifications, and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. USB interface 130 can be used to transfer data between electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as augmented reality devices.

[0125] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0126] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 140, the wireless communication module 150, the modem processor and the baseband processor.

[0127] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0128] The mobile communication module 140 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 140 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 140 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 140 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 140 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 140 can be set in the same device as at least some of the modules of the processor 110.

[0129] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 160A, the receiver 160B, etc.) or displays an image or video through the display screen 180. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 140 or other functional modules.

[0130] The wireless communication module 150 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 150 can be one or more devices that integrate at least one communication processing module. The wireless communication module 150 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 150 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0131] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 140, and the antenna 2 is coupled to the wireless communication module 150, so that the electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0132] Electronic device 100 implements display functionality through a GPU, display screen 180, and an application processor. The GPU is a microprocessor for image processing that connects display screen 180 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0133] Display screen 180 is used to display images, videos, and the like. Display screen 180 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 180, where N is a positive integer greater than one.

[0134] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0135] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0136] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0137] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0138] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0139] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 160, the speaker 160A, the receiver 160B, the microphone 160C, the headphone jack 160D, and the application processor.

[0140] The audio module 160 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 160 can also be used to encode and decode audio signals. In some embodiments, the audio module 160 can be provided in the processor 110, or some functional modules of the audio module 160 can be provided in the processor 110.

[0141] The speaker 160A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 160A.

[0142] The receiver 160B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 160B close to the ear to hear the voice.

[0143] Microphone 160C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 160C to input the sound signal into the microphone 160C. The electronic device 100 can be provided with at least one microphone 160C. In other embodiments, the electronic device 100 can be provided with two microphones 160C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 160C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.

[0144] The headphone jack 160D is used to connect a wired headphone and can be a USB interface 130 or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0145] Pressure sensor 170A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 170A can be located on display screen 180. There are many types of pressure sensors 170A, such as resistive, inductive, and capacitive. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force is applied to pressure sensor 170A, the capacitance between the electrodes changes. Electronic device 100 determines the intensity of the pressure based on this change in capacitance. When a touch operation is applied to display screen 180, electronic device 100 detects the touch intensity based on pressure sensor 170A. Electronic device 100 can also calculate the touch location based on the detection signal from pressure sensor 170A. In some embodiments, touch operations applied to the same touch location but with different touch intensities can correspond to different operation instructions. For example, when a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, an instruction to create a new short message is executed.

[0146] The gyroscope sensor 170B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 170B. The acceleration sensor 170C can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. The distance sensor 170D is used to measure distance. The electronic device 100 can measure distance using infrared or laser. The temperature sensor 170E is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature sensor 170E to detect temperature. The touch sensor 170F is also called a "touch device." The touch sensor 170F can be set on the display screen 180. The touch sensor 170F and the display screen 180 form a touch screen, also called a "touch screen." The touch sensor 170F is used to detect touch operations acting on or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation may be provided through the display screen 180. In other embodiments, the touch sensor 170F may also be disposed on the surface of the electronic device 100, at a position different from that of the display screen 180.

[0147] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a microservice architecture, or a cloud architecture. For example, the software system of the electronic device 100 may adopt an Android operating system (OS), a Harmony OS, or an IOS with a layered architecture. The embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100.

[0148] FIG2 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application.

[0149] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0150] The application layer can include a series of application packages.

[0151] As shown in FIG2 , the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.

[0152] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0153] As shown in FIG2 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0154] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0155] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0156] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0157] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0158] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0159] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0160] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.

[0161] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0162] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0163] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0164] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0165] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0166] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0167] A 2D graphics engine is a drawing engine for 2D drawings.

[0168] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0169] The following describes in detail the interaction method provided in the embodiment of the present application with reference to the accompanying drawings and specific application scenarios.

[0170] Please refer to Figure 3, which shows a schematic flow chart of an interaction method provided by an embodiment of the present application. The method can be applied to an electronic device with a display interface. A voice interaction system (such as a voice assistant) can be provided in the electronic device, and the user can activate the voice interaction system to perform voice interaction. The following will be exemplified by taking the electronic device as a vehicle-mounted device and the voice interaction system as a voice assistant as an example. As shown in Figure 3, the method may include:

[0171] S301. When a first interaction instruction from a user is obtained, determine a current state of the vehicle.

[0172] S302: If the current state is the parking state, display the first component in the display interface.

[0173] S303: If the current state is the driving state, a second component is displayed in the display interface, the second component is smaller than the first component, and the first content displayed by the first component or the second component is the content in response to the first interaction instruction.

[0174] In an embodiment of the present application, when the user's first interaction instruction is obtained, the on-board device can determine the current state of the vehicle. If the current state is a parking state, the on-board device can display a first component in the display interface of the on-board device. If the current state is a driving state, the on-board device can display a second component in the display interface of the on-board device. Among them, the second component is smaller than the first component, and the first content displayed by the first component or the second component can be the content in response to the first interaction instruction. That is, in an embodiment of the present application, when the vehicle is in a parking state, the on-board device can present the first content through the larger first component to facilitate the user to quickly identify and obtain a large amount of information. When the vehicle is in a driving state, the on-board device can present the first content through the smaller second component to minimize the display of the first content, avoid displaying too much content in the display interface, affect the driver's driving attention, and improve driving safety.

[0175] Exemplarily, the first interaction instruction may be an instruction requesting the execution of a certain function. For example, it may be a voice interaction instruction requesting the execution of a certain function. The first interaction instruction may be a instruction generated based on voice information input by a user in the vehicle cabin. For example, it may be a instruction generated based on voice information input by a user in the driver's seat, or it may be a instruction generated based on voice information input by a user in the passenger seat, etc.

[0176] Optionally, the first interaction instruction may include a wake-up instruction, or may not include a wake-up instruction. When the first interaction instruction does not include a wake-up instruction, before outputting the first interaction instruction, a wake-up instruction needs to be output to wake up the voice assistant. It should be understood that the wake-up instruction refers to an instruction to wake up the voice assistant. The wake-up instruction can be specifically set according to the actual scenario, and the embodiment of the present application does not impose any restrictions on this. For example, the wake-up instruction may be a voice instruction containing a preset wake-up word. Among them, the preset wake-up word can be customized by the user or set by default by the vehicle-mounted device. For example, the vehicle-mounted device can set the preset wake-up word by default to "Xiaoyi Xiaoyi" and the like. For example, the user can customize the preset wake-up word to "Hello Xiaoyi" and the like.

[0177] It can be understood that when the first interaction instruction includes a wake-up instruction, the vehicle-mounted device can wake up the voice assistant after obtaining the first interaction instruction, and can display the first component or the second component in the display interface of the vehicle-mounted device according to the current state of the vehicle, so as to display the first content in response to the first interaction instruction through the first component or the second component.

[0178] Among them, when the first interaction instruction does not include a wake-up instruction, the vehicle-mounted device can first obtain the wake-up instruction to wake up the voice assistant based on the wake-up instruction. After waking up the voice assistant, the vehicle-mounted device can display a voice bar (also called a voice capsule) at the default position of the display interface. The voice bar can be used to prompt the user to interact with the voice assistant by outputting voice information. For example, the voice bar can display a prompt message "You can speak at any time" to prompt the user to interact with the voice assistant by outputting voice information. Subsequently, when the first interaction instruction is obtained, the vehicle-mounted device can display the first component or the second component according to the current state of the vehicle.

[0179] It should be understood that after waking up the voice assistant based on the first interactive instruction containing the wake-up instruction, the vehicle-mounted device can display a voice bar at the default position of the display interface. Subsequently, the vehicle-mounted device can determine the current state of the vehicle, and can display the first component or the second component in the display interface of the vehicle-mounted device according to the current state of the vehicle. Alternatively, after waking up the voice assistant based on the first interactive instruction containing the wake-up instruction, the vehicle-mounted device may not display the voice bar, that is, the vehicle-mounted device can determine the current state of the vehicle, and can display the first component or the second component in the display interface of the vehicle-mounted device according to the current state of the vehicle. For example, when the display interface of the vehicle-mounted device is in an off-screen state, after the vehicle-mounted device obtains the first interactive instruction containing the wake-up instruction, the vehicle-mounted device can light up the display interface, and can display the first component or the second component in the lit display interface according to the current state of the vehicle.

[0180] It should be noted that the default position can be determined based on the actual scenario, and the embodiments of the present application do not impose any restrictions on this. For example, the default position can be the middle position at the bottom of the display interface, or the middle position at the top of the display interface, or the middle position at the left side of the display interface, or the middle position at the right side of the display interface, or the center position of the display interface, etc. The following will be exemplified using the default position being the middle position at the bottom of the display interface as an example.

[0181] For example, the current state of the vehicle may refer to the current driving state of the vehicle. Optionally, the current state of the vehicle may include a parking state and a driving state. It is understood that the parking state may refer to the vehicle being parked, such as when the vehicle is in P (parking) gear. The driving state may refer to the vehicle being in motion or may refer to the vehicle being in a non-parking state, such as when the vehicle is in a non-P gear.

[0182] It should be noted that the embodiments of the present application do not impose any restrictions on the specific method for determining the current state of the vehicle, and the method can be determined based on the actual scenario. For example, the on-board device can obtain the vehicle's current gear information to determine the vehicle's current state based on the vehicle's current gear information. Specifically, when the vehicle is currently in P gear, the on-board device can determine that the vehicle's current state is the parking state. When the vehicle is currently in a gear other than P, the on-board device can determine that the vehicle's current state is the driving state.

[0183] Exemplarily, the first component may be a window or other larger component that can display content. The second component may be a card or other smaller component that can display content. That is, the first component is larger than the second component, but the embodiments of the present application do not impose any restrictions on the specific forms of the first component and the second component. For example, the first component and the second component may both be windows, wherein the first component may be a larger window and the second component may be a smaller window. For example, the first component and the second component may both be cards, wherein the first component may be a larger card and the second component may be a smaller card, and so on. The following will be exemplified by taking the first component as a window and the second component as a card as an example.

[0184] Optionally, the width and height of the first component (e.g., window) may be set by default by the vehicle-mounted device. That is, upon receiving the user's first interaction instruction, if it is determined that the vehicle is currently in parking, the vehicle-mounted device may display a window of a default size (i.e., a window with a default width and a default height) on the vehicle's display interface to display the first content via the window of the default size.

[0185] Similarly, the width and height of the second component (e.g., a card) can be set by default by the in-vehicle device. That is, upon receiving the user's first interaction instruction, if it is determined that the vehicle is currently in the driving state, the in-vehicle device can display a card of a default size (i.e., a card with a default width and default height) on the vehicle's display interface to display the first content using the default-sized card. It should be understood that the default-sized card is smaller than the default-sized window.

[0186] For example, when the in-vehicle device interacts with the user via a voice assistant, the in-vehicle device can generate first content based on the first interaction instruction using a large language model (LLM). During the generation of the first content, the in-vehicle device can broadcast and display the generated first content via voice and text. That is, when displaying the first content via the first component or the second component, the in-vehicle device can also broadcast the first content via voice.

[0187] It is understood that LLM is a generative model composed of an artificial neural network with a large number of parameters, which can be trained through self-supervised learning or semi-supervised learning. The embodiments of this application do not impose any restrictions on the specific structure and training process of LLM, which can be determined according to the actual scenario.

[0188] Optionally, in the process of generating the first content through LLM, the vehicle-mounted device can display the first content in the first component or the second component in a streaming manner. It can be understood that streaming means that in the process of generating the first content based on the first interactive instruction through LLM, the generated first content can be generated downward word by word and line by line in a left-to-right order according to the user's reading habits. In other words, the first content displayed in the first component or the second component can be displayed word by word from left to right and from top to bottom.

[0189] Optionally, when the first content is displayed in the first component or the second component by streaming popping, the speed of the streaming popping can be set in advance. For example, the speed of the streaming popping can be set to ≤60 milliseconds / word, so that the user can easily identify the content of the streaming popping and ensure the transmission efficiency of the first content.

[0190] For example, when generating the first content according to the first interactive instruction, the vehicle-mounted device can obtain relevant data of the vehicle and can generate the first content in response to the first interactive instruction according to the relevant data of the vehicle. It is understandable that the relevant data of the vehicle can be specifically determined according to the actual scenario, and the embodiments of the present application do not impose any restrictions on this. For example, the relevant data of the vehicle may include the mileage of the vehicle, the current temperature of the vehicle, or the time when a certain part of the vehicle was last maintained (such as the air conditioning filter element, the air conditioning filter element, the range extender oil light), etc.

[0191] For example, when the first interactive instruction obtained by the on-board device is "When should the air conditioning filter be maintained?", the on-board device can obtain the mileage of the vehicle or the time when the air conditioning filter was last maintained, and can determine the first content corresponding to the first interactive instruction based on the mileage of the vehicle or the time when the air conditioning filter was last maintained. For example, the first content can be "The maintenance cycle of the air conditioning filter is every year or every 20,000 kilometers. According to your vehicle usage data, you need to replace the air conditioning filter in September 2023 or when the mileage exceeds 20,519 kilometers, whichever comes first. For more maintenance information on common items, such as the air conditioning filter, range extender oil light, etc., you can check the maintenance cycle table."

[0192] The following will describe in detail the process of S302, displaying the first component in the display interface if the current state is the parking state.

[0193] In some embodiments, if the current state is parking, the in-vehicle device can determine the user's position in the vehicle (hereinafter referred to as the first position) and can display a first component (e.g., a window) on the display interface of the in-vehicle device based on the first position. That is, after obtaining the first interaction instruction, the in-vehicle device can determine the user who needs to interact with the voice assistant by voice and can display a window near the user on the display interface, which can facilitate the user's interaction and facilitate the user to view the first content displayed in the window, thereby improving the efficiency of the user viewing the first content and enhancing the user experience.

[0194] For example, when the user's first position in the vehicle is the primary driver's seat, the in-vehicle device may display a window on the left side of the in-vehicle device's display interface to facilitate interaction with the user in the primary driver's seat. When the user's first position in the vehicle is not the primary driver's seat, the in-vehicle device may display a window on the right side of the in-vehicle device's display interface.

[0195] In one example, the in-vehicle device may determine the first position of the user in the vehicle based on the sound zone corresponding to the first interaction instruction or the sound zone corresponding to the wake-up instruction.

[0196] Optionally, in order to determine the position of the user in the cabin who outputs the voice information, the sound zones can be set in advance according to the seats in the cabin. Each sound zone can correspond to one or more seats. One or more voice collection devices (such as microphones) can be set in each sound zone. For each sound zone, the voice information in the sound zone can be collected by the voice collection device in the sound zone, and the collected voice information can be sent to the vehicle-mounted device. After the vehicle-mounted device obtains the voice information sent by a certain voice collection device, it can determine the sound zone corresponding to the voice information based on the correspondence between the voice collection device and the sound zone, thereby determining the position of the user who output the voice information in the cabin.

[0197] Optionally, after collecting voice information, any voice collection device may determine whether the collected voice information is within the sound zone corresponding to the voice collection device. For example, the determination of whether the collected voice information is within the sound zone corresponding to the voice collection device may be performed using methods such as sound intensity and time difference. If the collected voice information is within the sound zone corresponding to the voice collection device, the voice collection device may transmit the voice information to the vehicle-mounted device. After the vehicle-mounted device receives the voice information transmitted by the voice collection device, it may determine the sound zone corresponding to the voice information based on the correspondence between the voice collection device and the sound zone, thereby determining the location of the user who output the voice information within the vehicle cabin. If the collected voice information is not within the sound zone corresponding to the voice collection device, the voice collection device may not process the voice information. For example, the voice collection device may not transmit the collected voice information to the vehicle-mounted device.

[0198] For example, when the cabin contains four seats, four sound zones can be set, and the four sound zones correspond to the four seats in the cabin respectively, such as sound zone A corresponding to the main driver's seat, sound zone B corresponding to the front passenger seat, sound zone C corresponding to the main driver's rear seat, and sound zone D corresponding to the front passenger's rear seat. The voice collection device A in sound zone A can collect voice information output from the main driver's seat, the voice collection device B in sound zone B can collect voice information output from the front passenger seat, the voice collection device C in sound zone C can collect voice information output from the main driver's rear seat, and the voice collection device D in sound zone D can collect voice information output from the front passenger's rear seat. When the voice information (for example, voice information A) obtained by the vehicle-mounted device is the voice information sent by the voice collection device A, the vehicle-mounted device can determine that the position of the user who outputs the voice information A is the main driver's seat based on the correspondence between the voice collection device A and the sound zone A. When the voice information (for example, voice information B) acquired by the vehicle-mounted device is voice information sent by the voice collection device B, the vehicle-mounted device can determine that the position of the user who outputs the voice information B is the passenger seat based on the correspondence between the voice collection device B and the sound zone B.

[0199] It should be understood that the above-described determination of the user's first position in the vehicle based on the sound zone corresponding to the first interaction instruction or the sound zone corresponding to the wake-up instruction is only for illustrative purposes and should not be construed as limiting the embodiments of the present application. In the embodiments of the present application, the vehicle-mounted device may also determine the user's first position in the vehicle by other means. For example, a microphone array may be provided in the vehicle-mounted device, and the vehicle-mounted device may determine the position at which the first interaction instruction or the wake-up instruction is output by sound source localization of the microphone array, thereby determining the user's first position in the vehicle.

[0200] For example, when the in-vehicle device displays a window on a display interface, the window may include a voice bar, a close button, and a resize button. For example, the voice bar, close button, and resize button may be displayed at the top of the window. The voice bar may be used to prompt the user to interact with the voice assistant by outputting voice information. The close button may be used to close the window. The resize button may be used to adjust the size of the window.

[0201] Please refer to Figure 4, which shows a schematic diagram of an application scenario provided by an embodiment of the present application. This application scenario is exemplified by taking the example that the first interaction instruction does not include a wake-up instruction.

[0202] As shown in FIG4(a), after the vehicle-mounted device is started, the vehicle-mounted device may display a desktop on the display interface. The desktop may display information such as time, weather, signal status, battery level, and cabin temperature. When a wake-up indication is detected, the vehicle-mounted device may display a voice bar 410 at the bottom center of the display interface.

[0203] When the voice bar 410 is displayed in the display interface, if a first interactive instruction is obtained, such as a voice instruction of "When should the air conditioning filter be maintained?", the on-board device can determine the current status of the vehicle and can generate the first content according to the first interactive instruction. For example, the first content can be "The maintenance cycle of the air conditioning filter is every year or every 20,000 kilometers. According to your vehicle usage data, you need to replace the air conditioning filter in September 2023 or when the mileage exceeds 20,519 kilometers, whichever comes first. For more maintenance information of commonly used items, such as the air conditioning filter element, the range extender oil light, etc., you can check the maintenance cycle table."

[0204] When the current state of the vehicle is a parking state, the in-vehicle device may determine a first position of the user in the vehicle.

[0205] As shown in (b) in Figure 4, when the user's first position in the vehicle is the main driving position, the vehicle-mounted device can display a window 400 of a default size on the left side of the display interface, and can display the first content in the window 400 in a streaming manner during the generation of the first content.

[0206] As shown in (c) in Figure 4, when the user's first position in the vehicle is not the main driver's position, for example, when the user's position in the vehicle is the front passenger seat, the vehicle-mounted device can display a window 400 of a default size on the right side of the display interface, and can display the first content in the window 400 in a streaming manner during the generation of the first content.

[0207] As shown in (b) and (c) of FIG4 , window 400 may further include a voice bar 410, a close button 411, and an adjustment button 412. A prompt message “You can speak at any time” may be displayed in voice bar 410 to prompt the user to interact with the voice assistant via voice.

[0208] Please refer to Figure 5, which shows a second schematic diagram of an application scenario provided by an embodiment of the present application. This application scenario is exemplified by taking the example of the first interaction instruction including a wake-up instruction.

[0209] As shown in (a) of FIG5 , after the vehicle-mounted device is started, the vehicle-mounted device may display a desktop on the display interface, wherein the desktop may display information such as time, weather, signal status, battery level, and cabin temperature.

[0210] Subsequently, when a first interactive instruction including a wake-up instruction is obtained, for example, when a voice instruction of "Xiaoyi Xiaoyi, when should the air conditioning filter be maintained?" is obtained, the vehicle-mounted device can wake up the voice assistant. In addition, the vehicle-mounted device can also determine the current status of the vehicle and can generate the first content based on the first interactive instruction. For example, the first content can be "The maintenance cycle of the air conditioning filter is every year or every 20,000 kilometers. According to your vehicle usage data, you need to replace the air conditioning filter in September 2023 or when the mileage exceeds 20,519 kilometers, whichever comes first. For more maintenance information on common items, such as the air conditioning filter element, the range extender oil light, etc., you can check the maintenance cycle table."

[0211] When the current state of the vehicle is a parking state, the in-vehicle device may determine a first position of the user in the vehicle.

[0212] As shown in (b) in Figure 5, when the user's first position in the vehicle is the main driver's seat, the vehicle-mounted device can display a window 500 of a default size on the left side of the display interface, and during the generation of the first content, the first content can be displayed in the window 500 in a streaming manner to facilitate the user in the main driver's seat to interact with the window 500.

[0213] As shown in (c) in Figure 5, when the user's first position in the vehicle is not the main driver's seat, for example, when the user's position in the vehicle is the front passenger seat, the vehicle-mounted device can display a window 500 of a default size on the right side of the display interface, and can display the first content in the window 500 in a streaming manner during the generation of the first content, so as to facilitate the user in the front passenger seat or users in other positions to interact with the window 500.

[0214] In a possible implementation, the size of the window displayed on the display interface may be adaptively adjusted according to existing display content or to-be-displayed content on the display interface.

[0215] In one example, when a target toolbar (such as a smartdock bar) needs to be displayed in the display interface or the target toolbar is already displayed in the display interface, the vehicle-mounted device can determine the position of the target toolbar in the display interface (hereinafter referred to as the second position), and can adjust the size of the window according to the second position of the target toolbar in the display interface, so that the window and the target toolbar do not overlap, avoiding mutual obstruction between the window and the target toolbar, and improving the display effect.

[0216] For example, when the target toolbar needs to be displayed at the bottom of the display interface or is already displayed at the bottom of the display interface, the vehicle-mounted device can adjust the height of the window upwards to shrink the window upwards. For example, when the target toolbar needs to be displayed at the top of the display interface or is already displayed at the top of the display interface, the vehicle-mounted device can adjust the height of the window downwards to shrink the window downwards. For example, when the target toolbar needs to be displayed at the left edge of the display interface or is already displayed at the left edge of the display interface, and the window also needs to be displayed on the left side of the display interface, the vehicle-mounted device can adjust the width of the window to the right to shrink the window to the right. For example, when the target toolbar needs to be displayed at the right edge of the display interface or is already displayed at the right edge of the display interface, and the window also needs to be displayed on the right side of the display interface, the vehicle-mounted device can adjust the width of the window to the left to shrink the window to the left.

[0217] Optionally, when the window is resized, the first content displayed in the window can be adjusted synchronously. For example, when the window height needs to be adjusted upward, the first content displayed in the window can be moved upward. For example, when the window height needs to be adjusted downward, the first content displayed in the window can be moved downward.

[0218] Optionally, when a window is displayed in the display interface, if an operation that triggers the display of a target toolbar is detected, the vehicle-mounted device can determine that the target toolbar needs to be displayed in the display interface. At this time, the vehicle-mounted device can determine the second position of the target toolbar in the display interface and adjust the size of the window according to the second position.

[0219] It is understood that the operation for triggering the display of the target toolbar can be determined based on the actual scenario, and the present application does not impose any restrictions on this. For example, it can be an operation of sliding upward from the bottom, or sliding downward from the top, or sliding from the right edge to the left, or sliding from the left edge to the right, or double-clicking the display interface with a knuckle, etc.

[0220] For example, when the application interface corresponding to a certain application (such as application A) needs to be displayed in full screen in the display interface, the vehicle-mounted device can reduce the window, for example, the window can be shrunk into a voice bar to avoid blocking the content in the application interface while maintaining continuous reception, making it easier for users to view the content of application A and improving user experience.

[0221] Optionally, after displaying the window in the display interface, the vehicle-mounted device may further detect an interaction instruction (hereinafter referred to as a second interaction instruction), which may be an instruction to open a certain application (hereinafter referred to as the first application). If the second interaction instruction is detected, the vehicle-mounted device may determine that the user currently wants to view the content of the first application. At this point, the vehicle-mounted device may reduce the window according to the second interaction instruction. For example, the window may be reduced to a voice bar to avoid blocking the application interface corresponding to the first application while maintaining the reception of the sound, making it easier for the user to view the content of the first application.

[0222] Optionally, after the window is reduced to a voice bar based on the second interaction instruction, the position of the voice bar in the display interface can be determined based on the actual scenario, and the embodiments of the present application do not impose any restrictions on this. For example, the position of the voice bar in the display interface can be the original position of the window, or the position of the voice bar in the display interface can be the middle position of the display interface, such as the middle position at the bottom of the display interface, etc.

[0223] It should be understood that in a scenario where the display interface is split, for example, in a scenario where the display interface is split into left and right screens, when the in-vehicle device detects the second interaction instruction, it can determine the position of the first application that the user currently wants to view in the display interface (hereinafter referred to as position A) based on the position of the window in the display interface, and can display the application interface corresponding to the first application at position A. For example, when the window is on the left side of the display interface, the in-vehicle device can display the application interface corresponding to the first application on the right side of the display interface. When the window is on the right side of the display interface, the in-vehicle device can display the application interface corresponding to the first application on the left side of the display interface. That is, in a split-screen scenario, when the second interaction instruction is detected, the in-vehicle device can display the window and the application interface corresponding to the first application in a split-screen display without shrinking the window, so as to facilitate user interaction with the window without blocking the content of the first application.

[0224] It should be noted that the second interaction instruction can be an instruction generated based on any operation such as a touch operation or a click operation. Alternatively, the second interaction instruction can also be a voice interaction instruction. The embodiment of the present application does not impose any restrictions on the second interaction instruction, and it can be determined specifically according to the actual scenario.

[0225] Please refer to 6, which shows a third schematic diagram of an application scenario provided in an embodiment of the present application.

[0226] When receiving the first interactive instruction, such as the voice command "When should the air conditioning filter be maintained?", the on-board device can determine the current status of the vehicle and can generate the first content based on the first interactive instruction. For example, the first content can be "The maintenance cycle of the air conditioning filter is every year or every 20,000 kilometers. According to your vehicle usage data, you need to replace the air conditioning filter in September 2023 or when the mileage exceeds 20,519 kilometers, whichever comes first. For more maintenance information on common items, such as the air conditioning filter element, range extender oil light, etc., you can check the maintenance cycle table."

[0227] When the current state of the vehicle is a parking state, the in-vehicle device may determine the first position of the user in the vehicle.

[0228] As shown in FIG6(a), when the user is in the primary driver's seat in the vehicle, if the in-vehicle device determines that no other content is currently displayed on the display interface, the in-vehicle device may display a default-sized window 600 on the left side of the display interface. Window 600 may display the first content. Window 600 may also include a voice bar 610, which may display a prompt message stating "You can speak at any time" to prompt the user to interact with the voice assistant via voice.

[0229] As shown in (a) of Figure 6, when the window 600 is displayed in the display interface, when an operation of sliding upward from the bottom is detected, the vehicle-mounted device can determine that the target toolbar 620 needs to be displayed in the display interface. Assume that the target toolbar 620 needs to be displayed at the bottom of the display interface. As shown in (b) of Figure 6, the vehicle-mounted device can display the target toolbar 620 at the bottom of the display interface, and can shrink the window 600 upward to adjust the height of the window 600 so that the window 600 and the target toolbar 620 do not overlap. At the same time, the first content displayed in the window 600 can move upward synchronously. For example, the target toolbar 620 may include services and applications, setting applications, map applications, information applications, playback control buttons, and applications that record the status inside the vehicle, etc.

[0230] When the window 600 and the target toolbar 620 are displayed in the display interface, when an operation of opening a certain application is detected, for example, when a click operation on the icon corresponding to the music application in the target toolbar 620 is detected, as shown in (c) in Figure 6, the vehicle-mounted device can display the application interface corresponding to the music application in the display interface, and shrink the window 600 to a voice bar 610 displayed in the middle position at the bottom of the display interface, so as to avoid blocking the content in the music application while maintaining continuous sound reception through the voice bar 610, making it convenient for users to view the content in the music application.

[0231] In another possible implementation, the size of the window displayed on the display interface can be adaptively adjusted according to the first content, which is content generated in response to the first interaction instruction.

[0232] Exemplarily, the in-vehicle device may determine the type of the first content and adjust the size of the window according to the type of the first content.

[0233] Optionally, when the type of the first content includes a target type, the in-vehicle device may determine the width of the first content. When the width of the first content is greater than the default width of the window, the in-vehicle device may adjust the width of the window based on the width of the first content. For example, the width of the window may be adjusted to be greater than or equal to the width of the first content so that the window can fully display the first content, facilitating user viewing and improving user experience.

[0234] Optionally, the target type can be a chart type, or other content type that is not convenient to rearrange, such as an image. That is to say, for content that is not convenient to rearrange, such as charts or images, if the width of such content is greater than the default width of the window, when displaying such content through a window of the default size, the user needs to manually slide the content of the window to the left or right to view the complete content, resulting in a poor user experience. Therefore, when the type of the first content includes the target type, if it is determined that the width of the first content is greater than the default width of the window, the in-vehicle device can adaptively adjust the width of the window according to the width of the first content, so that the window can display the first content as completely as possible, to facilitate user viewing and improve the user experience.

[0235] Please refer to Figure 7, which shows a fourth schematic diagram of an application scenario provided by an embodiment of the present application. This application scenario is exemplified by taking the current state of the vehicle as the parking state and the user's first position in the vehicle as the primary driving position as an example.

[0236] After obtaining the first interaction instruction, when it is determined that the current state of the vehicle is the parking state, and it is determined that the user's first position in the vehicle is the main driving position, if the vehicle-mounted device determines that the type of the generated first content does not include the target type, for example, the first content is text content, as shown in (a) in Figure 6, the vehicle-mounted device can display the first content through a window of default size.

[0237] When the in-vehicle device determines that the type of the first content includes a chart type, the in-vehicle device may determine a width of the first content to adjust a width of the window according to the width of the first content.

[0238] As shown in (a) in Figure 7, when the width of the first content is less than or equal to the default width of the window 700, for example, when the first interaction instruction is the interaction instruction of "What are the advantages of the QJM5 compared with model A?", the first content generated by the vehicle-mounted device according to the first interaction instruction may include the key parameter configuration table corresponding to the QJM5 and model A. Assuming that the width of the key parameter configuration table is less than the default width of the window 700, the vehicle-mounted device can determine that the default size window 700 can fully display the first content. At this time, the vehicle-mounted device may not adjust the width of the window 700, that is, the first content can be directly displayed through the default size window 700.

[0239] As shown in (b) in Figure 7, when the width of the first content is greater than the default width of the window 700, for example, when the first interactive instruction is the interactive instruction "What are the advantages of Askworld M5 compared with model A and model B?", the first content generated by the vehicle-mounted device according to the first interactive instruction may include the key parameter configuration table corresponding to Askworld M5, model A and model B. Assuming that the width of the key parameter configuration table is greater than the default width of window 700, the vehicle-mounted device can determine that the default size window 700 cannot fully display the first content. At this time, the vehicle-mounted device can adjust the width of window 700 according to the width of the first content. For example, the width of window 700 can be adjusted to be greater than the width of the first content, so that the adjusted window 710 can fully display the first content, thereby making it convenient for users to view the first content.

[0240] Optionally, when the width of the window needs to be adjusted, in order to ensure the display effect of the display interface, a maximum width value can be set to adjust the width of the window according to the width of the first content and / or the maximum width value. In other words, when the width of the first content is less than or equal to the maximum width value, the in-vehicle device can adjust the width of the window according to the width of the first content. When the width of the first content is greater than the maximum width value, the in-vehicle device can adjust the width of the window according to the maximum width value so that the width of the window does not exceed the maximum value, thereby ensuring the display effect.

[0241] It is understood that the maximum width can be determined based on the actual application scenario, and the present embodiment does not limit this. For example, it can be set by default by the vehicle-mounted device based on the actual application scenario, or it can be customized by the user, and the present embodiment does not limit this.

[0242] The following will describe in detail the process of S303, displaying the second component in the display interface if the current state is the driving state.

[0243] In some embodiments, if the current state of the vehicle is driving state, the vehicle-mounted device can display a second component (such as a card) in the display interface, and display the first content through the card to visually minimize the display of the first content, reduce the impact on the driver's driving attention, and improve driving safety.

[0244] Optionally, when displaying the first content through a card, the vehicle-mounted device can also broadcast the first content through voice broadcast, so as to display the first content mainly through hearing and supplemented by vision, thereby reducing the impact of excessive visual content on driving behavior and improving driving safety.

[0245] It is understandable that the position of the card in the display interface can be determined according to the actual scenario, and the embodiments of the present application do not impose any restrictions on this.

[0246] In one example, the position of a card in the display interface can be set by default by the vehicle-mounted device. For example, the vehicle-mounted device can set the position of a card in the display interface to the center of the display interface by default, that is, the vehicle-mounted device can display the card in the center of the display interface. For example, the vehicle-mounted device can set the position of a card in the display interface to the middle of the bottom of the display interface by default, that is, the vehicle-mounted device can display the card in the middle of the bottom of the display interface. For example, the vehicle-mounted device can set the position of a card in the display interface to the middle of the top of the display interface by default, that is, the vehicle-mounted device can display the card in the middle of the top of the display interface.

[0247] In another example, the vehicle-mounted device can determine the position of the card in the display interface based on the user's first position in the vehicle. For example, when the user's first position in the vehicle is the main driver's seat, the vehicle-mounted device can determine the position of the card in the display interface to be the position on the left side of the display interface, such as the center position of the left side of the display interface, or the middle position of the bottom left side of the display interface, or the middle position of the top left side of the display interface. For example, when the user's first position in the vehicle is not the main driver's seat, such as when the user's first position in the vehicle is the co-driver's seat, the vehicle-mounted device can determine the position of the card in the display interface to be the position on the right side of the display interface, such as the center position of the right side of the display interface, or the middle position of the bottom right side of the display interface, or the middle position of the top right side of the display interface.

[0248] Optionally, when the in-vehicle device displays a card on the display interface, it may also simultaneously display a voice bar. The position of the voice bar on the display interface may be determined based on the position of the card on the display interface. For example, the voice bar on the display interface may be positioned directly above the card, meaning the in-vehicle device may display the voice bar directly above the card. For example, the voice bar on the display interface may be positioned directly below the card, meaning the in-vehicle device may display the voice bar directly below the card.

[0249] Optionally, due to the small size of the card, which can display less content, the in-vehicle device can display the first content via a streaming text format when displaying the first content via the card. That is, during the generation of the first content, the in-vehicle device can dynamically display the generated first content via the card and simultaneously announce the generated first content via voice playback. In other words, the card can display the dynamic process of the first content, ensuring efficient delivery of the first content.

[0250] Optionally, after the card completes displaying the first content, for example, after displaying the first content via streaming text, the in-vehicle device may display second content in the card. The second content may be a summary of the displayed first content or feedback on the execution of the first interactive instruction.

[0251] For example, while displaying a card on the display interface, the in-vehicle device may detect an interaction instruction for the card (hereinafter referred to as a third interaction instruction). The third interaction instruction may be an instruction to display detailed content in the card. When the third interaction instruction is detected, the in-vehicle device may determine whether to unfold the card based on the user's first position in the vehicle.

[0252] Optionally, when the first position is the primary driver's seat, that is, the user currently interacting with the voice assistant is the user in the primary driver's seat, to avoid the impact of expanding too much content on driving behavior, the in-vehicle device may not expand the card and output a prompt message. The prompt message can be used to remind the user that the content in the card is currently unable to be viewed, so as to prompt the user to concentrate on driving. When the first position is not the primary driver's seat, that is, the user currently interacting with the voice assistant is not the user in the primary driver's seat, the in-vehicle device can switch the card to a window and display the window on the right side of the display interface to facilitate user interaction.

[0253] It is understandable that the third interaction instruction can be an interaction instruction generated by clicking or touching a specific area in the card, or can be a direct voice instruction, etc. The embodiment of the present application does not impose any restrictions on the specific content of the third interaction instruction, which can be determined according to the actual application scenario.

[0254] Optionally, the vehicle-mounted device may output prompt information through a pop-up window. It should be understood that the position of the pop-up window in the display interface may be determined specifically according to the actual scenario, and the embodiment of the present application does not impose any limitation on this.

[0255] Please refer to Figures 8 and 9, which show a fifth schematic diagram of an application scenario provided by an embodiment of the present application. This application scenario is exemplified by an example in which the card is positioned in the middle of the bottom of the display interface and the voice bar is displayed directly above the card.

[0256] After receiving the first interactive instruction, such as the voice command "Xiaoyi Xiaoyi, when should the air conditioning filter be maintained?", the on-board device can determine the current status of the vehicle and generate the first content based on the first interactive instruction. For example, the first content can be "The maintenance cycle of the air conditioning filter is one year or every 20,000 kilometers. According to your vehicle usage data, you need to replace the air conditioning filter in September 2023 or when the mileage exceeds 20,519 kilometers, whichever comes first. For more maintenance information on common items, such as the air conditioning filter element, range extender oil light, etc., you can check the maintenance cycle table."

[0257] As shown in (a) of FIG8 , when the vehicle is currently in the driving state, the vehicle-mounted device may display a card 800 in the center of the bottom of the display interface, and may display a voice bar 810 directly above the card 800. During the generation of the first content, the card 800 may display the first content in a streaming manner. The voice bar 810 may display a prompt message "Try to speak to view details" to prompt the user to interact with the voice assistant by outputting voice information.

[0258] As shown in (b) in Figure 8, after completing the display of the first content, the vehicle-mounted device can determine the second content based on the first content or the execution of the first interactive instruction. For example, the second content can be determined as "We have helped you generate the content of "How to maintain the air conditioning filter", click to view details", and the second content can be displayed in card 800.

[0259] During the process of displaying card 800 in the display interface, for example, during the process of card 800 displaying the second content, when a third interaction instruction to view the detailed content in card 800 is detected, for example, when a click operation on card 800 or a voice command of "view details" is detected, the vehicle-mounted device can determine the user's first position in the vehicle.

[0260] As shown in (a) in Figure 9, when the user's first position in the vehicle is the main driving position, the vehicle-mounted device may not perform any operation on the card 800, and may display a pop-up window 910 in the display interface. The pop-up window 910 may display a prompt message "Please concentrate on driving and try again later" to remind the user that card expansion is not supported in the driving state.

[0261] As shown in FIG9( b ), when the user's first position in the vehicle is not the main driver's seat, for example, when the user's first position in the vehicle is the passenger seat, the in-vehicle device may switch card 800 to window 920 and may display window 920 on the right side of the display interface. Window 920 may display the first content.

[0262] In one possible implementation, while generating the first content to be displayed in a window or card, the in-vehicle device may further detect a new interaction instruction (hereinafter referred to as a fourth interaction instruction). The fourth interaction instruction may be an interaction instruction corresponding to a new voice request. Upon detecting the fourth interaction instruction, the in-vehicle device may concurrently execute the fourth interaction instruction while simultaneously generating the first content to be displayed in a window or card, so as to respond to the fourth interaction instruction while continuing to generate the first content, without interrupting the current content generation state.

[0263] In one example, after concurrently executing the fourth interaction instruction, the vehicle-mounted device may not voice broadcast the execution status of the fourth interaction instruction, that is, during the execution of the fourth interaction instruction and after completing the execution of the fourth interaction instruction, the vehicle-mounted device can continue to generate the first content and voice broadcast the first content so as not to interrupt the generation and broadcast status of the first content.

[0264] Optionally, when the fourth interaction instruction is an interaction instruction for adjusting the interface form of the window or card, or when the fourth interaction instruction is an interaction instruction for adjusting the display method of the first content, the vehicle-mounted device can execute the fourth interaction instruction concurrently in the process of generating the first content to be displayed in the window or card, and after executing the fourth interaction instruction, the execution status of the fourth interaction instruction can be omitted from voice broadcast, that is, the first content can be continuously voice broadcast.

[0265] It is understood that adjusting the interface form of the window or card may include adjusting the size of the window or card, for example, switching a card to a window, or switching a window to a card, etc. Adjusting the display mode of the first content may include highlighting a certain part of the first content, etc.

[0266] Please refer to FIG10 , which shows a sixth schematic diagram of an application scenario provided in an embodiment of the present application.

[0267] After receiving the first interactive instruction "Xiaoyi Xiaoyi, when should the air conditioning filter be maintained?", the on-board device can determine the current status of the vehicle and generate the first content according to the first interactive instruction. For example, the first content can be "The maintenance cycle of the air conditioning filter is to replace it every year or every 20,000 kilometers. According to your vehicle usage data, you need to replace the air conditioning filter in September 2023 or when the mileage exceeds 20,519 kilometers, whichever comes first. For more maintenance information on common items, such as the air conditioning filter element, range extender oil light, etc., you can check the maintenance cycle table."

[0268] As shown in FIG10( a ), when the vehicle is currently in the driving state, the in-vehicle device may display a card 1000 on the display interface and may display a voice bar 1010 directly above the card 1000. During the generation of the first content, the in-vehicle device may display the first content through the card 1000 and may also announce the first content in voice.

[0269] During the process of displaying the first content through the card 1000, if the fourth interaction instruction of "view details" is detected, the vehicle-mounted device can determine the first position of the user in the vehicle.

[0270] As shown in FIG10( b ), when the user's first position in the vehicle is not the primary driver's seat, the in-vehicle device may switch card 1000 to window 1020 while continuing to generate and broadcast the first content, and may continue to generate and display the first content in window 1020. When switching from card 1000 to window 1020, the in-vehicle device may not announce the switch in voice, so as not to interrupt the generation and broadcast of the first content, thereby ensuring the continuous generation and broadcast of the first content.

[0271] It is understandable that when it is determined that the user's first position in the vehicle is the main driver's position, that is, when it is determined that the user who is interacting with the voice assistant by voice is the user in the main driver's position, the vehicle-mounted device can continue to generate and broadcast the first content while displaying a pop-up window on the display interface. The pop-up window can display a prompt message "Please concentrate on driving and try again later" to remind the user in the main driver's position to concentrate on driving to improve driving safety.

[0272] In another example, after concurrently executing the fourth interactive instruction, the in-vehicle device may voice broadcast the execution status of the fourth interactive instruction, and after broadcasting the execution status of the fourth interactive instruction, may continue to broadcast the first content. That is, while concurrently executing the fourth interactive instruction, the in-vehicle device may continue to generate and broadcast the first content. After completing the execution of the fourth interactive instruction, the in-vehicle device may continue to generate the first content and voice broadcast the execution status of the fourth interactive instruction. After completing the voice broadcast of the execution status of the fourth interactive instruction, the in-vehicle device may continue to voice broadcast the first content.

[0273] For example, after obtaining the first interactive instruction of "When should the air conditioning filter be maintained?", the vehicle-mounted device can generate the first content according to the first interactive instruction. Assume that the first content is "The maintenance cycle of the air conditioning filter is to replace it every year or every 20,000 kilometers. According to your vehicle usage data, you need to replace the air conditioning filter in September 2023 or when the mileage exceeds 20,519 kilometers, whichever comes first. For more maintenance information of commonly used items, such as the air conditioning filter, range extender oil light, etc., please check the maintenance cycle table. "In the process of the vehicle-mounted device generating the first content, the vehicle-mounted device can display the first content in a streaming manner.

[0274] Assume that when the vehicle-mounted device determines to display the window on the left side of the display interface based on the current state of the vehicle and the first position of the user in the vehicle, the vehicle-mounted device can display the window on the left side of the display interface, so that in the process of generating the first content, the generated first content can be displayed through the window, and the generated first content can be broadcast by voice.

[0275] While the first content is being displayed through the window, if a fourth interactive instruction of "open the driver's window" is detected, the in-vehicle device may execute the action of opening the driver's window while continuing to generate the first content, and announce the execution status of the fourth interactive instruction through voice. For example, if the driver's window is opened, the in-vehicle device may announce "opened" or "the driver's window has been opened for you," etc. After executing the fourth interactive instruction, the in-vehicle device may continue to display the first content through the window and may continue to announce the generated first content through voice.

[0276] In another possible implementation, when displaying a window or card in the display interface, the vehicle-mounted device may also obtain the current state of the vehicle in real time. When a change in the current state of the vehicle is detected, the vehicle-mounted device may display the first content based on the changed current state.

[0277] For example, when the vehicle's current state changes from a parking state to a driving state, the in-vehicle device can switch the window displayed on the display interface to a card to avoid the impact of excessive content displayed on the display interface on driving behavior and improve driving safety. For example, when the vehicle's current state changes from a driving state to a parking state, the in-vehicle device can switch the card displayed on the display interface to a window, or the in-vehicle device can continue to display the first content through the window.

[0278] It is understandable that the above-mentioned automatic switching of windows and cards according to changes in the current state of the vehicle is only explained as an example and should not be understood as a limitation on the embodiments of the present application. In the embodiments of the present application, when the current state of the vehicle changes, the on-board device may not switch between windows and cards. That is to say, after the window is displayed in the display interface based on the first interaction instruction, if the current state of the vehicle changes, the on-board device can still display the window in the display interface and will not automatically switch to a card. Or after the card is displayed in the display interface based on the first interaction instruction, if the current state of the vehicle changes, the on-board device can still display the card in the display interface and will not automatically switch to a window.

[0279] Alternatively, the in-vehicle device may switch between the window and the card only when the vehicle's current state changes from the parking state to the driving state, thereby reducing the impact of the display of more content on driving behavior and ensuring driving safety. That is, after the window is displayed on the display interface based on the first interaction instruction, if the vehicle's current state changes, the in-vehicle device may switch the window on the display interface to a card. After the card is displayed on the display interface based on the first interaction instruction, if the vehicle's current state changes, the in-vehicle device may continue to display the card on the display interface without automatically switching the card to a window.

[0280] In an embodiment of the present application, when the user's first interaction instruction is obtained, the on-board device can determine the current state of the vehicle. If the current state is a parking state, the on-board device can display a first component in the display interface of the on-board device. If the current state is a driving state, the on-board device can display a second component in the display interface of the on-board device. Among them, the second component is smaller than the first component, and the first content displayed by the first component or the second component can be the content in response to the first interaction instruction. That is, in an embodiment of the present application, when the vehicle is in a parking state, the on-board device can present the first content through the larger first component to facilitate the user to quickly identify and obtain a large amount of information. When the vehicle is in a driving state, the on-board device can present the first content through the smaller second component to minimize the display of the first content, avoid displaying too much content in the display interface, affect the driver's driving attention, and improve driving safety.

[0281] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0282] Corresponding to the interaction method described in the above embodiment, the embodiment of the present application further provides an interaction device, and each module of the device can correspond to each step of the interaction method.

[0283] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of this application. Their specific functions and technical effects can be found in the method embodiment section and will not be repeated here.

[0284] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0285] The present application also provides an electronic device comprising at least one memory, at least one processor, and a computer program stored in the at least one memory and executable on the at least one processor. When the processor executes the computer program, the electronic device implements the steps of any of the above-described method embodiments. For example, the structure of the electronic device may be as shown in FIG1 .

[0286] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program. When the computer program is executed by a computer, the computer is enabled to implement the steps of any of the above method embodiments.

[0287] An embodiment of the present application provides a computer program product. When the computer program product is run on an electronic device, the electronic device implements the steps of any of the above method embodiments.

[0288] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by the processor, it can implement the steps of the above-mentioned various method embodiments. Wherein, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable storage medium may at least include: any entity or device that can carry the computer program code to the device / electronic device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electric carrier signal, a telecommunication signal and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, a computer-readable storage medium cannot be an electric carrier signal or a telecommunication signal.

[0289] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0290] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0291] In the embodiments provided in the present application, it should be understood that the disclosed devices / electronic devices and methods can be implemented in other ways. For example, the device / electronic device embodiments described above are merely schematic. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0292] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0293] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.

Claims

1. An interactive method, characterized in that: include: When obtaining the first interaction instruction from the user, determining the current state of the vehicle; If the current state is a parking state, displaying a first component in the display interface; If the current state is a driving state, displaying a second component in the display interface; The second component is smaller than the first component, and the first content displayed by the first component or the second component is content in response to the first interaction instruction.

2. The method according to claim 1, characterized in that The displaying of the first component in the display interface includes: determining a first position of the user in the vehicle; The first component is displayed in the display interface according to the first position.

3. The method according to claim 2, characterized in that The displaying the first component in the display interface according to the first position includes: When the first position is the main driving position, displaying the first component on the left side of the display interface; When the first position is not the main driving position, the first component is displayed on the right side of the display interface.

4. The method according to any one of claims 1 to 3, characterized in that The displaying of the first component in the display interface includes: Determining a second position of the target toolbar in the display interface; According to the second position, the first component is displayed in the display interface, and the first component does not overlap with the target toolbar.

5. The method according to any one of claims 1 to 4, characterized in that The displaying the first component in the display interface includes: determining a type of the first content; When the type of the first content includes a target type, the first component is displayed according to a width of the first content.

6. The method according to claim 5, characterized in that The target type is a chart type.

7. The method according to any one of claims 1 to 6, characterized in that After displaying the first component in the display interface, the method further includes: Obtaining a second interaction instruction, where the second interaction instruction is an instruction to open the first application; According to the second interaction instruction, the first component is reduced.

8. The method according to any one of claims 1 to 7, characterized in that If the current state is the parking state, after displaying the first component in the display interface, the method further includes: When it is detected that the current state is switched from the parking state to the driving state, the first component displayed in the display interface is switched to the second component.

9. The method according to any one of claims 1 to 8, characterized in that The displaying the second component in the display interface includes: The second component is displayed in the middle position of the display interface.

10. The method according to any one of claims 1 to 9, characterized in that After the second component is displayed in the display interface, the method further includes: When a third interaction instruction is obtained, determining a first position of the user in the vehicle, the third interaction instruction being an instruction to display content in the second component; When the first position is the main driving position, outputting a prompt message, wherein the prompt message is used to prompt that the content in the second component cannot be displayed; When the first position is not the main driving position, the second component is switched to the first component, and the first component is displayed on the right side of the display interface.

11. The method according to any one of claims 1 to 10, characterized in that The method further comprises: In the process of generating the first content, if a fourth interaction instruction is obtained, a response is made to the fourth interaction instruction while generating the first content.

12. The method according to any one of claims 1 to 11, characterized in that The method further comprises: After the first content is displayed in the second component, a second content is displayed in the second component, where the second content is content determined based on the first content, or the second content is content that provides feedback on the execution status of the first interactive instruction.

13. The method according to any one of claims 1 to 12, characterized in that The first content is content generated based on first data corresponding to the vehicle, the first data is data generated during the use of the vehicle, and the first data is acquired based on the first interaction instruction.

14. The method according to any one of claims 1 to 13, characterized in that The first component is a window.

15. The method according to any one of claims 1 to 14, characterized in that The second component is a card.

16. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the electronic device implements the interaction method according to any one of claims 1 to 15.

17. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a computer, the computer is enabled to implement the interactive method according to any one of claims 1 to 15.

18. A computer program product, characterized in that When the computer program product is executed on an electronic device, the electronic device is enabled to execute the interaction method according to any one of claims 1 to 15.

Images