Floating application message interaction method for intelligent motorcycle

Abstract

The invention relates to an information interaction method of an intelligent motorcycle, in particular to a floating application message interaction method for the intelligent motorcycle, which comprises the following steps of: creating a virtual display screen through DisplayManager and VirtualDisplay technologies in an Android system, and binding the virtual display screen to a specified area of a motorcycle instrument; a notification of the application is monitored in combination with an Accession API of the Android system, and the content of the notification is transmitted to the virtual display screen; and a driver interacts with the floating application interface through a voice instruction. According to the floating application message interaction method for the intelligent motorcycle provided by the invention, a floating WeChat interface is realized in a designated area of an intelligent instrument of the motorcycle through a virtual display technology, and a safe and convenient message viewing and interaction mode is provided, so that the use experience of a driver is improved; and the driving safety is not influenced by information transmission in the riding process.

Description

Technical Field

[0001] The present invention relates to an information interaction method for an intelligent motorcycle, in particular to a floating application message interaction method for an intelligent motorcycle. Background Art

[0002] In the current technical solutions, the display interface of a motorcycle instrument or an intelligent device is mainly used to display the vehicle running status and necessary navigation information, and it is impossible to achieve seamless integration with third-party applications (such as WeChat) on the instrument panel. The existing technologies face the following problems:

[0003] Display area limitation: The screen of an intelligent motorcycle instrument is generally small in size, and its display area is usually only used for displaying basic information of the vehicle-mounted system, and it is impossible to flexibly display the interfaces or notification contents of other third-party applications.

[0004] Safety issues: The existing solutions do not effectively consider the safety of the driver. The driver may be distracted when viewing social application messages, thus affecting driving safety.

[0005] Difficult adaptation: Due to the differences in hardware and systems of different motorcycle instruments, many third-party applications cannot be directly displayed on the instrument panel, resulting in the need to develop separate adaptation solutions for each device, with a huge workload.

[0006] Inconvenient operation: The existing technologies do not provide a simple interaction method and cannot meet the needs of the driver to receive WeChat messages and interact safely and conveniently during riding. Summary of the Invention

[0007] To solve the above problems, the present invention provides a floating application message interaction method for an intelligent motorcycle. The specific technical solution is as follows:

[0008] A floating application message interaction method for an intelligent motorcycle includes the following steps:

[0009] Create a virtual display screen through the DisplayManager and VirtualDisplay technologies in the Android system, and bind the virtual display screen to a specified area of the motorcycle instrument;

[0010] Combine the AccessibilityAPI of the Android system to monitor the notifications of applications and transfer the notification contents to the virtual display screen;

[0011] The driver interacts with the floating application interface through voice commands.

[0012] Preferably, the virtual display screen transfers the rendering content through a Surface.

[0013] Preferably, the creation of the virtual display screen includes the following steps:

[0014] Modify SystemUI to make the notification bar display in the blank area at the upper left corner of the screen;

[0015] Layout a SurfaceView in the right one-third area of the instrument to display the virtual display screen;

[0016] Use DisplayManager and VirtualDisplay to create the virtual display screen.

[0017] Further, when modifying SystemUI to make the notification bar display in the blank area at the upper left corner of the screen, rewrite NotificationPanelView to modify the display position of the notification bar, including the following steps:

[0018] Define x, y, width, and height left for the SystemUI notification bar in dimens.xml;

[0019] Obtain the x, y, width, and height of the notification bar in NotificationPanelView;

[0020] Modify the onLayout of NotificationPanelView to fix the SystemUI position at the position defined in dimens.xml.

[0021] Further, by default, the SurfaceView is set to the hidden state, and it is updated to the display state only when the application starts on the virtual display screen.

[0022] Preferably, the monitoring of the application's notifications includes the following steps:

[0023] Create a ChatHelper service application, register AccessibilityService in AndroidManifest.xml, and configure the applications to be monitored and basic information; create ChatAccessibilityService to inherit AccessibilityService to monitor the notifications of applications on the system notification bar. In the onAccessibilityEvent callback method, system notifications will be captured. When a new application notification arrives, the system will notify the ChatHelper service and pass the message content to the speech synthesizer for reading aloud.

[0024] Preferably, when the driver interacts with the floating application interface through voice commands, the focus is switched to the input text box of the application by simulating a click, and the text recognized by voice is automatically input into the input text box. Then, commands are sent by recognizing voice, and the message sending button is clicked by simulating a click event to send a message.

[0025] Preferably, when the notification content is passed to the virtual display screen, it also includes automatic control according to the vehicle speed. When the vehicle speed is greater than 0, the application is displayed on the virtual display screen. When the vehicle speed is equal to 0, the virtual display screen is hidden, and the application switches back to the physical screen to start and is displayed full screen.

[0026] Compared with the prior art, the present invention has the following beneficial effects:

[0027] A floating application message interaction method for an intelligent motorcycle provided by the present invention realizes a floating WeChat interface in a specified area of the intelligent instrument of the motorcycle through virtual display technology, provides a safe and convenient way to view and interact with messages, thereby improving the driver's usage experience and ensuring that information transmission during the riding process does not affect driving safety. Description of the Drawings

[0028] Figure 1 is the flowchart of this application;

[0029] Figure 2 is the flowchart of information interaction and operation. Detailed Embodiments

[0030] The present invention will be further described below in conjunction with the accompanying drawings.

[0031] By introducing virtual display screen technology into the intelligent motorcycle instrument system, the display of the floating WeChat interface in a specified area is realized, and combined with auxiliary tools and API interfaces, the viewing and simple operations of WeChat messages are realized.

[0032] As Figure 1 and Figure 2 shown, a floating application message interaction method for an intelligent motorcycle includes the following steps:

[0033] Create a virtual display screen: Create a virtual display screen through DisplayManager and VirtualDisplay in the Android system and bind it to a specified area of the motorcycle instrument. This area is located on the right side of the screen to ensure that other vehicle-mounted information is not covered. The virtual display screen passes the rendering content through the Surface to ensure that the display of WeChat messages does not interfere with the normal display of the vehicle-mounted system.

[0034] WeChat message reception and display: Integrate with the Accessibility API of the Android system to monitor WeChat notifications and transfer their content to the virtual display area. Through the parsing and formatting of WeChat message content, present it in the form of a floating interface and can be displayed on the motorcycle instrument screen, staying in the designated area.

[0035] Information interaction and operation: The driver can interact with the floating WeChat interface through simple voice commands. By optimizing the interaction method, ensure that the driver can view and reply to messages while maintaining safety. When specifically implemented, the Android AccessibilityService can be used for automated operations to simulate clicks and text input.

[0036] Hardware and software adaptation: To ensure the universality of the technical solution, adopt virtual display screen technology, which does not rely on specific hardware interfaces. Through SurfaceControl and VirtualDisplay, the content of third-party applications such as WeChat can be directly rendered onto the virtual display screen without the need for specialized adaptation for different motorcycle instruments.

[0037] Safety guarantee and control: The floating display interface will automatically adjust the display content and area according to the driving speed and status of the driver to ensure that it does not interfere with driving operations. The system can also judge whether it is in a driving state based on the vehicle speed and provide more comprehensive message viewing and operation functions when parked, thus improving driving safety.

[0038] Notification and information synchronization: In addition to WeChat messages, it also supports extended adaptation for the synchronous display of notifications from other common applications (such as DingTalk, QQ, etc.) and information. Through a unified virtual display screen interface, the notification information of multiple applications can be rendered onto the same virtual display screen to ensure that the driver can obtain important information in a timely manner.

[0039] By innovatively introducing virtual display technology and combining the floating WeChat interface with the intelligent motorcycle instrument system, it solves problems such as limited display area, poor safety, and high adaptation difficulty in the existing technology, significantly improving the convenience and safety of the driver during riding. It not only has good general adaptability and interaction experience, but also can reduce development costs, providing a brand-new solution for the intelligent motorcycle industry.

[0040] When creating the virtual display screen:

[0041] Modify SystemUI to make the notification bar display in the blank area at the upper left corner of the screen;

[0042] Rewrite the NotificationPanelView to modify the display position of the notification bar. Therefore, this part mainly modifies the layout files and views in SystemUI. The following are the general steps:

[0043] Define the x, y, width, and height in dimens.xml for the SystemUI notification bar in the upper left corner. Obtain these values in NotificationPanelView. Fix its position at the position defined in dimens.xml by modifying the onLayout of NotificationPanelView. So that it can be displayed in the blank area in the upper left corner of the screen and does not block other important content in the system (such as vehicle speed, engine speed, etc.).

[0044] Layout a SurfaceView in the right one-third area of the instrument to display the virtual display screen;

[0045] Add the SurfaceView to the layout of the instrument interface. The SurfaceView is placed on the right and occupies one-third of the screen width. By default, this SurfaceView is set to the hidden state and is updated to the display state only when WeChat is launched onto the virtual display screen.

[0046] Create a virtual display VirtualDisplay using the DisplayManager;

[0047] Create a virtual display using the DisplayManager, specify parameters such as the width, height, and resolution of the virtual display, and render its output to the SurfaceView on the right side of the instrument.

[0048] After creating the virtual display, launch the WeChat interface onto this virtual display when needed.

[0049] Create a new ChatHelper service application to integrate the WeChat message assistance service with voice recognition and voice input functions:

[0050] Create a ChatHelper service application and register the AccessibilityService in AndroidManifest.xml. Configure the applications to be monitored and basic information through the configuration file xml / accessibility_service_config.xml, such as the WeChat application, and the types of events and interaction modes to respond to.

[0051] Create ChatAccessibilityService by inheriting AccessibilityService to listen for WeChat messages on the system notification bar. In the onAccessibilityEvent callback method, the system notifications will be captured. When new WeChat messages arrive, the service will be notified, and the message content will be passed to the text-to-speech synthesizer for reading aloud.

[0052] Text-to-Speech (TTS) is implemented through the TextToSpeech class. By passing in the message text and calling the speak() method, the WeChat messages can be read aloud.

[0053] To enable users to send messages via voice input, we need to integrate SpeechRecognizer to convert the user's voice into text. Perform voice recognition in the Activity of the application and obtain the recognized text.

[0054] By simulating a click, switch the focus to the text input box in the WeChat chat interface and automatically input the text recognized by voice into the text box. Then continue to send commands by recognizing voice, simulate a click event to click the message send button, and send the message.

[0055] Adjust the display logic according to the vehicle speed: when the vehicle speed is greater than 0, WeChat is displayed on the virtual display screen; when the vehicle speed is equal to 0, the virtual display screen is hidden, and WeChat switches back to the physical screen and starts in full-screen display.

[0056] Compared with the prior art, the present invention has the following advantages:

[0057] Flexible display area: Through the virtual display screen technology, the interfaces of third-party applications such as WeChat can be flexibly displayed in the specified area of the motorcycle instrument panel, avoiding occupying the display area of the in-vehicle system itself and ensuring the diversity and flexibility of information display.

[0058] Improve driving safety: Through the carefully designed floating display interface, the driver can view WeChat messages without leaving the driving state, and the interface is reasonably designed without causing excessive interference to the driver, thus improving driving safety.

[0059] General adaptability: Through the virtual display screen technology, it is not necessary to rely on the display interfaces and formats of specific hardware, enabling third-party applications such as WeChat to be seamlessly integrated into various intelligent motorcycle instrument systems to achieve general adaptability.

[0060] Convenient interaction experience: Through the interaction with applications such as WeChat, the driver can view and reply to messages through simple voice commands on the instrument panel, greatly improving the satisfaction of social needs during driving without the need for complex operations.

[0061] Save development costs: Through the versatility of virtual display technology, third-party applications only need to adapt to the area of the virtual display screen, without the need for special development for different motorcycle instrument hardware, reducing development costs.

[0062] The technical principle of the present invention is described above in conjunction with specific embodiments. These descriptions are only for explaining the principle of the present invention and cannot be interpreted as limiting the protection scope of the present invention in any way. Based on the explanations herein, those skilled in the art can associate other specific implementations of the present invention without paying creative labor, and these methods will fall within the protection scope of the claims of the present invention.

Claims

1. A floating application message interaction method for an intelligent motorcycle, characterized in that, It includes the following steps: Create a virtual display through the DisplayManager and VirtualDisplay technologies in the Android system, and bind the virtual display to a specified area of the motorcycle instrument; Combine the Accessibility API of the Android system to monitor the notifications of the application and transfer the notification content to the virtual display; The driver interacts with the floating application interface through voice commands.

2. The floating application message interaction method for an intelligent motorcycle according to claim 1, wherein, The virtual display transfers the rendering content through the Surface.

3. A floating application message interaction method for an intelligent motorcycle according to claim 1, characterized in that, When creating the virtual display, it includes the following steps: Modify the SystemUI to make the notification bar display in the blank area in the upper left corner of the screen; Layout a SurfaceView in the right one-third area of the instrument to display the virtual display; Use the DisplayManager and VirtualDisplay to create a virtual display.

4. The floating application message interaction method for an intelligent motorcycle according to claim 3, characterized in that, When modifying the SystemUI to make the notification bar display in the blank area in the upper left corner of the screen, rewrite the NotificationPanelView to modify the display position of the notification bar, including the following steps: Define the x, y, width, and height left for the SystemUI notification bar in dimens.xml; Obtain the x, y, width, and height of the notification bar in the NotificationPanelView; Modify the onLayout of the NotificationPanelView to fix the SystemUI position at the position defined in dimens.xml.

5. A floating application message interaction method for an intelligent motorcycle according to claim 3, characterized in that, By default, the SurfaceView is set to the hidden state, and the SurfaceView is updated to the display state only when the application starts on the virtual display.

6. A floating application message interaction method for an intelligent motorcycle according to claim 1, characterized in that When monitoring the notifications of the application, it includes the following steps: Create a ChatHelper service application, register the AccessibilityService in the AndroidManifest.xml, and configure the applications and basic information to be monitored; Create a ChatAccessibilityService that inherits from AccessibilityService to monitor the notifications of the applications on the system notification bar. In the onAccessibilityEvent callback method, the system notifications will be captured. When a new application notification arrives, the system will notify the ChatHelper service and transfer the message content to the speech synthesizer for reading.

7. A floating application message interaction method for an intelligent motorcycle according to claim 1, characterized in that, When the driver interacts with the floating application interface through voice commands, the focus is switched to the input text box of the application by simulating a click, and the text recognized by voice is automatically input into the input text box. Then, continue to send commands by recognizing voice, simulate a click event to click the message send button, and send the message.

8. A floating application message interaction method for an intelligent motorcycle according to claim 1, characterized in that When delivering the notification content to the virtual display screen, it also includes automatic control according to the vehicle speed. When the vehicle speed is greater than 0, the application is displayed on the virtual display screen. When the vehicle speed is equal to 0, the virtual display screen is hidden, the application switches back to the physical screen to start, and the application is displayed full screen.

Images