Head-mounted device capable of displaying multi-layer operation interface and display method

Abstract

A head-mounted device and display method capable of displaying a multi-layered operating interface are provided. The head-mounted device includes an inertial sensor, a brainwave sensor, a display, and a processor. The inertial sensor detects the oscillation angle and direction. The brainwave sensor detects brainwave signals, wherein the brainwave signals are associated with a gaze target. In response to a communication connection between the head-mounted device and an electronic device, the processor generates a homepage including a visual flashing area and multiple application icons. The display outputs the homepage. The multiple application icons correspond to multiple applications in the electronic device. The visual flashing area includes multiple function keys, and the multiple function keys correspond to multiple different flashing frequencies. In response to a brainwave signal frequency that is the same as a flashing frequency and the duration of the brainwave signal is greater than a preset time, the processor generates and outputs control commands based on this flashing frequency.

Claims

1. A head-mounted device capable of displaying a multi-layered operating interface, comprising: Inertial sensors are used to detect the swing angle and swing direction; A brainwave sensor for detecting brainwave signals associated with a gaze target; a display; and a processor coupled to the inertial sensor, the brainwave sensor, and the display. In response to a communication connection between the head-mounted device and an electronic device, the processor generates a homepage including a visual flashing area and multiple application icons, and the display outputs the homepage. The application icons correspond to multiple applications in the electronic device, and one of these application icons is the selected application icon. The visual flashing area includes multiple function keys, each corresponding to a different flashing frequency. In response to the frequency of the brainwave signal being the same as a first flashing frequency and the duration of the brainwave signal being greater than a preset time, the processor generates and outputs a first control command based on the first flashing frequency. In response to the swing angle being greater than a preset angle, the selected application icon is updated based on the swing direction.

2. The head-mounted device as claimed in claim 1, wherein, The application icons on the homepage are arranged in a top-to-bottom order as a first preview column, a selection column, and a second preview column. The size of the first application icon in the first preview column and the size of the second application icon in the second preview column are both of the first size.

3. The head-mounted device as claimed in claim 2, wherein, The selected application icon is located in the center of the selection column, wherein the third application icons included on both sides of the selection column are of the second size, and the selected application icon is of the third size.

4. The head-mounted device as claimed in claim 3, wherein the third dimension is larger than the second dimension, and the second dimension is larger than the first dimension.

5. The head-mounted device as claimed in claim 2, wherein, The selected application icon is located in the center of the selection column, wherein the size of the third application icons included on both sides of the selection column is positively correlated with the distance between them and the selected application icon, and is larger than the first size.

6. The head-mounted device as claimed in claim 2, wherein, In response to the swing angle being greater than a preset angle, the selection column is updated based on the swing direction.

7. The head-mounted device as claimed in claim 1, wherein, These function keys include control keys and click keys.

8. The head-mounted device as claimed in claim 7, wherein, In response to the first flashing frequency corresponding to the control key, the processor outputs the first control command to the display, and the display stops flashing other function keys besides the control key based on the first control command.

9. The head-mounted device as claimed in claim 8, wherein the gaze target is the control key.

10. The head-mounted device as claimed in claim 7, wherein, In response to the first flashing frequency corresponding to the clicked key, the processor outputs the first control command to the electronic device, and the electronic device executes the specific application corresponding to the selected application icon based on the first control command.

11. The head-mounted device as claimed in claim 10, wherein the gaze target is the click button.

12. The head-mounted device as claimed in claim 10, wherein, In response to the execution of the specific application, the processor receives the function operation interface of the specific application and generates an application page including the function operation interface and the visual flashing area, and the display outputs the application page. The function operation interface includes multiple function icons, one of which is the selected function icon. In response to the frequency of the brainwave signal being the same as the second flashing frequency and the duration of the brainwave signal being greater than the preset time, the processor generates and outputs a second control command based on the second flashing frequency.

13. The head-mounted device as claimed in claim 12, wherein, In response to the swing angle being greater than a preset angle and the swing direction being vertical, the function operation interface in the application page is moved based on the vertical direction.

14. The head-mounted device as claimed in claim 12, wherein, In response to the swing angle being greater than a preset angle and the swing direction being horizontal, the selected function icon is updated.

15. The head-mounted device as claimed in claim 12, wherein the processor outputs the second control command to the electronic device, wherein, In response to the second flashing frequency corresponding to the click key, the processor outputs the second control command to the electronic device, and the electronic device executes the specific function corresponding to the selected function icon based on the second control command.

16. The head-mounted device as claimed in claim 12, wherein, In response to the second flashing frequency corresponding to the control key, the processor outputs the second control command to the display, and the display stops flashing other function keys besides the control key based on the second control command.

17. The head-mounted device as claimed in claim 12, wherein, These function keys also include a home button and a back button.

18. The head-mounted device as claimed in claim 17, wherein, In response to the second flashing frequency corresponding to the home button, the processor outputs the second control command to the electronic device and the display. The electronic device exits the specific application based on the second control command, and the display outputs the home page based on the second control command.

19. The head-mounted device as claimed in claim 17, wherein, In response to the second flashing frequency corresponding to the return key, the processor outputs the second control command to the electronic device and the display. The electronic device returns the function operation interface of the specific application to the previous function operation interface based on the second control command, and the display outputs the previous function operation interface based on the second control command.

20. The head-mounted device as claimed in claim 1, wherein the brainwave signal is a Steady State Visually Evoked Potential (SSVEP) signal.

21. A display method applicable to a head-mounted device capable of displaying multiple layers of operating interfaces, the display method comprising: The device detects the swing angle and direction using an inertial sensor; it detects brainwave signals using a brainwave sensor, wherein the brainwave signals are associated with the gaze target; in response to the communication connection between the head-mounted device and the electronic device, the processor generates a homepage including a visual flashing area and multiple application icons, and outputs the homepage through the display, wherein the application icons correspond to multiple applications in the electronic device, and one of the application icons is the selected application icon; the visual flashing area includes multiple function keys, and the function keys correspond to multiple different flashing frequencies; and in response to the frequency of the brainwave signal being the same as a first flashing frequency among the flashing frequencies and the duration of the brainwave signal being greater than a preset time, the processor generates and outputs a first control command based on the first flashing frequency, wherein in response to the swing angle being greater than a preset angle, the selected application icon is updated based on the swing direction.

Images