Information processing device and control method
By adopting multi-display area and touch sensing technology in the information processing device, combined with rotation mechanism and start-up control, the application start-up operation is simplified and the application start-up is achieved.
Patent Information
- Application Number
- CN202210025458.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-01-12
- Filing Date
- 2022-01-11
- Publication Date
- 2025-08-19
- Estimated Expiration
- 2042-01-11
AI Technical Summary
The existing information processing device is complicated to operate when starting the application software, making it difficult to quickly start the application.
Using a display section with a plurality of display areas and a touch sensing section, through the position and contact detection of the operating medium in the display section, combined with the rotation mechanism and the start control section, the icon menu display of different display areas and the rapid start of the application program are realized.
Simplifies application startup operations and enables quick start of applications.
Smart Images

Figure CN114764279B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an information processing device and a control method. Background Art
[0002] In recent years, information processing devices are known that can input various types of information by bringing an operation medium such as a pen into contact with a display screen (for example, see Patent Document 1).
[0003] Patent Document 1: Japanese Patent Application Laid-Open No. 2009-289045.
[0004] However, in the above-mentioned information processing device, for example, when launching application software (hereinafter referred to as an application), it is necessary to display a list of applications on the operation screen, select an application from the list, and launch it. Therefore, in the above-mentioned information processing device, the operation of launching an application is complicated, making it difficult to launch the application quickly. Summary of the Invention
[0005] The present invention has been made to solve the above-mentioned problem, and an object of the present invention is to provide an information processing device and a control method that can simplify the operation of starting an application and quickly start the application.
[0006] In order to solve the above-mentioned problem, a technical solution of the present invention provides an information processing device, comprising: a display unit, which has multiple display areas; a touch sensing unit, which detects the position of an operating medium on the screen of the above-mentioned display unit and the contact of the above-mentioned operating medium on the above-mentioned screen; and a startup control unit, which, when a prescribed operation is performed on the above-mentioned screen through the above-mentioned operating medium, displays a menu of different icons in the display area where the above-mentioned operating medium is detected and the screen display direction of the above-mentioned display unit according to the display area where the above-mentioned operating medium is detected in the above-mentioned multiple display areas, and starts an application corresponding to the icon selected by the contact of the above-mentioned operating medium in the menu of the displayed icons in the display area where the above-mentioned operating medium is detected.
[0007] In addition, in one technical solution of the present invention, according to the above-mentioned information processing device, the above-mentioned multiple display areas include a first display area and a second display area, and the information processing device comprises: a first shell, which has at least a first display area; a second shell, which has at least a second display area; and a rotation mechanism, which combines the above-mentioned first shell and the above-mentioned second shell, and can rotate the above-mentioned first shell relative to the above-mentioned second shell, and when the above-mentioned screen display direction is a direction in which the rotation axis of the above-mentioned rotation mechanism is parallel to the horizontal axis of the display, the above-mentioned startup control unit causes the display area of the above-mentioned operating medium to be detected to display different menus of the above-mentioned icons in the above-mentioned first display area and the above-mentioned second display area.
[0008] In addition, in one technical solution of the present invention, based on the above-mentioned information processing device, when the display direction of the above-mentioned screen is a direction in which the rotation axis of the above-mentioned rotating mechanism is parallel to the longitudinal axis of the display, the above-mentioned start control unit causes the display area of the above-mentioned operating medium to be detected to display the same menu of the above-mentioned icons in the above-mentioned first display area and the above-mentioned second display area.
[0009] Furthermore, in one aspect of the present invention, according to the information processing device, the startup control unit may change the menu of the icon to be displayed based on a selection history of past selections of the icon.
[0010] Furthermore, in one aspect of the present invention, according to the information processing device, the activation control unit may change the displayed menu of the icons according to the timing when the predetermined operation is performed.
[0011] In addition, in one technical solution of the present invention, according to the above-mentioned information processing device, the above-mentioned operating medium is a pen-shaped medium, and the above-mentioned touch sensing unit detects the situation that the above-mentioned pen-shaped medium approaches to within the prescribed distance relative to the screen of the above-mentioned display unit. When the above-mentioned pen-shaped medium approaches to within the above-mentioned prescribed distance relative to the above-mentioned screen, the position of the above-mentioned pen-shaped medium on the above-mentioned screen can be detected non-contactly, and the above-mentioned start control unit uses the above-mentioned touch sensing unit to detect the operation of maintaining the state of the above-mentioned pen-shaped medium stopping within the above-mentioned prescribed distance relative to the above-mentioned screen for a certain period of time as the above-mentioned prescribed operation.
[0012] In addition, in one technical solution of the present invention, according to the above-mentioned information processing device, the above-mentioned pen-shaped medium is an electronic pen including a resonant circuit, and the above-mentioned touch sensing portion detects the situation in which the above-mentioned electronic pen approaches the above-mentioned screen to within the above-mentioned prescribed distance and the position of the above-mentioned electronic pen on the above-mentioned screen through electromagnetic induction.
[0013] In addition, in one technical solution of the present invention, according to the above-mentioned information processing device, the above-mentioned operating medium includes the user's finger. When the above-mentioned prescribed operation is performed on the above-mentioned screen by the above-mentioned user's finger, the above-mentioned start control unit displays a different menu of the above-mentioned icons in the display area where the above-mentioned user's finger is detected according to the display area where the above-mentioned user's finger is detected and the screen display direction of the above-mentioned display unit.
[0014] In addition, in one technical solution of the present invention, according to the above-mentioned information processing device, the above-mentioned operating medium includes multiple operating media of different types, the above-mentioned prescribed operations include prescribed operations of different types, and the above-mentioned startup control unit displays different menus of the above-mentioned icons according to the type of the above-mentioned operating medium or the type of the above-mentioned prescribed operations performed.
[0015] In addition, in one technical solution of the present invention, according to the above-mentioned information processing device, the above-mentioned prescribed operation is a first prescribed operation, and the above-mentioned information processing device also has an indicating device different from the above-mentioned touch sensing part. When a second prescribed operation different from the above-mentioned first prescribed operation is performed on the above-mentioned screen through the above-mentioned indicating device, the above-mentioned start control part displays a menu of the above-mentioned icon different from the case of performing the above-mentioned first prescribed operation in the display area where the above-mentioned second prescribed operation is detected.
[0016] In addition, a technical solution of the present invention provides an information processing device, comprising: a display unit having a display area; a touch sensing unit that detects the position of a pen-shaped medium, i.e., an operating medium, on the screen of the above-mentioned display unit and the contact of the above-mentioned operating medium with the above-mentioned screen, and detects the situation that the above-mentioned pen-shaped medium approaches to within a specified distance relative to the screen of the above-mentioned display unit, and when the above-mentioned pen-shaped medium approaches to within the above-mentioned specified distance relative to the above-mentioned screen, the position of the above-mentioned pen-shaped medium on the above-mentioned screen can be detected non-contact; and a startup control unit that, when detecting as a specified operation the operation of stopping the above-mentioned pen-shaped medium within the above-mentioned specified distance relative to the above-mentioned screen for a certain period of time using the above-mentioned touch sensing unit, displays a menu of icons in the above-mentioned display area where the above-mentioned pen-shaped medium is detected, and starts an application corresponding to the icon selected by the contact of the above-mentioned pen-shaped medium in the displayed menu of icons.
[0017] In addition, a technical solution of the present invention provides a control method for an information processing device, which includes: a display unit having multiple display areas; and a touch sensing unit that detects the position of an operating medium on the screen of the above-mentioned display unit and the contact of the above-mentioned operating medium on the above-mentioned screen, wherein the control method of the information processing device includes the following steps: when a prescribed operation is performed on the above-mentioned screen through the above-mentioned operating medium, the start control unit displays a menu of different icons in the display area where the above-mentioned operating medium is detected according to the display area where the above-mentioned operating medium is detected in the above-mentioned multiple display areas and the screen display direction of the above-mentioned display unit; and the start control unit starts an application corresponding to the icon selected by the contact of the above-mentioned operating medium in the menu of the displayed above-mentioned icons in the display area where the above-mentioned operating medium is detected.
[0018] In addition, a technical solution of the present invention provides a control method for an information processing device, which includes: a display unit having a display area; a touch sensing unit that detects the position of a pen-shaped medium, i.e., an operating medium, on the screen of the above-mentioned display unit and the contact of the above-mentioned operating medium with the above-mentioned screen, wherein the touch sensing unit that detects the contact of the above-mentioned operating medium on the above-mentioned screen detects the situation that the above-mentioned pen-shaped medium approaches to within a prescribed distance relative to the screen of the above-mentioned display unit, and when the above-mentioned pen-shaped medium approaches to within the above-mentioned prescribed distance relative to the above-mentioned screen, the position of the above-mentioned pen-shaped medium on the above-mentioned screen can be detected non-contact, wherein the control method of the information processing device includes the following steps: when an operation of stopping the above-mentioned pen-shaped medium within the above-mentioned prescribed distance relative to the above-mentioned screen for a certain period of time using the above-mentioned touch sensing unit is detected as a prescribed operation, the start control unit displays a menu of icons in the above-mentioned display area where the above-mentioned pen-shaped medium is detected; and the above-mentioned start control unit starts an application corresponding to the icon selected by the contact of the above-mentioned pen-shaped medium in the menu of displayed icons.
[0019] According to the above aspect of the present invention, the operation of starting an application can be simplified, and the application can be started quickly. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] Figure 1 This is an external view showing an example of a notebook PC according to the first embodiment.
[0021] Figure 2 This is a diagram showing an example of the main hardware configuration of the notebook PC according to the first embodiment.
[0022] Figure 3 This is a block diagram showing an example of the functional configuration of the notebook PC according to the first embodiment.
[0023] Figure 4 It is a diagram showing an example of data in the setting menu storage unit according to the first embodiment.
[0024] Figure 5 This is a diagram showing a data example of the selection history storage unit in the first embodiment.
[0025] Figure 6 This is a first diagram showing a display example of an icon menu in the clamshell mode according to the first embodiment.
[0026] Figure 7 This is a second diagram showing a display example of the icon menu in the clamshell mode according to the first embodiment.
[0027] Figure 8 This is a first diagram showing a display example of the icon menu in the book mode according to the first embodiment.
[0028] Figure 9 This is a second diagram showing a display example of the icon menu in the book mode according to the first embodiment.
[0029] Figure 10 This is a flowchart showing an example of the icon menu setting process of the notebook PC according to the first embodiment.
[0030] Figure 11 This is a flowchart showing an example of the application startup process of the notebook PC according to the first embodiment.
[0031] Figure 12 This is a flowchart showing a modified example of the application startup process of the notebook PC according to the first embodiment.
[0032] Figure 13 This is a block diagram showing an example of the functional configuration of a notebook PC according to the second embodiment.
[0033] Figure 14 It is a diagram showing a data example of the setting menu storage unit according to the second embodiment.
[0034] Figure 15 This is a flowchart showing an example of application startup processing of the notebook PC according to the second embodiment.
[0035] Figure 16 This is a block diagram showing an example of the functional configuration of a notebook PC according to the third embodiment.
[0036] Figure 17 It is a diagram showing an example of data in the setting menu storage unit according to the third embodiment.
[0037] Description of Reference Signs
[0038] 1, 1a, 1b…notebook PC; 10, 10a, 10b…main control unit; 11…CPU; 12…main memory; 13…video subsystem; 14, 14A, 14B…display unit; 20…touch screen; 21…chipset; 22…BIOS memory; 23…HDD; 24…USB connector; 25…audio system; 26…WLAN card; 30…electronic pen; 31…embedded controller; 32…key input unit; 33, 33A, 33B…touch sensor unit; 34…power supply circuit; 5…sensing unit; 36…indicating device; 40, 40a, 40b…storage unit; 41, 41a, 41b…setting menu storage unit; 42…selection history storage unit; 101…first shell; 102…second shell; 103…hinge mechanism; 111…input control unit; 112…status detection unit; 113…display control unit; 114, 114a, 114b…setting processing unit; 115, 115a, 115b…start control unit; AR1, AR2…display area; LC1…resonance circuit. DETAILED DESCRIPTION
[0039] Hereinafter, an information processing device and a control method according to an embodiment of the present invention will be described with reference to the drawings.
[0040] [First embodiment]
[0041] Figure 1 1 is an external view showing an example of a notebook PC 1 according to this embodiment. In this embodiment, the notebook PC 1 is described as an example of an information processing device.
[0042] like Figure 1 As shown, the notebook PC 1 includes a first housing 101 , a second housing 102 , and a hinge mechanism 103 .
[0043] The first housing 101 includes the display portion 14A and the touch sensor portion 33A, and is connected to the second housing 102 via a hinge mechanism 103. The cover on the side of the first housing 101 where the display portion 14A is not visible (the back side of the display) is referred to as an A cover, and the cover on the side of the first housing 101 where the display portion 14A is visible (the display side) is referred to as a B cover.
[0044] The second housing 102 includes the display unit 14B and the touch sensor unit 33B and is connected to the first housing 101 via a hinge mechanism 103. A motherboard, which carries the main hardware of the notebook PC 1, is stored within the second housing 102. The cover of the second housing 102 on the side where the display unit 14B can be visually viewed (the display side) is referred to as the C cover, while the cover of the second housing 102 on the side where the display unit 14B cannot be visually viewed (the back side of the display) is referred to as the D cover.
[0045] The hinge mechanism 103 (an example of a rotation mechanism) can connect the first housing 101 and the second housing 102 and can rotate the first housing 101 around the rotation axis AX relative to the second housing 102 .
[0046] The display unit 14A is disposed in the first housing 101 and has a display area AR1 (first display area). The display unit 14B is disposed in the second housing 102 and has a display area AR2 (second display area).
[0047] In addition, in this embodiment, the display unit 14A and the display unit 14B are collectively referred to as the display unit 14 .
[0048] The touch sensor portion 33A is arranged to overlap the display portion 14A and detects contact between the display screen (display area AR1) of the display portion 14A and an operating medium, such as the electronic pen 30 or a finger, and the operating medium's contact position. The touch sensor portion 33A can detect the position of the electronic pen 30 on the display screen (display area AR1) without contact.
[0049] The touch sensor portion 33B is arranged to overlap the display portion 14B and detects contact between an operating medium, such as the electronic pen 30 or a finger, and the display screen (display area AR2) of the display portion 14B. The touch sensor portion 33B can detect the position of the electronic pen 30 on the display screen (display area AR2) without contact.
[0050] In addition, in this embodiment, the touch sensor portion 33A and the touch sensor portion 33B are collectively referred to as the touch sensor portion 33 .
[0051] Next, refer to Figure 2 , the main hardware structure of the notebook PC 1 is described.
[0052] Figure 2 This is a diagram showing an example of the main hardware configuration of the notebook PC 1 according to this embodiment.
[0053] like Figure 2 As shown, the notebook PC 1 includes a CPU 11, a main memory 12, a video subsystem 13, a display unit 14, a chipset 21, a BIOS memory 22, an HDD 23, a USB connector 24, an audio system 25, a WLAN card 26, an electronic pen 30, an embedded controller 31, a key input unit 32, a touch sensor unit 33, a power supply circuit 34, and a sensor unit 35.
[0054] A CPU (Central Processing Unit) 11 executes various calculation processes under program control and controls the entire notebook PC 1 .
[0055] The main memory 12 is a writable memory used as a read area for programs executed by the CPU 11 and as a work area for writing data processed by the programs. The main memory 12 is composed, for example, of multiple DRAM (Dynamic Random Access Memory) chips. The executable programs include the operating system (OS), various device drivers for operating the hardware of peripheral devices, various services / utilities, and application programs.
[0056] The video subsystem 13 is a subsystem for implementing functions related to image display, and includes a video controller. The video controller processes rendering commands from the CPU 11, writes the processed rendering information into the video memory, and reads the rendering information from the video memory to output it to the display unit 14 as rendering data (display data).
[0057] The display unit 14 is, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display, and displays a display screen based on the drawing data (display data) output from the video subsystem 13. Figure 1 As shown, the display unit 14 includes a display unit 14A and a display unit 14B, and has a plurality of display areas (AR1, AR2). Specifically, the plurality of display areas include a display area AR1 (first display area) and a display area AR2 (second display area).
[0058] The chipset 21 has controllers such as USB (Universal Serial Bus), Serial ATA (AT Attachment), SPI (Serial Peripheral Interface), PCI (Peripheral Component Interconnect), PCI-Express, and LPC (Low Pin Count) buses, and is connected to multiple devices. Figure 2 In the embodiment, as examples of devices, a BIOS memory 22 , an HDD 23 , a USB connector 24 , an audio system 25 , a WLAN card 26 , and an embedded controller 31 are connected to the chipset 21 .
[0059] The BIOS (Basic Input Output System) memory 22 is composed of an electrically rewritable nonvolatile memory such as an EEPROM (Electrically Erasable Programmable Read Only Memory) or a flash ROM. The BIOS memory 22 stores the BIOS and system firmware for controlling the embedded controller 31 and the like.
[0060] The HDD (Hard Disk Drive) 23 (an example of a nonvolatile storage device) stores an OS, various drivers, various services / utilities, application programs (hereinafter sometimes referred to as applications), and various data. The USB connector 24 is a connector for connecting peripheral devices using USB.
[0061] The audio system 25 records, reproduces, and outputs audio data.
[0062] The WLAN (Wireless Local Area Network) card 26 connects to a network via a wireless LAN to perform data communication. For example, when the WLAN card 26 receives data from the network, it generates an event trigger indicating that the data has been received.
[0063] The electronic pen 30 is a pen-shaped operating medium having a resonant circuit LC1 . The electronic pen 30 is supplied with power by electromagnetic induction to the coil of the resonant circuit LC1 . The resonant circuit enables contactless detection of the position of the electronic pen 30 on the screen of the display unit 14 .
[0064] The embedded controller 31 is a single-chip microcomputer that monitors and controls various devices (peripherals, sensors, etc.) regardless of the system status of the notebook PC 1. Furthermore, the embedded controller 31 has a power management function for controlling the power supply circuit 34. Furthermore, the embedded controller 31 is composed of a CPU, ROM, RAM, etc. (not shown), and has multiple channels of A / D input terminals, D / A output terminals, a timer, and digital input and output terminals. The embedded controller 31 is connected to, for example, a key input unit 32, a touch sensor unit 33, a power supply circuit 34, and a sensor unit 35 via these input and output terminals, and the embedded controller 31 controls their operation.
[0065] The key input unit 32 is, for example, an input device such as a power switch.
[0066] The touch sensor unit 33 detects the position of an operating medium, such as the electronic pen 30 or a finger, on the screen of the display unit 14, as well as any contact of the operating medium with the screen. For example, the touch sensor unit 33 detects when the electronic pen 30 (a pen-shaped medium) approaches within a predetermined distance from the screen of the display unit 14. When the electronic pen 30 approaches within the predetermined distance, the touch sensor unit 33 can detect the position of the electronic pen 30 on the screen without contact.
[0067] In addition, in this embodiment, as described above Figure 1 As shown, the touch sensor portion 33 includes a touch sensor portion 33A and a touch sensor portion 33B. The touch sensor portion 33 and the display portion 14 constitute the touch screen 20.
[0068] Furthermore, the touch sensor section 33 includes a contact detection section 331 and an electronic pen detection section 332 .
[0069] The contact detection unit 331 is, for example, a capacitive touch sensor, and detects an operating medium (such as the electronic pen 30 or a finger) in contact with the screen of the display unit 14 , and detects a position where the operating medium has made contact.
[0070] The electronic pen detection unit 332 is, for example, an electromagnetic induction touch sensor that detects the position of the electronic pen 30 on the screen of the display unit 14 in a non-contact manner using the resonant circuit LC1 of the electronic pen 30. For example, the electronic pen detection unit 332 can detect when the electronic pen 30 approaches within a predetermined distance from the screen of the display unit 14.
[0071] In addition, when the electronic pen detection unit 332 detects that the electronic pen 30 is close to the screen of the display unit 14 and is within a specified distance, the contact detection unit 331 detects that the electronic pen 30 is not in contact, so that the touch sensor unit 33 can detect that the electronic pen 30 is stopped within a specified distance from the screen, that is, hovering.
[0072] The power supply circuit 34 includes, for example, a DC / DC converter, a charging / discharging unit, a battery unit, and an AC / DC adapter, and converts the DC voltage supplied from the AC / DC adapter or the battery unit into a plurality of voltages required to operate the notebook PC 1. Furthermore, the power supply circuit 34 supplies power to various components of the notebook PC 1 under control from the embedded controller 31.
[0073] The sensor unit 35 is, for example, an acceleration sensor or a gyro sensor, and detects the screen display direction indicating the usage state of the notebook PC 1. The sensor unit 35 detects the direction of gravity acceleration, for example, and detects the screen display direction of the notebook PC 1 (display unit 14).
[0074] In addition, in this embodiment, the CPU 11 and the chipset 21 described above correspond to the main control unit 10. The main control unit 10 executes processing based on an OS (for example, Windows (registered trademark)).
[0075] Next, refer to Figure 3 , the functional structure of the notebook PC 1 of this embodiment is described.
[0076] Figure 3 This is a block diagram showing an example of the functional configuration of the notebook PC 1 according to this embodiment.
[0077] like Figure 3 As shown, the notebook PC 1 includes a main control unit 10 , a touch screen 20 , an electronic pen 30 , an embedded controller 31 , a sensor unit 35 , and a storage unit 40 .
[0078] exist Figure 3 In FIG. 1 , the touch screen 20 includes a display unit 14 and a touch sensor unit 33. In addition, the display unit 14 has Figure 1 The display unit 14A and the display unit 14B shown in FIG. 3 have a touch sensor unit 33. Figure 1 The touch sensor portion 33A and the touch sensor portion 33B are shown.
[0079] In addition, Figure 3 In the present invention, only the main functional structures related to the present embodiment are described as the structure of the notebook PC 1. In addition, the touch screen 20, the electronic pen 30, the embedded controller 31 and the sensor unit 35 are the same as those described above. Figure 2 The same, therefore, the description thereof is omitted here.
[0080] The storage unit 40 is realized by, for example, the HDD 23 , and includes a setting menu storage unit 41 and a selection history storage unit 42 .
[0081] The setting menu storage unit 41 stores setting information of a menu representing icons of applications (hereinafter referred to as an icon menu). The setting menu storage unit 41 stores the contents of the icon menu displayed when starting an application using the electronic pen 30 as setting information. Figure 4 , an example of data in the setting menu storage unit 41 is described.
[0082] Figure 4 1 is a diagram showing an example of data in the setting menu storage unit 41 according to the present embodiment.
[0083] like Figure 4 As shown, the setting menu storage unit 41 stores the display mode, the display area, and the menu information (application) in association with each other.
[0084] In this figure, the display mode is a mode indicating the use state of the notebook PC 1, and the display mode includes, for example, clamshell mode, book mode, tablet mode, etc. In addition, the display area is a display area indicating the use state of the notebook PC 1. Figure 1 Information on either the display area AR1 or the display area AR2 is stored as a B-cover area, a C-cover area, a right area, a left area, and the like according to the display mode.
[0085] Here, clamshell mode is Figure 1 The mode used in the illustrated state is a mode in which the display screen is oriented parallel to the horizontal axis of the display, with the rotation axis AX of the hinge mechanism 103 being parallel to the horizontal axis of the display. Furthermore, in clamshell mode, the display units 14A and 14B are displayed with the longitudinal direction of the display units 14A and 14B being the horizontal axis of the display, and the axis in the lateral direction of the display units 14A and 14B being the vertical axis of the display.
[0086] In the clamshell mode, the display area AR1 of the display unit 14A corresponds to the upper display area, namely the B-cover area, and the display area AR2 of the display unit 14B corresponds to the lower display area, namely the C-cover area.
[0087] In addition, the book mode is described later. Figure 8 The mode used in the illustrated state is one in which the display screen is oriented parallel to the vertical axis of the display, with the rotation axis AX of the hinge mechanism 103 being parallel to the vertical axis of the display. Furthermore, in book mode, the display on display units 14A and 14B is arranged such that the longitudinal direction of the display units 14A and 14B is the vertical axis of the display, and the axis along the transverse direction of the display units 14A and 14B is the horizontal axis of the display.
[0088] In the book mode, the display area AR1 of the display unit 14A corresponds to the left area, which is the display area on the left side, and the display area AR2 of the display unit 14B corresponds to the right area, which is the display area on the right side.
[0089] The tablet mode is a mode in which the hinge mechanism 103 is rotated 360 degrees so that the A cover and the D cover come into contact with each other and the display portion 14A and the display portion 14B are folded and used with the display portion 14A and the display portion 14B facing the front side.
[0090] In the figure, menu information is setting information indicating a list of applications whose icons are displayed in the icon menu. The menu information includes a plurality of application names (an example of application identification information), and is stored in order of priority, for example.
[0091] For example, in Figure 4In the example shown, the menu information (settings) when the display mode is "clamshell" and the display area is "B cover area" indicates "A browser", "B mail software", "C word processor", etc. Furthermore, the menu information (settings) when the display mode is "clamshell" and the display area is "C cover area" indicates "pen input software", "D memo software", "E memo software", etc.
[0092] In addition, when the display mode is "Book", when the display area is either the "right area" or the "left area", the menu information (setting information) is also the same, and the menu information (setting information) indicates "A browser", "B email software", "C word processor", etc.
[0093] return Figure 3 As explained above, the selection history storage unit 42 stores the selection history of the application selected by the user from the icon menu. Figure 5 , an example of data stored in the selection history storage unit 42 will be described.
[0094] Figure 5 1 is a diagram showing an example of data in the selection history storage unit 42 according to the present embodiment.
[0095] like Figure 5 As shown, the selection history storage unit 42 stores the display mode, the display area, the selection time, and the selected application in association with each other.
[0096] For example, in Figure 5 In the example shown, when the display mode is "clamshell" and the display area is "B cover area", at the selection time "2020 / 13 / 1 10:00:00" (10:00:00 on December 1, 2020 in the Gregorian calendar), the user selects "A browser" as the selected application.
[0097] Return again Figure 3 As described above, the main control unit 10 is a functional unit implemented by the CPU 11 and chipset 21 executing programs stored in the main memory 12, and performs various processes based on the OS. The main control unit 10 includes, for example, an input control unit 111, a state detection unit 112, a display control unit 113, a setting processing unit 114, and a startup control unit 115.
[0098] The input control unit 111 is, for example, a device driver that controls input via the touch sensor unit 33 and detects the position and contact of an operating medium on the screen of the display unit 14. When the touch sensor unit 33 detects, for example, that the electronic pen 30 has approached within a predetermined distance on the screen of the display unit 14, the input control unit 111 obtains detection information indicating that the electronic pen 30 has approached within the predetermined distance and the position coordinates of the electronic pen 30 on the screen of the display unit 14 (display area).
[0099] The state detection unit 112 acquires, for example, gravitational acceleration information from the sensor unit 35 and detects a mode indicating a usage state of the notebook PC 1 , such as clamshell mode, book mode, or tablet mode.
[0100] The display control unit 113 is, for example, a device driver that controls display on the display unit 14 , and displays various information (images, icon menus, etc.) in the display areas ( AR1 , AR2 ) of the display unit 14 .
[0101] The setting processing unit 114 is a functional unit for setting the setting information of the icon menu. According to the user's request, the setting processing unit 114 makes the setting menu storage unit 41 store the setting information of the icon menu. Figure 4 Register and change the setting information shown.
[0102] The startup control unit 115 uses an icon menu to execute application startup processing. When a specified operation is performed on the screen of the display unit 14 via an operating medium, the startup control unit 115 displays an icon menu in the display area where the operating medium was detected. Here, the operating medium is, for example, the electronic pen 30. The specified operation on the screen of the display unit 14 is an operation in which the electronic pen 30 is held within a specified distance from the screen, i.e., hovered for a predetermined period (e.g., one second) (a hovering operation). For example, when the input control unit 111 detects a hovering operation of the electronic pen 30, the startup control unit 115 displays a different icon menu in the display area where the electronic pen 30 is detected, depending on the detected display area and the screen display direction of the display unit 14.
[0103] The startup control unit 115 retrieves, from the settings menu storage unit 41, the icon menu setting information corresponding to the combination of the display area of the electronic pen 30 and the display orientation mode (display mode) detected by the state detection unit 112, and displays the icon menu based on the retrieved icon menu setting information. Furthermore, the startup control unit 115 causes the display unit 14's display areas (AR1, AR2) to display the icon menu via the display control unit 113.
[0104] For example, in the clamshell mode, when a hovering operation of the electronic pen 30 is detected and the detected display area is the B cover area (display area AR1), the startup control unit 115 displays an icon menu mainly including display-related applications such as a browser. In addition, in the clamshell mode, when a hovering operation of the electronic pen 30 is detected and the detected display area is the C cover area (display area AR2), the startup control unit 115 displays an icon menu mainly including input-related applications such as a memo software. Here, refer to Figure 6 and Figure 7 , a display example of the icon menu in the clamshell mode is described.
[0105] Figure 6 and Figure 7 This is a diagram showing a display example of an icon menu in the clamshell mode according to the present embodiment.
[0106] like Figure 6 As shown, in display area AR1 (cover area B), when a hovering operation of the electronic pen 30 relative to the screen is detected at a distance D, the startup control unit 115 displays an icon menu M1 containing icons I1 to I4 around the position of the electronic pen 30. Here, distance D is the length below the threshold at which the touch sensor unit 33 can detect the electronic pen 30. The startup control unit 115 uses the touch sensor unit 33 to detect a hovering operation, which occurs when the electronic pen 30 remains within the detectable threshold (within a predetermined distance) relative to the screen for a certain period of time. Icons I1 to I4 represent display-related applications such as browsers, email software, document display software, and editors, and correspond to the applications stored in the settings menu storage unit 41 as setting information for the cover area B in clamshell mode.
[0107] In addition, if Figure 7 As shown, when a hovering operation of the electronic pen 30 relative to the screen at a distance D is detected in the display area AR2 (C cover area), the startup control unit 115 causes the icon menu M2 including icons I5 to I7 to be displayed around the position of the electronic pen 30. Here, icons I5 to I7 are input-related applications such as memo software, pen input software, and memo software, and correspond to the applications stored in the settings menu storage unit 41 as setting information for the C cover area in clamshell mode.
[0108] In this way, when the clamshell mode is adopted in which the screen display direction is parallel to the rotation axis AX of the hinge mechanism 103 and the horizontal axis of the display, the startup control unit 115 causes the display area of the electronic pen 30 to be detected to display different icon menus in the display area AR1 (first display area) and the display area AR2 (second display area).
[0109] Return again Figure 3 For example, in the book mode, when a hovering operation of the electronic pen 30 is detected, the startup control unit 115 causes the display area to display the same icon menu in both the left area (display area AR1) and the right area (display area AR2). Figure 8 and Figure 9 , a display example of the icon menu in book mode is described.
[0110] Figure 8 and Figure 9 This is a diagram showing a display example of an icon menu in the book mode according to the present embodiment.
[0111] like Figure 8 As shown, in display area AR1 (left area), when a hovering operation of the electronic pen 30 relative to the screen at a distance D is detected, the startup control unit 115 causes an icon menu M3 including icons I1 to I5 to be displayed around the position of the electronic pen 30. Icons I1 to I5 correspond to applications stored in the settings menu storage unit 41 as setting information for the book mode.
[0112] In addition, if Figure 9 As shown, in the display area AR2 (right area), when a hovering operation of the electronic pen 30 relative to the screen based on the distance D is detected, the activation control unit 115 causes the control unit 115 to Figure 8 Similarly to the case of , an icon menu M3 including icons I1 to I5 is displayed around the position of electronic pen 30 .
[0113] In this way, when the book mode is adopted in which the screen display direction is parallel to the rotation axis AX of the hinge mechanism 103 and the vertical axis of the display, the startup control unit 115 causes the display area of the electronic pen 30 to be detected to display the same icon menu in the display area AR1 (first display area) and the display area AR2 (second display area).
[0114] Return again Figure 3 As described above, the startup control unit 115 starts an application corresponding to an icon selected by contact (screen touch) of the screen with the electronic pen 30 in the displayed icon menu in the display area where the electronic pen 30 is detected.
[0115] In addition, the startup control unit 115 changes the icon menu displayed based on the selection history of the past selected icons. The startup control unit 115, for example, changes the information of the selected icon, for example, Figure 5As shown in FIG. 1 , the selection history is stored in the selection history storage unit 42. In addition, the startup control unit 115 summarizes the selection frequency of each icon based on the selection history stored in the selection history storage unit 42, and changes the setting information (menu information) of the setting menu storage unit 41 so that applications corresponding to icons with high selection frequency are preferentially displayed.
[0116] For example, when the activation control unit 115 sets a portion of the menu information in the menu storage unit 41 to be displayed on the icon menu, the activation control unit 115 sets a portion of the menu information that is selected most frequently to be displayed on the icon menu.
[0117] Next, the operation of the notebook PC 1 according to this embodiment will be described with reference to the drawings.
[0118] Figure 10 This is a flowchart showing an example of the icon menu setting process of the notebook PC 1 according to the present embodiment.
[0119] like Figure 10 As shown, first, the setting processing unit 114 of the notebook PC 1 obtains information on the display mode and display area (step S101 ). The setting processing unit 114 obtains information on the display mode and display area input by the user operating the touch sensor unit 33 via the input control unit 111 .
[0120] Next, the settings processing unit 114 obtains menu information (step S102). The settings processing unit 114 obtains menu information input by the user through the touch sensor unit 33 via the input control unit 111. Here, the menu information refers to information about applications displayed in the icon menu. Regarding the menu information, the user can also select an application from a list of applications stored in the notebook PC 1 by operating the touch sensor unit 33.
[0121] Next, the setting processing unit 114 associates the acquired display mode and display area with the menu information and stores them in the setting menu storage unit 41 (step S103). Figure 4 As shown, the setting processing unit 114 associates the display mode and the display area with the menu information and stores them in the setting menu storage unit 41. After the process of step S103, the setting processing unit 114 ends the setting process of the icon menu.
[0122] Next, refer to Figure 11 Next, the application startup process of the notebook PC 1 according to this embodiment will be described.
[0123] Figure 11 This is a flowchart showing an example of the application startup process of the notebook PC 1 according to the present embodiment.
[0124] like Figure 11 As shown, the startup control unit 115 of the notebook PC 1 first determines whether the electronic pen 30 is detected hovering (step S201). The startup control unit 115, via the input control unit 111, determines whether the touch sensor unit 33 has detected the electronic pen 30 hovering. Furthermore, the touch sensor unit 33 detects hovering via the electronic pen detection unit 332. Hovering refers to a state in which the screen of the display unit 14 and the electronic pen 30 are within a predetermined distance due to load fluctuations caused by the supply of power to the resonant circuit LC1 of the electronic pen 30 through electromagnetic induction. If the startup control unit 115 detects the electronic pen 30 hovering (step S201: Yes), the process proceeds to step S202. If the startup control unit 115 does not detect the electronic pen 30 hovering (step S201: No), the process returns to step S201.
[0125] In step S202 , the activation control unit 115 detects the hovering position P (X, Y). The activation control unit 115 obtains the hovering position P (X, Y) of the electronic pen 30 on the screen of the display unit 14 detected by the touch sensor unit 33 via the input control unit 111 .
[0126] Next, the startup control unit 115 determines whether the electronic pen 30 has not been detected or whether a touch event has been detected (step S203). The startup control unit 115 determines, via the input control unit 111, whether the electronic pen 30 has not been detected by the touch sensor unit 33, or whether an event such as a finger, electronic pen 30, or other operating medium making contact (a touch) with the screen of the display unit 14 has occurred. If the electronic pen 30 has not been detected or a touch event has been detected (step S203: "Yes"), the startup control unit 115 returns the process to step S201. Alternatively, if the electronic pen 30 has been detected and no touch event has been detected (step S203: "No"), the startup control unit 115 proceeds to step S204.
[0127] In step S204, the startup control unit 115 determines whether the hovering state has lasted for one second. Specifically, the startup control unit 115 determines whether the hovering state has lasted for one second (an example of a predetermined period). If the hovering state has lasted for one second (step S204: "Yes"), the startup control unit 115 proceeds to step S205. If the hovering state has not lasted for one second (step S204: "No"), the startup control unit 115 returns the process to step S202.
[0128] In step S205, the startup control unit 115 detects the display mode. The startup control unit 115 detects the display mode (display direction mode) as the usage state via the state detection unit 112. The state detection unit 112 detects the display mode based on, for example, the direction of gravitational acceleration detected by the sensor unit 35.
[0129] Next, the startup control unit 115 determines whether the display mode is clamshell mode (step S206). The startup control unit 115 obtains the display mode (display orientation mode) as the usage state detected by the state detection unit 112 and determines whether the display mode is clamshell mode. If the display mode is clamshell mode (step S206: "Yes"), the startup control unit 115 advances the process to step S207. If the display mode is not clamshell mode (for example, book mode) (step S206: "No"), the startup control unit 115 advances the process to step S208.
[0130] In step S207, the activation control unit 115 determines whether the device is hovering over the B cover (step S207). Based on the hovering position P (X, Y), the activation control unit 115 determines whether the device is hovering in the display area AR1 (B cover area) or the display area AR2 (C cover area). If the device is hovering over the B cover (display area AR1 (B cover area)) (step S207: "Yes"), the activation control unit 115 advances the process to step S210. If the device is not hovering over the B cover (display area AR2 (C cover area)) (step S207: "No"), the activation control unit 115 advances the process to step S209.
[0131] Furthermore, in step S208, the startup control unit 115 obtains icon menus corresponding to other display modes (book mode / tablet mode). The startup control unit 115 obtains menu information (settings information) corresponding to, for example, the display mode and the right or left area from the settings menu storage unit 41. After processing step S208, the startup control unit 115 proceeds to step S211.
[0132] In step S209, the startup control unit 115 obtains the icon menu corresponding to the clamshell mode and the C-cover area. The startup control unit 115 obtains the menu information (setting information) corresponding to the clamshell mode and the C-cover area from the setting menu storage unit 41. Here, the menu information (setting information) is Figure 7 The icon menu shown mainly includes, for example, input-related applications such as memo software, etc. After the process of step S209 , the startup control unit 115 advances the process to step S211 .
[0133] In step S210, the startup control unit 115 obtains the icon menu corresponding to the clamshell mode and the B cover area. The startup control unit 115 obtains the menu information (setting information) corresponding to the clamshell mode and the B cover area from the setting menu storage unit 41. Here, the menu information (setting information) is Figure 6The icon menu shown mainly includes, for example, a browser and other display-related applications. After the process of step S210, the startup control unit 115 advances the process to step S211.
[0134] In step S211, the startup control unit 115 displays an icon menu around the hovered position P (X, Y). The startup control unit 115 displays an icon menu based on the menu information (setting information) obtained from the setting menu storage unit 41 around the hovered position P (X, Y) (see Figures 6 to 9 ).
[0135] Next, the startup control unit 115 determines whether an icon in the menu has been selected within a predetermined period (step S212). The startup control unit 115 determines, via the input control unit 111, whether the user has selected an icon in the icon menu, for example, using the electronic pen 30 or a finger. If an icon in the menu has been selected within a predetermined period (e.g., within 3 seconds) (step S212: "Yes"), the startup control unit 115 proceeds to step S214. If no icon in the menu has been selected within a predetermined period (e.g., within 3 seconds) (step S212: "No"), the startup control unit 115 returns to step S212.
[0136] Next, the startup control unit 115 starts the application corresponding to the selected icon (step S214 ).
[0137] Next, the startup control unit 115 adds the selection history and changes the setting information of the icon menu according to the selection information (step S215). Figure 5 As shown, the startup control unit 115 adds the selection history corresponding to the selected icon to the selection history storage unit 42. Furthermore, the startup control unit 115 summarizes the selection frequency of each icon based on the selection history stored in the selection history storage unit 42, and changes the setting information (menu information) in the setting menu storage unit 41 so that, for example, applications corresponding to icons with high selection frequency are preferentially displayed. After the processing of step S215, the startup control unit 115 returns the processing to step S201.
[0138] Next, refer to Figure 12 Next, a modification of the application startup process of the notebook PC 1 according to the present embodiment will be described.
[0139] In the above Figure 11In the application startup process shown, the operation medium is the electronic pen 30, and the prescribed operation that triggers the display of the icon menu is an example of an operation based on hovering the electronic pen 30 for a certain period of time, but the present invention is not limited to this. For example, instead of the electronic pen 30, the operation medium may be a pen-shaped medium, the user's finger, etc., and the prescribed operation may be an operation in which the operation medium is in contact (touched) with the screen and the state of being stopped is maintained for a certain period of time. Here, refer to Figure 12 A modification example of an operation in which an operation medium such as a pen-shaped medium or a user's finger is brought into contact (touched) with a screen and maintained in a stopped state for a certain period of time will be described.
[0140] Figure 12 This is a flowchart showing a modified example of the application startup process of the notebook PC 1 according to the present embodiment.
[0141] like Figure 12 As shown, first, the startup control unit 115 of the notebook PC 1 determines whether contact with the display unit 14 is detected (step S301). The startup control unit 115, via the input control unit 111, determines whether the touch sensor unit 33 has detected contact of the operating medium with the screen of the display unit 14. Furthermore, the touch sensor unit 33 detects contact of the operating medium based on changes in electrostatic capacitance via the contact detection unit 331. If contact with the display unit 14 is detected (step S301: "Yes"), the startup control unit 115 proceeds to step S302. Otherwise, if contact with the display unit 14 is not detected (step S301: "No"), the startup control unit 115 returns the process to step S301.
[0142] In step S302 , the activation control unit 115 detects the contact position P (X, Y). The activation control unit 115 obtains the contact position P (X, Y) of the operation medium on the screen of the display unit 14 detected by the touch sensor unit 33 via the input control unit 111 .
[0143] Next, the startup control unit 115 determines whether contact has not been detected or whether another event has been detected (step S303). The startup control unit 115 determines whether contact has not been detected or whether another event has occurred via the input control unit 111. If contact has not been detected or another event has been detected (step S303: "Yes"), the startup control unit 115 returns the process to step S301. Alternatively, if contact is still detected and no other event has been detected (step S303: "No"), the startup control unit 115 proceeds to step S304.
[0144] In step S304, the startup control unit 115 determines whether the operating medium has been in contact for one second. Specifically, the startup control unit 115 determines whether the operating medium has been in contact for one second (an example of a predetermined period). If the operating medium has been in contact for one second (step S304: "Yes"), the startup control unit 115 proceeds to step S305. If the operating medium has not been in contact for one second (step S304: "No"), the startup control unit 115 returns the process to step S302.
[0145] Next, the processing from step S305 to step S310 is the same as that described above. Figure 11 The processes from step S205 to step S210 shown are the same, and therefore, description thereof is omitted here.
[0146] In step S311, the startup control unit 115 displays the icon menu around the touched position P (X, Y). The startup control unit 115 displays the icon menu based on the menu information (setting information) obtained from the setting menu storage unit 41 around the touched position P (X, Y) (see Figures 6 to 9 ).
[0147] Next, the processing of step S312 to step S315 is the same as that of the above Figure 11 The processes of steps S212 to S215 shown are the same, and therefore, description thereof is omitted here.
[0148] In this way, the electronic pen 30 includes the user's finger or pen-shaped medium. When a prescribed operation is performed on the screen by the user's finger or pen-shaped medium, the start control unit 115 can also display a menu of different icons in the display area where the user's finger or pen-shaped medium is detected and the screen display direction of the display unit 14.
[0149] As described above, the notebook PC 1 (information processing device) of this embodiment includes a display unit 14 having multiple display areas, a touch sensor unit 33, and a startup control unit 115. The touch sensor unit 33 detects the position of an operating medium (e.g., electronic pen 30) on the screen of the display unit 14 and the contact of the operating medium with the screen. When a predetermined operation is performed on the screen using the operating medium, the startup control unit 115 displays a menu of different icons (icon menu) in the display area where the operating medium was detected, depending on the display area and the screen display orientation of the display unit 14. The startup control unit 115 activates the application corresponding to the icon selected by the contact of the operating medium in the displayed icon menu in the display area where the operating medium was detected.
[0150] Thus, the notebook PC 1 of this embodiment eliminates the need to display a list of applications on the operation screen, for example. Instead, the user can simply display an icon menu for selecting and starting an application by performing a predetermined operation on the screen using an operation medium. Therefore, the notebook PC 1 of this embodiment simplifies the operation of starting applications and enables quick application startup.
[0151] In addition, the notebook PC 1 of this embodiment displays different icon menus according to the display area of the operating medium and the screen display direction of the display unit 14, so that the appropriate icon menu corresponding to the usage status and display area can be displayed, and the appropriate application corresponding to the usage status and display area can be quickly started.
[0152] In this embodiment, the multiple display areas include a display area AR1 (first display area) and a display area AR2 (second display area). Furthermore, the notebook PC 1 includes a first housing 101, a second housing 102, and a hinge mechanism 103 (rotation mechanism). The first housing 101 includes at least the display area AR1 (first display area). The second housing 102 includes at least the display area AR2 (second display area). When the screen display direction is such that the rotation axis AX of the hinge mechanism 103 is parallel to the horizontal axis of the display (for example, in clamshell mode), the startup control unit 115 causes the display area detected by the electronic pen 30 to display menus with different icons in the display area AR1 (first display area) and the display area AR2 (second display area).
[0153] Thus, the notebook PC 1 of this embodiment displays different icon menus according to the display area of the detected operation medium, thereby being able to display an appropriate icon menu corresponding to the display area. For example, when the notebook PC 1 of this embodiment is used in clamshell mode, it is possible to display different icon menus in the B cover area and the C cover area, thereby improving convenience.
[0154] In addition, in this embodiment, when the screen display direction is a direction in which the rotation axis AX of the hinge mechanism 103 is parallel to the vertical axis of the display, the startup control unit 115 causes the display area of the electronic pen 30 to be detected so as to display a menu of the same icon in the display area AR1 (first display area) and the display area AR2 (second display area).
[0155] Thus, when the notebook PC 1 of the present embodiment is used in the book mode, for example, the same icon menu can be displayed in the left area and the right area, thereby improving convenience.
[0156] In this embodiment, the startup control unit 115 changes the displayed icon menu based on the selection history of past icon selections. For example, the startup control unit 115 changes the icon menu so that frequently used applications are preferentially displayed on the icon menu.
[0157] As a result, the notebook PC 1 of the present embodiment can preferentially display, for example, frequently used applications on the icon menu, thereby further improving convenience.
[0158] In this embodiment, the operating medium is a pen-shaped medium (e.g., electronic pen 30). The touch sensor unit 33 detects when the pen-shaped medium approaches within a predetermined distance from the screen of the display unit 14. When the pen-shaped medium approaches within the predetermined distance from the screen, the position of the pen-shaped medium on the screen can be detected contactlessly. The startup control unit 115 uses the touch sensor unit 33 to detect an operation (hovering operation) in which the pen-shaped medium remains within the predetermined distance from the screen for a predetermined period of time (e.g., one second) as a predetermined operation.
[0159] As described above, in the notebook PC 1 of the present embodiment, an icon menu can be easily displayed by hovering the pen-shaped medium, thereby simplifying the operation of starting an application and enabling the application to be started quickly.
[0160] In this embodiment, the pen-shaped medium is an electronic pen 30 including a resonant circuit LC1. The touch sensor 33 detects the proximity of the electronic pen 30 to the screen within a predetermined distance and the position of the electronic pen 30 on the screen by electromagnetic induction.
[0161] Thus, the notebook PC 1 of this embodiment can easily detect the hovering of the electronic pen 30 by electromagnetic induction.
[0162] In addition, in this embodiment, the operation medium includes the user's finger. When the user's finger performs a predetermined operation on the screen, the startup control unit 115 displays a menu of different icons in the display area where the user's finger is detected, depending on the display area where the user's finger is detected and the screen display direction of the display unit 14.
[0163] Thus, the notebook PC 1 of this embodiment can simply display an appropriate icon menu corresponding to the usage status and display area using a touch device that contacts the screen with the user's finger without using the electronic pen 30, and can quickly start an appropriate application corresponding to the usage status and display area.
[0164] Furthermore, the notebook PC 1 of this embodiment includes a setting processing unit 114 that changes the menu information (setting information) stored in the setting menu storage unit 41 in response to a user's request.
[0165] Thus, the notebook PC 1 of this embodiment can display an appropriate icon menu customized according to the user's request. Therefore, the notebook PC 1 of this embodiment can customize the icon menu for each user, thereby further improving convenience.
[0166] The notebook PC 1 of this embodiment includes a display unit 14 having a display area, a touch sensor unit 33, and a startup control unit 115. The touch sensor unit 33 detects the position of a pen-shaped medium, i.e., an operating medium (electronic pen 30), on the screen of the display unit 14, as well as contact of the pen-shaped medium with the screen. The touch sensor unit 33 can detect when the pen-shaped medium approaches within a predetermined distance from the screen of the display unit 14. When the pen-shaped medium approaches within the predetermined distance, the position of the pen-shaped medium on the screen can be detected contactlessly. When the touch sensor unit 33 detects an operation (hovering operation) in which the pen-shaped medium is held within a predetermined distance relative to the screen for a predetermined period as a predetermined operation, the startup control unit 115 displays a menu of icons in the display area where the pen-shaped medium was detected. The startup control unit 115 activates the application corresponding to the icon selected by contact with the pen-shaped medium in the displayed menu of icons.
[0167] Thus, for example, by hovering a pen-shaped medium (e.g., electronic pen 30) over the screen, the notebook PC 1 of this embodiment can easily display an icon menu for selecting and starting an application. Therefore, the notebook PC 1 of this embodiment can simplify the operation of starting an application and quickly start the application.
[0168] In the control method of this embodiment, the notebook PC 1 includes a display unit 14 having multiple display areas, and a touch sensor unit 33 that detects the position of an operating medium on the screen of the display unit 14 and the contact of the operating medium on the screen. The control method of the notebook PC 1 includes a menu display step and an application launch step. In the menu display step, when a predetermined operation is performed on the screen using the operating medium, the launch control unit 115 displays a menu of different icons in the display area where the operating medium is detected, depending on the display area of the multiple display areas where the electronic pen 30 is detected and the screen display direction of the display unit 14. In the application launch step, the launch control unit 115 launches the application corresponding to the icon selected by the contact of the operating medium in the displayed menu of icons in the display area where the operating medium is detected.
[0169] Thus, the control method of this embodiment achieves the same effects as those of the notebook PC 1 of this embodiment described above, and can simplify the operation of starting an application and quickly start the application.
[0170] In the control method of this embodiment, the notebook PC 1 includes a display unit 14 having a display area, and a touch sensor unit 33 configured to detect when a pen-shaped medium approaches a screen of the display unit 14 within a predetermined distance. When the pen-shaped medium approaches the screen within the predetermined distance, the touch sensor unit 33 can non-contactly detect the position of the pen-shaped medium on the screen. The control method for the notebook PC 1 includes a menu display step and an application activation step. In the menu display step, if the touch sensor unit 33 detects an operation of holding the pen-shaped medium within the predetermined distance relative to the screen for a predetermined period as a predetermined operation, the activation control unit 115 displays a menu of icons in the display area where the pen-shaped medium was detected. In the application activation step, the activation control unit 115 activates an application corresponding to an icon selected by contact with the pen-shaped medium from the displayed menu of icons.
[0171] Thus, the control method of this embodiment achieves the same effects as those of the notebook PC 1 of this embodiment described above, and can simplify the operation of starting an application and quickly start the application.
[0172] [Second embodiment]
[0173] Next, a notebook PC 1 a according to a second embodiment will be described with reference to the drawings.
[0174] Figure 13 This is a block diagram showing an example of the functional configuration of a notebook PC 1 a according to the second embodiment.
[0175] In this embodiment, a modification example in which the icon menu is changed according to the time period used will be described.
[0176] In addition, the appearance and hardware structure of the notebook PC 1a of the second embodiment are similar to those of the above-mentioned Figure 1 and Figure 2 The first embodiment shown is the same, so its description is omitted here.
[0177] like Figure 13 As shown, the notebook PC 1 a includes a main control unit 10 a , a touch screen 20 , an electronic pen 30 , an embedded controller 31 , a sensor unit 35 , and a storage unit 40 a .
[0178] exist Figure 13 In relation to the above Figure 3 The same structures are given the same reference numerals, and their description is omitted here.
[0179] The storage unit 40 a is realized by, for example, the HDD 23 , and includes a setting menu storage unit 41 a and a selection history storage unit 42 .
[0180] The setting menu storage unit 41a stores setting information of a menu representing an icon of an application (hereinafter referred to as an icon menu). The setting menu storage unit 41a stores the contents of the icon menu displayed when the application is started as setting information. Figure 14 , an example of data in the setting menu storage unit 41a is described.
[0181] Figure 14 1 is a diagram showing a data example of the setting menu storage unit 41 a according to the present embodiment.
[0182] like Figure 14 As shown, the setting menu storage unit 41 a stores the display mode, display area, time zone, and menu information (application) in association with each other.
[0183] The setting menu storage unit 41 a differs from the first embodiment described above in that it stores settings in association with time zones.
[0184] In this figure, the time period is the time period during which the notebook PC 1 is used. The setting menu storage unit 41 a of this embodiment can change the menu information (application) according to the time period.
[0185] For example, in Figure 14 In the example shown, when the display mode is "clamshell" and the display area is "B cover area", the menu information (settings) for the time period "9:00-12:00" indicates "C word processor", "B mail software", "A browser", etc. Furthermore, the menu information (settings) for the time period "12:00-13:00" indicates "A browser", "B mail software", "C word processor", etc.
[0186] return Figure 13 As described above, the main control unit 10a is a functional unit implemented by the CPU 11 and chipset 21 executing programs stored in the main memory 12, and performs various processes based on the OS. The main control unit 10a includes, for example, an input control unit 111, a state detection unit 112, a display control unit 113, a setting processing unit 114a, and a startup control unit 115a.
[0187] The setting processing unit 114a is a functional unit for setting the setting information of the icon menu. According to the user's request, the setting processing unit 114a stores the setting information of the icon menu in the setting menu storage unit 41a. Figure 14Register and change the setting information shown.
[0188] The startup control unit 115a executes the following processing to start the application using the icon menu. The basic functions of the startup control unit 115a are the same as those of the startup control unit 115 of the first embodiment described above. Here, only the functions that are different from the startup control unit 115 are described.
[0189] The activation control unit 115 a changes the menu of icons displayed according to the timing when a predetermined operation is performed.
[0190] For example, when a hovering operation of the electronic pen 30 is detected via the input control unit 111, the startup control unit 115a causes a different icon menu to be displayed in the display area where the electronic pen 30 was detected, depending on the display area where the electronic pen 30 was detected, the screen display direction of the display unit 14, and the time period. For example, the startup control unit 115a refers to the settings menu storage unit 41a to obtain menu information (settings information) corresponding to the time period in which the hovering operation was detected, and displays the icon menu based on the obtained menu information (settings information).
[0191] Next, refer to Figure 15 Next, the application startup process of the notebook PC 1a according to this embodiment will be described.
[0192] Figure 15 This is a flowchart showing an example of application startup processing of the notebook PC 1 a according to the present embodiment.
[0193] exist Figure 15 In the process of step S401 to step S407, the process is the same as the above Figure 11 The processes of steps S201 to S207 shown are the same, and therefore, description thereof is omitted here.
[0194] In step S408, the startup control unit 115a obtains icon menus corresponding to other display modes (book mode / tablet mode) and time periods. The startup control unit 115a obtains menu information (settings information) corresponding to, for example, the display mode, the right area or the left area, and the time period from the settings menu storage unit 41a. After processing step S408, the startup control unit 115a proceeds to step S411.
[0195] Furthermore, in step S409, the startup control unit 115a obtains an icon menu corresponding to the clamshell mode, the C-cover area, and the time period. The startup control unit 115a obtains menu information (settings information) corresponding to the clamshell mode, the C-cover area, and the time period from the settings menu storage unit 41a. After processing step S409, the startup control unit 115a proceeds to step S411.
[0196] Furthermore, in step S410, the startup control unit 115a obtains an icon menu corresponding to the clamshell mode, the B-cover area, and the time period. The startup control unit 115a obtains menu information (settings information) corresponding to the clamshell mode, the B-cover area, and the time period from the settings menu storage unit 41a. After processing step S410, the startup control unit 115a proceeds to step S411.
[0197] In addition, the processing of step S411 to step S414 is the same as the above Figure 11 The processes of steps S211 to S214 shown are the same, and therefore, description thereof is omitted here.
[0198] In step S415, the startup control unit 115a adds the selection history and changes the setting information of the icon menu according to the selection information. Figure 5 The selected icons are added to the selection history storage unit 42 as shown. Furthermore, the startup control unit 115a summarizes the selection frequency of each icon for each time period based on the selection history stored in the selection history storage unit 42, and modifies the setting information (menu information) in the setting menu storage unit 41a so that, for example, applications corresponding to icons with high selection frequency are preferentially displayed. After the processing of step S415, the startup control unit 115a returns the processing to step S401.
[0199] As described above, in the notebook PC 1 a of the present embodiment, the startup control unit 115 a changes the menu of icons displayed according to the timing when a predetermined operation is performed.
[0200] Thus, the notebook PC 1a of this embodiment can, for example, display an icon menu suitable for work during work hours, and display an icon menu suitable for personal use during private hours such as during breaks or after returning home. Therefore, the notebook PC 1a of this embodiment can simplify the operation of launching applications and quickly launch appropriate applications corresponding to the time period.
[0201] [Third embodiment]
[0202] Next, a notebook PC 1 b according to a third embodiment will be described with reference to the drawings.
[0203] Figure 16 This is a block diagram showing an example of the functional configuration of a notebook PC 1b according to the third embodiment.
[0204] In this embodiment, a modification example in which the icon menu is changed according to different types of operation media and pointing devices will be described.
[0205] In addition, the appearance and hardware structure of the notebook PC 1b of the third embodiment are basically the same as those of the above-mentioned Figure 1 and Figure 2 Since the first embodiment is the same as that shown, its description is omitted here. In addition, in this embodiment, a pointing device 36 is added.
[0206] like Figure 16 As shown, the notebook PC 1 b includes a main control unit 10 b , a touch screen 20 , an electronic pen 30 , an embedded controller 31 , a sensor unit 35 , a pointing device 36 , and a storage unit 40 b .
[0207] exist Figure 16 In relation to the above Figure 3 The same structures are given the same reference numerals, and their description is omitted here.
[0208] The pointing device 36 is, for example, a mouse or a touch pad, and is a pointing input device different from the touch screen 20 .
[0209] The storage unit 40 b is realized by, for example, the HDD 23 , and includes a setting menu storage unit 41 b and a selection history storage unit 42 .
[0210] The setting menu storage unit 41b stores setting information of a menu representing an icon of an application (hereinafter referred to as an icon menu). The setting menu storage unit 41b stores the contents of the icon menu displayed when the application is started as setting information. Figure 17 , an example of data in the setting menu storage unit 41b is described.
[0211] Figure 17 2 is a diagram showing a data example of the setting menu storage unit 41 b according to the present embodiment.
[0212] like Figure 17 As shown, the setting menu storage unit 41b stores the display mode, the display area, the operation medium / device, and the menu information (application) in association with each other.
[0213] Here, the operation medium / device refers to the types of operation media such as the electronic pen 30 and the user's finger, and the types of input devices such as a mouse and a touch panel.
[0214] The setting menu storage unit 41b is different from the first embodiment described above in that it stores information in association with an operation medium / device. The setting menu storage unit 41b of this embodiment can change menu information (application) according to the operation medium / device.
[0215] For example, in Figure 17In the example shown, when the display mode is "clamshell" and the display area is "cover area B," the menu information (settings) for the operation medium / device being "electronic pen" indicates "word processor C," "mail software B," "browser A," etc. Furthermore, the menu information (settings) for the operation medium / device being "finger" indicates "browser A," "mail software B," "word processor C," etc. Furthermore, the menu information (settings) for the operation medium / device being "touchpad" indicates "word processor C," "mail software B," "browser A," etc.
[0216] return Figure 16 As described above, the main control unit 10b is a functional unit implemented by the CPU 11 and chipset 21 executing programs stored in the main memory 12, and performs various processes based on the OS. The main control unit 10b includes, for example, an input control unit 111, a state detection unit 112, a display control unit 113, a setting processing unit 114b, and a startup control unit 115b.
[0217] The setting processing unit 114b is a functional unit for setting the setting information of the icon menu. According to the user's request, the setting processing unit 114b makes the setting menu storage unit 41b store the setting information of the icon menu. Figure 17 Register and change the setting information shown.
[0218] The startup control unit 115b executes a process of starting an application using an icon menu. The basic functions of the startup control unit 115b are the same as those of the startup control unit 115 of the first embodiment described above. Only the functions that differ from the startup control unit 115 will be described here.
[0219] In this embodiment, the operation medium includes multiple different types of operation media (such as the electronic pen 30 and the user's finger), and the prescribed operation includes different types of prescribed operations. Prescribed operations performed by the user's finger include, for example, touching the screen with the finger and holding it for a predetermined period, or tapping the screen multiple times with the finger.
[0220] The activation control unit 115 b displays different icon menus depending on the type of operation medium or the type of predetermined operation being performed.
[0221] For example, when a hovering operation (first predetermined operation) of the electronic pen 30 is detected via the input control unit 111, the activation control unit 115b causes a different icon menu to be displayed in the display area where the electronic pen 30 was detected, depending on the display area of the electronic pen 30, the screen display direction of the display unit 14, and the operation medium and input device (pointing device). The activation control unit 115b, for example, refers to the settings menu storage unit 41a to obtain menu information (settings information) corresponding to the electronic pen 30, and displays the icon menu based on the obtained menu information (settings information).
[0222] Furthermore, when a second prescribed operation different from the hovering operation (first prescribed operation) is performed on the screen using the pointing device 36, the startup control unit 115b displays an icon menu different from that displayed when the hovering operation (first prescribed operation) is performed in the display area where the second prescribed operation is detected. Here, the second prescribed operation is, for example, an operation of pointing to the display area using the touchpad, such as pressing the right button.
[0223] When the second specified operation of the pointing device 36 is detected, the startup control unit 115b refers to the setting menu storage unit 41a, for example, obtains menu information (setting information) corresponding to the touch panel (pointing device 36), and displays the icon menu based on the obtained menu information (setting information).
[0224] Furthermore, when launching the application corresponding to the selected icon, the launch control unit 115b adds a selection history record and changes the settings of the icon menu based on the selection information. The launch control unit 115b adds the selection history record corresponding to the selected icon to the selection history storage unit 42. Furthermore, the selection history record may also include the type of operation medium or input device.
[0225] In addition, the startup control unit 115b summarizes the selection frequency of each icon according to the type of operating medium or input device based on the selection history stored in the selection history storage unit 42, and changes the setting information (menu information) of the setting menu storage unit 41b, for example, by preferentially displaying applications corresponding to icons with high selection frequency.
[0226] As described above, in the notebook PC 1b of this embodiment, the operation medium includes multiple different types of operation media (e.g., the electronic pen 30, the user's finger, etc.). The prescribed operation includes different types of prescribed operations (e.g., hovering, touching the screen with a finger for a specified period of time, etc.). The startup control unit 115b displays a menu of different icons depending on the type of operation medium or the type of prescribed operation being performed.
[0227] Thus, the notebook PC 1b of this embodiment can display different icon menus depending on the electronic pen 30 and the user's finger, or can display different icon menus based on a hover operation or a finger touch operation. Therefore, the notebook PC 1a of this embodiment can simplify the application startup operation and quickly launch the appropriate application corresponding to the operation medium or specified operation.
[0228] In this embodiment, the hovering operation is the first predetermined operation, and the notebook PC 1b further includes a pointing device 36 separate from the touch sensor portion 33. When a second predetermined operation different from the first predetermined operation (the hovering operation) is performed on the screen via the pointing device 36 (for example, an operation such as pressing the right button of the touchpad via the pointing device 36), the startup control unit 115b displays a menu of icons different from those displayed when the first predetermined operation is performed in the display area where the second predetermined operation is detected.
[0229] Thus, the notebook PC 1b of this embodiment displays a menu of different icons in response to a predetermined operation (second predetermined operation) using the pointing device 36 different from the touch sensor portion 33, thereby enabling rapid activation of an appropriate application corresponding to the input device and the predetermined operation.
[0230] In addition, the present invention is not limited to the above-described embodiments, and modifications can be made without departing from the spirit of the present invention.
[0231] For example, in the above-mentioned embodiments, the information processing device is described as a notebook PC 1 (1a, 1b), but the present invention is not limited thereto. For example, it may be another information processing device such as a tablet terminal device, a desktop PC, or a smartphone.
[0232] Furthermore, in the above-described embodiments, the notebook PC 1 (1a, 1b) is described as including the settings menu storage unit 41 (41a, 41b) and the selection history storage unit 42, but the present invention is not limited thereto. For example, a server device on the network may also include either or both of the settings menu storage unit 41 (41a, 41b) and the selection history storage unit 42. The server device including either or both of the settings menu storage unit 41 (41a, 41b) and the selection history storage unit 42 allows the same icon menu to be displayed on multiple information processing devices, further improving convenience.
[0233] In addition, in the above-mentioned embodiments, an example is described in which the startup control unit 115b displays a common (same) icon menu in the left area and the right area of the book mode, but different icon menus can also be displayed based on the menu information stored by the setting menu storage unit 41 (41a, 41b).
[0234] In the above embodiments, the display unit 14 includes two display units, the display unit 14A and the display unit 14B. However, the display unit 14 may include three or more display units and display areas. Alternatively, the display unit 14 may be a single display unit with multiple display areas.
[0235] Furthermore, in the above embodiments, examples where the display mode is clamshell mode, book mode, or tablet mode are described, but the present invention is not limited thereto and can also be applied to other display modes, such as tent mode where the display is folded outward. In other words, the notebook PC 1 (1a, 1b) can include other display modes, and the contents of the icon menu can be changed according to the display mode.
[0236] Furthermore, each component of the aforementioned notebook PC 1 (1a, 1b) includes a computer system. Furthermore, a program for implementing the functions of each component of the aforementioned notebook PC 1 (1a, 1b) may be recorded on a computer-readable recording medium, and the computer system may read and execute the program recorded on the recording medium, thereby performing processing on each component of the aforementioned notebook PC 1 (1a, 1b). Here, "having the computer system read and execute the program recorded on the recording medium" includes the case where a program is installed in the computer system. The "computer system" referred to here includes hardware such as the operating system and peripheral devices.
[0237] Furthermore, a "computer system" may include multiple computer devices connected via a network including a communication line such as the Internet, a WAN, a LAN, or a dedicated line. Furthermore, a "computer-readable recording medium" refers to removable media such as floppy disks, magneto-optical disks, ROMs, and CD-ROMs, as well as storage devices such as hard disks built into the computer system. Thus, the recording medium storing the program may also be a non-transitory recording medium such as a CD-ROM.
[0238] In addition, the recording medium also includes an internal or external recording medium that is accessible from a distribution server in order to distribute the program. In addition, the program is divided into multiple parts, and the various structures possessed by the notebook PC 1 (1a, 1b) are integrated into one structure after being downloaded at different time intervals, and the distribution server that distributes the divided programs can also be different. Moreover, the "computer-readable recording medium" also includes a structure that saves the program for a certain period of time, such as the volatile memory (RAM) inside the computer system that becomes the server or client in the case of sending the program via the network. In addition, the above-mentioned program can also be used to implement a part of the above-mentioned functions. In addition, it can also be a program that can implement the above-mentioned functions by combining with a program already recorded in the computer system, that is, a so-called differential file (differential program).
[0239] Furthermore, some or all of the above functions may be implemented as integrated circuits such as LSIs (Large Scale Integration). Each of the above functions may be implemented as a separate processor, or some or all of them may be integrated into a processor. Furthermore, the method of integrated circuitization is not limited to LSIs; implementation may also be achieved using dedicated circuits or general-purpose processors. Furthermore, if advances in semiconductor technology lead to the emergence of integrated circuit technology that replaces LSIs, integrated circuits based on such technology may also be used.
Claims
1. An information processing device comprising: A display unit having a plurality of display areas; a touch sensing portion configured to detect a position of an operating medium on a screen of the display portion and a contact of the operating medium with the screen; and a startup control unit that, when a prescribed operation is performed on the screen via the operating medium, displays a menu of different icons in the display area where the operating medium is detected and a screen display direction of the display unit, and starts an application corresponding to an icon selected by contact with the operating medium in the menu of icons displayed in the display area where the operating medium is detected, The plurality of display areas include a first display area and a second display area, The information processing device comprises: A first housing having at least a first display area; a second housing having at least a second display area; and a rotation mechanism that combines the first shell and the second shell and enables the first shell to rotate relative to the second shell, When the screen display direction is a direction in which the rotation axis of the rotating mechanism is parallel to the horizontal axis of the display, the activation control unit causes the display area that detects the operation medium to display different menus of the icons in the first display area and the second display area.
2. The information processing device according to claim 1, wherein When the screen display direction is a direction in which the rotation axis of the rotating mechanism is parallel to the vertical axis of the display, the activation control unit causes the display area that detects the operation medium to display the same menu of icons in the first display area and the second display area.
3. The information processing device according to claim 1 or 2, wherein: The activation control unit changes a displayed menu of the icon based on a selection history of past selections of the icon.
4. The information processing device according to claim 1 or 2, wherein: The activation control unit changes the displayed menu of the icons according to the timing when the predetermined operation is performed.
5. The information processing device according to claim 1 or 2, wherein: The operating medium is a pen-shaped medium, The touch sensor portion detects a situation where the pen-shaped medium approaches within a predetermined distance relative to the screen of the display portion. When the pen-shaped medium approaches within the predetermined distance relative to the screen, the position of the pen-shaped medium on the screen can be detected contactlessly. The activation control unit detects, using the touch sensor unit, an operation in which the pen-shaped medium remains stopped within the predetermined distance relative to the screen for a predetermined period of time as the predetermined operation. The information processing apparatus according to claim 5 , wherein: The pen-shaped medium is an electronic pen including a resonant circuit, The touch sensor section detects, by electromagnetic induction, that the electronic pen has approached the screen within the predetermined distance and the position of the electronic pen on the screen.
7. The information processing device according to claim 1 or 2, wherein: The operating medium includes a user's finger, When the prescribed operation is performed on the screen by the user's finger, the startup control unit displays a different menu of the icons in the display area where the user's finger is detected, according to the display area where the user's finger is detected and the screen display direction of the display unit.
8. The information processing device according to claim 1 or 2, wherein: The operation medium includes a plurality of operation media of different types. The prescribed operations include different types of prescribed operations. The activation control unit displays a different menu of icons according to the type of the operation medium or the type of the performed predetermined operation.
9. The information processing device according to claim 1 or 2, wherein: The prescribed operation is a first prescribed operation, The information processing device further includes a pointing device different from the touch sensing portion, When a second predetermined operation different from the first predetermined operation is performed on the screen by the pointing device, the activation control unit displays a menu of icons different from the menu when the first predetermined operation is performed in the display area where the second predetermined operation is detected.
10. A method for controlling an information processing device, the information processing device comprising: a display unit having a plurality of display areas; and a touch sensor unit for detecting a position of an operating medium on a screen of the display unit and contact of the operating medium with the screen, wherein: The control method of the information processing device comprises the following steps: When a prescribed operation is performed on the screen via the operating medium, the activation control unit displays a menu of different icons in the display area where the operating medium is detected, depending on the display area where the operating medium is detected and the screen display direction of the display unit. as well as The startup control unit starts an application corresponding to the icon selected by the contact of the operation medium in the displayed menu of icons in the display area where the operation medium is detected, The plurality of display areas include a first display area and a second display area, The information processing device comprises: A first housing having at least a first display area; a second housing having at least a second display area; and a rotation mechanism that combines the first shell and the second shell and enables the first shell to rotate relative to the second shell, When the screen display direction is a direction in which the rotation axis of the rotating mechanism is parallel to the horizontal axis of the display, the activation control unit causes the display area that detects the operation medium to display different menus of the icons in the first display area and the second display area.
Citation Information
Patent Citations
Pen input type information processor, its warning method and computer executable program
JP2009289045A
Keyboard filling one screen or spanning multiple screens of a multiple screen device
CN103403647A
Menu display method and apparatus
CN107704160A
Devices, methods, and graphical user interfaces for an electronic device interacting with a stylus
CN112204509A
Method and handheld electronic device having a graphical user interface which arranges icons dynamically
US20120284620A1