Position indicating device, computer and control method
By integrating multiple sensors and communication components into the electronic pen, the problem of line width and transparency control in virtual reality space has been solved, achieving a writing feel similar to that of a traditional pen.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- WACOM CO LTD
- Filing Date
- 2019-04-04
- Publication Date
- 2026-05-01
AI Technical Summary
In virtual reality, augmented reality, and mixed reality spaces, electronic pens cannot detect pen pressure values through pen pressure sensors, resulting in an inability to effectively control line width and transparency, and a lack of writing feel similar to traditional pens.
The device employs a position indicator unit comprising a housing, a position indicator, a first sensor, a second sensor, a first communication unit, and a second communication unit. By detecting the first pressure and the second pressure, and in conjunction with an information processing device, it generates and controls 3D objects in virtual reality space.
Even without a physical touch surface, it can effectively control line width and transparency, providing a writing feel similar to a traditional pen.
Smart Images

Figure CN121957360A_ABST
Abstract
Description
[0001] This application is a divisional application of application filed on April 4, 2019, with application number 201980029211.9, entitled "Location Indicator and Information Processing Apparatus". Technical Field
[0002] The present invention relates to a position indicating device and an information processing device, and more particularly to a pen-shaped position indicating device used for indicating both a position within a touch surface and a position in space, and an information processing device connected to such a position indicating device. Background Technology
[0003] In recent years, pen-type position indicator devices (hereinafter referred to as "electronic pens") used in conjunction with tablet computers have attracted attention. These electronic pens typically include a pen pressure sensor that detects the pressure (pen pressure) applied to the pen tip. The computer receives the pen pressure value from the pen when detecting the pen's position on the touch surface. Furthermore, the pen is configured to control the line width and opacity based on the received pen pressure value when drawing lines according to the detected position. In this way, for example, it is possible to draw thicker lines by applying more pressure to the pen tip on the touch surface, thus providing a writing feel similar to conventional ink-jet pens.
[0004] Furthermore, Patent Document 1 discloses a pen-type input device that does not require a touch surface. This pen-type input device has a pressure sensor on its side, configured to detect the user's grip force. According to Patent Document 1, when holding a pen to draw text or graphics, changes in grip force will produce features corresponding to the text or graphics to be drawn. The technology of Patent Document 1 uses these features as text or graphics recognition, enabling text and graphics input even without detecting the position of the pen tip within the touch surface.
[0005] Existing technical documents
[0006] Patent documents
[0007] Patent Document 1: Japanese Patent Application Publication No. 8-6710 Summary of the Invention
[0008] The problem that the invention aims to solve
[0009] The inventors of this application have researched methods to enable the use of the aforementioned electronic pen to write or draw on a virtual plane within a virtual reality (including VR: Virtual Reality, AR: Augmented Reality, MR: Mixed Reality) space. In this case, since there is no real touch surface, it is impossible to use the aforementioned pen pressure sensor to detect pen pressure values. Without pen pressure values, it is impossible to control the line width and transparency corresponding to the pen pressure value, and it is impossible to provide a writing feel similar to conventional pens. Therefore, other methods are needed that can effectively control line width and transparency.
[0010] Therefore, one of the objectives of this invention is to provide a position indicator and information processing device that can effectively control line width and transparency even in the absence of a physical touch surface.
[0011] Methods for solving problems
[0012] The position indicating device of the present invention comprises: a housing; a position indicating part for indicating position; a first sensor for detecting a first pressure applied to the position indicating part; a second sensor for detecting a second pressure applied to the housing; a first communication part for transmitting the first pressure detected by the first sensor; and a second communication part for transmitting the second pressure detected by the second sensor.
[0013] It should be noted that the position indicating device of the present invention may include: a cylindrical outer housing housing a position indicating part for indicating the position in the input surface of a planar position sensor; a spatial position detection unit for detecting spatial position information indicating the position of the position indicating part in space through interaction with an external device; a pressure sensor for detecting force relative to the outer housing; and a processing unit configured to output the spatial position information detected by the spatial position detection unit, planar position information indicating the position of the position indicating part in the input surface, and pressure information related to the force detected by the pressure sensor.
[0014] The information processing apparatus of the present invention is capable of communicating with a position indicating device having a housing, a position indicating part, and a pressure sensor that detects the force applied to the housing. The apparatus includes: a communication part that receives pressure detected by the pressure sensor; and a controller that controls the generation of 3D objects in a virtual reality space based on the position of the position indicating device in space and the pressure received by the communication part.
[0015] It should be noted that the information processing device of the present invention can be a computer connected to a position indicating device having a cylindrical outer housing housing a position indicating part in the input surface of a planar position sensor and a pressure sensor that detects force relative to the surface of the outer housing. The device is configured to receive from the position indicating device spatial position information indicating the position of the position indicating device in space, planar position information indicating the position of the position indicating part in the input surface, and pressure information related to the force detected by the pressure sensor. Upon receiving the spatial position information and the pressure information, the device detects a spatial position indicating the position of the position indicating device in space based on the received spatial position information, performs 3D drawing based on the detected spatial position and the received pressure information, and, upon receiving the planar position information and the pressure information, detects a planar position indicating the position of the position indicating part in the touch surface based on the received planar position information, and performs 2D drawing based on the detected planar position and the received pressure information.
[0016] Invention Effects
[0017] There is a certain correlation between the force (grip force) detected by the pressure sensor when a user writes or draws on a virtual plane and the pen pressure detected when writing or drawing on a real touch surface. Therefore, according to the position indication device of the present invention, which can transmit the pressure detected by the pressure sensor, and the information processing device of the present invention, which can perform 3D drawing based on the pressure detected by the pressure sensor, line width and transparency can be well controlled even in the absence of a real touch surface. Attached Figure Description
[0018] Figure 1 This is a diagram showing the structure of a spatial position indication system 1 according to a first embodiment of the present invention.
[0019] Figure 2 (a) is a perspective view showing the appearance of the electronic pen 5. Figure 2 (b) is a schematic block diagram showing the function blocks of the electronic pen 5.
[0020] Figure 3 This is a flowchart showing the processing performed by the processing unit 50 of the electronic pen 5.
[0021] Figure 4 It is shown Figure 3 The flowchart shown illustrates the details of tablet input processing.
[0022] Figure 5 It is shown Figure 3 The flowchart shown illustrates the details of virtual reality spatial input processing.
[0023] Figure 6 This is a flowchart showing the processing performed by the control unit 2a of computer 2.
[0024] Figure 7 It is shown Figure 6 The flowchart shows the details of the correlation acquisition process (step S30).
[0025] Figure 8 This is a graph illustrating the correlation f between pen pressure and grip force.
[0026] Figure 9 Figures (a) and (b) respectively show specific examples of the depicted areas.
[0027] Figure 10 It is shown Figure 6 The diagram shows the process flow for depicting details of the flat panel.
[0028] Figure 11 It is shown Figure 6 The diagram shows the process flow for depicting virtual reality space.
[0029] Figure 12 This is a diagram illustrating the meaning of initial grip force.
[0030] Figure 13 This is a diagram showing the construction of the grip force sensor 55 in the first example.
[0031] Figure 14 This is a diagram showing the construction of the grip force sensor 55 in the second example.
[0032] Figure 15 This is a diagram showing the construction of the grip force sensor 55 in the third example.
[0033] Figure 16 This is a diagram showing the construction of the grip force sensor 55 in the fourth example.
[0034] Figure 17 This is a flowchart showing the processing of the processing unit 50 of the electronic pen 5 when using the grip force sensor 55 in the fourth example.
[0035] Figure 18 This is a diagram showing the construction of the grip force sensor 55 in the fifth example.
[0036] Figure 19 This is a diagram showing the construction of the grip force sensor 55 in the sixth example. Detailed Implementation
[0037] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
[0038] Figure 1 This is a diagram illustrating the structure of a spatial position indication system 1 according to an embodiment of the present invention. As shown in the diagram, the spatial position indication system 1 of this embodiment is configured to include a computer 2, a virtual reality display 3, a planar position sensor 4, an electronic pen 5, position detection devices 7a and 7b, and spatial position sensors 8a to 8c. The spatial position sensors 8a to 8c are respectively disposed on the planar position sensor 4, the virtual reality display 3, and the electronic pen 5.
[0039] Figure 1 The devices shown are, in principle, arranged within a room. In the spatial location indication system 1, the room as a whole can be utilized as a virtual reality space.
[0040] Computer 2 includes a control unit 2a and a memory 2b. The various processes performed by computer 2 as described below are implemented by the control unit 2a reading out and executing programs stored in memory 2b.
[0041] Computer 2 is connected to virtual reality display 3, position detection devices 7a and 7b, and planar position sensor 4 via wired or wireless means. In the wired case, USB (Universal Serial Bus) is suitable, for example. In the wireless case, wireless LAN such as Wi-Fi (registered trademark) or short-range wireless communication such as Bluetooth (registered trademark) is suitable, for example. It should be noted that if the planar position sensor 4 and virtual reality display 3 are built into the computer function, the computer can also be used to constitute part or all of computer 2.
[0042] Computer 2 is configured to display a virtual reality space on a virtual reality display 3. This virtual reality space can be a VR (Virtual Reality) space, an AR (Augmented Reality) space, or a MR (Mixed Reality) space. When displaying a VR space, the user wearing the virtual reality display 3 perceives the virtual reality as separate from the real world. Conversely, when displaying an AR or MR space, the user wearing the virtual reality display 3 perceives the space as a mixture of virtual reality and the real world.
[0043] Computer 2 is configured to function as a rendering device that renders various 3D objects within a virtual reality space defined by the positions of position detection devices 7a and 7b, and updates the display of virtual reality display 3 using the rendering results. Thus, various 3D objects appear within the virtual reality space displayed on virtual reality display 3. The rendering by computer 2 is performed based on 3D object information stored in memory 2b. This 3D object information describes the shape, position, and orientation of 3D objects within the virtual reality space defined by computer 2, and is stored in memory 2b for each 3D object being rendered.
[0044] In 3D objects rendered by computer 2, including such Figure 1 The 3D objects shown are real-world objects such as the planar position sensor 4 and the electronic pen 5 (hereinafter referred to as "first 3D objects"), and virtual tablets (not shown) that do not exist in reality (hereinafter referred to as "second 3D objects"). When rendering these 3D objects, the computer 2 first detects the position and orientation of the spatial position sensor 8b in real space, and obtains viewpoint information representing the user's viewpoint based on the detection results.
[0045] When rendering the first 3D object, the computer 2 further detects the position and orientation of the spatial position sensors (e.g., spatial position sensors 8a and 8c) installed on the corresponding object in real space, and saves the detection results to the memory 2b. Based on the saved position and orientation, the aforementioned viewpoint information, and the shape stored regarding the first 3D object, the computer 2 renders the first 3D object in the virtual reality space. Furthermore, the computer 2 performs the following specific processing regarding the electronic pen 5: it detects user actions in the virtual reality space by detecting the position of the spatial position sensor 8c, and based on the results, creates a new second 3D object (i.e., saves new 3D object information to the memory 2b), or moves or updates an already stored second 3D object (i.e., updates the 3D object information already saved to the memory 2b).
[0046] On the other hand, when rendering the second 3D object, the computer 2 is configured to render the second 3D object in the virtual reality space based on the 3D object information stored in the memory 2b and the aforementioned viewpoint information.
[0047] The Virtual Reality Display 3 is a VR display (head-mounted display) worn on a person's head. Among commercially available virtual reality displays, there are various types such as "transparent" or "non-transparent", "glasses" or "hat", but the Virtual Reality Display 3 can use any of them.
[0048] The virtual reality display 3 is connected to the spatial position sensor 8a and the electronic pen 5 (including the spatial position sensor 8c) via wired or wireless means. The spatial position sensors 8a and 8c are configured to transmit illumination level information (described later) to the virtual reality display 3 via this connection. The virtual reality display 3 transmits the illumination level information transmitted from the spatial position sensors 8a and 8c, along with the illumination level information from its built-in spatial position sensor 8b, to the computer 2. Based on this transmitted illumination level information, the computer 2 detects the position and orientation of each of the spatial position sensors 8a-8c within the real space.
[0049] The planar position sensor 4 is a device having an input surface 4a and multiple electrodes (not shown) arranged to cover the entire input surface 4a. The input surface 4a is preferably a flat surface, made of a material suitable for allowing the tip of the electronic pen 5 to slide. The multiple electrodes function to detect pen signals (described later) transmitted by the electronic pen 5. The pen signals detected by each electrode are supplied to the computer 2, which, based on the supplied pen signals, determines the indicated position of the electronic pen 5 within the input surface 4a and acquires various data transmitted by the electronic pen 5. The planar position sensor 4 can, for example, be built into a tablet terminal with a display function and a processor; in this case, the processor of the tablet terminal can be used to constitute part or all of the computer 2.
[0050] Spatial position sensor 8a is fixedly mounted on the surface of planar position sensor 4. Therefore, the position and orientation of spatial position sensor 8a detected by computer 2 represent the position and orientation of input surface 4a in virtual reality spatial coordinate system.
[0051] The electronic pen 5 is a pen-shaped position indicator device configured to function as an input device to the planar position sensor 4 (hereinafter referred to as "tablet input function") and as an input device to the computer 2 (hereinafter referred to as "virtual reality space input function"). The tablet input function includes indicating the position within the input surface 4a of the planar position sensor 4. On the other hand, the virtual reality space input function includes indicating the position within virtual reality space. Details of each function will be described later.
[0052] Position detection devices 7a and 7b are base station devices constituting a position detection system for detecting the positions of spatial position sensors 8a-8c. They are each configured to emit laser signals while changing direction under the control of computer 2. Spatial position sensors 8a-8c are each composed of multiple light-receiving sensors, configured to receive the laser signals emitted by position detection devices 7a and 7b respectively, obtaining light level information including the light level of each sensor. As described above, the obtained light level information is supplied to computer 2 via virtual reality display 3. It should be noted that in this embodiment, position detection devices 7a and 7b are configured to emit laser signals, but are not limited to this configuration. For example, they may be configured to use other non-visible light sensors, visible light sensors, or combinations thereof.
[0053] Figure 2 (a) is a perspective view showing the appearance of the electronic pen 5. As shown in the figure, the electronic pen 5 is configured as a cylindrical outer housing 5a having a pen tip 5b (position indicator) for position indication in the input surface 4a of the planar position sensor 4. It should be noted that the grip force sensor 55, which will be described later, and various components constituting various switches are mounted on the surface of the actual electronic pen 5, but... Figure 2 The description is omitted in (a).
[0054] When performing input based on the tablet input function, the user holds the outer casing 5a with one hand, bringing the pen tip 5b into contact with the input surface 4a of the planar position sensor 4. Then, by moving the pen tip 5b across the input surface 4a while maintaining contact, the user performs input based on the electronic pen 5. Conversely, when performing input based on the virtual reality spatial input function, the user holds the outer casing 5a with one hand and performs input based on the electronic pen 5 by moving the electronic pen 5 in the air. Input based on the virtual reality spatial input function includes input to the aforementioned virtual tablet.
[0055] Figure 2 (b) is a schematic block diagram showing the functional blocks of the electronic pen 5. As shown in the figure, the electronic pen 5 is configured to include a processing unit 50, a planar communication unit 51, a spatial communication unit 52, a spatial position detection unit 53, a pen pressure sensor 54, a grip force sensor 55 (pressure sensor), and a tactile generation unit 56. It should be noted that the electronic pen 5 may also have only one of the pen pressure sensor 54 and the grip force sensor 55, therefore, this case will also be included in the following description.
[0056] The processing unit 50 is connected to the other parts within the electronic pen 5 and is composed of a processor that controls them and performs various processes described later. The processing unit 50 performs the control of the other parts within the electronic pen 5 and the various processes described later by reading and executing a program stored in an internal memory (not shown).
[0057] The planar communication unit 51 is a functional unit that transmits and receives signals with the computer 2 via the planar position sensor 4 under the control of the processing unit 50. In this transmission and reception, a plurality of electrodes disposed in the input surface 4a of the planar position sensor 4 and a pen tip electrode (not shown) disposed near the pen tip 5b of the electronic pen 5 are used as antennas. Furthermore, this transmission and reception includes both a case where the electronic pen 5 unidirectionally transmits signals to the planar position sensor 4 and a case where signals are transmitted and received bidirectionally between the electronic pen 5 and the planar position sensor 4; however, the following explanation will continue based on the latter. The signal transmitted from the planar position sensor 4 toward the electronic pen 5 is referred to as a "beacon signal," and the signal transmitted from the electronic pen 5 toward the planar position sensor 4 is referred to as a "pen signal." As a specific method of signal transmission and reception in this case, electromagnetic induction or active electrostatic methods can be used, for example.
[0058] The beacon signal is a signal transmitted by the computer 2 at predetermined time intervals, including instructions for controlling the electronic pen 5 from the computer 2. The pen signal includes an unmodulated carrier wave, i.e., a burst signal (planar position information indicating the position of the pen tip 5b within the input surface 4a), and a data signal obtained by modulating the carrier wave with data requested to be transmitted by the instructions.
[0059] The space communication unit 52 has the function of transmitting and receiving signals between the virtual reality display 3 and the computer 2 under the control of the processing unit 50. As described above, the transmission and reception of these signals are achieved via wired or wireless means. The planar position sensor 4 is not used in the transmission and reception of signals between the space communication unit 52 and the computer 2.
[0060] Spatial position detection unit 53 is composed of Figure 1 The functional unit, comprised of the spatial position sensor 8c shown, functions to detect the aforementioned light level information (spatial position information indicating the position of the electronic pen 5 within space) through interaction with external devices (specifically, position detection devices 7a and 7b). Specifically, it performs the following processing: periodically or continuously detecting the laser signals sent by the position detection devices 7a and 7b, generating light level information corresponding to the detected laser signals, and supplying it to the processing unit 50 each time.
[0061] The pen pressure sensor 54 is a sensor configured to detect the force (pen pressure) applied to the pen tip 5b, and is, for example, a capacitive sensor (not shown) whose capacitance value changes according to the pen pressure. The processing unit 50 has the function of acquiring the pen pressure detected by the pen pressure sensor 54 and generating pen pressure information related to the acquired pen pressure. The pen pressure information is, for example, a digital value obtained by performing an analog-to-digital conversion on the pen pressure, which is analog information.
[0062] The grip force sensor 55 is configured to detect the force (= grip force) relative to the surface of the outer casing 5a of the electronic pen 5. The specific structure of the grip force sensor 55 will be explained later with reference to the appendix. Figure 1 The processing unit 50 has the function of acquiring the grip force detected by the grip force sensor 55 and generating pressure information related to the acquired grip force. The pressure information is, for example, a digital value obtained by performing an analog-to-digital conversion on the grip force, which is analog information.
[0063] The tactile generation unit 56 has the function of generating tactile sensation based on control signals supplied from the computer 2. The tactile sensation referred to here is, for example, the vibration of the outer casing 5a. For example, when the pen tip 5b is in contact with the surface of the virtual tablet (more precisely, when the pen tip 5b is within a predetermined distance from the surface of the virtual tablet), the computer 2 supplies the aforementioned control signal to the electronic pen 5 via the space communication unit 52, thereby causing the tactile generation unit 56 to generate tactile sensation. Thus, the user can experience the sensation of the pen tip 5b striking the surface of a virtual tablet that does not exist in reality.
[0064] When inputting via tablet input, the processing unit 50 first detects the beacon signal sent by the computer 2 via the planar communication unit 51. Upon detecting the beacon signal, the processing unit 50 outputs the aforementioned burst signal and data signal sequentially to the planar communication unit 51 in response to the beacon signal. The output data signal may include the aforementioned pen pressure information or pressure information. The planar communication unit 51 is configured to transmit the input burst signal and data signal to the computer 2 via the planar position sensor 4.
[0065] When computer 2 receives a burst signal via planar position sensor 4, it detects the planar position representing the position of pen tip 5b within input surface 4a based on the received intensity of the burst signal at each of the plurality of electrodes disposed within input surface 4a. Furthermore, it acquires data transmitted by electronic pen 5 by receiving a data signal from the electrode among the plurality of electrodes disposed within input surface 4a closest to the detected planar position. Then, computer 2 performs 2D drawing based on the detected planar position and the received data. Details regarding 2D drawing will be described later. This is how tablet input functionality is implemented.
[0066] On the other hand, when inputting based on the virtual reality spatial input function, the processing unit 50 is configured to output the light level information supplied from the spatial position detection unit 53 to the spatial communication unit 52 sequentially. Furthermore, the processing unit 50 is configured to output pen pressure information or pressure information generated as described above, along with the output of the light level information, to the spatial communication unit 52. The spatial communication unit 52 is configured to transmit each of these input information to the computer 2.
[0067] When computer 2 receives the aforementioned information from space communication unit 52, it detects the spatial position of electronic pen 5 within space based on the received light level information. In this case, information representing the shape of electronic pen 5 and the relative positional relationship between spatial position detection unit 53 and pen tip 5b can be pre-stored in computer 2. Computer 2 transforms the position directly calculated based on the light level information into the position of pen tip 5b based on this information, and detects the transformed position as the spatial position. Computer 2 performs 3D drawing based on the detected spatial position and received pen pressure information or pressure information. Details regarding 3D drawing will be described later. The virtual reality spatial input function is implemented in this way.
[0068] Figure 3 This is a flowchart showing the processing performed by the processing unit 50 of the electronic pen 5. Additionally, Figure 4 It is shown Figure 3 The flowchart shown illustrates the details of the tablet input processing (step S1). Figure 5 It is shown Figure 3 The flowchart showing details of virtual reality spatial input processing (step S2) is shown below. Referring to these... Figures 3-5 The operation of the electronic pen 5 will be explained in detail.
[0069] First, such as Figure 3 As shown, the processing unit 50 performs tablet input processing (step S1) and virtual reality spatial input processing (step S2) in time segments.
[0070] Next refer to Figure 4 The processing unit 50, which performs tablet input processing, first performs a beacon signal detection operation by the planar communication unit 51 (steps S10 and S11). In this detection operation, the planar communication unit 51 attempts to detect the beacon signal by demodulating the signal arriving at the pen tip electrode. If no beacon signal is detected, the tablet input processing ends. On the other hand, if a beacon signal is detected, the processing unit 50 outputs a burst signal to the planar communication unit 51, causing the planar communication unit 51 to send a burst signal (step S12).
[0071] The subsequent processing differs depending on whether the electronic pen 5 has a pen pressure sensor 54 or not. In the former case, the processing unit 50 obtains the pen pressure based on the output of the pen pressure sensor 54 (step S13) and transmits a data signal including pen pressure information related to the obtained pen pressure using the planar communication unit 51 (step S14). On the other hand, in the latter case, the processing unit 50 obtains the grip force based on the output of the grip force sensor 55 (step S15) and transmits a data signal including pressure information related to the obtained grip force using the planar communication unit 51 (step S16). After transmission in step S14 or step S16, the processing unit 50 ends the tablet input process, as if from... Figure 3 As understood, the next step of virtual reality spatial input processing begins (step S2).
[0072] Next refer to Figure 5 The processing unit 50, which performs virtual reality spatial input processing, first performs the detection operation of the spatial position detection unit 53 on the laser signal (steps S20 and S21). As a result, if no laser signal is detected, the virtual reality spatial input processing ends. On the other hand, if a laser signal is detected, the processing unit 50 obtains the light level information corresponding to the laser signal from the spatial position detection unit 53 and sends the light level information to the spatial communication unit 52 (step S22).
[0073] The subsequent processing differs depending on whether the electronic pen 5 has a pen pressure sensor 54 or not. In the latter case, the processing unit 50 obtains the grip force based on the output of the grip force sensor 55 (step S26) and transmits the pressure information related to the obtained grip force via the space communication unit 52 (step S27). On the other hand, in the former case, the processing unit 50 obtains the pen pressure based on the output of the pen pressure sensor 54 (step S23) and determines whether the obtained pen pressure exceeds a predetermined value (step S24). This determination is based on whether the pen tip 5b is in contact with a real surface, and is performed so that pen pressure is not used if there is no contact. It should be noted that the surface of a simple board or the like is equivalent to the real surface mentioned here. Thus, by configuring a real board in conjunction with the display position of the virtual tablet, for example, the pen pressure sensor 54 can also be used with respect to the virtual tablet.
[0074] If the pen pressure is exceeded in step S24, the processing unit 50 transmits the pen pressure information related to the acquired pen pressure using the spatial communication unit 52 (step S25). Conversely, if the pen pressure is not exceeded in step S24, the processing unit 50 moves the processing to step S26 and transmits the pressure information (steps S26 and S27). After the transmission in step S25 or S27, the processing unit 50 ends the virtual reality spatial input processing, as shown in the image. Figure 3As understood, the next step of tablet input processing (step S1) begins.
[0075] Figure 6 This is a flowchart showing the processing performed by the control unit 2a of computer 2. Additionally, Figure 7 It is shown Figure 6 The flowchart shown illustrates the details of the correlation acquisition process (step S30). Figure 10 It is shown Figure 6 The flowchart showing the details of the flat panel depiction process (step S35) is shown. Figure 11 It is shown Figure 6 The flowchart below details the virtual reality space depiction process (step S41). Refer to these... Figure 1 The actions of computer 2 will be explained in detail.
[0076] like Figure 6 As shown, the control unit 2a first performs the correlation acquisition process (step S30).
[0077] The correlation acquisition process is the process of obtaining the correlation f between the pen pressure detected by the pen pressure sensor 54 and the grip force detected by the grip force sensor 55. In this process, such as Figure 7 As shown, the control unit 2a first causes the electronic pen 5 to simultaneously perform the pen pressure detection action of the pen pressure sensor 54 and the grip force detection action of the grip force sensor 55 a predetermined number of times, and receives pen pressure information and pressure information from the electronic pen 5 each time (steps S50~S52).
[0078] After a predetermined number of repetitions, the control unit 2a obtains the correlation f between pen pressure and grip force based on multiple combinations of pen pressure and grip force (step S53), and ends the correlation acquisition process. The correlation f obtained in this way is, for example, a correlation function representing the correlation between pen pressure and grip force, and in one example, it is expressed in the form of pen pressure = f (grip force). Hereinafter, the explanation will continue on the premise of using such a correlation f.
[0079] Figure 8 (a) and (b) are graphs illustrating the correlation f between pen pressure and grip force. In these graphs, P represents pen pressure, G represents grip force, and F represents the frictional force between the user's hand and the surface of the electronic pen 5.
[0080] First refer to Figure 8 (a) When the user holds the electronic pen 5 perpendicularly to the input surface 4a while drawing a line, P≈F holds true. Furthermore, the relationship between the gripping force G and the frictional force F holds true: F≈μG. Here, μ is the coefficient of friction between the user's hand and the surface of the electronic pen 5. Therefore, P≈μG holds true.
[0081] Next refer to Figure 8(b) When the user holds the electronic pen 5 at an angle θ relative to the normal direction of the input surface 4a and draws a line, F≈P'=Pcosθ holds. Here, P' is the component of the pen pressure P along the pen axis. Therefore, according to the above relationship F≈μG, in this case, Pcosθ=μG holds.
[0082] The relationship Pcosθ=μG also includes Figure 8 The situation is shown in (a). Therefore, if we set f(G) = μG / cosθ, the correlation f can be generally represented. However, the coefficient of friction μ and the angle θ are quantities that may vary from user to user, so it is still necessary to calculate the pen pressure = f (grip force) for each user. Therefore, it is necessary to perform a reference... Figure 7 The relevant information was obtained and processed.
[0083] return Figure 6 After completing the correlation acquisition process, the control unit 2a then sets the drawing area within the virtual reality space (step S31). The drawing area is the area where 3D drawing based on the electronic pen 5 is performed.
[0084] Figure 9 (a) and (b) are diagrams showing specific examples of the depicted areas. Figure 9 In (a), an example is shown where a region within a predetermined distance from the display surface of the virtual tablet B is designated as the drawing area A. In this example, drawing area A is an area where input to the virtual tablet B can be performed. When the detected spatial position is within this drawing area A, the control unit 2a performs 3D drawing in the virtual reality spatial drawing process described later in step S35, based on replacing the detected spatial position with a spatial position obtained by projecting it onto the display surface of the virtual tablet B. Thus, the user can draw planar graphics onto the display surface of the virtual tablet B. It should be noted that the predetermined distance is preferably set to a value greater than 0. This is because, when the user wants to input onto the display surface of the virtual tablet B using the electronic pen 5, it is difficult to maintain continuous contact between the electronic pen 5 and the display surface, which is not physically present.
[0085] Figure 9 (b) shows an example of setting an arbitrary three-dimensional space as the depiction area A. If the detected spatial position is within the depiction area A, the control unit 2a does not perform the following actions: Figure 9 (a) is an example of displacement that performs 3D drawing. Thus, the user can draw a 3D graphic within the drawing area A.
[0086] return Figure 6Next, the control unit 2a performs the detection of light level information and burst signals (step S32). Specifically, this process includes receiving light level information from the electronic pen 5 via wired or wireless means and receiving burst signals from the electronic pen 5 via the planar position sensor 4. If step S32 results in the detection of a burst signal (affirmative determination in step S33), the control unit 2a proceeds to step S34; if no burst signal is detected (negative determination in step S33), the process proceeds to step S36.
[0087] After the control unit 2a, which has entered step S34, detects the aforementioned planar position (the position of the pen tip 5b within the input surface 4a) based on the detected burst signal (step S34), it performs, for example, a flat panel drawing process for 2D drawing on the display of the flat panel terminal including the planar position sensor 4 (step S35).
[0088] In flat surface rendering, such as Figure 10 As shown, the control unit 2a first performs a detection operation on the data signal sent by the electronic pen 5 via the planar position sensor 4 (step S60). Then, it determines whether the data signal includes pen pressure information or pressure information (step S61).
[0089] If it is determined in step S61 that pen pressure information is included, the control unit 2a further determines whether the pen pressure indicated by the pen pressure information is below a predetermined normal ON load (e.g., 0) (step S68). As a result, if it is determined to be below the normal ON load, 2D drawing is not performed and the process ends. This is the processing under the condition that the tip 5b of the electronic pen 5 is not in contact with the input surface 4a (so-called hover state). On the other hand, if it is determined in step S68 that it is greater than the normal ON load, the control unit 2a performs 2D drawing on the display of the tablet terminal, which is the planar position sensor 4, for example, based on the planar position detected in step S34 and the pen pressure indicated by the pen pressure information (step S69).
[0090] Here, the 2D drawing performed in step S69 will be described in detail. The 2D drawing includes rendering processing and display processing. In the rendering processing, the control unit 2a arranges circles with radii corresponding to the corresponding pen pressure at each of a series of sequentially detected planar positions. Then, by smoothly connecting the circumferences of each circle, two-dimensional curve data (ink data) with a width corresponding to the pen pressure is generated. The display processing is the process of displaying the curve data generated in this way on a display of, for example, a tablet terminal that serves as a planar position sensor 4.
[0091] If pressure information is determined to be included in step S61, the control unit 2a performs processing to convert the grip force represented by the pressure information into pen pressure (steps S62-S67). Specifically, the control unit 2a first determines whether the reset flag A is true or false (step S62). The reset flag A indicates whether the electronic pen 5 has just entered the range of the sudden signal reaching the plane position sensor 4. If it has just entered, the determination result of step S62 is false.
[0092] In step S62, the control unit 2a, which determines the error to be false, further determines whether the grip force represented by the pressure information is above a predetermined value (step S63). If it is determined to be below the predetermined value, the grip force represented by the pressure information is set as the initial grip force (step S64); if it is determined to be above the predetermined value, the predetermined value is set as the initial grip force (step S65). It should be noted that the initial grip force is a variable used to treat the grip force as 0 when the electronic pen 5 enters the range of the sudden signal reaching the planar position sensor 4 (when the pen is placed). Furthermore, step S65 determines an upper limit for the initial grip force, for example, to prevent the grip force required to thicken the line width from being too large, thus preventing the user from applying sufficient pen pressure.
[0093] Figure 12 This is a diagram illustrating the meaning of the initial grip force. The diagram shows a coordinate system with the force relative to the surface of the outer casing 5a as the horizontal axis and the grip force detected by the grip force sensor 55 as the vertical axis. The control unit 2a is configured to use the value obtained by subtracting the initial grip force from the grip force detected by the grip force sensor 55, rather than the grip force itself, as the grip force. In this way, the user can perform pen pressure input based on grip force by increasing or decreasing the grip force based on the grip force at the time of pen stroke.
[0094] return Figure 10 If step S64 or step S65 has been executed, the control unit 2a sets the reset flag A to true (step S66), and then performs the process of converting the grip force into pen pressure using the correlation f (step S67). Step S67 is also executed if the condition in step S62 is true. In step S67, the control unit 2a substitutes the value obtained by subtracting the initial grip force from the grip force represented by the pressure information into the correlation f as the grip force. Thus, as referred to... Figure 12 As explained, users can perform pen pressure-based input by adjusting the grip force based on the grip force at the time of pen stroke.
[0095] In step S67, the pen pressure control unit 2a uses the pen pressure to execute steps S68 and S69. Thus, the same 2D drawing is achieved as in the case where pen pressure information is included in the data signal.
[0096] The control unit 2a, having executed step S69, terminated the flat plate drawing process. Then, it returned... Figure 6 In step S32, the next step is to detect the light level information and the burst signal.
[0097] Let the processing enter Figure 6 In step S36, the control unit 2a first sets the reset flag A to false (step S36). Thus, if the electronic pen 5 moves out of the range of the plane position sensor 4 from the burst signal, the reset flag A can be restored to false.
[0098] Next, the control unit 2a determines whether light level information has been detected through the detection operation in step S32 (step S37). If it is determined that light level information has been detected, the control unit 2a detects the aforementioned spatial position (the position of the electronic pen 5 (or its tip 5b) within the space) based on the detected light level information (step S38). Next, the control unit 2a determines whether the detected spatial position is within the drawing area set in step S31 (step S39).
[0099] In step S39, the control unit 2a, which determines the position within the depicted area, performs virtual reality space depiction processing for 3D depiction within the virtual reality space (step S41). Here, as... Figure 6 As shown by the dashed line, a process (step S40) can also be inserted between steps S39 and S41 to replace the detected spatial position with the spatial position obtained by projection onto the display surface of the virtual flat panel. This step S40 is only performed when the depicted area including the detected spatial position is as shown... Figure 9 (a) shows the processing that can be performed on the area defined on the display surface of the virtual tablet B. Thus, as described above, the user can draw a planar graphic on the display surface of the virtual tablet.
[0100] In virtual reality spatial depiction processing, such as Figure 11 As shown, the control unit 2a first performs the action of receiving pen pressure information or pressure information (step S70). Then, it determines whether pen pressure information or pressure information has been received (step S71).
[0101] If it is determined in step S71 that pen pressure information has been received, the control unit 2a further determines whether the pen pressure indicated by the pen pressure information is below a predetermined normal ON load (e.g., 0) (step S80). As a result, if it is determined to be below the normal ON load, 3D drawing is not performed and the process ends. This is the processing when it is assumed that the tip 5b of the electronic pen 5 is not in contact with the aforementioned real-world board (e.g., a board configured to match the display position of the virtual tablet). On the other hand, if it is determined in step S80 that the pen pressure is greater than the normal ON load, the control unit 2a performs 3D drawing in the virtual reality space based on the spatial position detected in step S38 (or the spatial position obtained in step S40) and the pen pressure indicated by the pen pressure information (step S81).
[0102] Similar to the 2D drawing, the 3D drawing performed in step S79 also includes rendering and display processing. In the rendering process, the control unit 2a sequentially detects a series of spatial positions, each containing a sphere with a radius corresponding to the corresponding pen pressure. Then, by smoothly connecting the surfaces of each sphere, three-dimensional curve data with a cross-sectional diameter corresponding to the pen pressure is generated. The display processing involves displaying this generated curve data within the virtual reality space. However, if the spatial position is fixed within the display surface of the virtual tablet by executing step S40, 2D drawing within the display surface can be performed instead of 3D drawing.
[0103] If pressure information is determined to be received in step S71, the control unit 2a executes a process to convert the grip force represented by the pressure information into pen pressure (steps S72-S77). Details of this process are as follows... Figure 10 The processing in steps S62 to S67 is the same. In step S77, the pen pressure is obtained as the transformation result. However, in steps S72 to S77, reset flag B is used instead of reset flag A. Reset flag B indicates whether the electronic pen 5 has just entered the drawing area. If it has just entered, the determination result of step S72 becomes false.
[0104] In step S77, the pen pressure control unit 2a uses the pen pressure to execute steps S78 and S79. Steps S78 and S79 are the same as steps S80 and S81, except that "a different value than the normal ON load is used instead of the normal ON load, preferably a space ON load set to a value larger than the normal ON load (i.e., in step S78, it is determined whether the pen pressure indicated by the pressure information is a predetermined space ON load (> normal ON load) or less)". Thus, the same 3D drawing as when pen pressure information is received is achieved.
[0105] The use of a spatial ON load instead of a normal ON load in step S78 corresponds to the fact that "when operating the electronic pen 5 in a floating state, the grip force required to support the weight of the electronic pen 5 is increased compared to when it is operated in a state of contact with a fixed surface such as the input surface 4a." By using a spatial ON load larger than a normal ON load in step S78, 3D drawing can be performed appropriately despite this increase in grip force.
[0106] The control unit 2a, having executed step S79, terminates the virtual reality space rendering process. Then, it returns... Figure 6 In step S32, the subsequent detection of light level information and burst signals is performed. Additionally, the control unit 2a... Figure 6 In step S37, the case where no light level information is detected is determined, and in Figure 6 If, in step S39, the location is determined to be outside the depicted area, the reset flag B is set to false (step S42), and the process returns to step S32 to perform the subsequent detection of light level information and burst signals. By executing step S42, if the electronic pen 5 is removed from the depicted area (including if the electronic pen 5 is removed from the virtual reality space), the reset flag B can be restored to false.
[0107] As explained above, according to this embodiment, since the electronic pen 5 is configured to output pressure information related to gripping force, and the computer 2 is configured to perform 3D drawing and 2D drawing based on the pressure information related to gripping force, the line width and transparency can be well controlled even in the absence of a real touch surface.
[0108] The following describes the specific structure of the grip force sensor 55, with reference to the attached diagram. Figure 1 Please provide a detailed explanation.
[0109] Figure 13 This diagram illustrates the structure of the grip force sensor 55 in the first example. In this example, the grip force sensor 55 is configured as a touch sensor capable of sensing pressure via a pressure-sensitive method, and is disposed on the side of the outer housing 5a. In this case, the processing unit 50 obtains the pressure detected by the grip force sensor 55 as the grip force.
[0110] Figure 14 This diagram illustrates the structure of the grip force sensor 55 in the second example. In this example, the grip force sensor 55 is configured as a button mechanism capable of detecting the amount of pressure applied in stages or continuously, and is disposed on the side of the outer housing 5a. In this case, the processing unit 50 obtains the amount of pressure applied by the grip force sensor 55 as the grip force. Specific examples of button mechanisms include actuators, Hall effect elements, strain gauges, etc.
[0111] Figure 15 This diagram illustrates the structure of the grip force sensor 55 in the third example. In this example, the grip force sensor 55 also functions as a pen pressure sensor 54, and is composed of a capacitor having a structure in which a dielectric 11 is disposed between two electrode plates 10 and 12. Electrode plate 10 is connected to the other end of the core 13, which forms the pen tip 5b at one end. Furthermore, electrode plate 12 is connected to a button mechanism 14 disposed on the side of the outer housing 5a.
[0112] In this example, the capacitor is configured such that the distance between electrode plates 10 and 12 changes according to the force applied to the pen tip 5b, resulting in a change in electrostatic capacitance. Furthermore, the capacitor in this example is configured such that... Figure 15 (a) and Figure 15 (b) As understood through comparison, the electrode plate 12 moves laterally according to the amount of pressure applied to the button mechanism 14, resulting in a change in electrostatic capacitance. In this example, the processing unit 50... Figure 4 In the tablet input processing shown, the capacitor in this example is considered as the pen pressure sensor 54, and the pen pressure is obtained based on its electrostatic capacitance. On the other hand, in Figure 5 In the virtual reality spatial input processing shown, the capacitor in this example is regarded as a grip force sensor 55, and the grip force is obtained based on its electrostatic capacitance. According to this example, both the grip force sensor 55 and the pen pressure sensor 54 can be implemented using a single capacitor.
[0113] It should be noted that, in Figure 15 The example described is the use of a capacitor, but a load sensor can also be used as both the grip force sensor 55 and the pen pressure sensor 54. The load sensor can independently measure stress in the X, Y, and Z directions, and therefore can independently calculate the force in the pen axis direction (pen pressure) and the force perpendicular to the pen axis direction (grip force) based on the measured stresses.
[0114] Figure 16 This diagram illustrates the structure of the grip force sensor 55 in the fourth example. The grip force sensor 55 in this example has a structure consisting of a pressure-sensitive sensor 15, a substrate 16, and a dome button 17 stacked together, arranged on the side of the outer housing 5a with the surface of the dome button 17 exposed. The pressure-sensitive sensor 15 is configured to sense pressure relative to the surface of the outer housing 5a, and the dome button 17 is configured to be pressed / unpressed (ON / OFF) by a user.
[0115] Figure 17 This is a flowchart showing the processing performed by the processing unit 50 of the electronic pen 5 when using the grip force sensor 55 in the fourth example. Figure 17 (a) to Figure 3 The processing flowchart shown has been supplemented with steps S90-S95. Additionally, Figure 17 (b) on Figure 4 or Figure 5 The flowchart shown has been augmented with step S96. Hereinafter, while referring to this... Figure 17 The operation of the electronic pen 5 equipped with the fourth grip force sensor 55 will be explained.
[0116] First, such as Figure 17 As shown in (a), the processing unit 50 first determines whether the dome button 17 is pressed or not (step S90). As a result, if it is determined that it is not pressed, the reset flag C is set to false (step S95), and the tablet input processing in step S1 begins. The reset flag C is a flag indicating whether the dome button 17 has just been pressed. If it has just been pressed, the determination result of step S91 described later becomes false.
[0117] In step S90, the processing unit 50, which determines that the button 17 is pressed, then determines whether the reset flag C is true or false (step S91). If the determination is true, the processing unit 50 immediately begins the tablet input processing of step S1. On the other hand, if the determination is false, the processing unit 50 obtains the grip force from the grip force sensor 55 (step S92) and sets the obtained grip force as the initial grip force (step S93). The initial grip force here is a variable used to treat the grip force when the dome button 17 is pressed as 0, and is different from the initial grip force used in the computer 2 (in...). Figure 10 or Figure 11 The initial gripping force used in the processing flow shown is irrelevant. After executing step S93, the processing unit 50 sets the reset flag C true (step S94) and begins the tablet input processing of step S1.
[0118] Next, as Figure 17 As shown in (b), the processing unit 50 uses data from... Figure 4 The gripping force obtained in step S15 and in Figure 5 The gripping force obtained in step S26 is obtained by subtracting the initial gripping force from each gripping force obtained in step S26 (step S96). That is, the pressure information related to the gripping force obtained by the subtraction operation in step S96, rather than the gripping force obtained in steps S15 and S26, is sent to computer 2.
[0119] By performing the above processing by the processing unit 50, the user of the electronic pen 5 in this example can perform pen pressure input based on grip force by increasing or decreasing the grip force according to the grip force at which the dome button 17 is pressed.
[0120] Figure 18This diagram illustrates the structure of the grip force sensor 55 in the fifth example. The grip force sensor 55 in this example comprises a capacitor having a structure in which a dielectric 19 and a rubber 20 are disposed between two electrode plates 18 and 21, and is disposed on the side of the outer housing 5a. The processing unit 50 in this example is configured to obtain the electrostatic capacitance of the capacitor serving as the grip force sensor 55 as the grip force.
[0121] In this example, when the user presses the outer electrode plate 21, the rubber 20 is flattened by the pressure, and the distance between the electrode plates 18 and 21 decreases accordingly, resulting in an increase in electrostatic capacitance. Furthermore, when the user applies a force in the pen axis direction to the outer electrode plate 21, the deformation of the rubber 20 causes the electrode plate 21 to... Figure 18 As shown in (b), the pen axis slides in the direction of the pen axis, resulting in a decrease in the electrostatic capacitance. Therefore, according to the grip force sensor 55 in this example, the force in the direction of the pen axis can be detected as grip force in addition to the pressing pressure. It should be noted that if the distance between electrode plate 18 and electrode plate 21 is set as d, the overlapping area of electrode plates 18 and 21 in the non-slip state is set as S, the change in the overlapping area caused by sliding is set as ΔS, and the dielectric constant of the component made of dielectric 19 and rubber 20 is set as ε, then the electrostatic capacitance of the capacitor in this example is expressed by the following formula (1).
[0122] C = ε(S - ΔS) / d (1)
[0123] Figure 19 This is a diagram showing the structure of the grip force sensor 55 in the sixth example. As shown in the figure, the electronic pen 5 in this example has a grip member 22 mounted on the outer housing 5a, and the grip force sensor 55 in this example is built into the grip member 22. Figure 19 (a) shows the side of the electronic pen 5 with the grip member 22 installed. Figure 19 (b) shows the upper surface of the electronic pen 5 with the gripping member 22 installed. Figure 19 (c) shows the electronic pen 5 in use with the gripping member 22 installed.
[0124] like Figure 19 As shown in (a) to (c), the gripping member 22 is configured to have a cylindrical base 22a that fits into the outer shell 5a and a finger rest 22b that extends in an arched shape from one end of the base 22a. Figure 19 As shown in (c), the user uses the electronic pen 5 with their index finger placed on the finger rest 22b. It should be noted that... Figure 19 The image depicts an example where the gripping member 22 is separate from the outer shell 5a, but they can also be formed as a single unit.
[0125] The grip force sensor 55 is, for example, a strain gauge embedded in the finger rest 22b, configured to detect the force (pressing force of the finger rest 22b) applied by the user's index finger. In this example, the processing unit 50 is configured to acquire the detected force as the grip force.
[0126] Here, by embedding an accelerometer in the electronic pen 5 or the grip member 22, the processing unit 50 can also detect the user's action of swinging the electronic pen 5. If this is combined with the detection of the pressure of the grip force sensor 55 on the finger rest 22b, the light touch action of the touch surface can also be simulated.
[0127] While the preferred embodiments of the present invention have been described above, the present invention is not limited to such embodiments in any way, and the present invention can certainly be implemented in various ways without departing from its spirit.
[0128] Label Explanation
[0129] 1 Spatial Position Indication System
[0130] 2 Computers
[0131] 2a Control Department
[0132] 2b memory
[0133] 3 Virtual Reality Displays
[0134] 4. Planar position sensor
[0135] 4a Input surface
[0136] 5 electronic pens
[0137] 5a Outer casing
[0138] 5b nib
[0139] 7a, 7b Position detection equipment
[0140] 8a~8c Spatial Position Sensors
[0141] 10 and 12 electrode plates
[0142] 11 Dielectric
[0143] 13 cores
[0144] 14 Button Mechanism
[0145] 15 Pressure-sensitive sensors
[0146] 16 substrate
[0147] 17. Dome-shaped button
[0148] Electrode plates 18 and 21
[0149] 19 Dielectric
[0150] 20 Rubber
[0151] 22 Grip components
[0152] 22a base
[0153] 22b Finger support
[0154] 50 Processing Department
[0155] 51 Graphic Communications Department
[0156] 52 Space Communications Department
[0157] 53 Spatial Position Detection Department
[0158] 54 Pen Pressure Sensors
[0159] 55. Grip force sensor
[0160] 56. Tactile production unit
[0161] A Delineated Area
[0162] B. Virtual tablet.
Claims
1. A position indicator device for controlling the position of a 3D object in a virtual reality space, comprising: case; A first sensor detects a first pressure applied to a first component disposed at the front end of the housing; A second sensor detects a second pressure, which is the pressure applied to a second component located near the center of the housing between the first component and the second component, and is used for the control of the 3D object in the virtual reality space; as well as The first communication unit transmits one of the information related to the first pressure detected by the first sensor and the information related to the second pressure detected by the second sensor.
2. The position indicating device according to claim 1, It also has a second communication unit that operates independently of the first communication unit and, unlike the first communication unit, transmits information related to the first pressure detected by the first sensor.
3. The position indicating device according to claim 1, The second pressure is the pressure applied to the second component by the user gripping the housing.
4. The position indicating device according to claim 1, The first pressure is the pressure applied to the first component by the contact surface when the first component is in contact with the contact surface.
5. The position indicating device according to claim 1, The housing is pen-shaped.
6. The position indicating device according to claim 2, The first pressure is the pressure applied to the first component through the contact surface when the first component comes into contact with the contact surface of a sensor located on an external device, the external device having the sensor that receives information related to the first pressure transmitted from a second communication unit.
7. The position indicating device according to claim 1, The information related to the first pressure sent from the first communication unit is the pressure used to control the 3D object in the virtual reality space.
8. A computer capable of communicating with a position indicator for controlling 3D objects in a virtual reality space, comprising: a housing; a first sensor for detecting a first pressure applied to a first component disposed at the front end of the housing; A second sensor detects a second pressure, which is the pressure applied to a second component located near the center of the housing between the first component and the second component, and is used for the control of the 3D object in the virtual reality space; And a first communication unit, which transmits one of information related to the first pressure detected by the first sensor and information related to the second pressure detected by the second sensor, wherein it has: The communication unit receives one of the information related to the first pressure and the information related to the second pressure sent by the first communication unit of the position indication device; and The controller controls the linewidth of the 3D object in the virtual reality space based on one of the information related to the first pressure and the information related to the second pressure received by the communication unit.
9. The computer according to claim 8, The controller generates 3D objects in the virtual reality space based on the position of the position indicator device in the space and one of the information related to the first pressure and the information related to the second pressure received by the communication unit.
10. The computer according to claim 8, When the first component of the position indicator is in contact with the contact surface, the controller controls the linewidth of the 3D object based on information related to the first pressure received by the communication unit. When the first component of the position indicator is not in contact with the contact surface, the controller controls the linewidth of the 3D object based on information related to the second pressure received by the communication unit.
11. A control method implemented by a computer, the computer being able to communicate with a position indicator device, the position indicator device being a position indicator device for controlling a 3D object in a virtual reality space, comprising: a housing; a first sensor for detecting a first pressure applied to a first component configured to protrude from the front end of the housing; A second sensor detects a second pressure, which is the pressure applied to a second component located near the center of the housing between the second component and the first component, for use in controlling the 3D object in the virtual reality space; a first communication unit transmits one of information related to the first pressure detected by the first sensor and information related to the second pressure detected by the second sensor. And a second communication unit, which operates independently of the first communication unit, and unlike the first communication unit, transmits information related to the first pressure detected by the first sensor, wherein, Receive one of the information related to the first pressure and the information related to the second pressure sent by the first communication unit of the position indicating device. The linewidth of the 3D object in the virtual reality space is controlled based on one of the received information related to the first pressure and the second pressure.
12. The control method according to claim 11, The 3D object in the virtual reality space is generated based on the position of the position indicator device in the space and one of the received information related to the first pressure and the second pressure.
13. The control method according to claim 11, When the first component of the position indicator is in contact with the contact surface, the linewidth of the 3D object in the virtual reality space is controlled based on the received information related to the first pressure. When the first component of the position indicator is not in contact with the contact surface, the linewidth of the 3D object in the virtual reality space is controlled based on the received information related to the second pressure.
14. A position indicator device for controlling the position of a 3D object in a virtual reality space, comprising: case; A first sensor detects a first pressure, which is the pressure applied to a first component disposed at the front end of the housing, and is used to control the 3D object in the virtual reality space; The first communication unit transmits the first pressure detected by the first sensor through the front end of the housing; as well as The second communication unit, unlike the first communication unit, transmits the first pressure detected by the first sensor.
15. The position indicating device according to claim 14, It also includes a second sensor to detect a second pressure, which is applied to a second component located near the center of the housing between the first component and the second component, for use in controlling the 3D object in the virtual reality space. The second communication unit transmits the second pressure detected by the second sensor.
16. The position indicating device according to claim 15, The second pressure is the pressure applied to the second component by the user gripping the housing.
17. The position indicating device according to claim 14, The first pressure is the pressure applied to the first component through the contact surface when the first component is in contact with the contact surface.
18. The position indicating device according to claim 14, The housing is pen-shaped.
19. The position indicating device according to claim 14, The first pressure is the pressure applied to the first component through the contact surface when the first component comes into contact with the contact surface located on the sensor that receives the first pressure transmitted from the first communication unit.
20. The position indicating device according to claim 15, The first pressure sent from the second communication unit is a pressure used to control the 3D object in the virtual reality space.
21. A computer capable of communicating with a position indicator device for controlling the position of a 3D object in a virtual reality space, comprising: a housing; a first sensor for detecting a first pressure, the first pressure being a pressure applied to a first component disposed at a front end of the housing for controlling the 3D object in the virtual reality space; a first communication unit for transmitting the first pressure detected by the first sensor via the front end of the housing; and a second communication unit, distinct from the first communication unit, for transmitting the first pressure detected by the first sensor, wherein... have: The communication unit receives the first pressure sent by the second communication unit of the position indicating device; and The controller controls the 3D object in the virtual reality space based on the first pressure sent by the second communication unit of the position indicator device and received by the communication unit.
22. The computer according to claim 21, The controller controls the 3D object in the virtual reality space based on the position of the position indicator in the space and the first pressure sent by the second communication unit of the position indicator and received by the communication unit.
23. The computer according to claim 21, The communication unit is configured to receive the first pressure sent by the first communication unit of the position indication device via a planar position sensor.
24. The computer according to claim 22, The position indicator also includes a second sensor that detects a second pressure applied to a second component located near the center of the housing between the second component and the first component, for use in controlling the 3D object in the virtual reality space. The second communication unit of the position indicating device transmits the second pressure detected by the second sensor. The communication unit receives the second pressure sent by the second communication unit of the position indicating device. The controller controls the 3D object in the virtual reality space based on the second pressure sent by the second communication unit of the position indicator device and received by the communication unit.
25. The computer according to claim 24, When the first component of the position indicating device is in contact with the contact surface, the controller controls the 3D object based on the first pressure transmitted by and received by the second communication unit of the position indicating device. The controller controls the 3D object based on the second pressure sent by and received by the second communication unit of the position indicator when the first component of the position indicator is not in contact with the contact surface.
26. A control method implemented by a computer, the computer being able to communicate with a position indicating device, the position indicating device being for controlling the position of a 3D object in a virtual reality space, comprising: a housing; a first sensor for detecting a first pressure, the first pressure being pressure applied to a first component disposed at the front end of the housing for controlling the 3D object in the virtual reality space; a first communication unit for transmitting the first pressure detected by the first sensor via the front end of the housing; and a second communication unit, different from the first communication unit, for transmitting the first pressure detected by the first sensor, wherein... Receive the first pressure sent by the second communication unit of the position indicating device. The 3D object in the virtual reality space is controlled based on the first pressure sent by the second communication unit of the position indicator device.
27. The control method according to claim 26, The 3D object in the virtual reality space is controlled based on the position of the position indicator within the space and the first pressure sent by the second communication unit of the position indicator.
28. The control method according to claim 26, The first pressure is received via a planar position sensor from the first communication unit of the position indication device.
29. The control method according to claim 28, The position indicator also includes a second sensor that detects a second pressure applied to a second component located near the center of the housing between the second component and the first component, for use in controlling the 3D object in the virtual reality space. The second communication unit of the position indicating device transmits the second pressure detected by the second sensor. The control method is configured such that, Receive the second pressure sent by the second communication unit of the position indicating device. The 3D object in the virtual reality space is controlled based on the second pressure sent by the second communication unit of the position indicator device.
30. The control method according to claim 29, When the first component of the position indicator is in contact with the contact surface, the 3D object in the virtual reality space is controlled based on the first pressure transmitted by the second communication unit of the position indicator. When the first component of the position indicator is not in contact with the contact surface, the 3D object in the virtual reality space is controlled based on the second pressure sent by the second communication unit of the position indicator.
Citation Information
Patent Citations
Pen type input device
JP1996006710A