Computer program, information processing terminal, and control method therefor

Abstract

The present invention provides, for example, a novel configuration relating to the manipulation of a three-dimensional model such as a handpiece displayed on a screen. This information processing terminal receives a user operation on a screen displayed on a display unit of the information processing terminal, displays a three-dimensional model of a model object on the display unit, and displays a movable point of the three-dimensional model in an operable manner. In addition, when receiving a switching instruction for switching the number of movable points displayed on the display unit, the information processing terminal switches and displays the number of movable points displayed on the display unit in accordance with the switching instruction.

Description

Technical Field

[0001] The present invention relates to a computer program, an information processing terminal and a control method thereof. Background Art

[0002] Articulated figures (Japanese: フィギュア) with many joints are known. In addition, the following technology is known: photographing an object such as a figure from multiple directions, generating a three-dimensional model based on multiple camera images, and displaying the three-dimensional model in a virtual space. Patent document 1 proposes the following technology: mapping a texture on a three-dimensional model generated from multiple camera images, arranging it in a virtual space for display, and moving the texture in coordination with the rotational movement and translational movement of a primitive.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2020-107252 Summary of the invention

[0006] Problem that the invention aims to solve

[0007] In the above-mentioned prior art, the three-dimensional model generated based on the figure included in the camera image can be rotated or translated on the screen as a whole. On the other hand, in the above-mentioned prior art, although the figure can be moved as a whole, it is not mentioned that the joints and the like can be moved like a real movable figure. However, in the three-dimensional model displayed on the screen, if the joints and the like can be moved in the same way as a real movable figure, it can further give a sense of presence. In addition, if the joints and the like can be moved according to the user's operation, it can further improve the fun.

[0008] The present invention provides, for example, a new structure related to the operation of a three-dimensional model such as a figure displayed on a screen.

[0009] Solutions for solving problems

[0010] The present invention is characterized in that, for example, a computer of an information processing terminal is made to function as the following units: an acceptance unit that accepts user operations through a screen displayed on a display unit of the information processing terminal; and a display control unit that displays a three-dimensional model of a model object on the display unit and displays movable points of the three-dimensional model in an operable manner, wherein when a switching instruction to switch the number of movable points displayed on the display unit is accepted by the acceptance unit, the display control unit switches the number of movable points displayed on the display unit according to the switching instruction and displays them.

[0011] In addition, the present invention is, for example, an information processing terminal, characterized in that it comprises: an acceptance unit, which accepts user operations through a screen displayed in a display unit of the information processing terminal; and a display control unit, which displays a three-dimensional model of a model object on the display unit, and displays the movable points of the three-dimensional model in an operable manner, wherein when a switching instruction to switch the number of movable points displayed in the display unit is accepted by the acceptance unit, the display control unit switches the number of movable points displayed in the display unit according to the switching instruction and displays them.

[0012] In addition, the present invention is, for example, a control method for an information processing terminal, characterized in that it includes the following steps: an acceptance step, accepting user operations through a screen displayed in a display unit of the information processing terminal; and a display control step, displaying a three-dimensional model of a model object on the display unit, and displaying movable points of the three-dimensional model in an operable manner, wherein when a switching instruction for switching the number of movable points displayed in the display unit is received in the acceptance step, in the display control step, the number of movable points displayed in the display unit is switched and displayed according to the switching instruction.

[0013] Effects of the Invention

[0014] According to the present invention, for example, a new structure related to the operation of a three-dimensional model such as a figure displayed on a screen can be provided. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 This is a diagram showing a configuration example of a system according to one embodiment.

[0016] Figure 2 It is a diagram showing a configuration example of each device involved in one embodiment.

[0017] Figure 3 This is a diagram showing an example of screen transition of a digital figure provided by a system according to one embodiment.

[0018] Figure 4 It is a diagram showing the gradual increase and decrease of movable points according to one embodiment.

[0019] Figure 5 It is a diagram showing movable operations of a three-dimensional model according to one embodiment.

[0020] Figure 6 This is a diagram showing a sequence of a system according to one embodiment.

[0021] Figure 7 1 is a flowchart showing a basic control processing procedure according to one embodiment.

[0022] Figure 8 Detailed description of the invention is a flowchart showing a procedure of gesture editing according to one embodiment.

[0023] Fig. 9 This is a flowchart showing a processing procedure of movable display control according to one embodiment.

[0024] Fig.10 It is a diagram showing a modification 1 of the movable operation of the three-dimensional model according to one embodiment.

[0025] Fig.11 This is a diagram showing a second modification of the movable operation of the three-dimensional model according to one embodiment. DETAILED DESCRIPTION

[0026] The following embodiments are described in detail with reference to the accompanying drawings. In addition, the following embodiments do not limit the invention involved in the claims, and are not limited to the combination of features described in the embodiments as being necessary for the invention. Two or more of the multiple features described in the embodiments may also be arbitrarily combined. In addition, the same or similar structures are marked with the same figure numerals, and repeated descriptions are omitted.

[0027] <System Structure>

[0028] First, refer to Figure 1 The system structure involved in this embodiment is described. In addition, the minimum required simple structure is described here, but it does not limit the present invention. For example, each device may include multiple devices, or multiple servers may be set up in an integrated manner.

[0029] The present system is configured to include information processing terminals 101a, 101b, 101c and an application server 102. In the following, when describing the configuration and control applicable to any information processing terminal, the letters added to the end of the reference numerals are omitted and the information processing terminal 101 is simply described. The information processing terminal 101 and the application server 102 are connected via a network 103 so as to be able to communicate with each other.

[0030] The information processing terminal 101 is, for example, an information processing terminal such as a smart phone, a mobile phone, a tablet PC, or a stand-alone PC. Any device may be used as long as it has at least a communication unit that can communicate with the application server 102 via a network and a display unit that displays an image. The information processing terminal 101 downloads and installs an application for implementing the present invention from the application server 102 via the network 103. By executing the application in the information processing terminal 101, a three-dimensional model of a specified model object (movable figure) described below can be displayed on the screen, and the specified model object (figure) can be made movable on the screen by operating the movable part. In the following, a figure that is displayed on the screen in an operable manner like this is referred to as a digital figure.

[0031] The application server 102 provides the application to the information processing terminal 101. In addition, when the application is started in the information processing terminal 101, the application server 102 provides the information processing terminal 101 with the figures that the user can select and the posture (posture) information of each figure based on the user's authentication information. The user can purchase digital figures on the application. The application server 102 registers the digital figures purchased by the user in association with the user's authentication information. Therefore, the application server 102 can determine the digital figures that can be provided by referring to the user's authentication information and the above-mentioned registration information associated with the authentication information. In addition, the three-dimensional model information of the digital figures is information managed in the application server 102, but can also be stored in the local storage area of ​​the information processing terminal 101.

[0032] <Structure of Each Device>

[0033] Next, refer to Figure 2 Here, only the devices important for the description of the present invention are described. Therefore, the information processing terminal 101 and the application server 102 may be configured to include other devices instead of or in addition.

[0034] First, the configuration of the information processing terminal 101 will be described. The information processing terminal 101 includes a CPU 201, a storage unit 202, a communication control unit 203, a display unit 204, an operation unit 205, and a camera 206. Each component can transmit and receive data to and from each other via a system bus 210.

[0035] The CPU 201 is a central processing unit that integrally controls each component connected via the system bus 210. The CPU 201 executes each process described below by executing a computer program stored in the storage unit 202. The storage unit 202 is used as a work area and a temporary area of ​​the CPU 201, and stores a control program executed by the CPU 201 and various data.

[0036] The communication control unit 203 can perform bidirectional communication with the application server 102 via the network 103 by broadband wireless communication. In addition, the communication control unit 203 may have a function of short-distance wireless communication such as wireless LAN (WiFi), Bluetooth (registered trademark) communication, and infrared communication in addition to broadband wireless communication, or may have a function of short-distance wireless communication such as wireless LAN (WiFi), Bluetooth (registered trademark) communication, and infrared communication instead of broadband wireless communication. For example, when the communication control unit 203 has a WiFi communication function instead of a broadband wireless communication function, it connects to the network 103 via a nearby access point.

[0037] The display unit 204 may also be a touch panel type liquid crystal display, which displays various screens and displays the digital figures selected by the user on the application screen. The operation unit 205 functions as a receiving unit and is an operation input unit that receives user operations, and may also be provided integrally with the display unit 204. In addition, the operation unit 205 may also include physically constructed push-type or slide-type buttons, etc.

[0038] The camera 206 is a camera unit that captures the surrounding environment of the information processing terminal 101. It is also possible to configure and operate a digital figure in the image captured by the camera 206. In addition, the camera 206 is not a necessary structure for implementing the present invention. For example, the information processing terminal 101 involved in this embodiment can also synthesize a digital figure in a camera image received from the outside and display it.

[0039] Next, the configuration of the application server 102 is described. The application server 102 includes a CPU 211, a ROM 212, a RAM 213, a display unit 214, an operation unit 215, a communication control unit 216, and a hard disk drive (HDD) 217. The CPU 211 is a central processing unit that controls the components connected via the system bus 220 as a whole.

[0040] The CPU 211 performs various processes by reading computer programs stored in the ROM 212 and the HDD 217 into the RAM 213 and executing the computer programs. The ROM 212 is a nonvolatile memory that stores various programs and various data. The RAM 213 is a volatile memory used as a work area and a temporary area of ​​the CPU 211. The HDD 217 is a large-capacity storage device that stores user authentication information and registration information of each user associated with the authentication information.

[0041] The communication control unit 216 can perform two-way communication with the information processing terminal 101 via the network 103. In addition, the communication control unit 216 uses a wireless LAN (WiFi, etc.) and connects to the network 103 via a nearby access point. The display unit 214 displays various screens. The operation unit 215 is an operation input unit that accepts operations by the administrator of this system, etc. In addition, the operation unit 215 can also be a pointing device such as a mouse.

[0042] <Digital Figures>

[0043] Next, refer to Figure 3 An example of a digital figure provided by the system involved in this embodiment is described below. Here, the following processing is assumed: an application for providing a digital figure is downloaded from the application server 102 and installed on the information processing terminal 101. By executing the application on the information processing terminal 101, the three-dimensional model is displayed on the display unit 204 in an operable manner. Figure 3 (a)~ Figure 3 (d) shows screen transition in the above application.

[0044] Figure 3 The screen 300 shown in (a) is a figure selection screen displayed on the display unit 204 of the information processing terminal 101 when the application that provides digital figures is started. In the figure selection screen 300, a selection area 301 and a decision button 302 are displayed, which include multiple digital figures that can be selected separately. The user selects the selection area 303 of the figure he wants to operate on the screen and operates the decision button 302. In response to the user operation, the figure selection screen 300 is transferred to the posture selection screen 310. The selectable digital figures are managed in the application server 102 in association with user information such as authentication information. For example, a new digital figure can be purchased through a screen not shown in the figure, and the purchased digital figure is registered in the application server 102 together with the user information and added to the selection area 301 of the figure selection screen 300.

[0045] exist Figure 3(b) shows a posture selection screen 310. The posture selection screen 310 is a screen for selecting a default posture when starting to operate the digital figure. The posture selection screen 310 is displayed as including a selection area 311 that can select multiple postures (postures), a return button 312, a decision button 313, a menu button 314, an edit data selection button 316, and a preset selection button 317. The user selects the selection area 315 of the posture he wants to customize on the screen and operates the decision button 313. In response to the user operation, the posture selection screen 310 is transferred to the editing screen 320. When the return button 312 is operated, the screen returns to the figure selection screen 300. When the menu button 314 is operated, various setting items are displayed. When the edit data selection button 316 is operated, one or more postures that the user has customized in the past by operating the digital figure are displayed in the selection area 315 in a selectable manner. On the other hand, when the preset selection button 317 is operated, a plurality of postures preset for the target figure are displayed in the selection area 315 so as to be selectable.

[0046] exist Figure 3 (c) of FIG. 3 shows an editing screen 320. In the editing screen 320, the displayed digital figure is displayed in an editable manner. The editing screen 320 is displayed as including a digital figure 350, buttons 323 to 325, a cost display 329, and a posture monitor 328. When the button 323 is operated, the screen transitions to a screen in which the movable points of the digital figure are displayed in an operable manner. Figure 4 and Figure 5 This screen will be described later. When button 324 is operated, the parts that can be changed are displayed in a selectable manner. For example, the selectable head, arms, belt, etc. in the figure are displayed in a selectable manner. When button 327 is operated, various setting items are displayed. When button 326 is operated, the editing of the posture in the editing screen 320 is ended. When button 327 is operated, the posture of the digital figure being edited is saved in the application server 102. As the saving destination, it can also be saved in the local memory area of ​​the information processing terminal 101 in addition to the application server 102, or saved in the local memory area of ​​the information processing terminal 101 instead of the application server 102.

[0047] The cost display 329 is used to show the processing cost when configuring the digital figure being edited on a scenery in a virtual space. Depending on the processing performance of the information processing terminal 101, etc., there is an upper limit to the number of objects that can be configured on the scenery at the same time, and the cost display 329 shows the processing cost as their standard. The posture monitor 328 displays the posture of the currently displayed digital figure 350 in a maximum three-axis manner. In the editing screen 320, the digital figure is facing the front, so it is displayed in a two-axis manner. In addition, by operating the posture monitor 328, the digital figure 350 is also rotated and displayed in conjunction with the operation. On the other hand, by rotating the digital figure 350, the posture monitor 328 is also updated and displayed in conjunction.

[0048] Figure 3 (d) shows the updated editing screen 330 by rotating the digital figure 350 to the right in the editing screen 320. In the editing screen 330, the digital figure 351 is displayed after the digital figure 350 facing the front is rotated to the right by the rotation operation. In addition, in addition to the above-mentioned editing screen 320, buttons 321 and 322 are also displayed in the editing screen 330. When the posture of the digital figure 350 in the default posture is edited by the user operation, buttons 321 and 322 are displayed. Button 321 is a button for canceling the previous editing operation and returning to the previous posture. Button 322 is a button for advancing to the next posture maintained in the history from the state of returning to the past posture due to the selection of button 321. In addition, since the posture has been edited, the posture monitor 331 is also updated accordingly.

[0049] <Moveable Points>

[0050] Next, refer to Figure 4 The movable points in the digital figure involved in this embodiment are explained. Figure 4 (a)~ Figure 4 (c) shows the situation that the number of movable points of the digital figure is gradually increased or decreased according to the user operation. In addition, as movable points, it is possible to set the joint positions of the figure, the connection parts of each part, etc., but there is no particular limitation.

[0051] Figure 4 (a) shows that Figure 3 The editing screen 400 is displayed when the button 323 is operated in the editing screen 330 shown in (d). In the editing screen 400, as shown in 403, the plurality of movable points of the figure 351 are displayed in a manner overlapping the positions of the movable parts of the figure 351. The movable points are displayed in an operable manner, for example, using double circle marks. Figure 5The operation method will be described later. In the editing screen 400, a mode selection area 401 and a mode display unit 402 are also displayed. The mode selection area 401 is a slide button for increasing or decreasing the number of movable points displayed in stages. In the editing screen 400, a display indicating that the first mode is selected as the display mode is displayed in the left area of ​​the mode selection area 401 and the mode display unit 402. In the editing screen 400, the button 323 is selected, which is the stage where the display of movable points starts, so the default first mode is selected. According to the present embodiment, the display mode of movable points includes a plurality of modes, for example, including a first mode ("simple" mode), a second mode ("moderate" mode) and a third mode ("detailed" mode), and the number of movable points displayed increases or decreases in stages. In the third mode, the same number of movable points as the maximum number of movable parts of a real figure is displayed. Here, the movable part of a real figure refers to the movable part set when the digital figure displayed on the screen is assumed to be a real figure. Therefore, the real figure here does not necessarily need to exist as an actual figure, and the movable part can be set at any position, for example, it can also be set based on design data. However, when the movable point of the digital figure is set based on the movable part of the design data of the actual figure, the realism is increased by the movement, and a more preferable digital figure can be provided. In addition, the modes are divided into three levels here, but it is not intended to limit the present invention, and it can also be divided into two modes or more modes.

[0052] Figure 4 (b) shows an editing screen 410 that is transitioned when the second mode is selected in the mode selection area 401. The user can select the second mode by sliding from the left area of ​​the mode selection area 401 to near the center in the editing screen 400. This operation is equivalent to a switching instruction. In the editing screen 410, compared with the editing screen 400, a movable point surrounded by a dotted line is newly added, and it is displayed as including the mode selection area 411 and the mode display unit 412. In the editing screen 410, a display indicating that the second mode is selected as the display mode is displayed near the center of the mode selection area 411 and the mode display unit 412.

[0053] Figure 4(c) shows the editing screen 420 that is migrated when the third mode is selected in the mode selection area 411. The user can select the third mode by sliding from the center of the mode selection area 411 to the right area in the editing screen 410. This operation is equivalent to a switching instruction. In the editing screen 420, compared with the editing screen 410, a movable point surrounded by a dotted line is newly added, and it is displayed as including the mode selection area 421 and the mode display unit 422. In the editing screen 420, a display indicating that the third mode is selected as the display mode is displayed in the right area of ​​the mode selection area 421 and the mode display unit 422.

[0054] In addition, among the newly added movable points displayed in the editing screen 420, there are movable points that are displayed with a single circle mark instead of a double circle. This indicates that the movable category is different from the movable category of the movable point displayed with a double circle. The movable category includes, for example, a movable point that can be rotated in multiple directions using a spherical connecting portion (double circle) and a movable point that can only rotate in a single direction (for example, only in the up and down direction) (single circle). In this way, according to the present embodiment, different movable categories can also be represented by the category (shape, color, size, etc.) of the object representing the movable point. As a result, the user can easily identify the movable category of each movable point, its movable direction, etc.

[0055] In the above example, an example of increasing the number of displayed movable points step by step is described. On the other hand, it is also possible to decrease it step by step. For example, it is also possible to switch from the third mode to the second mode, or from the second mode to the first mode. In addition, as described later, it is also possible to switch to other modes after performing a movable operation in a prescribed mode. In addition, in the above example, an example of increasing or decreasing the number of movable points is described, but it is also possible to switch between multiple modes in which the number of movable points is set to the same number but the positions of the movable points are different. Alternatively, it is also possible to set multiple modes in which the number of movable points is increased or decreased and the positions of the movable points are also different.

[0056] <How to operate the digital figure>

[0057] Next, refer to Figure 5 Here, as an example, screen transitions according to the operation when the first mode is selected as the display mode of movable points as shown in the editing screen 400 will be described.

[0058] Figure 5(a) shows an editing screen 500 in a state where the user has selected the movable point of the right ankle of the digital figure 351. 501 represents an object for highlighting the selected movable point. Object 501 is displayed overlapping the selected movable point in a manner that covers the movable point. In addition, it is displayed so that the selected movable point can be visually confirmed through object 501. Thus, the user can easily identify which movable point has been selected. When any movable point is selected, buttons 502 and 503 are additionally displayed. Button 502 is a button for reducing the display scale of the digital figure 351. On the other hand, button 503 is a button for expanding the display scale of the digital figure 351. When the display scale is expanded, the enlarged display is centered on the currently selected movable point.

[0059] Figure 5 (b) shows the following editing screen 510: With the movable point selected as shown in 501, an operation is performed to rotate the right leg of the figure 351 backward and the display is updated. In the editing screen 510, the display of the figure 351 is updated to show the state after the right leg moves backward. As shown in 511, the display of the object representing the currently selected movable point is also moved and displayed accordingly. As a user operation, for example, by performing a sliding operation (swipe operation, flick operation, etc.) in a specified direction while pressing a specified movable point, the parts associated with the currently selected movable point are also moved and displayed in the specified direction. Alternatively, it can also be achieved in the following manner: a touch operation is performed to select a specified movable point, and after temporarily releasing the touch operation, a sliding operation (swipe operation, flick operation, etc.) is further performed on the screen in the direction in which the selected movable point is centered. Regarding the range of rotation of the associated parts of the digital figure 351, the range can also be changed in accordance with the operation amplitude and operation speed of the above-mentioned sliding operation.

[0060] Figure 5 (c) shows that Figure 5 From the state (b) of the figure 351, the right leg of the figure 351 is further rotated backward and the displayed editing screen 520 is updated. In the editing screen 520, the display of the figure 351 is updated to show the state after the right leg is further moved backward. As shown in 521, the display of the object representing the currently selected movable point is also moved and displayed accordingly. In addition, as shown in Figure 5 (b) and Figure 5As shown in (c), the currently selected movable point is the position of the right ankle, and the digital figure can be moved in the following manner: the movable point is moved in the direction of operation by sliding backward. In addition, according to the present embodiment, the display control is performed in a manner that not only the calf part that contacts the movable point moves, but also the thigh part moves following the movement of the calf part. In this way, according to the operation method of the digital figure involved in the present embodiment, the display control is performed in a manner that the parts associated with the movable point being operated and the parts following the parts move in conjunction with each other according to the user operation. As a result, the user can perform movable operations more intuitively in the same way as real figures. In addition, with respect to the moving display, it is expected that the display will be dynamically updated following the user's sliding operation. On the other hand, in the case of reducing the processing load, the display may not be updated during the operation (when the finger is in contact with the screen), and the moving distance is determined based on the release position and the display is updated when the user completes the sliding operation, that is, when the finger is released from the screen.

[0061] In addition, Figure 5 In the description, the screen transition when the first mode is selected as the display mode of the movable point is described. However, when the second mode or the third mode is selected as the display mode of the movable point, the screen transition can be based on Figure 4 (b) Figure 4 The movable point shown in (c) is Figure 5 The figure 351 is operated in the same manner as shown. When the second mode is selected, for example, the movable points of the toes are increased, and the position (angle) of the toes can be freely moved. In this embodiment, the settings related to the movable points can be changed. Therefore, when the user is not used to operating the digital figure, the first mode with a small number of movable points can be set, and when the user is used to the operation, the second mode, the third mode, etc. with a large number of movable points can be changed. The movable points can be set according to the user's proficiency, preferences related to the operation, etc., which can improve the convenience of the system.

[0062] <Timeline>

[0063] Next, refer to Figure 6 The sequence between the information processing terminal 101 and the application server 102 when realizing the digital figure according to the present embodiment is described. Here, the following processing is assumed: the application for providing the digital figure is downloaded from the application server 102 and installed on the information processing terminal 101. In addition, the action of operating the digital figure to edit the posture and saving the edited posture to the server is described.

[0064] When an operation for starting an application is received, the information processing terminal 101 starts the application in S1. When the application is started, the application notifies the application server 102 of the user's login request together with the user's authentication information in S2. Regarding the authentication information, it is possible to store the input information received from the user when the application is started for the first time and use the information at the next and subsequent starts, or to receive the information from the user at each start.

[0065] In S3, the application server 102 authenticates the requested user, and when the authentication is successful, responds to the information processing terminal 101 with user-related information associated with the user. The user-related information includes selectable figure information and selectable posture information of each figure registered in association with the user's authentication information. When receiving the user-related information, the application displays the figure selection screen 300 on the display unit 204 based on the selectable figure information of the user.

[0066] Next, when the application receives the selection of a figure through the figure selection screen 300 in S4, the application displays the posture selection screen 310 on the display unit 204 based on the posture information received in S3. In addition, it is also possible to make a request from the information processing terminal 101 to the application server 102 and receive the posture information related to the figure when the user selects the figure desired through the figure selection screen 300. In this way, compared with the case where the posture information of all figures is received in advance in S3, the memory usage in the information processing terminal 101 can be reduced.

[0067] Next, when the application receives the selection of the posture of the figure through the posture selection screen 310 in S5, the application is requested to display the three-dimensional model data of the digital figure representing the figure. In S7, the application server 102 returns the requested three-dimensional model data of the digital figure to the information processing terminal 101. In addition, the three-dimensional model data sent here can be data that has been specialized for the selected posture or data of a specified reference posture. In the case of sending the specified reference posture, the information processing terminal 101 needs to control the change and display of the three-dimensional model according to the selected posture.

[0068] When the three-dimensional model data is received, the application displays the editing screen 320 on the display unit 204 based on the received data in S8. After that, when the button 323 is operated, the application displays the editing screen 400, 500 in which the movable points are displayed in an operable manner in S9. Furthermore, when a mode selection or an operation on the movable points is received, the application updates the display of the digital figure displayed in the editing screen 400, 500.

[0069] After that, when button 325 is operated, in S10, the application notifies application server 102 of a request to save the current posture state of the digital figure. In S11, application server 102 registers the information in association with the user's authentication information and responds to information processing terminal 101 indicating that the saving is completed.

[0070] <Basic Control>

[0071] Next, refer to Figure 7 The following will describe the basic control processing procedure in the application for providing a digital figure according to the present embodiment. The processing described below is realized by, for example, the CPU 201 reading and executing a control program stored in advance in the storage unit 202.

[0072] First, in S101, when the application for providing digital figures according to the present embodiment is started, the CPU 201 displays the figure selection screen 300 on the display unit 204. When an arbitrary figure is selected through the figure selection screen 300, in S102, the CPU 201 displays the posture selection screen 310 on the display unit 204. When an arbitrary posture is selected through the posture selection screen 310, in S103, the CPU 201 notifies the application server 102 of the posture information of the selected figure and acquires the three-dimensional model data of the figure. The three-dimensional model data also includes information on movable points that can be displayed.

[0073] Next, in S104, the CPU 201 displays the editing screen of the digital figure on the display unit 204 according to the three-dimensional model data acquired in S103. When a user operation is accepted through the displayed editing screen, in S105, the CPU 201 determines whether the button 323 for displaying movable points has been operated. If it is determined that it has been operated, it proceeds to S109, otherwise it proceeds to S106. In S109, the CPU 201 displays the movable points with the default display number and accepts the editing operation. Figure 8 The detailed control of S109 will be described later.

[0074] On the other hand, in S106, the CPU 201 determines whether the button 325 for saving the gesture has been operated. If it is determined that it has been operated, the process proceeds to S107, otherwise it proceeds to S108. In S107, the CPU 201 notifies the application server 102 of the gesture information indicating the current state of the gesture and the request for saving instruction, and proceeds to S108.

[0075] In S108, the CPU 201 determines whether the application has been terminated. If not, the process returns to S105, and if it has been terminated, the application is terminated, and the process of this flowchart is terminated.

[0076] <Display control of movable points>

[0077] Next, refer to Figure 8 The processing procedure of the posture editing control (S109) according to the present embodiment will be described. The processing described below is realized by, for example, the CPU 201 reading out and executing a control program stored in advance in the storage unit 202.

[0078] First, in S201, the CPU 201 obtains information related to movable points from the three-dimensional model data obtained in S103. Next, in S202, the CPU 201 displays the movable points overlapping the digital figure in the default display mode of the movable points (here, the first mode) according to the obtained information related to the movable points.

[0079] Next, in S203, the CPU 201 determines whether the number of movable points displayed has been changed through the mode selection area 401. If changed, the process proceeds to S207, otherwise, the process proceeds to S204. In S207, the CPU 201 increases or decreases the number of movable points displayed according to the changed movable point display mode, and proceeds to S204.

[0080] In S204, the CPU 201 determines whether the movable point has been operated. If it has been operated, the process proceeds to S205, otherwise, the process proceeds to S206. In S205, the CPU 201 rotates the digital figure and updates the display according to the user's operation information, and the process proceeds to S206. Fig. 9 The detailed processing will be described later. In S206, the CPU 201 determines whether the button 325 and the button 326 are operated to determine whether to end the editing. In the case of ending the editing, the processing of this flowchart is ended and enters S106, otherwise the processing is returned to S203. In addition, here, when the button (save instruction) 325 is operated, it is determined that the editing is ended, but it can also be set as a control that continues without ending the editing. In this case, the same saving processing as S107 is performed, and the processing is returned to S203.

[0081] <Moveable Display Control>

[0082] Next, refer to Fig. 9 The processing procedure of the movable display control (S205) according to the present embodiment will be described. The processing described below is realized by, for example, the CPU 201 reading out and executing a control program stored in advance in the storage unit 202.

[0083] First, in S301, the CPU 201 obtains operation information related to the selected movable point. Next, in S302, the CPU 201 determines the associated parts of the digital figure according to the selected movable point. Figure 5 In the case of a movable point of the right ankle, parts connected to the movable part corresponding to the movable point, such as parts of the calf and the foot, are determined as related parts.

[0084] Next, in S303, the CPU 201 determines the action for the determined associated part according to the operation information. Here, for example, the action direction is determined according to the operation direction, and the action amplitude (movement distance of the part) is determined according to the operation amplitude and the operation speed. Next, in S304, the CPU 201 determines the action of the part that follows the action of the associated part according to the action of the determined associated part. Regarding the determination method, the following learning algorithm can be used for determination: the learning algorithm is obtained by machine learning in a manner that outputs the action of the follow-up part according to the action direction and action amplitude of the associated part for each joint. Alternatively, it can also be determined by referring to a table that defines the action mode of the follow-up part corresponding to the action of each part.

[0085] When the actions of the associated parts and the follow-up parts are determined, in S305, the CPU 201 updates the display of the digital figure to display the posture after the action, and ends the processing of this flowchart. Regarding the update of the display, the display can be dynamically updated following the user's sliding operation, or the display can be not updated during the operation (when the finger is in contact with the screen), and the display can be updated when the user completes the operation, that is, when the finger is released from the screen.

[0086] As described above, the information processing terminal 101 involved in this embodiment accepts user operations through the screen displayed in the display unit of the information processing terminal, displays the three-dimensional model of the model object on the display unit, and displays the movable points of the three-dimensional model in an operable manner. In addition, when the information processing terminal 101 receives a switching instruction to switch the number of movable points displayed in the display unit, it switches the number of movable points displayed in the display unit according to the switching instruction and displays them. Thus, according to this embodiment, the user can display the movable points that are easy for him to operate and perform movable operations, and can easily operate the joints of the three-dimensional model of the figure displayed in the display unit on the screen.

[0087] <Variation 1 of Operation Method>

[0088] The present invention is not limited to the above-mentioned embodiments, and various deformations and changes can be made within the scope of the main purpose of the invention. For example, in the above-mentioned embodiments, an example of performing the following display control is described: the user selects a movable point arranged near the part (leg, etc.) that the user wants to move, and moves (pulls) the part to make it move, etc., and the associated parts and the follower parts are moved through intuitive operations. However, the present invention is not limited to this, and for example, it can also be controlled so that only the joint corresponding to the selected movable point rotates in accordance with the operation.

[0089] Fig.10 This is used to explain the modification 1 of the operation method of the digital figure. Here, as an example, the screen transition corresponding to the operation when the first mode is selected as the display mode of the movable point as shown in the editing screen 400 is explained. In addition, Fig.10 Shown with Figure 5 The operation method shown is different from the operation method to make the digital hand Figure 5 An example of the same action is performed.

[0090] Fig.10 (a) shows the editing screen 1000 in a state where the user has selected the movable point at the root of the right thigh of the digital figure 351. 1001 indicates an object for highlighting the selected movable point. Object 1001 is displayed overlapping the selected movable point in a manner that covers the selected movable point. In addition, it is displayed so that the selected movable point can also be visually confirmed through object 1001. Thus, the user can easily recognize which movable point has been selected. In this modified example, only the movable part corresponding to the selected movable point can be rotated.

[0091] Fig.10 (b) shows the following editing screen 1010: With the movable point selected as shown in 1001, a sliding operation is performed to rotate the right leg of the figure 351 backward as shown by the arrow direction, and the display is updated. In the editing screen 1010, the display of the figure 351 is updated to show the state after the right leg moves backward. Here, the movable part corresponding to the selected movable point is rotated according to the operation shown by the arrow, thereby performing display control to cause the part group (right leg part) connected to the movable part to move.

[0092] Fig.10 (c) shows that from Fig.10When the selection of the movable point is further changed from 1001 to 1021 and a sliding operation is further performed in the direction of the arrow, the displayed editing screen 1020 is updated. Regarding 1021, it can be seen that the movable point corresponding to the knee of the right leg is selected, and only the parts below the knee are moved according to the sliding operation. In this way, according to this modification, the digital figure can be operated in a manner that only the parts connected to the selected movable point are moved. In this case, compared with the above-mentioned embodiment, more detailed actions can be specified by user operation.

[0093] <Variation 2 of Operation Method>

[0094] Next, refer to Fig.11 Modification 2 of the method for operating a digital figure will be described. Modification 2 of the method for operating a digital figure will be described. Here, as an example, screen transitions according to the operation when the first mode is selected as the display mode of movable points as shown in the editing screen 400 will be described.

[0095] Fig.11 (a) shows an editing screen 1100 in a state where the user selects a movable point to be fixed and further selects a movable point of the right ankle to be rotated. 1101 is an object representing a situation where the user selects the movable point to fix the rotation at the movable point. As a user operation, for example, it is possible to select the movable point as the movable point to be fixed by double-clicking, long pressing, etc. The object 1101 is displayed overlapping with the movable point in a manner that covers the mark of the movable point to show that the rotation of the movable point has been fixed. In addition, the object 1101 is displayed by a display object different from the object 1102 representing the point selected to be rotated (for example, a different type of shadow display).

[0096] Fig.11 (b) shows the following editing screen 1110: When the movable point is selected as shown in 1102, Figure 5 Similarly, the operation described in the figure 1110 is performed by sliding in the direction of rotating the right leg of the figure 351 backward and updating the display. In the editing screen 1110, the display of the figure 351 is updated to show the state after the right leg moves backward. However, in this modification, the movable point of the right thigh root is fixed, so the thigh part of the right leg is fixed, and only the part below the knee rotates.

[0097] Fig.11 (c) shows that Fig.11From the state (b), a sliding operation is further performed in the direction of rotating the right leg of the figure 351 backward, and the displayed editing screen 1120 is updated. Here, too, the movable point at the root of the right thigh is fixed, so the thigh of the right leg is fixed, and only the part below the knee rotates. In this way, according to this variation, a movable point to be rotated and fixed can be selected from multiple operable movable points. In this way, when the movable point to be rotated is operated in the state where the movable point to be fixed is selected, the digital figure can be operated in a manner that only the associated parts are moved, excluding the selected fixed movable point.

[0098] In addition, in the present embodiment, a human-shaped model object is used as an example to explain the model object, but it is not intended to limit the present invention, and it can be applied to model objects of various shapes such as humans, animals, robots, insects, dinosaurs, etc. In any case, the convenience of the system can be improved by changing the settings related to the movable points of the model object as described in the above embodiment.

[0099] <Summary of Implementation Methods>

[0100] The above-mentioned embodiments disclose at least the following computer program, information processing terminal and control method thereof.

[0101] (1) A computer program, characterized in that

[0102] Make the computer of the information processing terminal function as the following units:

[0103] an accepting unit that accepts a user operation through a screen displayed on a display unit of the information processing terminal; and

[0104] a display control unit that displays a three-dimensional model of the model object on a display unit and displays movable points of the three-dimensional model in an operable manner,

[0105] When the receiving unit receives a switching instruction to switch the number of movable points displayed on the display unit, the display control unit switches and displays the number of movable points displayed on the display unit according to the switching instruction.

[0106] (2) The computer program according to (1), wherein the display control unit increases or decreases the number of movable points step by step according to the switching instruction.

[0107] (3) The computer program according to (1) or (2), characterized in that the maximum number of the movable points displayed is the same as the maximum number of movable parts in a real model object corresponding to the three-dimensional model.

[0108] (4) A computer program according to any one of (1) to (3), characterized in that the display control unit displays the object representing the movable point in a manner overlapping with the position of the movable part of the three-dimensional model displayed in the display unit.

[0109] (5) The computer program according to any one of (1) to (4), characterized in that the computer of the information processing terminal is caused to function further as a determination unit, and when the receiving unit receives a user operation to operate the movable point, the determination unit determines the movement of at least one part of the three-dimensional model according to the user operation,

[0110] The display control unit updates the display of the three-dimensional model according to the movement of the at least one component determined by the determination unit.

[0111] (6) The computer program according to (5), wherein the determination unit further determines an action of a follow-up component, the action of the follow-up component following the action of the at least one component determined based on the user operation,

[0112] The display control unit updates the display of the three-dimensional model according to the movement of the following component in addition to the movement of the at least one component determined by the determination unit.

[0113] (7) The computer program according to (5) or (6) is characterized in that the user operation of operating the movable point is the following operation: pressing a movable point displayed in the display unit and lightly swiping in the direction of rotating the corresponding part in the pressed state.

[0114] (8) The computer program according to (5) or (6) is characterized in that the user operation of operating the movable point is the following operation: selecting a movable point displayed in the display unit, and after the selection, swiping in the direction to rotate the corresponding part.

[0115] (9) The computer program according to any one of (5) to (8), wherein the receiving unit is capable of receiving a user operation to fix the movable point,

[0116] The determination unit determines the motion of at least one component of the three-dimensional model excluding a component associated with the movable point fixed according to the user operation.

[0117] (10) A computer program according to any one of (5) to (9), characterized in that the computer of the information processing terminal also functions as a notification unit, and when the receiving unit receives a save instruction to save the posture of the edited three-dimensional model, the notification unit notifies an application server that can communicate via a network of the posture information of the edited three-dimensional model and the save request.

[0118] (11) A computer program according to any one of (5) to (10), characterized in that the display control unit rotates and displays the three-dimensional model displayed in the display unit in multiple directions according to a user operation accepted by the acceptance unit.

[0119] (12) An information processing terminal, characterized in that it comprises:

[0120] an accepting unit that accepts a user operation through a screen displayed on a display unit of the information processing terminal; and

[0121] a display control unit that displays a three-dimensional model of the model object on a display unit and displays movable points of the three-dimensional model in an operable manner,

[0122] When the receiving unit receives a switching instruction to switch the number of movable points displayed on the display unit, the display control unit switches and displays the number of movable points displayed on the display unit according to the switching instruction.

[0123] (13) A method for controlling an information processing terminal, comprising the following steps:

[0124] an acceptance step of accepting a user operation through a screen displayed on a display unit of the information processing terminal; and

[0125] a display control step of displaying a three-dimensional model of the model object on a display unit and displaying movable points of the three-dimensional model in an operable manner;

[0126] When a switching instruction to switch the number of movable points displayed on the display unit is received in the receiving step, the number of movable points displayed on the display unit is switched and displayed according to the switching instruction in the display control step.

[0127] Description of Reference Numerals

[0128] 101a, 101b, 101c: information processing terminal; 102: application server; 103: network; 201: CPU; 202: storage unit; 203: communication control unit; 204: display unit; 205: operation unit; 206: camera; 211: CPU; 212: ROM; 213: RAM; 214: display unit; 215: operation unit; 216: communication control unit; 217: HDD.

Claims

1. A computer program, characterized in that Make the computer of the information processing terminal function as the following units: an accepting unit for accepting a user operation through a screen displayed on a display unit of the information processing terminal; as well as a display control unit that displays a three-dimensional model of the model object on a display unit and displays movable points of the three-dimensional model in an operable manner, When the receiving unit receives a switching instruction to switch the number of movable points displayed on the display unit, the display control unit switches and displays the number of movable points displayed on the display unit according to the switching instruction.

2. The computer program according to claim 1, characterized in that The display control unit increases or decreases the number of the movable points step by step according to the switching instruction.

3. The computer program according to claim 2, characterized in that The maximum number of the movable points displayed is the same as the maximum number of movable parts in the real model object corresponding to the three-dimensional model.

4. The computer program according to claim 1, characterized in that The display control unit displays the object representing the movable point so as to overlap with the position of the movable part of the three-dimensional model displayed on the display unit.

5. The computer program according to any one of claims 1 to 4, characterized in that The computer of the information processing terminal is further configured to function as a determining unit, and when the receiving unit receives a user operation to operate the movable point, the determining unit determines the movement of at least one part of the three-dimensional model according to the user operation. The display control unit updates the display of the three-dimensional model according to the movement of the at least one component determined by the determination unit.

6. The computer program according to claim 5, characterized in that The determination unit further determines a movement of a follow-up component, the movement of the follow-up component following the movement of the at least one component determined according to the user operation, The display control unit updates the display of the three-dimensional model according to the movement of the following component in addition to the movement of the at least one component determined by the determination unit.

7. The computer program according to claim 5, characterized in that The user operation for operating the movable point is an operation of pressing one movable point displayed on the display unit and swiping the movable point in a direction in which the corresponding part is rotated while the movable point is pressed.

8. The computer program according to claim 5, characterized in that The user operation for operating the movable point is an operation of selecting one movable point displayed on the display unit and swiping the selected movable point in a direction for rotating the corresponding part.

9. The computer program according to claim 5, characterized in that The receiving unit is capable of receiving a user operation to fix the movable point. The determination unit determines the motion of at least one component of the three-dimensional model excluding a component associated with the movable point fixed according to the user operation.

10. The computer program according to claim 5, characterized in that The computer of the information processing terminal also functions as a notification unit. When the receiving unit receives a save instruction to save the edited posture of the three-dimensional model, the notification unit notifies an application server that can communicate via a network of the posture information of the edited three-dimensional model and the save request.

11. The computer program according to claim 5, characterized in that The display control unit rotates the three-dimensional model displayed on the display unit in a plurality of directions for display according to the user operation accepted by the acceptance unit.

12. An information processing terminal, characterized in that: have: an accepting unit that accepts a user operation through a screen displayed on a display unit of the information processing terminal; and a display control unit that displays a three-dimensional model of the model object on a display unit and displays movable points of the three-dimensional model in an operable manner, When the receiving unit receives a switching instruction to switch the number of movable points displayed on the display unit, the display control unit switches and displays the number of movable points displayed on the display unit according to the switching instruction.

13. A control method for an information processing terminal, characterized in that: Including the following processes: an acceptance step of accepting a user operation through a screen displayed on a display unit of the information processing terminal; as well as a display control step of displaying a three-dimensional model of the model object on a display unit and displaying movable points of the three-dimensional model in an operable manner; When a switching instruction to switch the number of movable points displayed on the display unit is received in the receiving step, the number of movable points displayed on the display unit is switched and displayed according to the switching instruction in the display control step.

Images