Information processing device, image processing device, and computer program

Abstract

Information regarding the appearance of an item is acquired with high precision and made available in a virtual space. An information processing device that generates data for a virtual space from scan information of the exterior of an item acquired by a three-dimensional scanner device receives an operation instruction for first scan information displayed on a first screen for adjusting the coordinate system of first scan information obtained by scanning an item to match the coordinate system of the frame data of the item, and generates data for a virtual space from second scan information and frame data obtained after the operation instruction.

Description

Technology Field

[0001] The present invention relates to an information processing device, an image processing device, and a computer program. Background Technology

[0002] Patent Document 1 describes a technology for generating and utilizing machine information by reading information of a plastic model from each terminal in an online game in which machines within a virtual space are played against each other by two or more terminals connected via a network. Prior art literature

[0003] Japanese Patent Publication No. 2016-087007 The problem to be solved

[0004] In Patent Document 1, information about a plastic model is read in a terminal that performs a game, and it is expected that the precision of the reading will be improved.

[0005] The present invention aims to acquire information regarding the appearance of an article with high precision and make it available for use in a virtual space. means of solving the problem

[0006] The present invention is an information processing device that generates virtual space data usable in a virtual space from scan information of the appearance of an article acquired by a three-dimensional scanner device configured to acquire three-dimensional shape and color information of the article, and comprises a determination means for determining the type of the article, an acquisition means for acquiring frame data that corresponds to the determined type of article and is configured to map texture information obtained from the scan information, a first screen for adjusting a coordinate system set for first scan information generated by scanning the article by the three-dimensional scanner device to a coordinate system set for the frame data, and a display control means for displaying a first screen including a display of the first scan information on a display unit, a receiving means for receiving an instruction including a first operation instruction for at least one of movement and rotation regarding the first scan information displayed on the first screen, second scan information obtained after the display of the first screen is terminated according to the instruction, and a first generating means for generating virtual space data including texture information for mapping onto the frame data from the frame data. Effects of the invention

[0007] According to the present invention, information regarding the appearance of an article can be acquired with high precision and made available for use in a virtual space. Brief explanation of the drawing

[0008] FIG. 1 is a drawing illustrating an example of the configuration of a game system corresponding to an embodiment, and a drawing illustrating an example of the hardware configuration of an information processing device (100). FIG. 2 is a drawing illustrating an example of the appearance of a toy body corresponding to an embodiment. FIG. 3 is a drawing illustrating an example of the appearance of a fixing device for fixing a toy body corresponding to an embodiment. FIG. 4 is a drawing illustrating an example of the data configuration of a data table corresponding to an embodiment. FIG. 5 is a flowchart corresponding to an example of processing for generating game data corresponding to an embodiment. FIG. 6 is a flowchart corresponding to an example of scan processing corresponding to an embodiment. FIG. 7 is a flowchart illustrating an example of game data generation processing corresponding to an embodiment. FIG. 8 is a drawing illustrating an example of a display of an operation screen displayed during game data generation processing corresponding to an embodiment. FIG. 9 is a drawing illustrating another display example of an operation screen displayed during game data generation processing corresponding to an embodiment. FIG. 10 is a flowchart showing an example of game processing corresponding to an embodiment. Specific details for implementing the invention

[0009] Hereinafter, embodiments are described in detail with reference to the attached drawings. Furthermore, the following embodiments do not limit the invention with respect to the patent claims, and not all combinations of features described in the embodiments are essential to the invention. Two or more features among the multiple features described in the embodiments may be arbitrarily combined. Also, identical or similar configurations are assigned the same reference number, and redundant descriptions are omitted. Additionally, in each drawing, the up, down, left, and right front and back directions relative to the surface are used in the description within the text as the up, down, left, and right front and back directions of the component (or part) in this embodiment.

[0010] First, the configuration of a game system corresponding to the present embodiment will be described. FIG. 1 (A) is a drawing illustrating an example of the configuration of a game system (10) corresponding to the present embodiment. The game system (10) is configured such that a scanner (110), a robot arm (120), a turntable (130), and a display device (140) are connected to an information processing device (100).

[0011] The information processing device (100) controls the operation of the scanner (110), robot arm (120), and turntable (130), scans the item to be scanned at any angle to generate three-dimensional data of the item, and generates game data usable in a game by applying the obtained three-dimensional data as a texture to frame data corresponding to the toy body. Additionally, the information processing device (100) can function as a game device that executes game processing using the generated game data, or as an image processing device that generates an image displayed in a virtual space by using the game data as data for a virtual space. The game device or the image processing device may be prepared separately from the information processing device (100). In this embodiment, the item to be scanned is a toy body such as a plastic model or a doll.

[0012] Next, the scanner (110) is a three-dimensional scanner device that, under the control of the information processing device (100), captures (scans) the three-dimensional shape of the toy body to be captured and outputs the three-dimensional shape and color information of the toy body to be captured. In this embodiment, the scan signal output from the scanner (110) is collectively referred to as a "scan image." For example, the Space Spider manufactured by Artec can be used as the scanner (110). In this embodiment, 3D scan data of the entire toy body can be obtained by acquiring, for example, about 500 to 800 frames of scan images.

[0013] The robot arm (120) is a position and posture control device that moves the scanner (110) to a predetermined scan position and posture according to the control of the information processing device (100). For example, the robot arm (120) can use the xArm 7 manufactured by UFACTORY. The xArm 7 consists of 7 joints and can move like a human arm.

[0014] The turntable (130) is a rotating device configured to rotate with a toy loaded thereon under the control of an information processing device (100). In this embodiment, after positioning the scanner (110) at any imaging position and imaging angle by the robot arm (120), the turntable (130) is rotated once to perform a scan. By performing this at multiple imaging positions and imaging angles, 3D scan data of the entire toy is acquired. Furthermore, by driving the turntable (130) and the robot arm (120) in synchronization, the scan processing can be performed more easily and with high precision, which is desirable.

[0015] The display device (140) is a display device such as a liquid crystal display (LCD) and displays 3D scan data acquired by the scanner (110), displays an operation screen as shown in FIG. 8 and FIG. 9, or displays a game screen using generated game data.

[0016] Figure 1 (B) illustrates an example of the hardware configuration of an information processing device (100). The CPU (101) is a device that performs overall control of the information processing device (100) and the calculation, processing, and management of data. Specifically, it controls the timing and number of scan images of the scanner (110) and controls the arm joint of the robot arm (120) to position the scanner (110) at any desired scanning position and scanning angle. In addition, after the scanning position and scanning angle of the scanner (110) are determined, the turntable (130) is rotated to perform a scanning operation by the scanner (110). Furthermore, the CPU (101) can also function as an image processing unit that compresses and encodes a digital image signal output from the scanner (110) to generate image data.

[0017] RAM (102) is a volatile memory and is used as a temporary storage area, such as the main memory or work area of ​​the CPU (101). ROM (103) is a non-volatile memory and stores image data, other data, and various programs for the CPU (101) to operate in a designated area. The CPU (101) controls each part of the information processing device (100) by using RAM (102) as a work memory according to, for example, a program stored in ROM (103). In addition, the program for the CPU (101) to operate is not limited to being stored in ROM (103) but may also be stored in a memory device (104).

[0018] The memory device (104) is composed of a magnetic disk, such as an HDD or flash memory, for example. Application programs, an OS, a control program, related programs, game programs, etc. are stored in the memory device (104). The memory device (104) can read or input data based on the control of the CPU (101). The memory device (104) may be used instead of RAM (102) or ROM (103).

[0019] The communication device (105) is a communication interface for communicating with the scanner (110), robot arm (120), and turntable (130) based on the control of the CPU (101). The communication device (105) may include a wireless communication module, and the module may include a well-known circuit mechanism including an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identification module card, memory, etc. Here, communication between the information processing device (100) and the scanner (110), robot arm (120), and turntable (130) may be performed by wireless communication.

[0020] Additionally, the communication device (105) may include a wired communication module for wired connection. The wired communication module enables communication with another device including a display device (140) through one or more external ports. Additionally, it may include various software components for processing data. The external ports connect with other devices directly or indirectly through a network via Ethernet, USB, IEEE1394, etc. Additionally, it may be configured as a replacement for a hardware device by software that realizes functions equivalent to each of the above devices.

[0021] The control unit (106) is composed of, for example, a button, a keyboard, a touch panel, etc., and receives operation input from a user. The display control unit (107) functions as an interface for displaying information on a display device (140) connected to an information processing device (100), and controls the operation of the display device (140).

[0022] If the game device is provided independently of the information processing device (100), the hardware configuration of the game device can also be made in the same way as (B) of FIG. 1.

[0023] Next, with reference to FIG. 2, an example of a toy body to be scanned in this embodiment will be described. The toy body (200) is a toy body having the appearance of a doll (robot or human). The toy body may be assembled and painted, for example, as a plastic model. The toy body in FIG. 2 is merely an example for illustrative purposes, and the shape of the toy body may not only have the appearance of a doll but may also be a toy body of any shape, such as a general vehicle, a race vehicle, a military vehicle, an aircraft, a ship, an animal, a virtual life form, etc. Furthermore, the item to be scanned is not limited to a toy body as long as it is an item that can be scanned by the scanner (110).

[0024] The toy body (200) has parts including a head part (201), a chest part (202), a right arm part (203), a left arm part (204), a right torso part (205), a left torso part (206), a right leg part (207), a left leg part (208), a right foot part (209), and a left foot part (210), and is constructed by combining these parts. At least some of the individual parts (201 to 210) are supported so as to be rotatable (or oscillating) with respect to adjacent parts. For example, the head part (201) is supported so as to be rotatable with respect to the chest part (202), and the right arm part (203) and the left arm part (204) are supported so as to be rotatable with respect to the chest part (202). In this way, since joint structures are provided in each part of the toy body (200), the toy body (200) can assume any posture. Meanwhile, in order to obtain three-dimensional shape or color information of the outer surface by scanning the toy body (200) with a scanner (110), it is necessary to assume a posture suitable for introducing the three-dimensional shape.

[0025] Accordingly, the posture for scanning the toy body (200) is determined using a fixing device (300) as shown in FIG. 3. The fixing device (300) has parts corresponding to each part of the toy body (200), such as the head part (201), chest part (202), right arm part (203), left arm part (204), right torso part (205), left torso part (206), right leg part (207), left leg part (208), right foot part (209), and left foot part (210). The head fixing part (301) is a member for fixing the head part (201). The chest fixing part (302) is a member for fixing the chest part (202). The right arm fixing part (303) and the left arm fixing part (304) each fix the right arm part (203) and the left arm part (204) so ​​that they are spaced apart from the chest part (202) and extend. Additionally, the right torso fixing part (305) and the left torso fixing part (306) fix the position of the right torso part (205) and the left torso part (206) relative to the chest part (202). The right leg fixing part (307) and the left leg fixing part (208) are members for fixing the right leg part (207) and the left leg part (208) by widening the stride, respectively, and the right foot fixing part (309) and the left leg fixing part (310) are members for fixing the right foot part (209) and the left leg part (210), respectively.

[0026] The fixing member (300) is fixed by covering the toy body (200) from the front side, and after positioning the toy body (200) in a posture corresponding to the shape of the fixing member (300), the toy body is placed on the turntable (130). At that time, a member for fixing the toy is installed on the turntable (130), and after the toy body is installed on said member, the fixing member (300) is removed from the toy body (200). By doing so, the toy body on the turntable (130) can be positioned in a predetermined posture suitable for acquiring a scanned image.

[0027] Although only the fixing device (300) used on the main body of the toy body (200) is shown in FIG. 3, in the case where the toy body (200) has an accessory and the installation angle or shape can be changed while the accessory is installed, a fixing device for fixing the position of the accessory can also be used.

[0028] Next, with reference to FIG. 4, the data structure of various tables stored in the memory device (104) of the information processing device (100) will be described. In the table (400) of FIG. 4 (A), model identification information (402), which is information for specifying the model name based on the appearance of the toy body in relation to the model name (401) of the toy body, fixing device information (403), which specifies the fixing device used, imaging system control information (404) when scanning, and frame data (frame information for mapping the scanned image as a texture) (405) corresponding to the model of the toy body are registered.

[0029] First, the model name (401) is registered with identification information for uniquely identifying a toy body capable of creating game data in this embodiment. The model identification information (402) is information for identifying the model name or type of the toy body from the appearance of the toy body, and, for example, information regarding the shape of a specific part of the toy body may be registered. Specifically, information such as the shape, form, and number of holes of the sole of the toy body is registered, and it is possible to identify the model by processing the image of the sole of the toy body (200) based on the model identification information (402).

[0030] Fixing information (403) contains information for identifying a fixing device installed on a toy body that is determined to be a model registered in the model name (401). The fixing information includes the color, material, shape, and number of the fixing device. The imaging system control information (404) is control information for the CPU (101) to control the operation of the scanner (110), robot arm (120), and turntable (130) for each model during scanning.

[0031] Frame data (405) is template data to which a texture generated from a scanner image introduced by the scanner (110) is mapped. Frame data includes vertex data of each vertex of the model (vertex position coordinates, texture coordinates, color data, normal vector or α value, etc.) and information of the movable joints. A coordinate system is set for each frame data. Frame data is data available in the game (except for the case where no texture is mapped), has an appearance corresponding to various toys, and can be operated in the game just like the structure of the toys. By mapping texture data obtained from a real toy onto the surface of the frame data, it is possible to create an expression in the game that makes it look as if the toy is actually being operated.

[0032] In this embodiment, the external appearance and movable joints differ for each model. For example, in the toy body of Model A, the ankle is movable but the hip joint is fixed, whereas in the toy body of Model B, the ankle is not movable but the hip joint is movable instead. In this case, the frame data (405) corresponding to Model A has the ankle movable but the hip joint fixed, and the frame data (405) corresponding to Model B has the ankle fixed while the hip joint is movable. By including the structural characteristics of the actual toy body in the frame data in this way, the structural characteristics of the toy body are reflected in a game that incorporates the external information of the toy body.

[0033] Next, FIG. 4 (B) shows an example of the configuration of a table (410) that registers information introduced by scanning processing as user-specific registration information. The table (410) registers user information (411), model name (412), scan information (413), and game data (414). User information (411) is information for uniquely identifying the user (or player) who is the owner of the toy introduced by scanning. User information (411) may be used as login information when running a game. The model name (412) is an information that indicates the type of toy owned by the user. The model name (412) corresponds to any one of the information registered as the model name (401) in the table (400).

[0034] Scan information (413) is registered with information of a scanned image obtained by scanning a toy owned by a user registered in username (411). Game data (414) is registered with game data generated based on the scan information (413). The method for generating game data will be described later with reference to the flowchart of FIG. 7.

[0035] Next, with reference to FIG. 5, an example of processing performed by an information processing device (100) corresponding to the present embodiment will be described. At least some of the processing corresponding to the flowchart is realized by the CPU (101) of the information processing device (100) executing a program stored in a ROM (103) or a memory device (104).

[0036] First, in S501, the CPU (101) determines the type of toy body (200). In determining the type, for example, an image of the sole of the toy body (200) is input into the information processing device (100), and the CPU (101) can determine the type of toy, i.e., the model name (401), by processing the image based on the model identification information (402).

[0037] In the subsequent S502, the CPU (101) identifies the corresponding fixture information (403) in the table (400) according to the information of the specified model name (401). At this time, the CPU (101) may display the contents of the identified fixture information (403) on the display device (140) through the display control unit (107). Specifically, information necessary to identify the fixture, such as the color, material, shape, and number of the fixture, can be displayed as meaningful information for identifying the fixture.

[0038] In the subsequent S503, the user of the information processing device (100) selects a fixing device (300) according to the information regarding the displayed fixing device and installs it on the toy body (200). The position of the toy body (200) can be fixed by the fixing device (300). Then, in S504, the user installs the toy body (200) on a fixing member on a turntable and then removes the fixing device (300) from the toy body (200). Additionally, the processes of S503 and S504 may be performed under the control of the CPU (101) using a robot arm, etc., without relying on human means.

[0039] In the following S505, the CPU (101) obtains imaging system control information (404) according to the type of toy body (200) determined in S501 from the table (400), and in S506, performs a scan process to generate scan information (413). In the following S507, the CPU (101) generates game data (414) based on the scan information (413).

[0040] Next, with reference to FIG. 6, details of the scan processing in S506 will be explained. In this embodiment, the imaging control information (404) includes driving information of a robot arm (120) for specifying a scan position and the number of images taken by the scanner (110) at the scan position, which are registered for each scan position. Then, when taking an image at each scan position, the scan is performed by rotating the turntable (130).

[0041] First, in S601, the CPU (101) controls the robot arm (120) to move the scanner (110) to a scan position registered in the image control information (404). In the subsequent S602, the CPU (101) obtains scan information (413) of the toy body (200) by rotating the turntable (130) at the scan position and taking an image of 3D data with the scanner (110). Also, at this time, the turntable (130) may be stopped at a specific rotation position, and the robot arm (120) may be controlled to move the scanner (110) in a vertical direction while scanning the toy body.

[0042] In the subsequent S603, the CPU (101) determines whether there is an unselected scan position in the imaging control information (404), and if there is an unselected scan position, it returns to S601 and continues processing. On the other hand, if there is no unselected scan position, it proceeds to S604. In S604, the CPU (101) stores the scan information obtained above as scan information (413) of the table (410) in the memory device (104) and terminates the scan processing.

[0043] Next, with reference to FIG. 7, the details of the processing of S507, which generates game data (414) based on the scan information obtained in S506, are described. First, in S701, the CPU (101) reads frame data (405) corresponding to the type of a specified toy body from the table (400). In the subsequent S702, the display control unit (107) displays the scan information and frame data (405) on the display device (140), and modifies the position or angle of the scan information so that the scan information is superimposed on the frame data (405). At this time, the CPU (101) may display a guide screen for position alignment of the scan information based on the frame data (405) and determine the position of the scan information by aligning it with the guide screen.

[0044] The processing of S702 is a process for adjusting the coordinate system set for the scan information (which is set during the scan processing and varies according to individual scan information even for toys of the same type) to match the coordinate system of the frame data (405). Since the scan information and the frame data (405) are originally information of toys of the same type, they will be displayed superimposed as they are when displayed in a common coordinate system. However, there may be a slight misalignment in the coordinate system of the scan information generated by the scan processing, and due to the influence of this misalignment, a misalignment occurs with respect to the frame data (405) even when displayed in a common coordinate system. In S702, the scan information itself is moved or rotated to adjust this misalignment of the coordinate system.

[0045] FIG. 8 illustrates an example of a guide screen displayed on a display device (140) during processing in S702. FIG. 8 (A) shows an example of an operation panel (800) in the guide screen. On the operation panel (800), "top," "side," and "front" are displayed for the display direction to set which direction the scan information is to be viewed (display direction), and if "top" is selected, a display screen (810) as shown in FIG. 8 (B) is displayed. On the display screen (810), an image of the scan information (811) of the toy body (200) is displayed from the top, that is, the head part (201) of the toy body (200) is viewed from the top. At this time, the corresponding outline position of the frame data (405) with respect to the scan information (811) is indicated as guide information (812). By moving and rotating the position of the scan information (811) so that the chest contour of the guide information (812) and the scan information (811) match, the scan information (811) can be superimposed on the frame data (405).

[0046] In the example of FIG. 8, since the scan information (811) is rotated counterclockwise and offset upward in FIG. 8 (B), by moving the scan information (811) downward with the cross key button and rotating it with the clockwise rotation button, the chest contour of the scan information (811) matches the guide information (812) as shown in FIG. 8 (C).

[0047] By aligning the positions in the same way for the "side" or "front" other than the top surface, it becomes possible to superimpose the scan information (811) onto the frame data. For example, when "side" is selected, guide information for the side of the lumbar region can be displayed to align the scan information (811). Also, when "front" is selected, guide information for the front of the chest and lumbar region can be displayed to align the scan information (811). In the above, position alignment is performed when there is a misalignment between the scan information (811) and the guide information. Naturally, depending on the scanning method, there may be cases where no misalignment occurs, so in such cases, an operation instruction to correct the misalignment becomes unnecessary. After the above position alignment processing is completed (or may be completed without an operation instruction), if the "Complete" button is operated, the display of the guide screen of FIG. 8 ends, and the processing in S702 also ends.

[0048] Returning to the description of FIG. 7, once the position and angle adjustment of the scan information is completed in S702, the processing proceeds to S703, and the CPU (101) superimposes a pre-prepared image onto a location corresponding to the deformation part of the toy body. S703 is a process for determining the location where game data (image) is superimposed onto the scan information. The superimposed location may be a pre-set location in the frame data (405) corresponding to the type of toy body, or it may be determined based on a designation received on the scan information using the guide screen of FIG. 9. The deformation part of the toy body refers to a movable part such as a joint part that bends and folds, such as the knee or elbow of the toy body. In this embodiment, since scan information is acquired while the arms or legs of the toy body are extended, if the joint part obtained in this way is displayed as bending or extending during the game, the way the joint part is displayed becomes unnatural. Therefore, for the deformation (movable) location such as the joint part, joint data corresponding to the deformation prepared in advance for each type of toy body is superimposed and used. In this embodiment, regarding the deformed parts of the toy body's structure, a pre-prepared image corresponding to the deformation is superimposed and displayed on top of texture data obtained from scan information. However, this is not limited to this, and there may be cases where texture data obtained from scan information is not used.

[0049] FIG. 9 illustrates an example of a guide screen when joint data is superimposed on scan information. The screen (900) in FIG. 9 (A) illustrates an example of an operation panel (900) in the guide screen. The operation panel (900) displays a selection button for specifying which joint position in the scan information of the toy body the joint data will be superimposed on, and FIG. 9 (A) illustrates the state in which the selection button (901) at the top left is selected. That is, the right arm portion of the toy body is selected, and FIG. 9 (B) illustrates the display screen (910) of the scan information at this time. Joint data (912) is superimposed on the right arm joint portion of the scan information (911). However, in (B) of FIG. 9, since the angle of the right arm and the joint data (912) does not match, the position of the joint data (912) on the right arm of the scan information (911) can be determined by operating the counterclockwise rotation button of the control panel (900) as shown in (C) of FIG. 9. Additionally, the joint data (912) may be prepared for each model of the toy body, or one joint data (912) may be used commonly for multiple models. In the above, the position alignment of the scan information (911) and the joint data (912) is performed when there is a misalignment between the two. Naturally, depending on the scanning method, there may be cases where no misalignment occurs, so in such cases, an operation instruction to correct the misalignment becomes unnecessary. After the above position alignment processing is completed (it may be completed without an operation instruction), if the “Complete” button is operated, the display of the guide screen of FIG. 9 ends, and the processing in S703 also ends.

[0050] In the subsequent S704, the CPU (101) generates game data. Specifically, the CPU (101) generates texture information for mapping to frame data based on the scan information generated by the processing described above, and stores the said texture information in the memory device (104) as game data (414) of the table (410) in relation to the texture coordinates when mapping the said texture information onto the frame data. The CPU (101) also includes information on the position for mapping the joint data determined in S703 in the game data. The information on the mapping position is a position pre-set in the frame data (405) corresponding to the type of toy body, or a position determined based on the designation received on the scan information using the guide screen of FIG. 9. By doing the above, game data (414) can be generated.

[0051] In addition, in the above, the position and orientation of the scanner (110) are controlled using a robot arm (120), but the position determination may be performed manually instead of using a robot arm (120).

[0052] Next, FIG. 10 illustrates an example of processing when running a game using game data generated by the processing described above. At least some of the processing corresponding to the flowchart is realized by the CPU (101) of the information processing device (100) executing a program stored in the ROM (103) or memory device (104).

[0053] First, in S1001, the CPU (101) receives a user selection. For example, it displays an input screen on a display device (140) and receives input of user information. The user information may be a set of a login name and a password. This information is registered in a table (410) as user information (411).

[0054] When a user is identified by the information input in S1001, in the subsequent S1002, the CPU (101) reads information about game data (414) registered in relation to the user from the table (410) and displays it on the display device (140). In this embodiment, it is possible to register multiple game data for one user, and if multiple game data (414) are registered, their icon images, etc. are displayed on the display device (140) to receive a selection from the user. When game data (414) is selected, the processing proceeds to S1003 and game processing begins. The game can be an online or offline battle type game in which characters (robots, people, vehicles, aircraft, etc.) generated from game data are battled on a predetermined field within a virtual space, for example. The opponent may be a CPU of a game device, etc., or another user. In addition, the type of game is not limited to fighting games, but can be applied to various games such as simulation games, role-playing games, and adventure games. Also, if multiple people participate in the game, S1001 and S1002 are repeated as many times as the number of people, and then S1003 is executed.

[0055] In S1003, a game character is created by mapping texture information included in the game data (414) to frame data (405) corresponding to the selected game data (414). At that time, for the movable part specified in S703 of FIG. 7, an overlapping image according to the pose of the game character is created and used based on data of a pre-prepared joint model that is superimposed on the texture information included in the game data (414). By doing so, a more natural expression becomes possible when the joint part bends. Furthermore, in the description of the above-described embodiment, a case was described in which game data is created based on information regarding the appearance of a toy body for use in a game performed in a virtual space. However, the use of the game data created in this embodiment is not limited to games; by using it as data for a virtual space, it can be used to create images displayed in a virtual space and can be widely applied to processing that operates a character in a virtual space. For example, it is possible to have the character appear in events, concerts, sports, online meetings, etc., held in a virtual space. Furthermore, the technology of the present embodiment may be applied to video technology that fuses the real world and the virtual world, such as cross-reality (XR), to make it possible to perceive things that do not exist in real space.

[0056] In this way, in the present embodiment, information on the appearance of a toy body is obtained, and texture information is generated from said appearance information and mapped to frame data so that it can be used as a character for a game in a game or any virtual space. The toy body may be finished as a unique work by the user, such as by painting, for example, a plastic model, and since its individuality can be reflected in the character expression in the game or virtual space, its likeability can be significantly improved.

[0057] The invention is not limited to the above embodiments, and various modifications and changes are possible within the scope of the gist of the invention.

Claims

Claim 1 An information processing device for generating virtual space data usable in a virtual space from scan information of the appearance of an item acquired by a three-dimensional scanner device configured to acquire three-dimensional shape and color information of an item, comprising: a determination means for determining the type of the item; an acquisition means for acquiring frame data that corresponds to the item of the determined type and is configured to map texture information obtained from the scan information; a first screen for adjusting a coordinate system set for first scan information generated by scanning the item by the three-dimensional scanner device to match a coordinate system set for the frame data, and a display control means for displaying a first screen including a display of the first scan information on a display unit; a receiving means for receiving an instruction including a first operation instruction for at least one of movement and rotation regarding the first scan information displayed on the first screen; a second scan information obtained after the display of the first screen is terminated according to the instruction; and a first generating means for generating virtual space data including texture information for mapping onto the frame data from the frame data. Claim 2 In claim 1, the first screen includes a display of the first scan information corresponding to a part of any of the articles and a display indicating the position of the part in the frame data, and the receiving means receives an operation instruction to match the display position of the first scan information of the part with the display position of the position of the part, an information processing device. Claim 3 In paragraph 2, the first screen includes a switching operation unit for switching the display direction of the first scan information, and an information processing device that displays the first scan information of a part of any of the articles and the position of said part in the frame data in the display direction according to the selected switching operation unit. Claim 4 An information processing device according to any one of claims 1 to 3, wherein the first generating means generates data for the virtual space such that it includes location information of an image superimposed on the second scan information corresponding to a predetermined location of the article. Claim 5 An information processing device according to any one of claims 1 to 3, wherein the display control means further displays a second screen for adjusting the position of an image superimposed on the first scan information corresponding to a predetermined location of the article on the display unit, the receiving means can also receive a second operation instruction of at least one of movement and rotation for the image displayed on the second screen, and the first generating means generates data for the virtual space such that it further includes position information of the image according to the second operation instruction. Claim 6 In paragraph 4, the above-mentioned designated location is an information processing device that is a movable part of the above-mentioned article. Claim 7 In paragraph 6, an information processing device in which, when the above article is a toy body of a doll, the above movable part is a joint part. Claim 8 An information processing device having further a selection means for selecting a fixture that defines the posture of the article when scanned by the three-dimensional scanner device based on the determined type of the article in any one of claims 1 to 3. Claim 9 In claim 8, the first scan information is an information processing device generated by scanning the article by the three-dimensional scanner device in a position determined by the fixing device. Claim 10 An information processing device according to any one of claims 1 to 3, wherein the three-dimensional scanner device is installed therein and further comprises a position and attitude control device for controlling the position and attitude of the three-dimensional scanner device, and wherein the first scan information is generated by scanning the article by the three-dimensional scanner device at a predetermined position and attitude installed by the position and attitude control device. Claim 11 An information processing device according to any one of claims 1 to 3, further comprising a rotating device configured to be rotatably loaded with the article, wherein the first scan information is generated by scanning the article loaded with the rotating device by the three-dimensional scanner device. Claim 12 In any one of paragraphs 1 to 3, the determination means is an information processing device that determines the type of the article based on information of a predetermined part of the article. Claim 13 In Clause 12, an information processing device in which, when the above article is a toy body of a doll, the above-mentioned specific part is the sole of the foot. Claim 14 An image processing device that generates an image displayed in a virtual space using data for a virtual space generated by an information processing device described in paragraph 4, and comprises a second generating means for generating display information of a predetermined character corresponding to the item by mapping texture information included in the data for the virtual space to frame data, wherein the second generating means generates the display information to display a predetermined superimposed image other than the texture information included in the data for the virtual space at a location corresponding to a predetermined place of the item of the display information of the character, based on the location information included in the data for the virtual space. Claim 15 In paragraph 14, the image processing device wherein the superimposed image is an image common to multiple types of the above-mentioned article. Claim 16 In paragraph 14, the image processing device wherein the superimposed image is an image unique to the type of article. Claim 17 A computer-readable recording medium having a computer program for operating a computer as each means of an information processing device described in any one of paragraphs 1 to 3. Claim 18 A computer-readable recording medium having a computer program for operating a computer as each means of the image processing device described in paragraph 14.

Images