Information processing device and computer program

Abstract

To provide an information processor which acquires information of appearance of an article with high precision for use in a virtual space.SOLUTION: An information processor creates data for virtual space from scanned information of appearance of an article acquired by a three-dimensional scanner. The information processor receives an operation guidance for first scanned information displayed on a first image plane so as to adjust the coordinate system of first scanned information acquired by scanning the article to the coordinate system of frame data of the article, and creates data for virtual space from second scanned information acquired after the operation guidance and the frame data.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an image processing apparatus, and a computer program.

Background Art

[0002] Patent Document 1 describes a technique for generating and using aircraft information by reading information on a plastic model at each terminal in an online game in which aircraft in a virtual space operated by two or more terminals connected via a network compete against each other.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In Patent Document 1, the information on the plastic model is read at the terminal where the game is executed, and it is expected to improve the accuracy of reading.

[0005] An object of the present invention is to accurately acquire information related to the appearance of an article and make it available in a virtual space.

Means for Solving the Problems

[0006] The present invention relates to an information processing device that generates virtual space data usable in a virtual space from scan information of the appearance of an article acquired by a three-dimensional scanner device configured to acquire the three-dimensional shape and color information of the article, comprising: determination means for determining the type of article; acquisition means for acquiring frame data corresponding to the determined type of article, which is configured to map texture information obtained from the scan information; display control means for displaying a first screen on a display unit, which is a first screen for adjusting the coordinate system set for first scan information generated by scanning the article with the three-dimensional scanner device to match the coordinate system set for the frame data, and which includes the display of the first scan information; reception means capable of receiving instructions including at least one first operation instruction of movement and rotation for the first scan information displayed on the first screen; and first generation means for generating virtual space data including texture information for mapping onto the frame data from second scan information obtained after the display of the first screen has ended in response to the instruction and the frame data. Furthermore, the present invention is an information processing device that generates virtual space data usable in a virtual space from scan information of the appearance of an article acquired by a three-dimensional scanner device, comprising: acquisition means for acquiring frame data corresponding to the type of article, which is configured to map texture information obtained from the scan information; first generation means for generating second scan information by adjusting the coordinate system set for first scan information generated by scanning the article with the three-dimensional scanner device to match the coordinate system of the frame data; and second generation means for generating virtual space data including texture information for mapping onto the frame data from the second scan information and the frame data, wherein the first generation means, upon receiving a first operation instruction of at least one of movement and rotation for the first scan information, performs the adjustment in accordance with the first operation instruction. i) The second generation means generates the virtual space data so as to include positional information of an image superimposed on the second scan information corresponding to a predetermined location of the article. . [Effects of the Invention]

[0007] According to the present invention, information regarding the appearance of an article can be acquired with high accuracy and made available for use in a virtual space. [Brief explanation of the drawing]

[0008] [Figure 1] A diagram showing an example configuration of a game system corresponding to the embodiment, and a diagram showing an example of the hardware configuration of the information processing device 100. [Figure 2] A diagram showing an example of the appearance of a toy body corresponding to an embodiment. [Figure 3] A diagram showing an example of the appearance of a fastener used to secure a toy body corresponding to an embodiment. [Figure 4] A diagram showing an example of the data structure of a data table corresponding to an embodiment. [Figure 5] A flowchart illustrating an example of the process for generating game data corresponding to the embodiment. [Figure 6] A flowchart corresponding to an example of the scanning process corresponding to the embodiment. [Figure 7] A flowchart showing an example of the game data generation process corresponding to the embodiment. [Figure 8] This figure shows an example of the operation screen displayed during the game data generation process corresponding to the embodiment. [Figure 9] This figure shows another example of the operation screen displayed during the game data generation process corresponding to the embodiment. [Figure 10] A flowchart showing an example of game processing corresponding to the embodiment. [Modes for carrying out the invention]

[0009] The embodiments will be described in detail below with reference to the attached drawings. Note that the following embodiments do not limit the invention as defined in the claims, and not all combinations of features described in the embodiments are essential to the invention. Two or more of the features described in the embodiments may be arbitrarily combined. Also, identical or similar configurations will be given the same reference numeral, and redundant descriptions will be omitted. Furthermore, in each figure, the top, bottom, left, right, front, and back directions relative to the paper will be used as the top, bottom, left, right, front, and back directions of the parts (or components) in this embodiment, and will be used in the descriptions within the text.

[0010] First, the configuration of the game system corresponding to this embodiment will be described. Figure 1(A) is a diagram showing an example of the configuration of the game system 10 corresponding to this embodiment. The game system 10 is configured by connecting an information processing device 100, a scanner 110, a robot arm 120, a turntable 130, and a display device 140.

[0011] The information processing device 100 controls the operation of the scanner 110, robot arm 120, and turntable 130, scans the object to be scanned from any angle to generate three-dimensional data of the object, and applies the obtained three-dimensional data as a texture to frame data corresponding to a toy body to generate game data usable in a game. The information processing device 100 can also function as a game device that executes game processing using the generated game data, or as an image processing device that generates images displayed in a virtual space by using the game data as virtual space data. The game device and image processing device may be provided separately from the information processing device 100. In this embodiment, the object to be scanned is a toy body such as a plastic model or a doll.

[0012] Next, the scanner 110 is a three-dimensional scanner device that captures (scans) the three-dimensional shape of the target toy to be imaged according to the control of the information processing apparatus 100 and outputs the three-dimensional shape and color information of the target. In the present embodiment, the scan signals output from the scanner 110 are collectively referred to as "scan images". For the scanner 110, for example, Space Spider manufactured by Artec can be used. In the present embodiment, for example, by acquiring about 500 to 800 frames of scan images, 3D scan data of the entire toy can be obtained.

[0013] The robot arm 120 is a position and orientation control device that moves the scanner 110 to a predetermined scan position and orientation according to the control of the information processing apparatus 100. For the robot arm 120, for example, xArm 7 manufactured by UFACTORY can be used. xArm7 consists of seven joints and can move in the same way as a human arm.

[0014] The turntable 130 is a rotating device configured to be rotatable in a state where the toy is placed according to the control of the information processing apparatus 100. In the present embodiment, after the scanner 110 is positioned at an arbitrary imaging position and imaging angle by the robot arm 120, the turntable 130 is rotated one full turn for scanning. By performing this at a plurality of imaging positions and imaging angles, 3D scan data of the entire toy can be obtained. Here, it is preferable to drive the turntable 130 and the robot arm 120 synchronously so that the scanning process can be performed more simply and with higher accuracy.

[0015] The display device 140 is a display device such as a liquid crystal display (LCD), and displays the 3D scan data acquired by the scanner 110, an operation screen as shown in FIGS. 8 and 9, or a game screen using the generated game data.

[0016] FIG. 1(B) shows an example of the hardware configuration of the information processing apparatus 100. The CPU 101 is a device that performs overall control of the information processing apparatus 100 and calculates, processes, and manages data. Specifically, it controls the imaging timing and the number of imaging of the scanned image in the scanner 110, and controls the joints of the arm of the robot arm 120 to arrange the scanner 110 at an arbitrary imaging position and imaging angle. Further, after the imaging position and imaging angle of the scanner 110 are determined, the turntable 130 is rotated to perform a scanning operation by the scanner 110. Also, the CPU 101 can function as an image processing unit that compresses and encodes the digital image signal output from the scanner 110 to generate image data.

[0017] The RAM 102 is a volatile memory and is used as a temporary storage area such as the main memory and work area of the CPU 101. The ROM 103 is a non-volatile memory, and image data, other data, various programs for the operation of the CPU 101, etc. are stored in respective predetermined areas. The CPU 101 controls each part of the information processing apparatus 100 using the RAM 102 as a work memory according to a program stored in the ROM 103, for example. Note that the program for the operation of the CPU 101 is not limited to being stored in the ROM 103 and may be stored in the storage device 104.

[0018] The storage device 104 is constituted by a magnetic disk such as an HDD or a flash memory, for example. Application programs, an OS, control programs, related programs, game programs, etc. are stored in the storage device 104. The storage device 104 can read and write data based on the control of the CPU 101. The storage device 104 may be used instead of the RAM 102 or the ROM 103.

[0019] The communication device 105 is a communication interface for communicating with the scanner 110, robot arm 120, and turntable 130 based on the control of the CPU 101. The communication device 105 may include a wireless communication module, which may include well-known circuit mechanisms such as an antenna system, RF transceiver, one or more amplifiers, tuners, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identification module card, and memory. Here, communication between the information processing device 100 and the scanner 110, robot arm 120, and turntable 130 may be performed by wireless communication.

[0020] Furthermore, the communication device 105 may also include a wired communication module for wired connection. The wired communication module enables communication with other devices, including the display device 140, via one or more external ports. It may also include various software components for processing data. The external ports connect to other devices directly or indirectly via a network, such as via Ethernet, USB, or IEEE 1394. It should be noted that software that achieves equivalent functionality to the above devices can also be used as a substitute for the hardware devices.

[0021] The operation unit 106 consists of, for example, buttons, a keyboard, a touch panel, etc., and accepts user input. The display control unit 107 functions as an interface for displaying information on the display device 140 connected to the information processing device 100, and controls the operation of the display device 140.

[0022] If the game device is provided independently of the information processing device 100, the hardware configuration of the game device can be the same as that shown in Figure 1(B).

[0023] Next, with reference to Figure 2, an example of a toy body to be scanned in this embodiment will be described. The toy body 200 is a toy body having the appearance of a doll (robot or human). This toy body can be assembled and painted, for example, as a plastic model. The toy body in Figure 2 is merely an example for illustrative purposes, and the shape of the toy body is not limited to having the appearance of a doll, but can be any shape, such as a general vehicle, racing car, military vehicle, aircraft, ship, animal, virtual life form, etc. It should be noted that the item to be scanned is not limited to a toy body as long as it is an item that can be scanned by the scanner 110.

[0024] The toy body 200 has the following parts: head 201, chest 202, right arm 203, left arm 204, right torso 205, left torso 206, right leg 207, left leg 208, right foot 209, and left foot 210, which are joined together to form the toy body. At least a portion of each individual part 201-210 is supported so as to be rotatable (or swingable) relative to an adjacent part. For example, the head 201 is supported so as to be rotatable relative to the chest 202, and the right arm 203 and left arm 204 are supported so as to be rotatable relative to the chest 202. In this way, each part of the toy body 200 is provided with a joint structure, so that the toy body 200 can assume any posture. On the other hand, in order to scan the toy body 200 with the scanner 110 to obtain the three-dimensional shape and color information of its outer surface, it is necessary to assume a posture suitable for capturing the three-dimensional shape.

[0025] Therefore, the posture of the toy body 200 when scanning is determined using a fixing device 300 as shown in Figure 3. The fixing device 300 has parts corresponding to each part of the toy body 200: the head 201, chest 202, right arm 203, left arm 204, right torso 205, left torso 206, right leg 207, left leg 208, right foot 209, and left foot 210. The head fixing part 301 is a member for fixing the head 201. The chest fixing part 302 is a member for fixing the chest 202. The right arm fixing part 303 and the left arm fixing part 304 fix the right arm 203 and the left arm 204 respectively so that they extend away from the chest 202. Furthermore, the right torso fixing part 305 and the left torso fixing part 306 fix the positions of the right torso part 205 and the left torso part 206 relative to the chest part 202. The right leg fixing part 307 and the left leg fixing part 208 are members for fixing the right leg part 207 and the left leg part 208 with a stride width apart, respectively, and the right foot fixing part 309 and the left leg fixing part 310 are members for fixing the right foot part 209 and the left leg part 210, respectively.

[0026] The fixing device 300 is placed over the front of the toy body 200 to secure it, and after the toy body 200 is positioned to match the shape of the fixing device 300, the toy body is placed on the turntable 130. At this time, a member for fixing the toy is installed on the turntable 130, and after attaching the toy body to this member, the fixing device 300 is removed from the toy body 200. This allows the toy body on the turntable 130 to be positioned in a predetermined position suitable for acquiring a scanned image.

[0027] Figure 3 shows only the fastener 300 used for the main body of the toy 200. However, if the toy 200 has accessories and the mounting angle and shape of the accessories can be changed when they are attached, a fastener for fixing the position of the accessories can also be used.

[0028] Next, with reference to Figure 4, the data structure of the various tables stored in the storage device 104 of the information processing device 100 will be described. In the table 400 of Figure 4(A), the following information is registered: model identification information 402, which is information for identifying the model name of the toy body based on the appearance of the toy body, associated with the model name 401 of the toy body; fixing device information 403, which identifies the fixing device to be used; imaging system control information 404 when scanning; and frame data 405 corresponding to the model of the toy body (frame information for mapping the scanned image as a texture).

[0029] First, in this embodiment, model name 401 is registered with identification information to uniquely identify a toy body from which game data can be created. Model identification information 402 is information for identifying the model name or type of the toy body from its appearance, and may include, for example, information regarding the shape of a specific part of the toy body. Specifically, information such as the shape, pattern, and number of holes on the soles of the toy body's feet is registered, and the model can be identified by processing an image of the soles of the toy body 200's feet based on the model identification information 402.

[0030] The fixing device information 403 contains information for identifying a fixing device to be attached to a toy body whose type has been determined to be the model registered in the model name 401. The fixing device information includes the color, material, shape, and fixing device number of the fixing device. The imaging system control information 404 is control information for the CPU 101 to control the operation of the scanner 110, robot arm 120, and turntable 130 for each model during scanning.

[0031] Frame data 405 is template data to which textures generated from scanner images captured by scanner 110 are mapped. The frame data includes vertex data for each vertex of the model (vertex position coordinates, texture coordinates, color data, normal vector or alpha value, etc.) and information on movable joints. Each frame data has its own set coordinate system. The frame data is usable in the game (except for the lack of texture mapping), has an appearance corresponding to various toy bodies, and can be operated in the game in the same way as the structure of a real toy body. By mapping texture data obtained from a real toy body onto the surface of the frame data, it becomes possible to represent the toy body in the game as if it were actually being manipulated.

[0032] In this embodiment, the external shape and movable joints differ for each model. For example, in toy model A, the ankle is movable but the hip joint is fixed, while in toy model B, the ankle is not movable but the hip joint is movable. In this case, frame data 405 corresponding to model A will show that the ankle is movable but the hip joint is fixed, while frame data 405 corresponding to model B will show that the ankle is fixed but the hip joint is movable. By including the structural characteristics of the actual toy body in the frame data in this way, the structural characteristics of the toy body will be reflected in the game that incorporates the external appearance information of the toy body.

[0033] Next, Figure 4(B) shows an example of the configuration of table 410, which registers information captured by the scanning process as user-specific registration information. Table 410 registers user information 411, model name 412, scan information 413, and game data 414. User information 411 is information to uniquely identify the user (or player) who owns the toy body captured by scanning. User information 411 may also be used as login information when running the game. Model name 412 registers information indicating the type of toy body owned by the user. Model name 412 corresponds to one of the pieces of information registered as model name 401 in table 400.

[0034] Scan information 413 contains information about scanned images obtained by scanning a toy owned by the user registered under username 411. Game data 414 contains game data generated based on the scan information 413. The method for generating game data will be described later with reference to the flowchart in Figure 7.

[0035] Next, with reference to Figure 5, an example of processing performed by the information processing device 100 corresponding to this embodiment will be described. At least a part of the processing corresponding to the flowchart is realized by the CPU 101 of the information processing device 100 executing a program stored in the ROM 103 or the storage device 104.

[0036] First, in S501, the CPU 101 determines the type of toy body 200. In determining the type, for example, an image of the sole of the toy body 200 is input to the information processing device 100, and the CPU 101 processes the image based on the model identification information 402 to identify the type of toy, i.e., the model name 401.

[0037] In the subsequent S502, the CPU 101 identifies the corresponding fixture information 403 in the table 400 according to the information of the identified model name 401. At this time, the CPU 101 may display the contents of the identified fixture information 403 on the display device 140 via the display control unit 107. Specifically, information necessary to identify the fixture, such as the color, material, shape, and fixture number of the fixture, can be displayed.

[0038] In the following step S503, the user of the information processing device 100 selects the fixing device 300 according to the information about fixing devices displayed and attaches it to the toy body 200. The fixing device 300 can fix the posture of the toy body 200. After that, in S504, the user attaches the toy body 200 to the fixing member on the turntable and then removes the fixing device 300 from the toy body 200. Note that steps S503 and S504 may be performed by the control of the CPU 101 using a robotic arm or the like, without relying on human means.

[0039] In the following step S505, the CPU 101 obtains imaging system control information 404 from the table 400 corresponding to the type of toy body 200 determined in S501, and in S506 executes a scan process to generate scan information 413. In the following step S507, the CPU 101 generates game data 414 based on the scan information 413.

[0040] Next, with reference to Figure 6, the details of the scanning process in S506 will be explained. In this embodiment, the imaging control information 404 contains drive information for the robot arm 120 to identify the scan position, and the number of scans taken by the scanner 110 at that scan position is registered for each scan position. When imaging is performed at each scan position, the scan is carried out by rotating the turntable 130.

[0041] First, in S601, the CPU 101 controls the robot arm 120 to move the scanner 110 to one of the scan positions registered in the imaging control information 404. In the subsequent S602, the CPU 101 rotates the turntable 130 at the scan position and captures 3D data with the scanner 110 to acquire scan information 413 of the toy body 200. Alternatively, the turntable 130 may be stopped at a specific rotation position, and the robot arm 120 may be controlled to move the scanner 110 vertically while scanning the toy body.

[0042] In the subsequent S603, the CPU 101 determines whether there are any unselected scan positions in the imaging control information 404. If there are unselected scan positions, it returns to S601 and continues processing. On the other hand, if there are no unselected scan positions, it proceeds to S604. In S604, the CPU 101 stores the scan information obtained above as scan information 413 in table 410 in the storage device 104, and terminates the scan process.

[0043] Next, referring to Figure 7, the details of the process in S507 that generates game data 414 based on the scan information obtained in S506 will be explained. First, in S701, the CPU 101 reads frame data 405 corresponding to the identified toy type from the table 400. In the following S702, the display control unit 107 displays the scan information and frame data 405 on the display device 140 and corrects the position and angle of the scan information so that the scan information is superimposed on the frame data 405. At this time, the CPU 101 may also display a guide screen for aligning the scan information based on the frame data 405 and position the scan information according to the guide screen.

[0044] The S702 process adjusts the coordinate system set for the scan information (which is set during the scanning process and can vary depending on the individual scan information, even for toys of the same type) to match the coordinate system of the frame data 405. Since the scan information and frame data 405 are originally information for toys of the same type, they should be displayed superimposed on each other when displayed in a common coordinate system. However, there may be a slight discrepancy in the coordinate system of the scan information generated by the scanning process, and this discrepancy causes a shift in the frame data 405 when displayed in a common coordinate system. In S702, the scan information itself is moved or rotated to adjust for this shift in the coordinate system.

[0045] Figure 8 shows an example of a guide screen displayed on the display device 140 during processing in S702. Figure 8(A) shows an example of the operation panel 800 on the guide screen. The operation panel 800 displays "Top," "Side," and "Front" as display directions for setting the direction from which to view the scan information (display direction). When "Top" is selected, the display screen 810 shown in Figure 8(B) is displayed. The display screen 810 displays an image of the scan information 811 of the toy body 200 viewed from above, that is, the head 201 of the toy body 200 viewed from above. At this time, the guide information 812 indicates the corresponding contour position of the frame data 405 relative to the scan information 811. By moving and rotating the position of the scan information 811 so that the guide information 812 and the contour line of the chest of the scan information 811 match, the scan information 811 can be superimposed on the frame data 405.

[0046] In the example shown in Figure 8, the scan information 811 is shifted upwards in Figure 8(B) and rotated counterclockwise. By moving the scan information 811 downwards using the directional pad buttons and rotating it clockwise using the rotation button, the chest contour of the scan information 811 will match that of the guide information 812, as shown in Figure 8(C).

[0047] By performing similar alignment on the "sides" and "front" in addition to the top view, it becomes possible to superimpose the scan information 811 onto the frame data. For example, if "side" is selected, the guide information for the side of the waist can be displayed to align the scan information 811. If "front" is selected, the guide information for the front of the chest and waist can be displayed to align the scan information 811. In the above, alignment should be performed if there is a discrepancy between the scan information 811 and the guide information. Depending on the scanning method, there may be cases where no discrepancy occurs, in which case no instructions are needed to correct the discrepancy. After the above alignment process is completed (it may be completed without instructions), pressing the "Complete" button will end the display of the guide screen in Figure 8, and the processing in S702 will also end.

[0048] Returning to the explanation of Figure 7, once the adjustment of the position and angle of the scan information is completed in S702, the process proceeds to S703, where the CPU 101 superimposes a pre-prepared image onto the area corresponding to the deformation part of the toy body. S703 is a process to determine the position where the game data (image) is superimposed on the scan information. This superposition position may be a position pre-set in the frame data 405 corresponding to the type of toy body, or it may be determined based on the specification received on the scan information using the guide screen in Figure 9. The deformable parts of the toy body are the movable parts such as the knees and elbows, which are joints that bend. In this embodiment, since scan information is obtained with the arms and legs of the toy body extended, if the joints obtained in this way are then displayed as bent or extended during the game, the appearance of the joints will be unnatural. Therefore, for the deformable (movable) parts such as the joints, pre-prepared joint data corresponding to the deformation is superimposed for each type of toy body. In this embodiment, for the deformable parts of the toy body structure, pre-prepared images corresponding to the deformation are displayed on top of the texture data obtained from the scan information. However, this is not the only method, and it is also possible not to use texture data obtained from the scan information.

[0049] Figure 9 shows an example of a guide screen when superimposing joint data onto scan information. The screen 900 in Figure 9(A) shows an example of the operation panel 900 on the guide screen. The operation panel 900 displays selection buttons for specifying which joint position in the toy body's scan information the joint data should be superimposed on. In Figure 9(A), the upper left selection button 901 is selected. That is, the right arm of the toy body is selected, and the scan information display screen 910 at this time is shown in Figure 9(B). The joint data 912 is superimposed on the right arm joint of the scan information 911. However, in Figure 9(B), the angle between the right arm and the joint data 912 does not match, so the position of the joint data 912 on the right arm of the scan information 911 can be determined by operating the counterclockwise rotation button on the operation panel 900, as shown in Figure 9(C). Note that the joint data 912 may be prepared for each toy body model, or one joint data 912 may be used in common for multiple models. In the above, alignment between scan information 911 and joint data 912 should only be performed if there is a misalignment between them. Depending on the scanning method, it is possible that no misalignment will occur, in which case no instructions for correcting the misalignment are necessary. After the above alignment process is completed (it may be completed without any instructions), pressing the "Complete" button will end the display of the guide screen in Figure 9, and the process in S703 will also end.

[0050] In the subsequent S704, the CPU 101 generates game data. Specifically, the CPU 101 generates texture information for mapping to frame data based on the scan information generated by the above process, associates this texture information with texture coordinates when mapping it onto the frame data, and stores it in the storage device 104 as game data 414 in table 410. The CPU 101 also includes information on the position to which the joint data determined in S703 will be mapped in the game data. The mapping position information is either a position pre-set in the frame data 405 corresponding to the type of toy body, or a position determined based on the specification received on the scan information using the guide screen in Figure 9. Thus, game data 414 can be generated.

[0051] In the above description, the position and orientation of the scanner 110 were controlled using the robot arm 120, but manual positioning may be performed instead of using the robot arm 120.

[0052] Next, Figure 10 illustrates an example of the process when running a game using the game data generated by the process described above. At least a part of the process corresponding to this flowchart is realized by the CPU 101 of the information processing device 100 executing programs stored in the ROM 103 and the storage device 104.

[0053] First, in S1001, the CPU 101 accepts user selection. For example, it displays an input screen on the display device 140 and accepts user information. User information may be a set of login name and password. This information is registered in table 410 as user information 411.

[0054] In S1001, once the user is identified based on the input information, in the subsequent S1002, the CPU 101 reads the information of the game data 414 registered in association with that user from the table 410 and displays it on the display device 140. In this embodiment, it is possible to register multiple game data for one user, and if multiple game data 414 are registered, their icon images, etc., are displayed on the display device 140 to accept selection from the user. Once a game data 414 is selected, the process moves to S1003 and the game processing begins. The game can be, for example, an online or offline competitive game in which characters (robots, people, vehicles, aircraft, etc.) generated from the game data battle on a predetermined field in a virtual space. The opponent may be a CPU such as a game device, or another user. Note that the type of game is not limited to competitive games, but can be applied to various games such as simulation games, role-playing games, adventure games, etc. If multiple people participate in the game, the processes of S1001 and S1002 are repeated for each person, and then S1003 is executed.

[0055] In S1003, a game character is generated by mapping the texture information contained in the selected game data 414 to the frame data 405 corresponding to the selected game data 414. At that time, for the movable parts specified in S703 in Figure 7, an overlaid image corresponding to the game character's posture is generated and used based on pre-prepared joint model data that is displayed overlaid on the texture information contained in the game data 414. This makes it possible to express more natural movements when the joints bend. In the above description of the embodiment, we described a case where game data is generated based on information about the appearance of a toy body for use in a game conducted in a virtual space. However, the use of the game data generated in this embodiment is not limited to games; by using it as virtual space data, it can be used to generate images to be displayed in a virtual space, and can be widely applied to processes that make characters move in a virtual space. For example, it is possible to make the character appear in events, concerts, sports, online meetings, etc., held in a virtual space. Furthermore, the technology of this embodiment can also be applied to video technologies that merge the real world and the virtual world, such as cross-reality (XR), and make it possible to perceive things that do not exist in the real world.

[0056] In this embodiment, information about the appearance of the toy can be acquired, texture information can be generated from this appearance information and mapped to frame data, allowing it to be used as a character in a game or in any virtual space. Some toys, such as plastic models, are painted or otherwise finished by the user to create their own unique works, and their individuality can be reflected in the character representation in the game or virtual space, significantly improving their appeal.

[0057] The invention is not limited to the embodiments described above, and various modifications and changes are possible within the scope of the gist of the invention.

Claims

1. An information processing device that generates virtual space data usable in a virtual space from scan information of the appearance of an object acquired by a three-dimensional scanner, An acquisition means for acquiring frame data corresponding to the type of article, wherein the frame data is configured to allow mapping of texture information obtained from the scan information, A first generation means that generates second scan information by adjusting the coordinate system set for the first scan information generated by scanning the aforementioned article with the three-dimensional scanner device to match the coordinate system of the frame data, A second generation means for generating virtual space data including texture information for mapping onto the frame data from the second scan information and the frame data, Equipped with, When the first generation means receives a first operation instruction for at least one of movement and rotation with respect to the first scan information, it performs the adjustment in accordance with the first operation instruction. The second generation means is an information processing device that generates the virtual space data so as to include positional information of an image superimposed on the second scan information corresponding to a predetermined location of the article.

2. An information processing device that generates virtual space data usable in a virtual space from scan information of the appearance of an article acquired by a three-dimensional scanner, An acquisition means for acquiring frame data corresponding to the type of article, wherein the frame data is configured to allow mapping of texture information obtained from the scan information, A first generation means that generates second scan information by adjusting the coordinate system set for the first scan information generated by scanning the aforementioned article with the three-dimensional scanner device to match the coordinate system of the frame data, A second generation means for generating virtual space data including texture information for mapping onto the frame data from the second scan information and the frame data, Equipped with, When the first generation means receives a first operation instruction for at least one of movement and rotation with respect to the first scan information, it performs the adjustment in accordance with the first operation instruction. The first generation means receives instructions, including the first operation instructions, for the first scan information displayed on the first screen for performing the adjustments displayed on the display unit, The display unit further displays a second screen for adjusting the position of an image superimposed on the first scan information corresponding to a predetermined location of the article. The first generation means is further capable of receiving a second operation instruction for at least one of movement and rotation of the image displayed on the second screen. The second generation means is an information processing device that generates the virtual space data, further including positional information of the image corresponding to the second operation instruction.

3. The information processing apparatus according to claim 1, wherein the first generation means receives instructions including the first operation instructions for the first scan information displayed on the first screen for performing the adjustments displayed on the display unit.

4. The first screen includes a display of the first scan information corresponding to any part of the article, and a display indicating the position of the part in the frame data, The information processing apparatus according to claim 2 or 3, wherein the first operation instruction includes an operation instruction for matching the display position of the first scan information of the part with the display position of the part.

5. The first screen includes a switching operation unit for switching the display direction of the first scan information, The information processing device according to claim 4, which displays the first scan information of any part of the article and the position of the part in the frame data in the display direction corresponding to the selected switching operation unit.

6. The information processing apparatus according to any one of claims 1 to 5, wherein the predetermined location is a movable part of the article.

7. The information processing apparatus according to claim 6, wherein, when the article is a human-shaped toy, the movable part is a joint.

8. The system further comprises determination means for determining the type of the article, The information processing apparatus according to any one of claims 1 to 7, further comprising a selection means for selecting a fixing device that defines the orientation of the article when it is scanned by the three-dimensional scanner device, based on the determined type of article.

9. The information processing apparatus according to claim 8, wherein the determination means determines the type of the article based on information of a predetermined part of the article.

10. The information processing apparatus according to claim 9, wherein, when the article is a human-shaped toy, the predetermined part is the sole of the foot.

11. The information processing device according to any one of claims 8 to 10, wherein the first scan information is generated when the article is scanned by the three-dimensional scanner device in a posture determined by the fixing device.

12. The three-dimensional scanner device is installed, and the system further includes a position and orientation control device for controlling the position and orientation of the three-dimensional scanner device. The information processing apparatus according to any one of claims 1 to 11, wherein the first scan information is generated by scanning the article with the three-dimensional scanner device at a predetermined position and orientation set by the position and orientation control device.

13. The aforementioned article is further provided with a rotating device on which it is mounted and configured to be rotatable, The information processing device according to any one of claims 1 to 12, wherein the first scan information is generated by scanning the article placed on the rotating device with the three-dimensional scanner device.

14. A computer program for causing a computer to operate as one of the means of an information processing apparatus described in any one of claims 1 to 13.

Images