Computer program, information processing method, and information processing system
Patent Information
- Application Number
- JP2023011553
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-01-30
- Publication Date
- 2025-03-07
- Estimated Expiration
- 2039-06-19
AI Technical Summary
【0019】 本発明によれば、上述した従来技術の問題の少なくとも一部を解決又は緩和する技術的な改善を提供することができる。本発明によれば、動画配信において異なるデータの内容が要求されるシステム間の連携をスムーズに行うことができる。
Smart Images

Figure 0007629610000001 
Figure 0007629610000002 
Figure 0007629610000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a computer program, an information processing method, and an information processing system. [Background technology]
[0002] Conventionally, a video distribution system has been known that generates animation of a character object based on the movement of a broadcasting user and broadcasts a video including the animation of the character object live. Such a video distribution system is disclosed in, for example, Patent Document 1 and Non-Patent Document 1.
[0003] Recently, specific file formats have begun to be provided that enable character objects to be used with common 3D data across different video distribution platforms (Non-Patent Document 2). [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2015-184689 A [Non-patent literature]
[0005] [Non-Patent Document 1] Yusuke Hasegawa, The Dawn of a New Era of Virtual Idols PROJECT MariA, CG WORLD, Japan, Born Digital Co., Ltd., November 10, 2017, Vol. 231, pp. 74-79 [Non-Patent Document 2] “VRM 3D Humanoid Avatar format for VR”, VRM Consortium, [Retrieved May 20, 2019], Internet<https: / / vrm.dev / > Summary of the Invention [Problem to be solved by the invention]
[0006] However, even if common 3D data created in the specific file formats mentioned above can be used between different video distribution platforms, if the required data content differs, there is a possibility that there will not be enough information to generate a character object.
[0007] In that case, it would be necessary to create the missing parts of the 3D data from scratch, which could discourage streamers from distributing the content on other video streaming platforms.
[0008] Therefore, an object of the present disclosure is to provide a technical improvement that solves or alleviates at least a part of the problems of the prior art described above. A more specific object of the present disclosure is to provide an information processing system, an information processing method, and a computer program that can smoothly cooperate with systems that require different data contents in video distribution. [Means for solving the problem]
[0009] The computer program of the present invention is a computer program for distributing video including animation of a character object generated based on the movement of a distributing user, and is characterized in that it causes one or more computer processors to realize an acquisition function for acquiring first avatar information including first body part information related to a first body part of the character, a specification function for identifying second body part information related to a second body part of the character not included in the first avatar information based on the first body part information acquired by the acquisition function, and a generation function for generating second avatar information based on the first body part information acquired by the acquisition function and the second body part information identified by the specification function.
[0010] The identification function can extract one or more pieces of second part information corresponding to the first part information, and identify one piece of second part information based on user selection information for the extracted one or more pieces of second part information.
[0011] The acquisition function acquires first avatar information including first body part information associated with one or more pieces of attachment object information; The identification function can identify second part information including one or more attachment object information associated with the second part based on the one or more attachment object information.
[0012] The first avatar information may be information for generating an avatar whose face moves at least based on motion information of an actor's face acquired by a facial capture function of a given information processing terminal.
[0013] The second avatar information can be information for generating an avatar whose entire body moves, based on whole-body motion information of an actor acquired by a motion capture function of a given information processing device.
[0014] The computer program of the present invention further causes one or more computers to realize a type acquisition function that acquires the type of avatar information required when a character appears in a program, and when the type acquired by the type acquisition function is the type of second avatar information, the generation function can generate the second avatar information.
[0015] The computer program of the present invention further causes one or more computers to realize a judgment function for judging whether or not second avatar information has already been generated, and when the judgment function determines that the second avatar information has not yet been generated and the type acquired by the type acquisition function is the type of second avatar information, the generation function can generate the second avatar information.
[0016] The identifying function can identify second part information that pairs with the first part information acquired by the acquiring function.
[0017] The information processing method of the present invention is an information processing method for distributing a video including an animation of a character object generated based on the movement of a distributing user, and is characterized in having one or more computer processors execute an acquisition step of acquiring first avatar information including first body part information related to a first body part of the character, an identification step of identifying second body part information related to a second body part of the character not included in the first avatar information based on the first body part information acquired in the acquisition step, and a generation step of generating second avatar information based on the first body part information acquired in the acquisition step and the second body part information identified in the identification step.
[0018] The information processing system of the present invention is an information processing system that distributes video including animation of a character object generated based on the movement of a broadcasting user, and is equipped with one or more computer processors, and the one or more computer processors are characterized in having an acquisition unit that acquires first avatar information including first body part information related to a first body part of the character, an identification unit that identifies second body part information related to a second body part of the character not included in the first avatar information based on the first body part information acquired by the acquisition unit, and a generation unit that generates second avatar information based on the first body part information acquired by the acquisition unit and the second body part information identified by the identification unit. Effect of the Invention
[0019] According to the present invention, it is possible to provide a technical improvement that solves or alleviates at least a part of the problems of the prior art described above. According to the present invention, it is possible to smoothly cooperate between systems that require different data contents in video distribution. [Brief description of the drawings]
[0020] [Figure 1] 1 is a system configuration diagram showing an example of an information processing system according to the present invention. [Diagram 2]FIG. 1 is a system configuration diagram showing an example of an information processing system with which the information processing system of the present invention can cooperate; [Diagram 3] FIG. 13 is a conceptual diagram showing an image of a distribution screen for mobile distribution. [Figure 4] FIG. 13 is a conceptual diagram showing an image of a distribution screen for studio distribution. [Diagram 5] FIG. 2 is a block diagram showing a functional configuration of an information processing device according to an embodiment of the present invention. [Figure 6] 13 is a conceptual diagram showing an image of an attachment object associated with the upper body of a character. FIG. [Figure 7] 13 is a conceptual diagram showing an image of an attachment object associated with the lower body of a character. FIG. [Figure 8] 13 shows an example of a data table of attachment objects and coordinate points. [Figure 9] 13 shows a data table of priority of attached objects. [Figure 10] FIG. 13 is a configuration diagram showing a functional configuration of an information processing device according to another embodiment of the present invention. [Figure 11] FIG. 2 is a configuration diagram showing an example of a hardware configuration of an information processing device according to an embodiment of the present invention. [Figure 12] FIG. 2 is a flow diagram showing an example of the flow of an information processing method according to an embodiment of the present invention. [Figure 13] FIG. 2 is a circuit configuration diagram showing an example of a circuit for realizing the functional configuration of a computer program according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0021] First, an overview of an information processing system according to the present invention will be described with reference to the drawings.
[0022] An information processing system according to an embodiment of the present invention is an information processing system that distributes moving images including animations of character objects generated based on movements of a broadcasting user, and includes one or more computer processors.
[0023] <System configuration> As shown as an example in FIG. 1, the information processing system 100 may include one or more viewing user terminals 200, and an information processing device (support computer) 400 located in a video distribution studio, etc., and connected to these viewing user terminals 200 via a network 300.
[0024] Moreover, the information processing device 400 may be connected to a server device 500 (not shown) via the Internet, and part of the processing to be performed by the information processing device 400 (described later) may be performed by the server device 500.
[0025] In this specification, such distribution by the information processing system 100 is referred to as studio distribution.
[0026] In studio streaming, the entire body movements of the streaming user (actor) are captured by a camera installed in the studio using markers attached to the streaming user, and are reflected in the character in real time using known motion capture technology.
[0027] Furthermore, the information processing system 100 of the present invention can cooperate with another information processing system 10 shown as an example in Fig. 2. The information processing system 10 shown in Fig. 2 can include a broadcasting user terminal 20, one or more viewing user terminals 30, and an information processing device (server device) 50 connected to these broadcasting user terminals 20 and viewing user terminals 30 via a network 40.
[0028] In the above example, the broadcast user terminal 20 may be an information processing terminal such as a smartphone. In this specification, such broadcast by the information processing system 10 is referred to as mobile broadcast.
[0029] In mobile distribution, the facial movements of the broadcasting user are captured by a camera mounted on the broadcasting user's information processing terminal, and are reflected on the character's face in real time using known face tracking technology.
[0030] The video generated by the information processing system 100 and the information processing system 10 can be distributed to viewing users from one video distribution platform, for example.
[0031] Here, as an example, it is assumed that a general broadcasting user is only permitted to perform mobile broadcasting via the information processing system 10 in the video broadcasting platform. As shown in Fig. 3, in mobile broadcasting, only the upper body of the broadcasting user's character is displayed, and the lower body is not displayed. Therefore, the only 3D data required for the character is the data for the upper body.
[0032] The upper body here means at least excluding the legs, and may include the waist and buttocks as shown in FIG.
[0033] On the other hand, an official distribution user is permitted to perform studio distribution using the information processing system 100 on the video distribution platform. The official distribution user here refers to an actor of a character who appears in an official program determined by the operator of the video distribution platform.
[0034] As shown in Figure 4, the broadcasting user's character is displayed entirely in the studio broadcast, so the required 3D data for the character is the entire body.
[0035] In this embodiment, mobile distribution and studio distribution are realized on a common video distribution platform, and the link between these distributions is described, but the present invention can also be applied to link between distributions on separate video distribution platforms. In such a case, there is no limitation on the distribution format of the video (for example, mobile distribution or studio distribution).
[0036] Here, in the above-mentioned video distribution platform, there are cases where a general distribution user performs studio distribution.
[0037] As an example, an operator of a video distribution platform can hold an "official program debut event" for general distribution users. The details of the event will not be explained here, but for example, the event can be one in which gifts received from viewing users are converted into an event score and the users compete for ranking. The characters of the top three general distribution users who win this "official program debut event" will earn the right to appear on the official program (i.e., the right to broadcast in the studio). Note that the number of distribution users who can earn this right is not limited to three.
[0038] In the information processing system 100 of this embodiment, the event results of broadcast users are stored as data, and top performers are flagged. Then, 3D data (second avatar information, described later) of the whole body of the character of the flagged top performer, which is required when appearing on an official program, is generated.
[0039] Ordinary broadcasting users do not usually have 3D data of the entire body of a character prepared for studio broadcasting. Ordinary broadcasting users generate 3D data of the upper body of their own original characters by freely combining pre-prepared character parts (body type, skin color, hairstyle, etc.) and wearable items (clothes, accessories, etc.), and use this data for mobile broadcasting, because preparing 3D data of the entire body of such a wide variety of original characters in advance requires a huge amount of work and is not realistic.
[0040] Therefore, the one or more computer processors according to the present invention include an acquisition unit 410, an identification unit 420, and a generation unit 430, as shown in FIG.
[0041] The acquiring unit 410 acquires the first avatar information.
[0042] The first avatar information includes first body part information related to a first body part of the character, and is, for example, 3D data of contents required for mobile distribution.
[0043] A character is composed of multiple parts. A character may be composed of two parts, an upper body and a lower body, or may be composed of smaller parts such as a head, neck, chest, shoulders, arms, torso, and legs.
[0044] The first body part is at least one of the above body parts. The first body part information includes gender information, color information, and / or size information of the first body part. The first body part information may include information of an attachment object associated with the first body part. Attachment Object These may be items such as clothing, accessories and / or gadgets.
[0045] The identification unit 420 identifies the second body part information based on the first body part information acquired by the acquisition unit 410. As an example, the identification unit 420 identifies the second body part information including the same gender information, color information, and / or size information based on the gender information, color information, and / or size information included in the first body part information. Variations in the method of identifying the second body part information will be described later.
[0046] The second body part information is related to a second body part of the character that is not included in the first avatar information. The second body part information includes gender information, color information, and / or size information of the second body part. The second body part information may include information on a wearable object associated with the second body part, as will be described in detail later. The wearable object associated with the second body part may be an item such as clothing, an accessory, and / or a small item.
[0047] As an example, if the first part is the upper body, the second part is the lower body.
[0048] Then, the generating unit 430 generates second avatar information based on the first body part information acquired by the acquiring unit 410 and the second body part information identified by the identifying unit 420 .
[0049] As an example, the second avatar information is 3D data of the whole body of a character generated based on first body part information, which is information about the upper body, and second body part information, which is information about the lower body. As an example, the 3D data of the whole body is 3D data of contents required for studio distribution.
[0050] According to the above configuration, second avatar information can be automatically generated from first avatar information, which allows smooth cooperation between systems that require different data contents in video distribution.
[0051] For example, at an event such as that described above, 3D data of the entire body of a character for studio streaming can be easily generated from 3D data of the upper body of a character for mobile streaming for general streaming users, thereby reducing the workload of streaming users and / or administrators.
[0052] Furthermore, as described above, the first avatar information can be information for generating an avatar whose face at least moves, based on motion information of an actor's face acquired by a facial capture function provided in a specific information processing terminal.
[0053] Similarly, the second avatar information can be information for generating an avatar whose entire body moves, based on whole-body motion information of an actor acquired by a motion capture function of a specific information processing device.
[0054] The acquiring unit 410 also acquires first avatar information including first body part information associated with one or more pieces of attachment object information.
[0055] As shown in Fig. 6, a character represented by the first avatar information is usually not naked but is displayed wearing clothes. The first avatar information includes attachment object information associated with the first body part information, and therefore includes at least top information when the first body part is the upper body.
[0056] The first avatar information may also include wearable object information such as a T-shirt or jacket as a top, a headband worn on the head, a hat, glasses, earrings, or a bracelet or watch worn on the arm, or a ring worn on the finger.
[0057] Then, the identification unit 420 can identify second part information including one or more pieces of attachment object information associated with the second part based on the one or more pieces of attachment object information.
[0058] As shown in Fig. 7, the character displayed by the second avatar information is usually displayed wearing clothes, not naked. Therefore, the coordination of the wearable objects for the upper and lower body is important.
[0059] As an example, coordination information that associates a certain top with a matching bottom can be stored, and this information can be used to determine one or more pieces of wearable object information associated with a second part based on one or more pieces of wearable object information associated with a first part.
[0060] In other words, the coordinate information is used to manage an attachment object in association with other attachment objects that can be coordinated with the attachment object. This association may be a one-to-one relationship, a one-to-many relationship, or a many-to-many relationship.
[0061] When the correspondence is one-to-one, the identifying unit 420 can identify the second part information that is paired with the first part information acquired by the acquiring unit 410.
[0062] This is an effective method for identifying clothing such as one-piece dresses, yukatas, swimsuits, overalls, and uniforms or suits in which the top and bottom are a set, in which the top and bottom are not separate.
[0063] Furthermore, when the association is one-to-many or many-to-many, the identifying unit 420 can identify the second part information associated with the first part information acquired by the acquiring unit 410.
[0064] For example, bottoms a, b, c, and d are associated with top A. At this time, the coordinate points with top A may be determined for these multiple bottoms. Fig. 8 shows a data table of attachment objects and coordinate points stored in the storage unit of the information processing system 100 of the present invention or in an external storage device.
[0065] In this way, when multiple attachment objects are associated with one attachment object, the priority may be determined by the coordinate points, the top attachment object may be determined, and the second part information associated with this attachment object may be specified. When there are multiple top attachment objects, one attachment object may be determined randomly.
[0066] In addition, when the correspondence is one-to-many or many-to-many, the identification unit 420 can extract one or more pieces of second part information associated with the first part information, and identify one piece of second part information based on user selection information for the extracted one or more pieces of second part information.
[0067] For example, in the example of Figure 8, all of the second body part information associated with each of the multiple bottom pairs may be displayed on the display screen of the information processing terminal, and the user may select one piece of second body part information from the displayed information.
[0068] The user here can be an actor, that is, a broadcast user or an operator.
[0069] This allows the user to select the lower half of the body wearing the bottoms of their choice from a plurality of bottoms presented, thereby increasing the freedom of coordination of the character.
[0070] In addition, when a plurality of attachment objects are associated with the first part information, the second part information can be identified based on the predetermined priority of the attachment objects. Fig. 9 shows a data table of the priority of the attachment objects stored in the storage unit of the information processing system 100 of the present invention or in an external storage device.
[0071] In the example of Fig. 9, the second body part information associated with the bottoms that correspond to the tops with the highest priority among the multiple wearing objects is specified. This priority can be determined based on the degree of impression that the wearing object gives to the coordination of the character.
[0072] Moreover, the information processing system 100 of the present invention can further include a type acquisition unit 440 as shown in FIG.
[0073] The type acquiring unit 440 acquires the type of avatar information that is requested when a character appears in a program.
[0074] The type of avatar information may be the type of data format of the avatar information, etc. The data format may be a file format called VRM, which is a file format for handling humanoid 3D avatar (3D model) data for VR applications.
[0075] Then, when the type acquired by the type acquiring unit 440 is the type of second avatar information, the generating unit 430 can generate the second avatar information.
[0076] In the above description, it is assumed that the types of data formats of the first avatar information are the same. That is, the second avatar information is generated by simply generating information that is lacking in the first avatar information. Therefore, the type acquisition unit 440 can confirm that the type of requested avatar information is the type (data format) of the second avatar information that can be generated by the present invention, and generate the second avatar information.
[0077] Moreover, the information processing system 100 of the present invention can further include a determination unit 450 .
[0078] The determination unit 450 determines whether the second avatar information has already been generated.
[0079] Then, when the determination unit 450 determines that the second avatar information has not yet been generated and the type acquired by the type acquisition unit 440 is the type of the second avatar information, the generation unit 430 can generate the second avatar information.
[0080] According to the embodiment described above, by using VRM as an example, a full-body avatar for studio distribution can be automatically generated based on an avatar (upper body only) used for mobile distribution, making it possible to smoothly accommodate studio distribution (e.g., official programs) without any effort on the part of the user.
[0081] For example, it is possible to automatically determine avatar information for other parts from the avatar data for the upper body, or to present candidates for avatar information for other parts that match the avatar data for the upper body to the player. This is expected to be useful for Vtuber applications that support both studio and mobile distribution.
[0082] <Hardware configuration> Here, a hardware configuration of an information processing device 400 included in the information processing system 100 will be described with reference to Fig. 11. The information processing device 400 includes a processor 401, a memory 402, a storage 403, an input / output interface (input / output I / F) 404, and a communication interface (communication I / F) 405. The components are connected to each other via a bus B.
[0083] The information processing device 400 can realize the functions and methods described in this embodiment through cooperation between a processor 401, a memory 402, a storage 403, an input / output I / F 404, and a communication I / F 405.
[0084] The processor 401 executes functions and / or methods realized by codes or instructions included in a program stored in the storage 403. The processor 401 includes, for example, a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), a microprocessor, a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc., and may realize each process disclosed in each embodiment by a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (an integrated circuit (IC) chip, a large scale integration (LSI)), etc.). These circuits may be realized by one or more integrated circuits, and a plurality of processes shown in each embodiment may be realized by one integrated circuit. An LSI may also be called a VLSI, a super LSI, an ultra LSI, etc., depending on the degree of integration.
[0085] The memory 402 temporarily stores a program loaded from the storage 403 and provides a working area for the processor 401. The memory 402 also temporarily stores various data generated while the processor 401 is executing the program. The memory 402 includes, for example, a random access memory (RAM) and a read only memory (ROM).
[0086] The storage 403 stores programs. The storage 403 includes, for example, a hard disk drive (HDD), a solid state drive (SSD), a flash memory, and the like.
[0087] The communication I / F 405 is implemented as hardware such as a network adapter, communication software, or a combination of these, and transmits and receives various data via the network 600. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as mutual communication can be performed. The communication I / F 405 executes communication with other information processing devices via the network 600. The communication I / F 405 transmits various data to other information processing devices according to instructions from the processor 401. The communication I / F 405 also receives various data transmitted from other information processing devices and transmits it to the processor 401.
[0088] The input / output I / F 404 includes an input device for inputting various operations to the information processing device 400, and an output device for outputting processing results processed by the information processing device 400. The input / output I / F 404 may be an integrated input device and an output device, or may be separate input device and output device.
[0089] The input device is realized by any one or a combination of all kinds of devices that can receive input from a user and transmit information related to the input to the processor 401. The input device includes, for example, a touch panel, a touch display, hardware keys such as a keyboard, a pointing device such as a mouse, a camera (operation input via an image), and a microphone (operation input by voice).
[0090] The output device outputs the processing result processed by the processor 401. The output device includes, for example, a touch panel, a speaker, etc. The viewing user terminal 200 can also be configured with the same hardware configuration as that in FIG. 11, except where noted otherwise.
[0091] Next, an example of an information processing method according to an embodiment of the present invention will be described.
[0092] The information processing method of the present invention is an information processing method in an information processing system that distributes moving images including animation of a character object generated based on the movements of a broadcasting user, as shown in FIG. 12, and causes one or more computer processors to execute an acquisition step S110, an identification step S120, and a generation step S130.
[0093] In the acquisition step S110, first avatar information including first body part information related to a first body part of a character is acquired. The acquisition step S110 can be executed by the acquisition unit 410 described above.
[0094] The identifying step S120 identifies second body part information related to a second body part of the character not included in the first avatar information based on the first body part information acquired in the acquiring step. The identifying step S120 can be executed by the identifying unit 420 described above.
[0095] The generating step S130 generates second avatar information based on the first body part information acquired in the acquiring step and the second body part information identified in the identifying step. The generating step S130 can be executed by the generating unit 430 described above.
[0096] According to the above configuration, second avatar information can be automatically generated from first avatar information, which allows smooth cooperation between systems that require different data contents in video distribution.
[0097] Finally, the computer program of the present invention will be described.
[0098] The computer program of the present invention is a computer program for distributing moving images including animation of a character object generated based on the movements of a broadcasting user, and causes one or more computer processors to realize an acquisition function, a identification function, and a generation function.
[0099] The acquisition function acquires first avatar information including first body part information related to a first body part of the character.
[0100] The identifying function identifies second body part information related to a second body part of the character not included in the first avatar information, based on the first body part information acquired by the acquiring function.
[0101] The generating function generates second avatar information based on the first body part information acquired by the acquiring function and the second body part information identified by the identifying function.
[0102] The above-mentioned acquisition function, specification function, and generation function can be realized by an acquisition circuit 1410, a specification circuit 1420, and a generation circuit 1430 shown in Fig. 13. The acquisition circuit 1410, the specification circuit 1420, and the generation circuit 1430 are realized by the above-mentioned acquisition unit 410, specification unit 420, and generation unit 430, respectively. Details of each unit are as described above.
[0103] According to the above configuration, second avatar information can be automatically generated from first avatar information, which allows smooth cooperation between systems that require different data contents in video distribution.
[0104] In addition, an information processing device such as a computer or a mobile phone can be suitably used to function as the server device or terminal device according to the above-described embodiment. Such an information processing device can be realized by storing a program describing the processing contents for realizing each function of the server device or terminal device according to the embodiment in a storage unit of the information processing device, and reading and executing the program by a CPU of the information processing device.
[0105] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims.
[0106] The method described in the embodiment can be stored as a program that can be executed by a calculator (computer) on a recording medium such as a magnetic disk (floppy disk, hard disk, etc.), an optical disk (CD-ROM, DVD, MO, etc.), or a semiconductor memory (ROM, RAM, flash memory, etc.), and can also be distributed by transmitting it via a communication medium. The program stored on the medium side also includes a setting program that configures software means (including not only execution programs but also tables and data structures) that the computer executes. The computer that realizes this device reads the program recorded on the recording medium, and in some cases, configures the software means by the setting program, and executes the above-mentioned processing by controlling the operation of the software means. The recording medium referred to in this specification is not limited to a storage medium for distribution, but also includes a storage medium such as a magnetic disk or semiconductor memory provided inside the computer or in a device connected via a network. The storage unit may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. [Note] The claims as originally filed of the original application of this application are set forth below. [1] A computer program for distributing video including animation of a character object generated based on a distributor's movements, the computer program comprising: an acquisition function for acquiring first avatar information including first body part information related to a first body part of a character; a specifying function for specifying second body part information related to a second body part of the character that is not included in the first avatar information, based on the first body part information acquired by the acquiring function; a generating function for generating second avatar information based on the first body part information acquired by the acquiring function and the second body part information identified by the identifying function; A computer program that achieves this. [2] The computer program described in [1] above, wherein the identification function extracts one or more pieces of second part information corresponding to the first part information, and identifies one piece of second part information based on user selection information for the extracted one or more pieces of second part information. [3] The acquiring function acquires first avatar information including first body part information associated with one or more pieces of attachment object information; The computer program described in [1] or [2] above, wherein the identification function identifies the second part information including one or more attachment object information associated with the second part based on the one or more attachment object information. [4] The computer program according to any one of [1] to [3] above, wherein the first avatar information is information for generating an avatar whose at least facial movement is based on facial motion information of an actor acquired by a facial capture function of a specific information processing terminal. [5] The computer program according to any one of [1] to [4] above, wherein the second avatar information is information for generating an avatar whose entire body moves based on whole-body motion information of an actor acquired by a motion capture function of a predetermined information processing device. [6] one or more computers, further comprising: A type acquisition function that acquires the type of avatar information required when the character appears in a program. Realize this, The computer program according to any one of claims [1] to [5], wherein, when the type acquired by the type acquisition function is the type of the second avatar information, the generation function generates the second avatar information. [7] one or more computers, further comprising: A determination function for determining whether the second avatar information has already been generated. Realize this, The computer program according to the above item [6], wherein when the second avatar information has not yet been generated as a result of the determination by the determination function and the type acquired by the type acquisition function is a type of second avatar information, the generation function generates the second avatar information. [8] A computer program described in any one of [1] to [7] above, characterized in that the identification function identifies the second part information that pairs with the first part information acquired by the acquisition function. [9] An information processing method for distributing a video including an animation of a character object generated based on a distributor's movement, comprising: an acquiring step of acquiring first avatar information including first body part information related to a first body part of a character; a specifying step of specifying second body part information related to a second body part of the character that is not included in the first avatar information based on the first body part information acquired in the acquiring step; a generating step of generating second avatar information based on the first body part information acquired in the acquiring step and the second body part information identified in the identifying step; An information processing method.
[10] An information processing system for distributing video including animation of a character object generated based on a distributor user's movements, comprising one or more computer processors, the one or more computer processors: an acquisition unit that acquires first avatar information including first body part information related to a first body part of a character; an identification unit that identifies second body part information related to a second body part of the character that is not included in the first avatar information, based on the first body part information acquired by the acquisition unit; a generating unit that generates second avatar information based on the first body part information acquired by the acquiring unit and the second body part information identified by the identifying unit; An information processing system comprising: The following are the claims as originally filed in the parent application: [1] A computer program for distributing video including animation of a character object, comprising: an acquisition function for acquiring first avatar information, which is character data required in a first distribution format; a specifying function for specifying required information required to generate second avatar information required in a second delivery format based on the first avatar information acquired by the acquiring function; a generating function that generates the second avatar information based on the first avatar information acquired by the acquiring function and the request information specified by the specifying function; A computer program that achieves this. [2] the first form of delivery is a form of mobile delivery; The computer program according to [1], wherein the second distribution format is a studio distribution format. [3] The first distribution format is a distribution format for a first video distribution platform; The computer program described in [1] or [2], wherein the second distribution format is a distribution format in a second video distribution platform that is different from the first video distribution platform and is capable of linking with the first video distribution platform. [4] The computer program according to [1], [2] or [3], wherein the request information is additional information required to generate the second avatar information from the first avatar information, and the second avatar information has a larger amount of information than the first avatar information. [5] The acquiring function acquires first avatar information including one or more pieces of attachment object information; The computer program according to any one of [1] to [4], characterized in that the identification function identifies the request information including one or more attachment object information based on the one or more attachment object information. [6] the one or more computer processors further comprising: a type acquisition function for acquiring a type of avatar information required for generating the character object; a confirmation function for confirming whether avatar information of the type acquired by the type acquisition function has already been generated; Realize this, the identifying function, when it is determined by the checking function that the avatar information has not yet been generated, identifying the request information based on the first avatar information acquired by the acquiring function; The generating function generates the second avatar information of the same type as the type acquired by the type acquiring function, based on the first avatar information acquired by the acquiring function and the request information identified by the identifying function. [7] The computer program described in any one of [1] to [6], wherein the first avatar information is information for generating an avatar whose at least facial movement is based on facial motion information of an actor acquired by a facial capture function of a specified information processing terminal. [8] The computer program according to any one of [1] to [7], wherein the second avatar information is information for generating an avatar whose entire body moves based on whole-body motion information of an actor acquired by a motion capture function of a specified information processing device. [9] An information processing method for distributing video including animation of a character object, comprising: an acquisition step of acquiring first avatar information which is character data required in a first distribution format; a specifying step of specifying required information required to generate second avatar information required in a second delivery format based on the first avatar information acquired in the acquiring step; a generating step of generating the second avatar information based on the first avatar information acquired in the acquiring step and the request information specified by the specifying function; An information processing method.
[10] An information processing system for distributing video including animation of a character object, comprising one or more computer processors, the one or more computer processors: an acquisition unit that acquires first avatar information, which is character data required in a first distribution format; a specification unit that specifies required information required to generate second avatar information required in a second delivery format based on the first avatar information acquired by the acquisition unit; a generating unit that generates the second avatar information based on the first avatar information acquired by the acquiring unit and the request information identified by the identifying unit; An information processing system comprising: [Explanation of symbols]
[0107] 100 Information Processing Systems 200 Viewing user terminal 300 Network 400 Information processing device 410 Acquisition Department 420 Specific part 430 Generation part 440 Type Acquisition Department 450 Judgment Department
Claims
1. one or more computer processors, an acquisition function for acquiring first information, which is data necessary for displaying a first character object having a first portion; a specifying function that specifies required information required to generate second information, which is data required to display a second character object having the first portion and a second portion, based on the first information acquired by the acquiring function; a generating function that generates the second information based on the first information acquired by the acquiring function and the request information specified by the specifying function; Realize this, the first information includes first body part information related to a first body part of the first character object, the first body part information further including first attachment object information of an attachment object associated with the first body part; The request information includes second part information including second attachment object information of an attachment object associated with the second part, the second attachment object information being specified based on the first attachment object information included in the first part information; the first character object is displayed in a state in which one or more attachment objects based on the first attachment object information are attached to the first body part; The second character object is Attaching one or more attachment objects based on the first attachment object information to the first part; and A computer program that displays the second portion in a manner such that one or more attachment objects based on the second attachment object information are attached to the second portion.
2. The one or more computer processors further include: a type acquisition function for acquiring a type of information required for generating the second character object; a confirmation function for confirming whether the type information acquired by the type acquisition function has already been generated; Realize this, The computer program of claim 1, wherein the generation function generates, when the confirmation function determines that information of the type acquired by the type acquisition function has not yet been generated, the second information of the same type as the type acquired by the type acquisition function based on the first information acquired by the acquisition function.
3. The computer program product according to claim 1, characterized in that the first information is information for generating the first character object having at least a moving facial portion based on facial motion information of an actor acquired by a facial capture function provided in a specified information processing terminal.
4. The computer program according to claim 1, characterized in that the second information is information for generating the second character object whose entire body moves based on whole-body motion information of an actor obtained by a motion capture function provided in a specified information processing device.
5. The computer program product according to claim 1, characterized in that the identification function identifies one piece of required information necessary to generate second information based on the first information acquired by the acquisition function, the required information being determined from one or more of the required information.
6. 6. The computer program product according to claim 5, wherein the one piece of requested information is determined by a user's selection.
7. 6. The computer program product according to claim 5, wherein the one piece of requested information is automatically determined based on a priority.
8. 2. The computer program according to claim 1, wherein the computer program is a computer program for distributing moving images including animations of character objects.
9. one or more computer processors, an acquisition step of acquiring first information which is data necessary for displaying a first character object having a first portion; a specifying step of specifying required information necessary for generating second information, which is data necessary for displaying a second character object having the first portion and a second portion, based on the first information acquired in the acquiring step; a generating step of generating the second information based on the first information acquired in the acquiring step and the request information identified in the identifying step; Run the command, the first information includes first body part information related to a first body part of the first character object, the first body part information further including first attachment object information of an attachment object associated with the first body part; The request information includes second part information including second attachment object information of an attachment object associated with the second part, the second attachment object information being specified based on the first attachment object information included in the first part information; the first character object is displayed in a state in which one or more attachment objects based on the first attachment object information are attached to the first body part; The second character object is Attaching one or more attachment objects based on the first attachment object information to the first part; and The information processing method includes displaying the second part in a state in which one or more attachment objects based on the second attachment object information are attached to the second part.
10. An acquisition unit that acquires first information, which is data necessary for displaying a first character object having a first portion; an identification unit that identifies required information required to generate second information, which is data required to display a second character object having the first portion and a second portion, based on the first information acquired by the acquisition unit; a generating unit that generates the second information based on the first information acquired by the acquiring unit and the request information identified by the identifying unit; Equipped with the first information includes first body part information related to a first body part of the first character object, the first body part information further including first attachment object information of an attachment object associated with the first body part; The request information includes second part information including second attachment object information of an attachment object associated with the second part, the second attachment object information being specified based on the first attachment object information included in the first part information; the first character object is displayed in a state in which one or more attachment objects based on the first attachment object information are attached to the first body part; The second character object is Attaching one or more attachment objects based on the first attachment object information to the first part; and An information processing system in which the second part is displayed in a state in which one or more attachment objects based on the second attachment object information are attached to the second part.
Citation Information
Patent Citations
Game system
JP2009279152A
Three-dimensional model display system
JP2010267241A
Moving image generation device and program
JP2015184689A