Method for generating design drawing of block object

Abstract

To provide a method for making it easier for a user to assemble a block object using block parts.SOLUTION: In a system including a distributor terminal of a distributor who distributes a method for assembling a block object made up of multiple types of block parts, a user terminal of a user assembling the block object, and a server terminal connected to the distributor terminal and the user terminal via a network, a method for distributing a video of assembling the block object executed by a processor of the server terminal includes receiving a request to access design drawing information for assembling the block object from the distributor terminal, transmitting the design drawing information to the distributor terminal, receiving a request to distribute video for assembling the block object from the distributor terminal, and executing video distribution by the distributor.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to a method for recommending block objects. [Background technology]

[0002] 2. Description of the Related Art Toys that allow a user to assemble block object models, such as animals, buildings, vehicles, etc., using block parts such as Lego bricks, are becoming popular.

[0003] For example, Patent Document 1 discloses a method for improving the efficiency of designing block parts that constitute a block object. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 5665872 Summary of the Invention [Problem to be solved by the invention]

[0005] However, while the technology disclosed in Patent Document 1 above makes it possible to realize efficient design and visualization of block parts, it does not disclose a method for visualizing an image of assembling block objects from a user's perspective.

[0006] Therefore, an object of the present invention is to provide a method that makes it easy for a user to assemble block objects using block parts. [Means for solving the problem]

[0007] In one aspect of the present invention, a method for distributing a video of assembling a block object, which is executed by a processor of a server terminal connected via a network to a distributor terminal of a distributor who distributes a method for assembling a block object composed of multiple types of block parts and a user terminal of a user who assembles the block object, wherein the processor of the server terminal accepts a request from the distributor terminal to access blueprint information for assembling the block object, transmits the blueprint information to the distributor terminal, accepts a request from the distributor terminal to distribute a video for assembling the block object, and executes video distribution by the distributor. Effect of the Invention

[0008] According to the present invention, it is possible to provide a method that makes it easy for a user to assemble a block object using block parts. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a system for providing a method for recommending a block object according to a first embodiment of the present invention; [Diagram 2] 2 is a functional block diagram showing the server terminal 100 of FIG. 1. [Diagram 3] 2 is a functional block diagram showing a user terminal 200 of FIG. 1. [Figure 4] FIG. 2 is a functional block diagram showing a sensor device 300 of FIG. [Diagram 5] FIG. 2 is a diagram showing an example of object model information stored in the server 100. [Figure 6] FIG. 2 is a diagram showing an example of block part information stored in the server 100. [Figure 7] 10 is an example of a flowchart showing details of a method for delivering a video of assembling a block object according to the first embodiment of the present invention. [Figure 8]11 is another example of a flowchart illustrating details of the method for delivering an assembly animation of block objects according to the first embodiment of the present invention. [Figure 9] 4 is an example of a video distribution screen displayed on a user terminal according to the first embodiment of the present invention. [Figure 10] 13 is another example of a video distribution screen displayed on a user terminal according to the first embodiment of the present invention. [Figure 11] 13 is yet another example of a video distribution screen displayed on a user terminal according to the first embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Note that the embodiment described below does not unduly limit the contents of the present invention described in the claims. Furthermore, not all of the components shown in the embodiment are necessarily essential components of the present invention.

[0011] <Configuration> FIG. 1 is a block diagram showing a system for providing a method for distributing a video of assembling a block object according to a first embodiment of the present invention. The system 1 includes a distributor terminal 200A of a distributor who distributes a method of assembling a block object composed of a plurality of types of block parts, a user terminal 200B of a user who assembles the block object, a sensor device 300 connected to the distributor terminal 200A, and a server terminal 100 that is connected to the distributor terminal 200A and the user terminal 200B via a network, stores design drawing information for assembling the block object, and distributes a video of assembling the block object. Here, as a configuration of the system 1, a server that performs video distribution may be provided as a video distribution terminal separately from the server terminal 100. Also, the distributor terminal 200A and the user terminal 200B are described as singular, but a terminal corresponding to each of a plurality of distributors and users may be provided separately.

[0012] Here, as an example of a block object made up of multiple block parts, in this embodiment, video distribution by a broadcaster disguised as a character, a so-called Vtuber, is assumed, and an object with a character motif will be described as an example, but other examples include other characters, people, robots, vehicles, food, buildings, etc., and are not limited to this one example.

[0013] The server terminal 100, the distributor terminal 200A, and the user terminal 200B are each connected via a network NW. The network NW is configured by the Internet, an intranet, a wireless LAN (Local Area Network), a WAN (Wide Area Network), or the like.

[0014] The server terminal 100 may be, for example, a general-purpose computer such as a workstation or a personal computer, or may be logically realized by cloud computing. In this embodiment, for convenience of explanation, one server terminal is illustrated, but the present invention is not limited to this and may be multiple servers.

[0015] The distributor terminal 200A and the user terminal 200B are, for example, information processing devices such as personal computers and tablet terminals, but may also be configured as smartphones, mobile phones, PDAs, and the like.

[0016] The sensor device 300 is, for example, a mouse-like device that operates the distributor terminal 200A, and includes a base on which a block part can be placed and a sensor such as an acceleration sensor that can generate coordinate information of the base, and is connected to and paired with the distributor terminal 200A via short-range wireless communication such as Bluetooth (registered trademark). Here, instead of the sensor device 300, an acceleration sensor may be attached to the block part by pasting, etc.

[0017] Fig. 2 is a functional block configuration diagram of the server terminal 100 of Fig. 1. The server terminal 100 includes a communication unit 110, a storage unit 120, and a control unit .

[0018] The communication unit 110 is a communication interface for communicating with the user terminal 200 via the network NW, and communication is performed according to a communication protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol).

[0019] The storage unit 120 stores programs for executing various control processes and functions in the control unit 130, input data, etc., and is composed of a RAM (Random Access Memory), a ROM (Read Only Memory), etc. The storage unit 120 also has an object model information storage unit 121 that stores information related to the object model, etc., and a block part information storage unit 122 that stores information on block parts generated based on the object model, etc. A database (not shown) storing various data may be constructed outside the storage unit 120 or the server terminal 100.

[0020] The control unit 130 controls the overall operation of the server terminal 100 by executing a program stored in the storage unit 120, and is composed of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc. Functions of the control unit 130 include an information receiving unit 131 that receives information such as instructions from the distributor terminal 200A and the user terminal 200B, an object model information processing unit 132 that refers to and processes various information related to the object model, a block part information processing unit 133 that refers to and processes various information related to the block parts, an output processing unit 134 that transmits design drawing information related to the block objects to be output to the user terminal and processes a video of assembling the block objects, and a coordinate analysis unit 135 that analyzes coordinate information related to the block parts received from the distributor terminal 200A and the user terminal 200B. The information receiving unit 131, object model information processing unit 132, block part information processing unit 133, output processing unit 134, and coordinate analysis unit 135 are started by a program stored in the memory unit 120 and executed by the server terminal 100, which is a computer (electronic calculator).

[0021] The information receiving unit 131 receives information from the user terminal 200 when a distributor or user makes a specified request (by entering text, pressing an icon, etc.) via a user interface such as a screen provided by the server terminal 100 and displayed via a web browser or application on the distributor terminal 200A and the user terminal 200B, or receives coordinate information of block parts generated by the sensor device 300 via the distributor terminal 200A and the communication unit 110.

[0022] The object model processing unit 132 stores information related to the object model in the object model information storage unit 121 and performs processing for referring to the stored object model information.

[0023] The block parts information processing unit 133 stores information relating to block parts in the block parts information storage unit 122 and performs processing to refer to the stored block parts information.

[0024] The output processing unit 134 performs a process of transmitting necessary information to the distributor terminal 200A or the user terminal 200B in order to display design drawing information and the like related to the block objects on the distributor terminal 200A or the user terminal 200B, and also executes a process required to distribute a video of assembling the block objects to the user terminal 200B. At this time, the output processing unit 134 can generate screen information required to be displayed on the interface of the user terminal 200 by using the image and text data stored in the storage unit 120 as materials and arranging various images and text in a predetermined area of ​​the user interface based on a predetermined layout rule. This screen information generation process can also be executed by a GPU (Graphics Processing Unit).

[0025] The coordinate analysis unit 135 analyzes coordinate information regarding block parts obtained from the sensor device 300 or the broadcaster terminal 200A, and performs processing to determine the inclination of the displayed block object when displaying design drawing information, etc. related to the block object on the broadcaster terminal 200A.

[0026] Fig. 3 is a functional block diagram showing the distributor terminal 200A of Fig. 1. The distributor terminal 200A includes a communication unit 210, a display operation unit 220, a storage unit 230, and a control unit 240.

[0027] The communication unit 210 is a communication interface for communicating with the server terminal 100 via the network NW, and communication is performed according to a communication protocol such as TCP / IP. The communication unit 210 can also include a communication interface for communicating with the sensor device 300 via short-range wireless communication or the like.

[0028] The display operation unit 220 is a user interface used by the distributor to input instructions and display text, images, etc. according to input data from the control unit 240, and is configured with a display, keyboard, and mouse when the distributor terminal 200A is configured as a personal computer, and is configured with a touch panel, etc. when the distributor terminal 200A is configured as a smartphone or tablet terminal. This display operation unit 220 is started up by a control program stored in the storage unit 230 and executed by the distributor terminal 200A, which is a computer (electronic calculator).

[0029] The storage unit 230 stores programs for executing various control processes and functions in the control unit 240, input data, etc., and is composed of a RAM, a ROM, etc. The storage unit 230 also temporarily stores the contents of communication with the server terminal 100.

[0030] The control unit 240 controls the overall operation of the user terminal 200 by executing the programs stored in the storage unit 230, and is composed of a CPU, a GPU, and the like.

[0031] The user terminal 200B can also have substantially the same configuration as the distributor terminal 200A, and a description thereof will be omitted.

[0032] Fig. 4 is a functional block diagram showing the sensor device 300 of Fig. 1. The sensor device 300 includes a communication unit 310, an acceleration sensor 320, an input unit 330, and a control unit 340.

[0033] The communication unit 310 is a communication interface for communicating with the server terminal 100 via the network NW, and communication is performed according to a communication protocol such as TCP / IP. The communication unit 210 can also include a communication interface for communicating with the user terminal 200 via short-range wireless communication or the like.

[0034] The acceleration sensor 320 measures the inclination of the X-axis, Y-axis, and Z-axis of a base on which the user places the block parts, which is provided on the sensor device 300 (not shown), relative to the plane on which the sensor device 300 is placed, and generates coordinate information. Note that the sensor is not limited to an acceleration sensor, and other sensors capable of detecting the inclination of the base relative to the plane, such as an angular velocity sensor, can also be used.

[0035] The input unit 330 is an interface for inputting instructions for executing operations on a screen displayed on the user terminal 200, and may be, for example, physical buttons or buttons displayed on a liquid crystal screen.

[0036] The control unit 340 controls the overall operation of the sensor device 300 by executing a program stored in a storage unit (not shown), and is composed of a CPU, a GPU, and the like.

[0037] FIG. 5 is a diagram showing an example of the object model information stored in the server 100. As shown in FIG.

[0038] The object model information 1000 shown in FIG. 5 stores information related to an object model generated by a service manager or a distributor terminal 200A and / or a distributor and / or a user related to the server terminal 100 and / or a user terminal 200B. In FIG. 4, for convenience of explanation, an example of one object model (a user identified by an object ID "10001") is shown, but information of a plurality of object models can be stored. As various data related to an object model, it can include information such as 3D model data of the object model, cross-sectional data of the object model, data related to one or more types of block parts and the number of pieces required to assemble the object model, and design drawing information related to block parts arranged in each layer of the cross section. Here, the 3D model data can also be stored as 2D model data converted into a 3D model by a predetermined process.

[0039] FIG. 6 is a diagram showing an example of block parts information stored in the server 100. As shown in FIG.

[0040] Block part information 2000 shown in FIG. 6 stores information related to the shape, size, color, and weight of a block part. For convenience of explanation, FIG. 6 shows an example of one block part (a block part identified by ID "20001"), but information related to multiple block parts can be stored. The various data related to the block parts can include, for example, data related to block parts corresponding to parts for assembling a block object (consisting of the shape, size, color, etc. of the block parts). Here, each of the multiple types of block parts can be associated with a unique color, but is not limited to this.

[0041] FIG. 7 is an example of a flowchart showing details of a method for delivering a video of assembling block objects according to the first embodiment of the present invention.

[0042] Here, in order to use this system 1, the distributor pairs the distributor terminal 200A with the sensor device 300 by short-range wireless communication or the like, and places a block part held by the user on a base (not shown) of the sensor device 300. Here, the base may have a protrusion on the surface on which the block part is placed so that the block part can fit when placed. Also, as described above, an acceleration sensor may be attached to the block part instead of the sensor device 300.

[0043] As a preliminary process, the distributor accesses the server terminal 100 using a web browser of the distributor terminal 200A or an application (if an application is installed). A predetermined screen is displayed on a user interface via a website or application. Following the instructions displayed on the predetermined screen, the distributor activates a camera built into the distributor terminal 200A to capture a two-dimensional code such as a QR code (registered trademark) printed on a package containing block parts that the distributor purchased as a product, and link information (URL) of a website for accessing blueprint information for assembling a block object is displayed on the user interface of the distributor terminal 200A. The distributor selects and operates the link information to access the blueprint information for assembling a block object.

[0044] In step S101, the information receiving unit 131 of the control unit 130 of the server terminal 100 receives a request to access design drawing information for assembling a block object from the distributor terminal 200A via the communication unit 110. This access request may include an ID for identifying the block object.

[0045] Next, in the processing of step S102, the object model information processing unit 132 of the control unit 130 of the server terminal 100, in response to the above access request, refers to the design drawing information stored in the object model information storage unit 121 of the memory unit 120, and identifies the design drawing information corresponding to the ID that identifies the block object. Then, the output processing unit 134 of the control unit 130 transmits the design drawing information to the distributor terminal 200A.

[0046] Next, in the process of step S103, the distributor inputs necessary information via the user interface of the distributor terminal 200A to distribute a video of assembling block objects, and the information receiving unit 131 of the control unit 130 of the server terminal 100 receives a video distribution request from the distributor terminal 200A via the communication unit 110. The necessary information may include information such as the distributor's name, the names of the block objects to be assembled, the distribution date (in the case of real-time distribution), and the distribution URL (if already generated and assigned).

[0047] Next, in step S104, the output processing unit 134 of the control unit 130 of the server terminal 100 performs processing for distributing a video of assembling the block objects to the user in response to the request. In this processing, when the distributor distributes in real time, the output processing unit 134 stores distribution information such as the distributor name, the name of the block object to be assembled, the distribution date, and the distribution URL together with the design drawing information based on the received information as object model information 1000 in the object model information storage unit 121, and transmits the distribution information to the user who has received the request to assemble the block objects via the user terminal 200B. Here, the distribution information can also be displayed on a website where design drawing information for assembling the block objects is displayed.

[0048] In addition, in the case where the distributor distributes the content via recorded distribution, the output processing unit 134 can also perform processing to upload, together with the above distribution information, a recorded file of a video of the assembly of block objects, which the distributor has previously filmed and recorded, to a website where blueprint information is displayed or a website for video distribution.

[0049] Through the above process, a user can purchase a product for assembling a block object of a character of their favorite Vtuber, etc., and by accessing the QR code (registered trademark) printed on the product package, they can refer to the blueprint information for assembling the character and assemble the character's block object while watching the Vtuber's assembly video broadcast.

[0050] 8 is another example of a flowchart showing details of a method for distributing a video of assembling a block object according to the first embodiment of the present invention. In this example, a process when a distributor actually distributes a video will be described. Regarding video distribution, when the server terminal 100 receives a video distribution request from the user terminal 200B on the distribution date specified in the distribution information set above, the server terminal 100 distributes a video of the distributor demonstrating the assembly of a block object via a video distribution application.

[0051] The distributor selects a function for requesting screen sharing of a blueprint of a block object in a video distribution application started on the distributor terminal 200A as an aid for explaining a method for assembling the block object. In the process of step S201, the information receiving unit 131 of the control unit 130 of the server terminal 100 receives a request for screen sharing of blueprint information for assembling the block object from the distributor terminal 200A via the communication unit 110.

[0052] Next, in the process of step S202, the object model information processing unit 132 of the control unit 130 of the server terminal 100 refers to the design information stored in the object model information storage unit 121 of the storage unit 120 in response to the above-mentioned sharing request, and identifies the design information corresponding to the ID for identifying the block object. Here, in order to identify the design information, the distributor inputs the name or identification ID of the block object when making a screen sharing request, and the object model information processing unit 132 can refer to and identify the corresponding design information. However, in the process of step S102, if the distributor has already accessed the design information and the design information is displayed on the distributor terminal 200A, the distributor can select a screen sharing function in the video distribution application and select the window screen in which the design information is displayed or the entire screen of the distributor terminal 200A to identify the design information as screen information.

[0053] Next, in step S203, the output processing unit 134 of the control unit 130 of the server terminal 100 transmits the identified design drawing information to the user terminal 200B via the screen sharing screen of the video distribution application. This allows the distributor to share the design drawing information with the user terminal 200 while assembling the block object.

[0054] As shown in FIG. 9, the screen 1000 of the video distribution application displayed on the user terminal 200B is composed of at least a distributor screen display area 1010 in which a distributor (or a character played by the distributor) assembling a block object is displayed, and a blueprint information display area 1020 in which blueprint information for assembling the block object is displayed.

[0055] The distributor can also assemble block objects by placing block parts on a base provided via a rotation mechanism in the sensor device 300 paired with the distributor terminal 200A by short-range wireless communication or the like, and rotating or tilting the base. In response to tilting or rotating the base, the acceleration sensor 320 built into the sensor device 300 detects coordinates (position information of the base in the X-axis, Y-axis, and Z-axis directions relative to the ground) according to the tilt or rotation of the base relative to the ground, such as a tabletop on which the sensor device 300 is placed, and generates coordinate information. The sensor device 300 transmits the generated coordinate information to the distributor terminal 200A via short-distance wireless communication or the like, and when the server terminal 100 receives the coordinate information generated by the sensor device 300 from the distributor terminal 200A via the network and the communication unit 110, the coordinate analysis unit 135 of the control unit 130 of the server terminal 100 analyzes the received coordinate information and converts it into coordinate information of an object model composed of block parts in the 3D space of the design drawing information display area 1020, which is displayed as a design drawing of a block object on the distributor terminal 200A. The output processing unit 134 of the control unit 130 of the server terminal 100 performs output processing by generating screen information by arranging the object model in the design drawing information display area 1020 as design drawing information to be displayed on the distributor terminal 200A based on the analyzed coordinate information.

[0056] Fig. 10 is an example of an object model displayed in the blueprint information display area 1020. The distributor can easily assemble the block object while referring to the blueprint information corresponding to the inclination of the block object placed on the sensor device 300 on the distributor terminal 200A so as to correspond to the block object tilted as shown in Fig. 10(b) from the front view of the block object as shown in Fig. 10(a). Even from the user's perspective, the user can easily assemble the block object while enjoying a sense of realism, since the blueprint information that could only be referred to as a still image in the past is displayed as the block object as blueprint information in a dynamic form linked to the distributor's movement as in this example, while the distributor is demonstrating the assembly of the block object. The broadcaster terminal 200 may also be equipped with a camera (not shown). In this case, the camera can capture an image of an AR marker provided on the block part, identify the type of block part (determined by shape, color, etc.), share corresponding blueprint information on the screen, and determine coordinates in an augmented reality (AR) space, thereby determining the inclination of the block object and sharing blueprint information according to the inclination.

[0057] Furthermore, the distributor can operate the input unit 330 provided in the sensor device 300 (for example, by operating a mouse click button or performing a tap operation on a smartphone) to request an update of a block object in the blueprint information displayed on the distributor terminal 200A, whereby the object model processing unit 132 of the control unit 130 of the server terminal 100 refers to the blueprint information and refers to the corresponding blueprint information, and the output processing unit 134 performs processing to display this as the updated blueprint information on the distributor terminal 200A.

[0058] For example, as shown in Fig. 11, on the user interface screen of the video distribution application of the distributor terminal 200A, blueprint information of the block object is displayed in the blueprint display area 1020, and the distributor assembles the block parts according to the blueprint of the object model displayed in Fig. 11(a), and can request an update of the blueprint information of a desired state during the assembly of the block object by designating an arbitrary point with the blueprint information instruction button 1022 of the display guide gauge 1021 for blueprint information from the start (START) of assembly of the block parts to the completion (GOAL) of assembly, and the output processing unit 134 can output the blueprint information according to the request, as shown in Fig. 11(b). The blueprint information is shared with users who watch the video distribution via the video distribution application, so that the users can dynamically refer to the blueprint information according to the progress of assembly as in this example, while watching the distributor's assembly distribution of the block object, which could only be referred to in still images in the past, and can easily assemble the block object while enjoying a sense of realism.

[0059] Although the embodiments of the present invention have been described above, they can be implemented in various other forms, and can be implemented with various omissions, substitutions, and modifications. These embodiments and modifications, as well as those with omissions, substitutions, and modifications, are included in the technical scope of the claims and their equivalents. For example, in this example, an example has been described in which a distributor distributes a method for assembling a specific block object while sharing design drawing information via the distributor terminal 200, but as long as it does not deviate from the essence of this embodiment, it can also be applied to an example in which users, not just distributors such as Vtubers, share an assembly method with each other. [Explanation of symbols]

[0060] 1 System 100 Server terminal, 110 Communication unit, 120 Storage unit, 130 Control unit, 200 Distributor terminal (user terminal), 300 Sensor device, NW network

Claims

1. A method for distributing a video of an assembly of a block object, the method being executed by a processor of a server terminal connected via a network to a distributor terminal of a distributor who distributes a method of assembling a block object made up of a plurality of types of block parts and a user terminal of a user who assembles the block object, the processor comprising: The processing unit of the server terminal receiving a request from the distributor terminal to access design drawing information for assembling the block object; Transmitting the design drawing information to the distributor terminal; receiving a request from the distributor terminal to distribute a video for assembling the block object; A method for executing a video distribution process by the distributor.

2. The method of claim 1 , further comprising: screen sharing the blueprint information in the video.

3. The method according to claim 1 , further comprising: accepting a request to update the design information from the distributor terminal; and updating the design information based on the request to update.

4. The method according to claim 1 , further comprising accepting a request for access to the video distribution from the user terminal, and distributing the video.

5. The method of claim 1 , wherein the video is a recorded file.

Images