Terminal, method and computer program

Abstract

To provide a method for customizing a product according to the preference of a user, thereby further improving a vending machine.SOLUTION: A method for operating functions of a vending machine comprises the following steps in which: a user logs in to a user interface of a user terminal or enters as a guest to select a livestreamer (S502) and select a product (S504), the user being allowed to browse products and choose a desired item based on their mood; if the product selected by the user is a pre-made product (No in S506), a terminal may provide the user with the product (S508) if the product is in stock and the user finishes the purchase; if the product selected by the user is a customized product (Yes in S506), the terminal may determine whether the user satisfies a specific condition; if the user satisfies the specific condition (Yes in S510), the terminal may proceed with manufacturing the customized product (S512); and the terminal may provide the user with the product (S508) if the material is in stock and the user finishes the purchase.SELECTED DRAWING: Figure 22

Description

[Technical field]

[0001] The present disclosure relates to information and communication technology, and in particular to a terminal, a method, and a computer program for live streaming. [Background technology]

[0002] Nowadays, there are more and more vending machines in the city. They sell various products such as drinks and toys. In addition, vending machines are in operation 24 hours a day, 365 days a year, so customers can make purchases at any time.

[0003] In addition, many businesses offer collaboration products with popular characters in vending machines, which can increase the purchasing motivation of even more consumers. Non-Patent Document 1 discloses a vending machine that allows the purchase of blind boxes, where you do not know what is inside until you open them.

[0004] However, the functionality of such vending machines is limited. As technology advances, consumer expectations of the services provided by the machines are increasing. Therefore, it is important to find ways to further improve these vending machines. [Prior art documents] [Non-patent literature]

[0005] [Non-Patent Document 1] https: / / www.youtube.com / watch?v=0LPzaIw9TlE Summary of the Invention

[0006] A terminal for operating functions of a vending machine according to one embodiment of the present disclosure includes one or more processors, which execute machine-readable instructions to perform functions of generating first streaming data for a first user, transmitting the first streaming data to a server, receiving second streaming data from the server, playing the second streaming data on a screen of the terminal, receiving information on a product selected by the first user, and providing the selected product to the first user.

[0007] A method for operating a function of a vending machine according to another embodiment of the present disclosure includes generating first streaming data of a first user, transmitting the first streaming data to a server, receiving second streaming data from the server, playing the second streaming data on a screen of the terminal, receiving information of a product selected by the first user, and providing the selected product to the first user.

[0008] A computer program according to another embodiment of the present disclosure causes a terminal to realize the following functions: generating first streaming data of a first user; transmitting the first streaming data to a server; receiving second streaming data from the server; playing the second streaming data on a screen of the terminal; receiving information on a product selected by the first user; and providing the selected product to the first user.

[0009] According to the present disclosure, the product can be customized according to the user's preferences, and the user can interact with live streamers in more diverse ways. The user may also be a live streamer who interacts with other live streamers and purchases products in more diverse ways. Thus, the user experience may be improved. [Brief description of the drawings]

[0010] [Figure 1] 1 is a schematic diagram showing a configuration of a live streaming system 1 based on some embodiments of the present disclosure. [Diagram 2] FIG. 2 is a block diagram of a user terminal 20 according to some embodiments of the present disclosure. [Diagram 3] FIG. 1 is a block diagram of a server 10 according to some embodiments of the present disclosure. [Figure 4] 4 is a table showing an example data structure of the stream DB 320 of FIG. 3. [Diagram 5] 4 is a table showing an example data structure of the user DB 322 of FIG. 3. [Figure 6] 4 is a table showing an example data structure of the purchase DB 324 of FIG. 3. [Figure 7] 3 is a table illustrating an example data structure of the product DB 270 of FIG. 2. [Figure 8] 3 is a table showing an example data structure of the material DB 272 of FIG. 2. [Figure 9] 3 is a table illustrating an example data structure for the customized product lookup table 274 of FIG. 2. [Figure 10] 3 is an exemplary data structure of the context DB 276 of FIG. 2. [Figure 11] 3 is a table illustrating an example data structure of the game DB 278 of FIG. 2. [Figure 12] 2 is a schematic diagram illustrating an example of the operation of a terminal 30c according to some embodiments of the present disclosure. [Figure 13] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 14] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 15]6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 16] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 17] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 18] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 19] 6 is an exemplary screen image of a live streaming room screen 600 displayed on the display of a live streamer's user terminal 20 or a viewer's user terminal 30. [Figure 20] 1 is a schematic diagram showing an example of the operation of product P according to some embodiments of the present disclosure. [Figure 21] 2 is a schematic diagram illustrating an example of the operation of a terminal 30c according to some embodiments of the present disclosure. [Figure 22] 13 is a flowchart showing the steps of purchasing a product on a user terminal. [Diagram 23] 1 illustrates an exemplary hardware configuration of an information processing device based on some embodiments of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the same or similar components, parts, steps, or signals shown in each drawing will be denoted by the same reference numerals in all drawings, and duplicated explanations will be omitted as appropriate. In addition, some parts that are not important in the explanation of each drawing will be omitted.

[0012] The live streaming system 1 according to some embodiments of the present disclosure provides enhanced functionality to facilitate communication and interaction between users, and more specifically, to entertain viewers and live streamers in a technological manner.

[0013] FIG. 1 is a schematic diagram showing a configuration of a live streaming system 1 according to some embodiments of the present disclosure. The live streaming system 1 provides a live streaming service for a live streamer (also called a liver, streamer, or distributor) LV and a viewer (also called an audience) AU (AU1, AU2, ...) of streaming to interact with each other in real time. As shown in FIG. 1, the live streaming system 1 may include a server 10, a user terminal 20, and a user terminal 30 (30a, 30b, ...). The user terminal 20 may be a live streamer, and the user terminal 30 may be a viewer. In some embodiments, the live streamer and the viewer may be called users.

[0014] The server 10 may include one or more information processing devices connected via a network NW. The user terminals 20 and 30 may be, for example, mobile terminals such as smartphones, tablets, notebook PCs, recorders, portable game consoles, and wearable terminals, or stationary computers such as desktop PCs. The server 10, the user terminals 20, and the user terminals 30 may be communicatively connected via any type of wired or wireless network NW.

[0015] The live streaming system 1 involves the live streamer LV, the viewer AU, and an app provider (not shown) that provides the server 10. The live streamer LV can record content such as his / her own singing, talking, performance, game streaming, etc. on his / her user terminal 20 and upload it to the server 10, thereby distributing the content in real time. In some embodiments, the live streamer LV can interact with the viewer AU through the live streaming.

[0016] The app provider may provide a platform for content to be live streamed on the server 10. In some embodiments, the app provider may be a media or manager that manages real-time communication between the live streamer LV and the viewer AU. The viewer AU may access the platform through the user terminal 30 and select and view the content that the viewer AU wants to view. The viewer AU may perform operations to interact with the live streamer, such as commenting on the live streamer or cheering on the live streamer, through the user terminal 30. The live streamer providing the content may respond to the comments or cheers. The live streamer's response may be transmitted to the viewer AU by video and / or audio. Thus, mutual communication between the live streamer and the viewer may be achieved.

[0017] As used herein, "live streaming" may refer to data transmission that enables the viewer AU to substantially play and view the content recorded by the live streamer LV via the user terminal 20 via the user terminal 30. In some embodiments, "live streaming" may refer to streaming realized by the above-mentioned data transmission. The live streaming may be realized by known technologies such as HTTP live streaming, CMAF (Common Media Application Format), WebRTC (Web Real-Time Communications), RTMP (Real-Time Messaging Protocol), and MPEG DASH.

[0018] The live streaming may further include an embodiment in which the viewer AU can play or watch the content with a certain delay while the live streamer is recording the content. The degree of the delay is preferably small enough to at least allow the live streamer LV and the viewer AU to communicate with each other. However, live streaming is different from so-called on-demand delivery. More specifically, the on-demand delivery may refer to storing all data of the recorded content in a server and providing the data to the user from the server at random times in response to a user's request.

[0019] In this specification, "streaming data" may refer to data including image data and audio data. More specifically, the image data (which may be called video data) may be generated by an image capture function of the user terminals 20 and 30. The audio data (which may be called audio data) may be generated by an audio input function of the user terminals 20 and 30. The streaming data may be played back on the user terminals 20 and 30 to enable viewing of content related to the user.

[0020] In some embodiments, it is assumed that the streaming data is compressed, expanded, encoded, decoded, transcoded, or otherwise processed to change the format or size standard of the data from when it is generated at the user terminal of the live streamer until it is played at the user terminal of the viewer. The content (video or audio) is not substantially changed before and after such processing, and therefore, in the current embodiment of the present disclosure, the streaming data before processing and the streaming data after processing are described as being the same. In other words, when the streaming data generated by the user terminal of the live streamer is played at the user terminal of the viewer via the server 10, the streaming data generated at the user terminal of the live streamer, the streaming data that has passed through the server 10, and the streaming data received and played by the user terminal of the viewer are all the same streaming data.

[0021] As shown in Fig. 1, the live streamer LV provides live streaming. The user terminal 20 of the live streamer generates streaming data by recording the video and / or audio of the streamer, and transmits the streaming data to the server 10 via the network NW. At the same time, the user terminal 20 displays the video VD on the display of the user terminal 20, so that the user can check the streaming content of the live streamer LV.

[0022] Viewers AU1, AU2 such as user terminals 30a, 30b, 30c that request the platform to provide live streaming of the live streamer can receive streaming data corresponding to the live streaming via the network NW, play the received streaming data to display videos VD1, VD2 on a display, and output audio from a speaker, etc. The videos VD1, VD2 displayed on the user terminals 30a, 30b, respectively, are substantially the same as the videos recorded by the user terminals of the live streamer LV, and the audio output from the user terminals 30a, 30b is substantially the same as the audio recorded by the user terminals of the live streamer LV.

[0023] The recording of the live streamer on the user terminal 20 may be simultaneous with the playback of the streaming data on the user terminals 30a, 30b of the viewers AU1, AU2. When the viewer AU1 inputs a comment on the content of the live streamer LV to the user terminal 30a, the server 10 displays the comment on the user terminal 20 of the live streamer in real time, and also on the user terminals 30a, 30b of the viewers AU1, AU2. When the live streamer LV responds to the comment, the response is output as text, image, video, or audio from the user terminals 30a, 30b of the viewers AU1, AU2, thereby realizing communication between the live streamer LV and the viewers AU1, AU2. Thus, the live streaming system can realize two-way live streaming.

[0024] 2 is a block diagram showing the functions and configuration of the user terminal 20 shown in FIG. 1 according to an embodiment of the present disclosure. The user terminal 30 has the same functions and configuration as the user terminal 20. The blocks depicted in the block diagrams in this specification are implemented by hardware such as a device or mechanical part, such as a computer CPU, and software such as a computer program that represents functional blocks implemented by the cooperation of these elements. Therefore, it will be understood by those skilled in the art that the functional blocks can be implemented in various ways by combining hardware and software.

[0025] The live streamer LV and the viewer AU can download and install the live streaming application (live streaming app) of the present disclosure from a download site to the user terminals 20 and 30 via the network NW. Alternatively, the live streaming app may be pre-installed in the user terminals 20 and 30. By executing live streaming by the user terminals 20 and 30, the user terminals 20 and 30 can communicate with the server 10 via the network NW and realize a plurality of functions.

[0026] The functions realized by the execution of the live streaming app by the user terminals 20 and 30 (more specifically, processors such as CPUs) are described below as functions of the user terminals 20 and 30. The functions are basically functions that the live streaming app causes the user terminals 20 and 30 to realize. In some embodiments, these functions may be realized by transmitting them from the server 10 to web browsers of the user terminals 20 and 30 via the network NW and executing them by computer programs in the web browsers. The computer programs may be written in a programming language such as HTML (Hyper Text Markup Language).

[0027] The user terminal 20 includes a streaming unit 100, a viewing unit 200, a provision unit 250, a product DB 270, a material DB 272, a customized product lookup table 274, a context DB 276, and a game DB 278. In some embodiments, the streaming unit 100 is configured to record a user's audio and / or video data and generate streaming data to send to the server 10. The viewing unit 200 is configured to receive and play the streaming data from the server 10.

[0028] In some embodiments, a user can activate the streaming unit 100 during a broadcast or activate the viewing unit 200 when viewing a stream. In some embodiments, the user terminal that activates the streaming unit 100 can be referred to as a live streamer or as the user terminal that generates streaming data. The user terminal that activates the viewing unit 200 can be referred to as a viewer or as the user terminal that plays the streaming data.

[0029] The streaming unit 100 may include a video control unit 102, an audio control unit 104, a distribution unit 106, and a UI control unit 108. The video control unit 102 may be connected to a camera (not shown), and the video is controlled by the camera. The video control unit 102 can obtain the video data from the camera. The audio control unit 104 may be connected to a microphone (not shown), and the audio is controlled by the microphone. The audio control unit 104 can obtain the audio data from the microphone.

[0030] The delivery unit 106 receives streaming data including video data from the video control unit 102 and audio data from the audio control unit 104 and transmits the streaming data to the server 10 via the network NW. In some embodiments, the delivery unit 106 transmits the streaming data in real time, i.e., the generation of the streaming data from the video control unit 102 and the audio control unit 104 and the delivery by the delivery unit 106 are performed simultaneously.

[0031] The UI control unit 108 controls the UI of the live streamer. The UI control unit 108 is connected to a display (not shown) and configured to generate the streaming data for the distribution unit 106 to transmit, play and display on the display. The UI control unit 108 is configured to display an object to be operated or an object to be instructed on the display and to receive a tap input from the live streamer.

[0032] The viewing unit 200 may include a UI control unit 202, a rendering unit 204, and an input sending unit 206. The viewing unit 200 is configured to receive streaming data from the server 10 via a network NW. The UI control unit 202 controls the UI of the viewer. The UI control unit 202 is connected to a display (not shown) and / or a speaker (not shown) and configured to display a video on the display and output a sound from the speaker by playing the streaming data. In some embodiments, outputting a video on the display and outputting a sound from the speaker may be referred to as "playing streaming data". The UI control unit 202 is connected to an input unit such as a touch panel, a keyboard, a display, etc., and can obtain input from a user.

[0033] The rendering unit 204 may be configured to render streaming data from the server 10 and frame images. The frame images may include user interface objects for accepting input from a user, comments entered by a viewer, and data received from the server 10. The input sending unit 206 is configured to receive the user input from the UI control unit 202 and send it to the server 10 via the network NW.

[0034] In some embodiments, the user input may be clicking an object on the screen of the user terminal, such as selecting a live stream, entering a comment, sending a gift, following or unfollowing a user, voting in an event, playing a game, etc. For example, the input sending unit 206 may generate gift information and send it to the server 10 via the Internet NW when the user terminal of a viewer clicks a gift object on the screen to send a gift to the live streamer.

[0035] The provision unit 250 may include a UI control unit 252, an inventory unit 254, a processing unit 256, and an input sending unit 258. The provision unit 250 is configured to provide the product to the user. The UI control unit 252 controls the viewer's UI. The UI control unit 252 is configured to display the product selection on the display. In some embodiments, the UI control unit 252 may output a sound from a speaker, for example, when the user selects a product or when a purchase is completed. The UI control unit 252 may also be connected to an input unit, such as a touch panel, a keyboard, or a display, to obtain input from a user.

[0036] The inventory unit 254 may be configured to check the availability of the product or material from the product DB 270 or material DB 272. For example, when the user selects a product, the inventory unit 254 may refer to the product DB 270 to check the availability of the product. When the user selects a customized product, the inventory unit 254 may refer to the customized product lookup table 274 to check the materials of the customized product, and refer to the material DB 272 to check the availability of the materials, etc. In some embodiments, if the product or material is insufficient or out of stock, a warning or error message may be displayed to notify the user.

[0037] The processing unit 256 may be configured to perform a process of providing a product or a customized product to the user. For example, if the product is available, the processing unit 256 may provide the product to the user. If the materials of the customized product are available, the processing unit 256 may refer to the customized product lookup table 274 to confirm the method, materials, conditions, etc. of the customized product, and then manufacture the customized product for the user. In some embodiments, if the conditions do not satisfy the information of the user, a warning message or an error message may be displayed to notify the user.

[0038] In some embodiments, the frame image may include user interface objects for accepting input from the user, such as selecting the product or customized product. The input sending unit 206 is configured to receive the user input from the UI control unit 252 and send it to a corresponding unit or the server 10 via the network NW.

[0039] In some embodiments, the user input may be clicking an object on the screen of the user terminal, such as selecting the product or a customized product. For example, the input sending unit 258 may generate product information and send it to the server 10 via the Internet NW when the user terminal of the user clicks a product on the screen 600 to purchase the product.

[0040] In some embodiments, a payment system (not shown) may be introduced into the live streaming system 1. The payment system may be configured to process financial transactions. In some embodiments, the payment system may be a system separate from the server 10 or the terminal, or may be integrated into the server 10 or the terminal. In some embodiments, the product may be purchased with virtual items such as points, or with cash, credit cards, etc. In some embodiments, the design of the payment system may be flexibly determined according to actual needs.

[0041] 7 shows a table illustrating an exemplary data structure of the product DB 270 in FIG. 2. The product DB 270 holds information about products. The products may be ready-made products, customized products, etc. The product DB 270 stores a product ID that identifies a product on the live streaming platform provided by the live streaming system 1, a description that identifies a description of the product, points that identify points of the product, and inventory that identifies the inventory status of the product in association with each other.

[0042] 8 shows a table illustrating an exemplary data structure of the material DB 272 of FIG. 2. The material DB 272 holds information about materials for manufacturing a product or customized product. The material DB 272 stores a material ID that identifies a material and a status that identifies a state of the material in association with each other. In some embodiments, the material may be any material for manufacturing a product, such as metal, non-metal, paper, ink, etc.

[0043] In some embodiments, the material may include plastics such as PLA and ABS, nylon, resin, metal, rubber, etc. The material may be colored or colorless. In some embodiments, the material for coloring may include multi-colored plastics, paints, dyes, pigment powders, etc. In some embodiments, the status of the material may be "available", "low stock", "out of stock", etc. In some embodiments, the setting of the material and status may be flexibly determined according to actual needs.

[0044] 9 illustrates a table showing an example data structure for the customized product lookup table 274 of FIG. 2. The customized product lookup table 274 may be configured to store information for manufacturing customized products, etc. In some embodiments, the customized product lookup table 274 may also include information for manufacturing an off-the-shelf product. If the off-the-shelf product is out of stock and materials are available, the product may be manufactured and provided to the user.

[0045] In some embodiments, the customized product lookup table 274 holds information on the above-mentioned products or customized products. The customized product lookup table 274 stores a product ID that identifies a product or customized product on the live streaming platform provided by the live streaming system 1, a manufacturing method that identifies a manufacturing method of the product, a material ID that identifies a material for manufacturing the product, and conditions that identify specific purchase conditions of the product, in association with each other. For example, the manufacturing method of the key holder may be a 3D printer that uses resin, metal, paint, etc. as materials. In some embodiments, the purchase conditions of the product may be flexibly determined according to actual needs.

[0046] 10 shows an exemplary data structure of the context DB 276 of FIG. 2. The context DB 276 holds information about a context. The context DB 276 stores a context ID that identifies a context, a description that specifies a description of the context, and a URL that specifies a location of the context, in association with each other. In some embodiments, the context may be a text object, an image object, a video object, etc., provided by the live streaming system 1 or uploaded by the user.

[0047] In some embodiments, the context may be an image or video of the live streamer, and the image or video may be obtained from live streaming data, archive data of the live streamer, etc. In some embodiments, the context may be some background image or video uploaded by the user, provided by the live streaming system 1, or obtained from the Internet, etc. In some embodiments, the context may be flexibly determined according to actual needs.

[0048] FIG. 11 shows a table illustrating an exemplary data structure of the game DB 278 of FIG. 2. The game DB 278 holds information about games. The game DB 278 stores a game ID that identifies a game on a live streaming platform provided by the live streaming system 1, a title that identifies the title of the game, and a URL that identifies the location of the game, in association with each other. In some embodiments, the game may be an online game or an offline game. The game may be an interactive game with a live streamer or other users. The game may be downloaded in advance or played in real time over a network. In some embodiments, the implementation of the game play may be flexibly determined according to actual needs.

[0049] 3 is a block diagram of the server 10 according to some embodiments of the present disclosure. The server 10 may include a streaming information unit 302, a relay unit 304, a processing unit 306, a stream DB 320, a user DB 322, and a purchase DB 324.

[0050] The streaming information unit 302 receives a request for live streaming from the user terminal 20 of the live streamer via the network NW. Upon receiving the request, the streaming information unit 302 registers the information of the live streaming in the stream DB 320. In some embodiments, the information of the live streaming may be a stream ID of the live streaming and / or a live streamer ID of the live streamer corresponding to the live streaming.

[0051] When receiving a request for providing the information of the live streaming from the viewing unit 200 of the user terminal 30 via the network NW, the streaming information unit 302 refers to the stream DB 320 and generates a list of available live streaming. Then, the streaming information unit 302 transmits the list to the user terminal 30 via the network NW. The UI control unit 202 of the user terminal 30 generates a live streaming selection screen based on the list and displays the list on the display of the user terminal 30.

[0052] When the input sending unit 206 of the user terminal 30 receives the selection of live streaming by the viewer on the live streaming selection screen, it generates a delivery request including the stream ID of the selected live streaming, and sends it to the server 10 via the network. The streaming information unit 302 can start providing the live streaming specified by the stream ID in the delivery request to the user terminal 30. The streaming information unit 302 can update the stream DB 320 and add the viewer ID of the viewer of the user terminal 30 to the live streamer ID of the stream ID.

[0053] The relay unit 304 can relay the transmission of live streaming from the user terminal 20 of the live streamer to the user terminal 30 of the viewer in the live streaming started by the streaming information unit 302. The relay unit 304 can receive a signal indicating a user input from the viewer from the input transmission unit 206 during playback of streaming data. The signal indicating the user input may be an object designation signal indicating designation of an object to be displayed on the display of the user terminal 30. The object designation signal may include a viewer ID of the viewer, a live streamer ID of a live streamer who delivers the live streaming being viewed by the viewer, and an object ID designated by the object. If the object is a gift or the like, the object ID may be a gift ID or the like. Similarly, the relay unit 304 can receive a signal indicating a user input of the live streamer, such as the object designation signal, from the streaming unit 100 of the user terminal 20 during playback of streaming data.

[0054] The processing unit 306 is configured to process a request in response to an operation from a user's user terminal. For example, the user may request game data to be downloaded from the server 10 or a context such as an image or background material of a live streamer. The processing unit 306 may refer to a corresponding database such as a data DB (not shown) to obtain the game data or context data, and then transmit them to the user terminal of the user.

[0055] In some embodiments, the processing unit 306 may update the corresponding database in response to an operation of the user from the user terminal. For example, when the user purchases a product through the user terminal, the input sending unit 258 may generate and send product information such as a purchase record to the server 10. The processing unit 306 may refer to the purchase DB 324 and store the purchase record in the purchase DB 324 for reference or the like.

[0056] Fig. 4 is a table showing an example data structure of the stream DB 320 in Fig. 3. The stream DB 320 holds information about currently running live streams. The stream DB 320 stores a stream ID for identifying a live stream on a live streaming platform provided by the live streaming system 1, a live streamer ID for identifying a live streamer providing the live stream, and a viewer ID for identifying a viewer of the live stream, in association with each other.

[0057] Fig. 5 is a table showing an example data structure of the user DB 322 in Fig. 3. The user DB 322 holds information about users. The user DB 322 stores a user ID for identifying a user, points for identifying points accumulated by the user, a level for identifying the level of the user, and a status for identifying the status of the user, in association with each other.

[0058] The points are electronic value circulating within the live streaming platform. The level may be an indication of the amount of activity or engagement of the user on the live streaming platform. The status may be the identity or membership status of the user on the live streaming platform. In some embodiments, the products or customized products may be subject to purchase conditions based on the user's information. For example, some customized products may be available only to VIP users or users at level 80 or above.

[0059] In some embodiments, the user DB 322 may also store an archive of the user. The archive may include an archive URL that identifies the location of the archived content. The archived content may include images of the live streamer, etc. In this embodiment, images of the live streamer may be obtained even if the live streamer is not online. In some embodiments, information related to the user may be stored, such as the user's displayed images, uploaded images, etc.

[0060] Fig. 6 is a table showing an exemplary data structure of the purchase DB 324 in Fig. 3. The purchase DB 324 holds information about purchase records. The purchase DB 324 stores a user ID for identifying a user as a purchaser, time information for identifying a purchase time, an item ID for identifying a product or customized product purchased by the user, and points for identifying points spent by the user on the product, in association with each other.

[0061] 12 is a schematic diagram showing an example of the operation of a terminal 30c according to some embodiments of the present disclosure. As shown in FIG. 12, the user terminal 30c may be a device or machine equipped with a screen 600. In some embodiments, the terminal may be a vending machine, a photo booth, an arcade cabinet, an arcade machine, or the like. The terminal may also include an enclosed space ES equipped with a cover CO or curtain CU for the user to operate privately.

[0062] In some embodiments, the screen 600 may be a touch screen for performing operations. The terminal may also include physical buttons B, sensors S, a product manufacturing zone MZ, a take-out port PW, etc. In some embodiments, a specific device such as a printer or a 3D printer may be installed in the manufacturing zone MZ. In some embodiments, the design and layout of the terminal may be flexibly determined according to actual needs.

[0063] The screen 600 may include a user interface for the user to perform operations. In some embodiments, the user may register or log in as a live streamer or a viewer, or perform operations as a guest. In some embodiments, as a guest, the user may not be allowed to perform some operations. In some embodiments, the privileges of a live streamer, a viewer, or a guest may be set according to actual needs.

[0064] The screen 600 may include multiple tabs 602 for the user to switch between different features. In some embodiments, the screen 600 may include tabs 602 such as "Products," "Customize," "Live," "Photos," and "Games." The "Products" tab 602 may include a list of pre-made products for the user to select, purchase, etc. The "Customize" tab 602 may provide the user with customized product information. The "Live" tab 602 may allow the user to watch live streaming, archived videos, or live stream. The "Photos" tab 602 may allow the user to take photos, videos, etc. The "Games" tab 602 may allow the user to play games offline or online with other live streamers, etc.

[0065] 13 to 19 are exemplary screen images of a live streaming room screen 600 displayed on the display of the live streamer's user terminal 20 or the viewer's user terminal 30. As shown in FIG. 13, the screen 600 may display a list of ready-made products P. In some embodiments, the product P may be any item having the characteristics of a live streamer on a live streaming platform. For example, the product P may be a figurine of the live streamer or a phone holder on which an image of a virtual live streamer is displayed.

[0066] In some embodiments, the product P may be a famous IP character such as Barbie or Lego. In some embodiments, a search bar SB may be provided to allow the user to search for a particular product or products related to a particular live streamer. In some embodiments, a pre-made object P may be displayed in a physical window separate from the screen 600 so that the user can see the appearance of the product.

[0067] As shown in FIG. 14, the user may also purchase a customized product, and the customized product may be manufactured according to the user's preferences. For example, the user may select a live streamer and a product to manufacture a customized product with the characteristics of the live streamer. In some embodiments, a search bar SB may be provided to allow the user to select the live streamer, the product, etc. In some embodiments, the provision unit 250 may refer to a material DB 272, a customized product lookup table 274, a context DB 276, etc. for manufacturing the customized product in response to the selection of a live streamer and a product from the user. For example, when the user selects the live streamer "Hana" and the product "photo", a photo of the live streamer may be printed or otherwise manufactured.

[0068] In some embodiments, a preview PV of the customized product may be provided so that the user can see the appearance of the finished product. In some embodiments, the user may make changes to the finished product based on their preferences. For example, the terminal may provide default hair, face, body, clothing, and gesture models, and the user may customize their product with different shapes and colors.

[0069] In some embodiments, the user may customize the product by adding decorations, moving the location of the live streamer, or rearranging parts of the product. In some embodiments, an exemplary customized product may be displayed in a physical window separate from the screen 600 so that the user can check the appearance of the customized product. In some embodiments, the design and layout of the customized product may be flexibly determined by the user according to actual needs.

[0070] The "Customize" tab 602 may include purchase information PI for the user to proceed with the purchase. In some embodiments, the purchase information PI may include a description of the customized product and corresponding points, as well as a total of points. When the user completes the purchase, the input sending unit 258 may send the purchase record to the server 10, and the processing unit 306 may store the purchase record in the purchase DB 324.

[0071] In some embodiments, the live streamer selected for a pre-made or customized product may receive a reward. The reward may be a virtual or physical reward, etc. In some embodiments, the live streamer may receive the reward if the live streamer is live streaming when a product related to the live streamer is purchased. For example, if the selected live streamer is live streaming, the live streamer may receive the reward in the live streaming room.

[0072] A message M saying "Hana has received a reward of 1,000 points" may be displayed in the live streaming room to notify the live streamer of the reward, as shown in Fig. 15. In some embodiments, the part where the live streamer has received the reward may be displayed on the terminal, as shown in Fig. 16. According to this embodiment, the user can see the live streamer's facial expression after receiving the gift, and the live streamer can thank the user in real time.

[0073] In some embodiments, the portion for which the live streamer received the reward may be archived as an archive video. A link to the archive video may be provided on the product by a digital code or the like. For example, a QR code for the video may be printed on the bottom of the figure of the live streamer or the like. In some embodiments, the video may be played on the screen 600 as shown in FIG. 16. The user may play, fast forward, rewind, etc. the video.

[0074] In some embodiments, as shown in FIG. 16, a download button B may be provided so that the user can download the video. In some embodiments, the user may share the video with other users or other social network platforms. In some embodiments, the use of the video may be flexibly determined according to actual needs. According to this embodiment, the interaction between the real terminal and the virtual streaming room can be improved.

[0075] As shown in FIG. 17, the user may watch or broadcast live streaming through the terminal. The tab 602 of "Live" may include a list of live streaming LS displayed on the screen 600, which the user may select and watch. In some embodiments, the screen 600 may have an area R displaying the live streaming room, etc. The user may watch the live streaming while waiting for the production of the customized product, etc. In some embodiments, the thumbnail of the live streaming or live streaming room may include a product button PB for the user to access the product related to the live streamer. For example, the user may click the product button PB to access other tabs using the ID of the live streamer as a search keyword.

[0076] In some embodiments, a "live streaming" button B may be provided on the screen 600, allowing the user to start streaming through the terminal. In some embodiments, when the user clicks the "GO LIVE" button B, a live streaming pre-setting screen may be displayed in the area R, allowing the user to pre-set title, tag, event, virtual skin, etc. In some embodiments, the design and layout of the live streaming page may be flexibly determined according to actual needs. According to this embodiment, the user can have more choices while operating the terminal or waiting for the product.

[0077] As shown in FIG. 18, the "Photo" tab 602 may be configured as a photo booth. The user may take a selfie, take a picture with a friend, etc. In some embodiments, the image or image of the user may be used as context to create the customized product. For example, the user may select a phone holder product of the live streamer and further add a selfie next to the live streamer.

[0078] In some embodiments, as shown in FIG. 18, there may be a context that the user U can select and combine with the photo, such as an image of a live streamer LV and a background BG. The image or video of the user U may be collected from a camera or the like. For example, the user U may select a virtual live streamer LV and the background BG of an amusement park and take a photo of the live streamer with the user at the amusement park. In some embodiments, the "Photo" tab 602 may be a separate tab on the screen 600 or may be integrated into a customized product list or the like. According to this embodiment, the user can customize their own context using a default context and camera.

[0079] In some embodiments, the opportunity to be in context within the photo booth may be a reward if the live streamer or virtual live streamer wins an event on the live streaming platform. Fans of the live streamer may cheer on their favorite live streamer to win a reward and then use the device to take a customized photo with their favorite live streamer. Additionally, the live streaming platform may run campaigns or prize draws to motivate viewers to share, for example, customized photos.

[0080] As shown in FIG. 19, the "Game" tab 602 may be configured as an arcade machine. In some embodiments, the game may be an online game or an offline game. A leaderboard (not shown) may be provided to rank the user according to the game score. The user may select one or more opponents to play with. In some embodiments, the opponents may be live streamers or other users of the live streaming platform. The screen 600 may have an area R that displays a game screen of the user and the opponents, etc.

[0081] In some embodiments, the viewing unit 200 may receive information of a game selected by the user and information of another user selected by the user as an opponent. The viewing unit 200 may further generate a real-time battle UI based on the selected game and opponent. The viewing unit 200 may further render the real-time battle UI on the screen 600 for the user to play a game with another user. According to this embodiment, the user can have more choices while operating the terminal or waiting for the product.

[0082] In some embodiments, the user may use a default avatar AT or upload a unique avatar AT to play games with the live streamer in the live streaming room. For example, a camera may scan the user's appearance to generate an avatar for the user. The avatar may be uploaded by scanning a QR code, an image, etc. According to this embodiment, each user may have their own avatar, which may improve the user experience.

[0083] In some embodiments, the virtual avatar may be purchased as a product by the user. For example, a QR code may be printed on an action figure purchased by the user. The user may scan the QR code with a terminal such as a smartphone to obtain the virtual avatar. This embodiment can increase the user's options when purchasing a product.

[0084] 20 is a schematic diagram illustrating an example of an operation of a product P according to some embodiments of the present disclosure. As shown in FIG. 20, the product P may include a code object, such as a QR code. When the user scans the QR code of the product P, a virtual avatar VA may be imported into the user's smartphone or the like. In some embodiments, the virtual avatar VA may be generated by, for example, photo editing software, a machine learning model, an artificial intelligence program, or the like.

[0085] In some embodiments, each product may include a unique virtual avatar. That is, points spent on an action figure are equivalent to purchasing a permanent right to use that virtual skin. In some embodiments, the virtual avatar as well as the background of the live streaming room, special gifts, chat frames, chat colors, etc. may be obtained in a similar manner. Furthermore, the user may access the "Live" tab 602 and attempt to broadcast using the virtual avatar, background, etc. This embodiment may improve the user experience.

[0086] In some embodiments, the screen 600 of the terminal may be projected onto another large screen. FIG. 21 is a schematic diagram showing an example of the operation of the terminal 30c according to some embodiments of the present disclosure. As shown in FIG. 21, the screen 600 of the terminal 30c may be projected onto another large screen 700 and made available to the public. In some embodiments, the large screen 700 may be a video wall of a building, a projection screen, etc. The purpose of projecting onto the large screen may be instruction, publicity, advertising, a campaign, an event, etc. In some embodiments, as shown in FIG. 21, another terminal such as the user terminal 30b may be used as a remote controller to remotely demonstrate the operation of the terminal 30c by the user.

[0087] Next, the operation of the live streaming system 1 having the above configuration will be described. FIG. 22 is a flow chart showing the steps of purchasing a product on a user terminal. When a user logs into the user interface of the user terminal 30c or enters as a guest, the user may refer to the products and select the product (S504) by, for example, selecting the live streamer (S502). In some embodiments, the user can freely view the products and select the desired item according to his / her mood at the time.

[0088] If the product selected by the user is a ready-made product (S506: No), the terminal may provide the product to the user if the product is in stock and the user completes the purchase (S508). If the product selected by the user is a customized product (S506: Yes), the terminal may determine whether the user meets certain conditions (S510). In some embodiments, the conditions vary depending on the product selected by the user. For example, if the customized product is only available to registered users with VIP status, the terminal may further check the user's identity, status, etc.

[0089] If the user does not meet the specific conditions (S510, "No"), an error message may be displayed and the user may return to step S504 to reselect the product. If the user meets the specific conditions (S510, "Yes"), the terminal 30c may proceed to manufacture the customized product (S512). Furthermore, if the materials are in stock and the user completes the purchase, the terminal may provide the product to the user (S508).

[0090] In some embodiments, the manufacturing of the customized product may be any possible method, such as 3D printing, printing, die-casting injection molding, etc. In some embodiments, the hardware and software required for the above manufacturing method may be pre-installed on the terminal or connected to the terminal. In some embodiments, the product may be manufactured based on the customized product lookup table 274, etc.

[0091] For example, for 3D printing, 3D models may be generated by various 3D modeling software such as Blender, AutoCAD, SolidWorks, etc. In some embodiments, the file format for 3D printing may be STL (Standard Tessellation Language), OBJ (Wavefront OBJ), 3MF (3D Manufacturing Format), etc. The file of the 3D model may be exported to a suitable file format and input into a 3D printer for printing. In some embodiments, the file may be prepared in advance or uploaded by the user, etc.

[0092] According to the present disclosure, the product can be customized according to the user's preferences, and the user can interact with live streamers in more diverse ways. The user may also be a live streamer who interacts with other live streamers and purchases products in more diverse ways. Thus, the user experience may be improved.

[0093] Fig. 23 is a schematic block diagram of a system configuration and computer hardware for executing processing according to some embodiments of the present disclosure. The information processing device 900 in Fig. 23 is configured to realize, for example, the server 10 and the user terminals 20 and 30 according to some embodiments of the present disclosure.

[0094] The information processing device 900 includes a CPU 901, a read-only memory (ROM) 903, and a random access memory (RAM) 905. The information processing device 900 may further include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input unit 915, an output unit 917, a storage unit 919, a drive 921, a connection port 925, and a communication unit 929. The information processing device 900 may include an imaging device (not shown) such as a camera. The information processing device 900 may include a processing circuit such as a digital signal processor (DSP) or an application specific integrated circuit (ASIC) instead of or in addition to the CPU 901.

[0095] The CPU 901 functions as an arithmetic processing device and a control device, and controls the overall operation of the information processing device 900 or a part of the operation according to various programs recorded in the ROM 903, the RAM 905, the storage unit 919, or the removable recording medium 923. For example, the CPU 901 controls the overall operation of each functional unit included in the server 10 and the user terminals 20 and 30 of the above-mentioned embodiment. The ROM 903 stores programs and operation parameters used by the CPU 901. The RAM 905 transiently stores programs used when the CPU 901 executes programs and parameters that change appropriately when the programs are executed. The CPU 901, the ROM 903, and the RAM 905 are connected to each other via a host bus 907 consisting of an internal bus such as a CPU bus. The host bus 907 is connected to an external bus 911 such as a peripheral component interconnect / interface (PCI) bus via the bridge 909.

[0096] The input unit 915 is a device operated by a user, such as a mouse, a keyboard, a touch panel, a button, a switch, or a lever. The input unit 915 may be a device that converts a physical quantity into an electric signal, such as an audio sensor (such as a microphone), an acceleration sensor, a tilt sensor, an infrared sensor, a depth sensor, a temperature sensor, or a humidity sensor. The input unit 915 may be, for example, a remote control device that uses infrared rays or another type of radio wave. Alternatively, the input unit 915 may be an external connection terminal 927 such as a mobile phone that supports the operation of the information processing device 900. The input unit 915 includes an input control circuit that generates an input signal based on information input by a user and outputs the generated input signal to the CPU 901. The user operates the input unit 915 to input various data and instruct the information processing device 900 to perform a processing operation.

[0097] The output unit 917 includes a device that can visually or audibly notify the user of the acquired information. The output unit 917 may be, for example, a display device such as an LCD, a PDP, or an OLED, an audio output device such as a speaker or a headphone, a printer, etc. The output unit 917 outputs the results obtained by the processing executed by the information processing device 900 in the form of text, video such as an image, or sound such as voice.

[0098] The storage unit 919 is a data storage device and is an example of a storage unit of the information processing device 900. The storage unit 919 includes, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, a magneto-optical storage device, etc. The storage unit 919 stores programs and various data executed by the CPU 901, and various data acquired from the outside.

[0099] The drive 921 is a reader / writer of a removable recording medium 923 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and is built into or externally attached to the information processing device 900. The drive 921 reads out information recorded on the attached removable recording medium 923, and outputs it to the RAM 905. The drive 921 writes information to the attached removable recording medium 923.

[0100] The connection port 925 is a port used for directly connecting a device to the information processing device 900. The connection port 925 may be, for example, a USB (Universal Serial Bus) port, an IEEE 1394 port, or a SCSI (Small Computer System Interface) port. The connection port 925 may be an RS-232C port, an optical audio terminal, an HDMI (High Definition Multimedia Interface (registered trademark)) port, or the like. By connecting an external connection terminal 927 to the connection port 925, various data can be exchanged between the information processing device 900 and the external connection terminal 927.

[0101] The communication unit 929 is, for example, a communication interface including a communication device for connecting to a communication network NW. The communication unit 929 may be, for example, a communication card for a wired or wireless local area network (LAN), Bluetooth (registered trademark), or Wireless USB (WUSB).

[0102] The communication unit 929 may be, for example, a router for optical communication, a router for ADSL (asymmetric digital subscriber line), or a modem for various types of communication. For example, the communication unit 929 transmits and receives signals on the Internet and transmits and receives signals with other communication devices using a predetermined protocol such as TCP / IP. The communication network NW to which the communication unit 929 is connected is a network established by a wired connection or a wireless connection. The communication network NW is, for example, the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication.

[0103] The imaging device (not shown) is a device that captures real space and generates a captured image using an imaging element such as a CCD (charge-coupled device) or a CMOS (complementary metal-oxide semiconductor) and various members such as a lens for controlling the formation of a subject image on the imaging element. The imaging device may capture still images or moving images.

[0104] The live streaming system 1 of the present disclosure has been described above with reference to the embodiments. The above-mentioned embodiments are described merely for the purpose of explanation. Rather, those skilled in the art can easily conceive of various combinations of the above-mentioned components and processes of the embodiments and various modifications, which are also included in the technical scope of the present disclosure.

[0105] The steps described in this specification, particularly the steps described using flow charts or flow charts, may include some of the steps constituting the steps, may include steps not explicitly included in the steps constituting the steps, and / or may rearrange the order of the steps. Such omissions, additions, and rearrangements of steps are also included in the scope of the present disclosure as long as they do not deviate from the gist of the present disclosure.

[0106] In some embodiments, at least a part of the functions performed by the server 10 may be performed by a device other than the server 10, for example, the user terminal 20 or 30. In some embodiments, at least a part of the functions performed by the user terminal 20 or 30 may be performed by a device other than the user terminal 20 or 30, for example, the server 10. In some embodiments, rendering of frame images may be performed by the user terminal of a viewer, a server, a live streamer, or the like.

[0107] Furthermore, the system or method described in the above embodiments may be provided in a non-transitory computer-readable storage device such as a solid-state storage device, an optical disk storage device, a magnetic disk storage device, or a computer program product. Alternatively, the program may be downloaded from a server via the Internet.

[0108] Although the technical contents and features of the present disclosure have been described above, those skilled in the art can still make many variations and modifications without departing from the teachings and disclosure of the present disclosure. Therefore, the scope of the present disclosure is not limited to the embodiments already disclosed, but is within the scope of the following claims, including other variations and modifications that do not depart from the present disclosure. [Explanation of symbols]

[0109] 1. Live Streaming System 10 Server 20 User terminal 100 Streaming Units 102 Video control unit 104 Audio control unit 106 Delivery Unit 108 UI control unit 200 viewing units 202 UI control unit 204 Rendering Units 206 Input Transmission Unit 250 units offered 252 UI control unit 254 units in stock 256 processing units 258 Input Sending Unit 270 Product DB 272 Material DB 274 Customized Product Lookup Table 276 Context DB 278 Game DB 30, 30a, 30b User terminal 302 Streaming Information Unit 304 Relay unit 306 Processing Unit 320 Stream DB 322 User DB 324 Purchase DB 600 screens 602 Tabs 700 screens 900 Information processing device 901 CPU 903 ROM 905 RAM 907 Host Bus 909 Bridge 911 External Bus 913 Interface 915 Input Unit 917 Output Unit 919 Storage Unit 921 Drive 923 Removable Recording Media 925 Connection Port 927 External connection terminal 929 Communication Unit LS Live Streaming LV Live Streamer NW Network SP Specific part AU1, AU2 viewers S502, S504, S506, S508, S510, S512 process VD, VD1, VD2 Video

Claims

1. 1. A terminal for operating functions of a vending machine, the terminal comprising: one or more processors, the one or more processors executing machine-readable instructions to: generating first streaming data of a first user; transmitting the first streaming data to a server; receiving second streaming data from the server; a function of playing the second streaming data on a screen of the terminal; receiving information on a product selected by the first user; providing the selected product to the first user; A terminal characterized by executing the above.

2. determining whether the selected product is an off-the-shelf product or a customized product; and in response to the selected product being the customized product, manufacturing the selected product; The function of manufacturing the selected product is realized by one or more of the following methods: 3D printing, printing, die casting, and injection molding; 2. The terminal according to claim 1, characterized in that:

3. the second streaming data includes live streaming data or archived streaming data of a second user; and The terminal of claim 1 , characterized in that the selected product includes information related to the second streaming data.

4. sending a reward to the second user in response to the second user being in subscription when the selected product is purchased; providing an archived video of the video for which the second user receives the reward; The terminal of claim 3 further comprising:

5. collecting video data of the first user; rendering the second streaming data onto the video data; a function of generating an image of the second streaming data on the video data in response to an operation from the first user; The terminal of claim 1 further comprising:

6. the selected product includes code for converting the selected product into a virtual skin via a second terminal; The virtual skin is used for a virtual avatar or a virtual background during distribution.

2. The terminal according to claim 1, characterized in that:

7. receiving information about a game selected by the first user; receiving information of a second user selected by the first user; A function of generating a real-time battle UI based on the selected game and the second user; A function of rendering the real-time battle UI on the first streaming data; The terminal of claim 1 further comprising:

8. projecting content displayed on said screen onto a second screen; a function of controlling content displayed on said screen via a second terminal; The terminal of claim 1 further comprising:

9. 1. A method for operating a function of a vending machine, comprising: generating first streaming data of a first user; transmitting the first streaming data to a server; receiving second streaming data from the server; playing the second streaming data on a screen of the terminal; receiving information of a product selected by the first user; providing the selected product to the first user; A method comprising:

10. A computer program, comprising: generating first streaming data of a first user; transmitting the first streaming data to a server; receiving second streaming data from the server; a function of playing the second streaming data on a screen of the terminal; receiving information on a product selected by the first user; providing the selected product to the first user; A computer program product characterized by:

Images