Information processing system, program, and information processing method

WO2025203294A1PCT designated stage Publication Date: 2025-10-02MITSUBISHI MOTORS CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/012160
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-03-27
Publication Date
2025-10-02

AI Technical Summary

Technical Problem

Existing systems fail to prevent the leakage of conversations during live streaming calls in vehicles, which is crucial for privacy protection.

Method used

An information processing system that detects incoming calls during live streaming and forcibly pauses the stream to prevent conversation leakage, incorporating security and privacy measures.

Benefits of technology

Effectively prevents the leakage of conversations during live streaming calls by detecting and pausing the stream, ensuring privacy and security in real-time live streaming scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024012160_02102025_PF_FP_ABST
    Figure JP2024012160_02102025_PF_FP_ABST
Patent Text Reader

Abstract

This information processing system comprises an information processing unit that is communicably connected to a live-streaming device for live-streaming scenery outside a mobile body, the scenery having been captured from the mobile body. The information processing unit: acquires, from the live-streaming device, a live-streaming start request requesting the start of live streaming; starts the live streaming; detects an incoming call related to a call to a passenger of the mobile body during the live streaming; receives the detection of the incoming call related to the call; and forcibly pauses the live streaming.
Need to check novelty before this filing date? Find Prior Art

Description

Information processing system, program, and information processing method

[0001] The present disclosure relates to an information processing system, a program, and an information processing method.

[0002] Conventionally, systems have been known that acquire live video from occupants of a vehicle such as a passenger car and distribute the live video to participants (see, for example, Patent Documents 1 and 2). The system of Patent Document 1 applies a vehicle with excellent soundproofing and privacy performance to the live distribution environment, providing an opportunity for free live distribution.

[0003] JP 2023-108992 A JP 2023-132130 A

[0004] Privacy measures are important for real-time live streaming. For example, it is desirable to avoid situations where conversations between passengers in a vehicle (e.g., via a phone app or a regular phone) are leaked during live streaming. Patent Documents 1 and 2 do not disclose a system that solves this problem.

[0005] An object of the present disclosure is to provide an information processing system that prevents the leakage of conversations that occur during live streaming calls.

[0006] According to one aspect of the present disclosure, there is provided an information processing system including an information processing unit communicably connected to a live streaming device for live streaming a scene outside a moving object captured from the moving object, the information processing unit receiving a live streaming start request from the live streaming device to start the live streaming, detecting an incoming call to a passenger of the moving object during the live streaming, and forcibly pausing the live streaming upon detection of the incoming call.

[0007] A program according to one aspect of the present disclosure causes a computer to perform the following steps: communicatively connecting to live streaming equipment for live streaming a scene outside the moving body photographed from the moving body; acquiring a live streaming start request from the live streaming equipment to start the live streaming; detecting an incoming call to a passenger of the moving body during the live streaming; and forcibly pausing the live streaming upon detection of the incoming call.

[0008] An information processing method according to one aspect of the present disclosure includes a step of communicatively connecting to a live streaming device for live streaming a scene outside the moving body photographed from the moving body, a step of acquiring a live streaming start request from the live streaming device to start the live streaming, and starting the live streaming, a step of detecting an incoming call to a passenger of the moving body during the live streaming, and a step of forcibly pausing the live streaming upon detection of the incoming call.

[0009] This information processing system detects an incoming call during live streaming and forcibly pauses the live streaming, thereby preventing leakage of conversations that occur during calls during live streaming.

[0010] 1 is an overall system diagram of an information processing system according to an embodiment of the present disclosure. FIG. 2 is a system diagram of a server according to an embodiment of the present disclosure. FIG. 3 is a diagram showing an example of a video selection screen according to an embodiment of the present disclosure. FIG. 4 is a diagram showing an example of a live video management table according to an embodiment of the present disclosure. FIG. 5 is a diagram showing an example of a recorded video management table according to an embodiment of the present disclosure. FIG. 6 is a flowchart showing a control procedure executed by an information processing unit according to an embodiment of the present disclosure. FIG. 7 is a diagram showing an example of a thumbnail arrangement in a video selection screen according to an embodiment of the present disclosure. FIG. 8 is a flowchart showing a control procedure executed by an information processing unit according to an embodiment of the present disclosure. FIG. 9 is a flowchart showing a control procedure executed by an information processing unit according to an embodiment of the present disclosure. FIG. 10 is a flowchart showing a control procedure executed by an information processing unit according to an embodiment of the present disclosure. FIG. 11 is a diagram showing an example of a standby screen according to an embodiment of the present disclosure. FIG. 12 is a diagram showing an example of a distribution screen according to an embodiment of the present disclosure. FIG. 13 is a diagram showing an example of a pause screen according to an embodiment of the present disclosure.

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0012] (whole)

[0013] As shown in FIG. 1, in this embodiment, an information processing system 1 includes a vehicle C1, a server S, and user terminals T1 and T2.

[0014] As shown in FIG. 1 , the vehicle C1 includes a control device E1, a GPS (Global Positioning System) receiver E2, a camera E3, a transceiver E4, a display E5, a speaker E6, and a microphone E7. These devices function as live streaming equipment E9. The vehicle C1 may also include a smartphone E8 carried by a vehicle occupant. The smartphone E8 includes devices equivalent to the control device E1, the GPS receiver E2, the camera E3, the transceiver E4, the display E5, the speaker E6, and the microphone E7, and may function as live streaming equipment E9. The smartphone E8 also includes telephone functions such as receiving and communicating with a telephone. The control device E1 is electrically connected to the GPS receiver E2, the camera E3, the transceiver E4, the display E5, the speaker E6, and the microphone E7. The control device E1 is connected to the smartphone E8 via wired or wireless communication. The control device E1 is actually an ECU (Electronic Control Unit) that is configured by a microcomputer including a timer, a calculation unit, memory (ROM, RAM, non-volatile RAM, etc.), an input / output buffer, etc.

[0015] In this embodiment, the vehicle C1 is capable of performing live streaming, in which the vehicle C1 captures the scenery outside the vehicle C1 and broadcasts the captured video in real time. Specifically, the camera E3 captures the scenery outside the vehicle C1 to generate video data. At the same time, the microphone E7 collects the voices of the occupants of the vehicle C1 to generate first audio data. The control device E1 generates distribution data including the video data and the first audio data. The transceiver E4 transmits the distribution data to the server S via the Internet 2. The user terminals T1 to T2 are, for example, smartphones. The user terminals T1 to T2 access the server S via the Internet 2 to receive the distribution data. The user terminals T1 to T2 extract the video data and the first audio data from the distribution data, play the video based on the video data, and play the audio of the occupants based on the first audio data.

[0016] The live streaming may enable two-way exchange of audio data. For example, the user terminals T1 and T2 collect audio from viewers of the live streaming to generate second audio data, and transmit the second audio data to a server S via the Internet 2. The control device E1 acquires the second audio data from the server S and transmits it to a speaker E6. The speaker E6 reproduces the audio of the viewers based on the second audio data.

[0017] The live broadcast may be either a public location broadcast in which the geographical location of the vehicle C1 is made public, or a private location broadcast in which the geographical location of the vehicle C1 is kept private. Prior to the live broadcast, the control device E1 may display a location disclosure setting screen on the display E5 and receive an instruction from the occupant of the vehicle C1 regarding whether to disclose the geographical location. For example, the location disclosure setting screen includes a public icon that allows the geographical location of the vehicle C1 to be disclosed, and a private icon that denies the disclosure of the geographical location of the vehicle C1.

[0018] In the location disclosure distribution, the GPS receiver E2 receives a positioning signal from an artificial satellite. The control device E1 identifies the geographical position of the vehicle C1 from the positioning signal and generates location information indicating the geographical position of the vehicle C1. The distribution data described above includes the location information in addition to the video data and the first audio data. The user terminals T1 and T2 may extract the location information from the distribution data to identify the geographical position of the vehicle C1 and display a map including a vehicle icon indicating the vehicle C1.

[0019] The live broadcast may be either a free broadcast, which allows live broadcasting to an unspecified number of users who wish to receive the live broadcast, or an invited broadcast, which allows live broadcasting only to users invited by the occupants of the vehicle C1. Before starting the live broadcast, the control device E1 may display a broadcast type setting screen on the display E5 and receive instructions regarding the broadcast type from the occupants of the vehicle C1. The broadcast type setting screen includes, for example, a free broadcast icon indicating free broadcast and an invited broadcast icon indicating invited broadcast.

[0020] In the free broadcast, audio data may be transmitted in only one direction from the occupants of the vehicle C1 to the viewers, whereas in the invited broadcast, audio data may be exchanged in both directions between the occupants of the vehicle C1 and the viewers.

[0021] 2, the server S includes a storage unit 10 and an information processing unit 16 connected to the storage unit 10. The storage unit 10 may be a hard disk drive (HDD), a solid state drive (SSD), or other large-capacity storage. The information processing unit 16 may include a memory and a processor that executes a non-transitory computer-readable program stored in the memory.

[0022] In this embodiment, the storage unit 10 includes a video database 12 and a thumbnail database 14 .

[0023] The video database 12 stores a plurality of videos. Each of the plurality of videos has a unique URL (Uniform Resource Locator). Each of the plurality of videos is a live video or a recorded video. A live video is a video that is captured from a moving object and broadcasts live the scenery outside the moving object. A recorded video is a video that is captured from a moving object and records the scenery outside the moving object.

[0024] Recorded videos may include a variety of content. Recorded videos may include content that entices viewers to experience driving and, ultimately, to live stream as broadcasters. For example, recorded videos may be filmed from a vehicle traveling on a mountain road. Recorded videos may be filmed from a vehicle racing, driven by a professional driver. In this way, recorded videos can inspire a sense of adventure that ordinary drivers cannot experience, thereby inspiring ordinary drivers to experience driving. Saving recorded videos may be permitted only to administrators with uploading rights, such as video distribution service providers.

[0025] The thumbnail database 14 stores a plurality of thumbnails, each having a URL, and each of the thumbnails is a live video thumbnail associated with a live video or a recorded video thumbnail associated with a recorded video.

[0026] The multiple thumbnails may be stored by an administrator with upload authority, such as a video distribution service provider. Before distributing the live video, the control device E1 may display a thumbnail setting screen on the display E5 and receive an instruction from an occupant of the vehicle C1 regarding a thumbnail to be associated with the live video. The thumbnail setting screen may include, for example, multiple thumbnails stored in the thumbnail database 14. Since multiple thumbnails are managed by an administrator, this is preferable from the perspective of protecting personal information and security.

[0027] A plurality of thumbnails may be prepared by each broadcaster of a live broadcast, which increases the broadcaster's freedom in selecting thumbnails.

[0028] The information processing unit 16 executes the following processes for providing a video distribution service.

[0029] (Video selection screen generation process)

[0030] 3, the video selection screen 21 is displayed on the user terminal T1 and is a screen for receiving from the viewer the video that the viewer wishes to view. In this embodiment, the video selection screen 21 includes a first field 21a, a second field 21b, a third field 21c, and a fourth field 21d. The first field 21a includes a recorded video thumbnail 23a. The second field 21b includes a live video thumbnail 25a. The third field 21c includes a recorded video thumbnail 23b. The fourth field 21d includes a live video thumbnail 25b.

[0031] It is desirable for video distribution service providers to provide high-quality recorded videos to entice viewers to experience driving and ultimately encourage viewers to broadcast live. In this embodiment, the information processing unit 16 generates a video selection screen 21 that includes thumbnails of live videos and thumbnails of recorded videos.

[0032] The information processing unit 16 manages live videos currently being distributed using a live video management table 17 shown in Fig. 4, and manages existing recorded videos using a recorded video management table 18 shown in Fig. 5. Upon receiving a request to acquire a video selection screen 21 from the user terminal T1, the information processing unit 16 generates the video selection screen 21 by referring to the live video management table 17 and the recorded video management table 18.

[0033] As shown in FIG. 4, the live video management table 17 includes a video ID, a video type, a distribution type, a location disclosure type, a video URL, a thumbnail URL, a distribution room ID, an invitee account, a start time, the number of participants, and location information.

[0034] The live video management table 17 manages live videos currently being distributed. The number of simultaneous live broadcasts changes from moment to moment, so the live video management table 17 is updated from moment to moment.

[0035] The video ID is automatically assigned upon receiving a request for live video distribution. The video type indicates live video or recorded video. The distribution type indicates free distribution or invitation distribution. The location disclosure type indicates location disclosure distribution or location non-disclosure distribution. The video URL is a URL unique to the live video. The thumbnail URL is a URL unique to the thumbnail assigned to the live video. The distribution room ID indicates a room generated to invite invitees before the live video is distributed if the live distribution is an invitation distribution. The distribution room ID is automatically assigned when the room is generated. The invitee account is the account of the invitee invited by the occupant of vehicle C1. The start time indicates the start time of the live video. The number of participants indicates the number of participants watching the current live distribution. The location information indicates the current geographical location of vehicle C1.

[0036] As shown in FIG. 5, the recorded video management table 18 includes a video ID, a video type, a video URL, a thumbnail URL, a release date, and a release time.

[0037] The recorded video management table 18 manages recorded videos. The recorded videos are updated less frequently than live videos.

[0038] As shown in FIG. 6 , the information processing unit 16 receives a video selection screen acquisition request from the user terminal T1 (S101). Upon receiving the video selection screen acquisition request, the information processing unit 16 refers to the live video management table 17 to identify a live video thumbnail related to the live video currently being distributed (S102). The information processing unit 16 further refers to the recorded video management table 18 to identify a recorded video thumbnail related to the recorded video (S103). The information processing unit 16 generates a video selection screen including a live video thumbnail and a recorded video thumbnail (S104). The information processing unit 16 transmits the video selection screen to the user terminal T1 (S103).

[0039] The generation of the video selection screen in S104 above includes processing for arranging video thumbnails on one scroll of the video selection screen according to a predetermined rule. In this embodiment, the video selection screen includes 20 thumbnail fields. In this embodiment, the predetermined rule is that the video selection screen includes four units, as shown in FIG. 7A. Each unit includes one recorded video thumbnail and four live video thumbnails. In FIG. 7A, "R" indicates a recorded video thumbnail, and "L" indicates a live video thumbnail.

[0040] As shown in (a) of Figure 7, in principle, the information processing unit 16 places a recorded video thumbnail in the first field of each of the first to fourth units, and places a live video thumbnail in the second to fifth fields.

[0041] However, the number of live videos currently being streamed and the number of recorded videos currently being prepared change in real time, so it is not always possible to fill in the 20 thumbnail fields as planned.

[0042] For example, (b) of Fig. 7 shows an example of the arrangement of video thumbnails on the video selection screen when one recorded video is currently prepared and 19 or more live videos are currently being streamed. (c) of Fig. 7 shows an example of the arrangement of video thumbnails on the video selection screen when two recorded videos are currently prepared and 14 or more live videos are currently being streamed. (d) of Fig. 7 shows an example of the arrangement of video thumbnails on the video selection screen when 16 or more recorded videos are currently prepared and 4 live videos are currently being streamed. (e) of Fig. 7 shows an example of the arrangement of video thumbnails on the video selection screen when 12 or more recorded videos are currently prepared and 8 live videos are currently being streamed. (f) of Fig. 7 shows an example of the arrangement of video thumbnails on the video selection screen when 17 or more recorded videos are currently prepared and 3 live videos are currently being streamed. FIG. 7G shows an example of the arrangement of video thumbnails on the video selection screen when the number of recorded videos currently prepared is 14 or more and the number of live videos currently being distributed is 6.

[0043] As shown in FIG. 8 , to implement the above-described arrangement rule, if there is one or more recorded videos currently being prepared, the information processing unit 16 arranges one recorded video thumbnail related to one recorded video in one field of the recording selection image (S111: YES, S112). Next, if there are four or more live videos currently being streamed, the information processing unit 16 arranges four live video thumbnails related to the four live videos in four fields of the recording selection image, respectively (S113: NO, S114: YES, S115, S116: NO, S117: NO). The information processing unit 16 repeats the processes from S114 to S116 four times, and then, if there are any unprocessed videos remaining, repeats the processes from S111 to S117. An unprocessed video is a video, among the currently prepared recorded videos and live videos currently being streamed, whose corresponding thumbnails have not yet been arranged in the video selection screen. The information processing unit 16 ends the thumbnail arrangement process when a total of 20 video thumbnails have been arranged (S113: YES, S116: YES). Furthermore, the information processing unit 16 ends the thumbnail arrangement process if there are no unprocessed videos remaining (S118: NO). In this embodiment, the number of live video thumbnails included in each unit is four, but this is not limited to four and may be any number greater than or equal to one. The number of times steps S114 to S116 are processed is not limited to four and may be changed depending on the number of live video thumbnails included in each unit. In this embodiment, the video selection screen includes 20 thumbnail fields, but this is not limited to 20 and may be any number greater than or equal to two.

[0044] In this way, the information processing unit 16 generates a video selection screen 21 including live video thumbnails and recorded video thumbnails, so that video distribution service providers can provide high-quality recorded videos to induce viewers to experience driving, and ultimately induce viewers to broadcast live as broadcasters.

[0045] Furthermore, the recorded video thumbnail is always placed at the top of the video selection screen and is therefore conspicuous, which increases the opportunities to view the recorded video associated with that recorded video thumbnail, constantly encouraging viewers to experience driving, and ultimately continuing to encourage viewers to broadcast live as broadcasters.

[0046] The algorithm for generating the video selection screen is not limited to the above example. For example, the video selection screen may be generated by the algorithm shown in FIG.

[0047] 9, the information processing unit 16 receives a video selection screen acquisition request from the user terminal T1 (S11). Upon receiving the video selection screen acquisition request, the information processing unit 16 refers to the live video management table 17 to identify the number of live videos currently being distributed (S12).

[0048] If the number of live videos currently being distributed is the first number less than the lower limit, the information processing unit 16 identifies a second number that satisfies the lower limit (S13: YES). Satisfying the lower limit means that the number is equal to or exceeds the lower limit. The lower limit is, for example, the number of thumbnails displayed per unit scroll. For example, in the example of FIG. 3, it is 4. When the bottom end of a unit scroll is displayed, if a further sliding motion is performed, another unit scroll appears. The lower limit is, for example, 10, 15, 20, 30, etc.

[0049] The information processing unit 16 acquires a first number of live video thumbnails from the thumbnail database 14 (S14). These live video thumbnails are all associated with the live broadcasts currently being broadcast. The information processing unit 16 acquires a second number of recorded video thumbnails from the thumbnail database 14 (S15). These recorded video thumbnails are all associated with the recorded videos.

[0050] The information processing unit 16 generates a video selection screen 21 including a first number of live video thumbnails and a second number of recorded video thumbnails (S18), and transmits the video selection screen 21 to the user terminal T1 (S19). In this way, the information processing unit 16 generates a video selection screen 21 that satisfies the lower limit, so even if the number of simultaneous live broadcasts is small, a video distribution service provider can provide high-quality recorded videos to induce viewers to experience driving, and ultimately induce viewers to engage in live broadcasting as a broadcaster.

[0051] On the other hand, if the number of live videos currently being distributed is equal to or greater than the lower limit, the information processing unit 16 identifies a third number that is less than the lower limit and a fourth number that satisfies the lower limit (S13: NO).

[0052] The information processing unit 16 acquires a third number of live video thumbnails from the thumbnail database 14 (S16). These live video thumbnails are all associated with the live broadcasts currently being broadcast. The information processing unit 16 acquires a fourth number of recorded video thumbnails from the thumbnail database 14 (S17). These recorded video thumbnails are all associated with the recorded videos.

[0053] The information processing unit 16 generates a video selection screen 21 including a third number of live video thumbnails and a fourth number of recorded video thumbnails (S18). In this way, the video selection screen 21 always includes recorded video thumbnails. With the recent development of information technology, live video distribution and live video viewing have become easy to implement. Users can be both live video distributors and live video viewers. Even if there are a large number of simultaneous live streams, video distribution service providers can provide high-quality recorded videos to encourage viewers to experience driving, which in turn can encourage viewers to engage in live streaming as distributors.

[0054] (Thumbnail placement on the video selection screen)

[0055] The information processing unit 16 may arrange the live video thumbnails and the recorded video thumbnails on the video selection screen 21 according to a first arrangement rule. The first arrangement rule may be to place the recorded video thumbnail at the top. For example, as shown in FIG. 3 , the recorded video thumbnail 23 a is arranged at the top of the video selection screen 21. The recorded video thumbnail at the top stands out, which increases the opportunities to view the recorded video associated with that recorded video thumbnail, constantly encouraging viewers to experience driving, and ultimately continuing to encourage viewers to engage in live streaming as a broadcaster.

[0056] The first arrangement rule may further be to arrange the recorded video thumbnails at equal intervals. For example, as shown in Fig. 3, the recorded video thumbnails 23a and 23b are arranged at equal intervals, every other thumbnail. The evenly spaced recorded video thumbnails are more noticeable when scrolled, which can increase the chances of viewing the recorded videos associated with those recorded video thumbnails.

[0057] The information processing unit 16 may determine the priority regarding the order in which the live video thumbnails are arranged on the video selection screen 21. The priority may be determined, for example, as follows.

[0058] The information processing unit 16 may refer to the live video management table 17 to identify the number of participants participating in each live video currently being distributed, and may determine the priority based on the number of participants. The information processing unit 16 may arrange live video thumbnails higher the more participants there are in a live video. For example, as shown in FIG. 3 , the video selection screen 21 displays viewer icons 27 indicating participants participating in a live video currently being distributed. The live video associated with live video thumbnail 25a has five participants. The live video associated with live video thumbnail 25b has three participants. Therefore, the live video thumbnail 25a is arranged higher than the live video thumbnail 25b. By arranging live video thumbnails with more participants participating in the live video higher, opportunities to watch more popular and attractive live video distributions can be increased.

[0059] The information processing unit 16 may refer to the live video management table 17 to determine whether each live video currently being streamed is a location-disclosed stream or a location-undisclosed stream, and may determine the priority based on this. The information processing unit 16 may place live video thumbnails of location-disclosed streams higher than live video thumbnails of location-undisclosed streams. By placing live video thumbnails of location-disclosed streams higher than live video thumbnails of location-undisclosed streams, it is possible to increase the opportunities to watch live video streams with more information.

[0060] The information processing unit 16 may refer to the live video management table 17 to identify the broadcast start time of each live video currently being broadcast, and may determine the priority based on the identified broadcast start time. For example, the information processing unit 16 may arrange live video thumbnails with earlier broadcast start times higher than live video thumbnails with later broadcast start times. By arranging live video thumbnails higher in the rankings according to the length of the live video, viewers can have more opportunities to watch broadcasts of live videos that interest them more.

[0061] The information processing unit 16 may refer to the live video management table 17 to identify the broadcast room ID of each live video currently being broadcast, and determine the priority based on the identified broadcast room ID. For example, the earlier the broadcast room was generated, the smaller the broadcast room ID. The information processing unit 16 may arrange live video thumbnails with smaller broadcast room IDs higher than live video thumbnails with larger broadcast room IDs. Conversely, the information processing unit 16 may arrange live video thumbnails with larger broadcast room IDs higher than live video thumbnails with smaller broadcast room IDs. By arranging live video thumbnails according to the size of the broadcast room ID, viewers can have more opportunities to watch broadcasts of live videos that interest them.

[0062] The information processing unit 16 may identify the geographical location of the user terminal T1 and determine the priority of the live video of the location-revealing distribution based on the geographical location of the user terminal T1 and the geographical location of the vehicle C1. For example, the shorter the distance between the user terminal T1 and the vehicle C1, the higher the priority of the live video thumbnail. Conversely, the longer the distance between the user terminal T1 and the vehicle C1, the higher the priority of the live video thumbnail. This sorting order may be changeable by the user terminal T1. By placing the live video thumbnail at the top according to the distance between the geographical location of the user terminal T1 and the geographical location of the vehicle C1, viewers can have more opportunities to watch live video distributions that are of more interest to them.

[0063] Returning to FIG. 3 , the live video thumbnails 25a, 25b may include a first icon to distinguish them from the recorded video thumbnails 23a, 23b. For example, the live video thumbnails 25a, 25b include a live icon 26 indicating that a live broadcast is in progress and a drive icon 28 indicating that the live broadcast is available. The recorded video thumbnails 23a, 23b may include a second icon to distinguish them from the live video thumbnails 25a, 25b. For example, the recorded video thumbnails 23a, 23b include a logo icon 24 indicating the operator of the video distribution service. These icons can distinguish the live video thumbnails from the recorded video thumbnails.

[0064] (Security measures)

[0065] Security measures are important for real-time live distribution from the vehicle C1. The following describes security measures to be taken when the vehicle C1 starts live distribution.

[0066] 10 , the information processing unit 16 receives a live streaming request from the control device E1 of the vehicle C1 and performs advance preparations for the live streaming (S21). For example, the advance preparations include obtaining control information indicating free streaming and invitational streaming from the control device E1, obtaining setting information indicating whether the geographical location is public or private from the control device E1, and obtaining thumbnail information indicating the selection of a live video thumbnail from the control device E1.

[0067] The information processing unit 16 receives a request to start live streaming from the control device E1 of the vehicle C1 (S22). If the live streaming is a free streaming (YES at S23), the information processing unit 16 puts the live streaming on hold until a first predetermined time has elapsed (S24), and starts the live streaming when the first predetermined time has elapsed (S26). On the other hand, if the live streaming is an invitation-only streaming (NO at S23), the information processing unit 16 puts the live streaming on hold until a second predetermined time has elapsed (S25), and starts the live streaming when the second predetermined time has elapsed (S26).

[0068] In this way, the information processing unit 16 waits for the predetermined time (first predetermined time or second predetermined time) to elapse after receiving the request to start live streaming, thereby preventing immediate start of live streaming. Even if an occupant of the vehicle C1 accidentally presses the start button near their home, workplace, or other related location, the information processing unit 16 prevents live streaming from starting in the vicinity of that location.

[0069] The second predetermined time may be shorter than the first predetermined time. Participants in an invitational broadcast are invited by the occupants of vehicle C1. Therefore, emphasis is placed on starting the live broadcast early rather than on security. On the other hand, participants in a free broadcast are an unspecified number of people. Therefore, emphasis is placed on a high security level rather than on starting the live broadcast early. The second predetermined time may be zero.

[0070] As shown in FIG. 13 , the standby screen 31a includes a real-time video captured by the camera E3. The standby screen 31a further includes a speaker icon 32, a microphone icon 33, a stop icon 34, a countdown display 35, and a time extension icon 36. The speaker icon 32 is an icon for controlling the on / off of the speaker E6. The microphone icon 33 is an icon for turning the microphone E7 on / off. The stop icon 34 is an icon for completely stopping the distribution of the live video. The countdown display 35 or the time extension icon 36 is an icon (extension request display unit) for extending a predetermined time (standby time). In this embodiment, the countdown display 35 is described as an icon (extension request display unit) for extending a predetermined time (standby time).

[0071] The information processing unit 16 may extend a predetermined time (standby time) in response to an instruction from an occupant of the vehicle C1 while waiting for the live video distribution. As shown in FIG. 11 , the information processing unit 16 provides a standby screen 31a including a countdown display 35 on the display E5 (S31). If the predetermined time has elapsed (S32: YES), the information processing unit 16 starts the live distribution (S33). If the predetermined time has not elapsed (S32: NO), the information processing unit 16 monitors whether the countdown display 35 has been pressed (S34). If the information processing unit 16 detects that the countdown display 35 has been pressed (S34: YES), the information processing unit 16 detects the number of times the countdown display 35 has been pressed (S35). The information processing unit 16 determines the extension time based on the number of times the countdown display 35 has been pressed (S36) and extends the predetermined time (standby time) (S37). For example, each press of the countdown display 35 extends the standby time by one minute. Pressing the countdown indicator 35 five times extends the waiting time by five minutes. Pressing the time extension icon 36 may also extend the predetermined time (waiting time) in the same way as pressing the countdown indicator 35. In this way, the information processing unit 16 allows the predetermined time to be extended to any length with a simple operation. The occupant of the vehicle C1 is not forced to perform complex operations while driving the vehicle C1.

[0072] When live streaming begins, a streaming screen 31b is displayed as shown in Fig. 14. The streaming screen 31b includes real-time video captured by camera E3. The streaming screen 31b also includes a speaker icon 32, a microphone icon 33, a stop icon 34, a pause icon 37, and an elapsed time indicator 38. As shown below, the pause icon 37 indicates a temporary pause of the live streaming, and is distinct from a complete stop.

[0073] As shown in Fig. 12, if the information processing unit 16 detects that the pause icon 37 has been pressed during live streaming (S41: YES), it pauses the live streaming (S42) and displays a pause screen on the display E5 (S43). As shown in Fig. 15, the pause screen 41 includes a resume icon 43, a stop icon 34, and a pause indicator 42. The resume icon 43 is an icon for resuming the paused live streaming. The control device E1 detects that the resume icon 43 has been pressed, and generates a third resume request requesting that the paused live streaming be resumed, and transmits the third resume request to the information processing unit 16.

[0074] Returning to Figure 12, if the information processing unit 16 receives a third resume request (S44: YES), it puts the live distribution on hold until a third predetermined time has elapsed (S45), and resumes the live distribution when the third predetermined time has elapsed (S46).

[0075] When a live stream is completely stopped, the resumption of the live stream begins with a live stream request, as shown in FIG. 10 . The waiting time (predetermined times: first and second predetermined times) at the start of the live stream is preferably relatively long to ensure security. On the other hand, when resuming a live stream after pausing it, emphasis is placed on quickly resuming the live stream rather than on security. The third predetermined time may be shorter than the predetermined times (first and second predetermined times). The third predetermined time may be zero.

[0076] During the pause, the information processing unit 16 may provide a pause screen indicating that the program is paused to the user terminals T1 to T2. The information processing unit 16 can inform the viewers that there is no malfunction or trouble, but that the program is simply paused.

[0077] (Privacy measures)

[0078] Privacy measures are important for real-time live distribution from the vehicle C1. The following describes privacy measures when the vehicle C1 starts live distribution.

[0079] As shown in FIG. 16 , if the information processing unit 16 detects an incoming call to an occupant of the vehicle C1 (S51: YES), it forcibly pauses the live streaming (S52). The incoming call can be detected, for example, by the occupant's smartphone E8 notifying the control device E1. The information processing unit 16 displays the pause screen 41 shown in FIG. 15 on the display E5 (S53). The control device E1 detects the pressing of the resume icon 43 and generates a fourth resume request requesting the forcibly paused live streaming, and transmits the fourth resume request to the information processing unit 16. If the information processing unit 16 receives the fourth resume request (S54: YES), it puts the live streaming on hold until a fourth predetermined time has elapsed (S55) and resumes the live streaming after the fourth predetermined time has elapsed (S56). In this way, the information processing unit 16 forcibly pauses the live streaming based on the detection of an incoming call, thereby preventing the leaking of conversations during the live streaming.

[0080] The fourth predetermined time may be the same as or different from the third predetermined time. The third predetermined time is related to restarting the vehicle when it is temporarily stopped at the will of the occupant of the vehicle C1. On the other hand, the fourth predetermined time is related to restarting the vehicle when it is temporarily stopped regardless of the will of the occupant of the vehicle C1. The third predetermined time may be shorter than the fourth predetermined time. However, this is not limited to this, and the third predetermined time may be longer than the fourth predetermined time. The fourth predetermined time may be zero.

[0081] When a live stream is completely stopped, the resumption of the live stream begins with a live stream request, as shown in FIG. 10 . The waiting time (predetermined times: the first and second predetermined times) at the start of the live stream is preferably relatively long to ensure security. On the other hand, when resuming a live stream after a forced pause, emphasis is placed on quickly resuming the live stream rather than on security. The fourth predetermined time may be shorter than the predetermined times (the first and second predetermined times).

[0082] The fourth predetermined time for invitational streaming may be different from the fourth predetermined time for free streaming. Participants in invitational streaming are invited by the occupants of vehicle C1. Therefore, emphasis is placed on starting live streaming early rather than on security. On the other hand, participants in free streaming are an unspecified number of people. Therefore, emphasis is placed on a high level of security rather than on starting live streaming early.

[0083] The information processing unit 16 may acquire a time change request requesting a change in the length of the fourth predetermined time from the control device E1, and change the fourth predetermined time based on the time change request.

[0084] The information processing unit 16 may provide a countdown display 35 or a time extension icon 36 during standby for the fourth predetermined time. If the information processing unit 16 detects that the countdown display 35 or the time extension icon 36 has been pressed, the information processing unit 16 detects the number of times the countdown display 35 or the time extension icon 36 has been pressed. The information processing unit 16 determines the extension time based on the number of times the countdown display 35 or the time extension icon 36 has been pressed, and extends the predetermined time (standby time). In this way, the information processing unit 16 enables the occupant of the vehicle C1 to extend the predetermined time to any length with a simple operation after receiving a call, according to their convenience. The occupant of the vehicle C1 is not forced to perform complex operations while driving the vehicle C1.

[0085] During the pause, the information processing unit 16 may provide the user terminals T1 to T2 with a pause screen indicating that the pause is being forcibly performed. For example, the pause screen may display "on the phone." The information processing unit 16 can inform the viewer that there is no malfunction or trouble, but that the pause is simply being performed.

[0086] The forced pause of the live broadcast may be a pause of at least the audio. For example, the information processing unit 16 may pause only the audio while continuing the live broadcast of the video. By pausing the audio, the information processing unit 16 prevents the contents of the telephone call from being leaked.

[0087] Although the embodiments of the present invention have been described above, the present invention is not limited to the above embodiments, and various modifications are possible within the scope of the gist of the invention. In particular, the multiple modifications described in this specification can be combined as needed.

[0088] In the above embodiment, the information processing unit 16 of the server S executes the processes shown in Figures 6, 8 to 12, and 16. However, this is not limiting, and the in-vehicle control device E1 may execute these processes. Furthermore, the smartphone E8 of the occupant of the vehicle C1 may execute these processes. By installing a program in the control device E1 or the smartphone E8, the control device E1 or the smartphone E8 can execute the same processes as the information processing unit 16 of the server S.

[0089] In the above embodiment, the moving body is a vehicle C1, but is not limited to this and may be any object that moves on land, on the sea, underwater, in the air, or in space.

[0090] In the above embodiment, the incoming call is an incoming phone call, but is not limited to this and may also include an incoming call via an app or an incoming video call.

[0091] 1: Information processing system, 10: Storage unit, 16: Information processing unit, 21: Video selection screen, 23a, 23b: Recorded video thumbnails, 25a, 25b: Live video thumbnails

Claims

1. An information processing system comprising an information processing unit communicably connected to live streaming equipment for live streaming a scene outside a moving body photographed from the moving body, wherein the information processing unit: acquires a live streaming start request from the live streaming equipment to start the live streaming, and starts the live streaming; detects an incoming call to a passenger of the moving body during the live streaming; and forcibly pauses the live streaming upon detection of the incoming call.

2. The information processing system of claim 1, wherein the live streaming can be paused in response to a pause request from the live streaming equipment, and the information processing unit: acquires a third resume request requesting the resumption of the live streaming during a pause based on the pause request from the live streaming equipment; resumes the live streaming after a third predetermined time has elapsed since acquisition of the third resume request; acquires a fourth resume request requesting the resumption of the live streaming during a pause based on detection of an incoming call; and resumes the live streaming after a fourth predetermined time different from the third predetermined time has elapsed since acquisition of the fourth resume request.

3. The information processing system according to claim 2, wherein the information processing unit waits for the live streaming to begin until a predetermined time has elapsed since the request to start the live streaming has been received, and executes the live streaming when the predetermined time has elapsed since the request to start the live streaming has been received.

4. The information processing system according to claim 3, wherein the fourth predetermined time is shorter than the predetermined time.

5. The information processing system of claim 1, wherein the information processing unit: acquires control information from the live streaming device indicating either free streaming, which allows the live streaming to an unspecified number of users who wish to receive the live streaming, or invited streaming, which allows the live streaming only to users invited by passengers of the vehicle; acquires a fourth resume request from the live streaming device during a pause based on detection of an incoming call related to the call, which requests resumption of the live streaming; and resumes the live streaming after a fourth predetermined time has elapsed since acquisition of the fourth resume request; and the fourth predetermined time for the free streaming is longer than the fourth predetermined time for the invited streaming.

6. The information processing system according to claim 5, wherein the fourth predetermined time in the invitation distribution is zero.

7. The information processing system according to claim 1, wherein the live streaming includes audio and video, and the forced pause of the live streaming comprises pausing at least the audio.

8. The information processing system according to claim 1, wherein the information processing unit delivers a display indicating that the live streaming is paused while the live streaming is paused.

9. The information processing system of claim 1, wherein the information processing unit acquires a fourth resume request requesting the resumption of the live streaming during a pause based on the detection of an incoming call related to the call, resumes the live streaming after a fourth predetermined time has elapsed since the acquisition of the fourth resume request, acquires a time change request from the live streaming device requesting a change in the length of the fourth predetermined time, and changes the fourth predetermined time based on the time change request.

10. The information processing system of claim 1, wherein the information processing unit: acquires a fourth resume request from the live streaming device during the forced pause of the live streaming, requesting the resumption of the live streaming; resumes the live streaming after a fourth predetermined time has elapsed since the acquisition of the fourth resume request; provides an extension request display unit to the live streaming device to request an extension of the fourth predetermined time during the period from the acquisition of the fourth resume request to the elapse of the fourth predetermined time; detects presses of the extension request display unit; and determines the extension time of the fourth predetermined time depending on the number of times the extension request display unit is pressed.

11. A program for causing a computer to execute the following steps: connecting to a live streaming device capable of communicating with the device for live streaming a scene outside the vehicle photographed from the vehicle; receiving a request to start the live streaming from the live streaming device, and starting the live streaming; detecting an incoming call to a passenger of the vehicle during the live streaming; and forcibly pausing the live streaming upon detection of the incoming call.

12. An information processing method including: a step of communicatively connecting to a live streaming device for live streaming a scene outside the moving body photographed from the moving body; a step of acquiring a live streaming start request from the live streaming device to start the live streaming, and starting the live streaming; a step of detecting an incoming call to a passenger of the moving body during the live streaming; and a step of forcibly pausing the live streaming upon detection of the incoming call.

Citation Information

Patent Citations

  • Moving image distribution server and moving image distribution system

    JP2021097407A

  • System, method, and program for distributing output screen image of terminal device

    WO2017010253A1