Information processing system, information processing method, and recording medium
By setting multiple users as community members and leveraging the collaborative control of management servers and wireless devices, the problem of inconsistent service experience in multi-user activities was solved, achieving a synchronized service experience when users are acting together, thus improving the user experience.
Patent Information
- Application Number
- CN202080049147.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-07-11
- Filing Date
- 2020-06-26
- Publication Date
- 2025-12-23
- Estimated Expiration
- 2040-06-26
AI Technical Summary
When multiple users are working together, existing technologies struggle to provide each user with the same type of service at essentially the same time through their respective devices, resulting in inconsistent user experiences.
By using an information processing system, multiple users acting together can be assigned to a specific community. Through the coordinated control of management servers and wireless devices, each user can experience the same type of service at roughly the same time, such as music distribution, payment processing, and social networking services.
This allows multiple users to experience the same type of service at roughly the same time using their respective devices when working together, thereby improving user experience and enhancing coordination and consistency among users.
Smart Images

Figure CN114080601B_ABST
Abstract
Description
Technical Field
[0001] This technology relates to information processing systems, information processing methods, and recording media, and particularly to information processing systems, information processing methods, and recording media that can provide a better user experience. Background Technology
[0002] In recent years, with the popularization of information devices, various services and functions utilizing the characteristics of these devices have been provided (see, for example, Patent Documents 1 to 6).
[0003] Citation List
[0004] Patent documents
[0005] Patent Document 1: Japanese Patent Publication No. 2002-278572
[0006] Patent Document 2: Japanese Patent Publication No. 2002-244676
[0007] Patent Document 3: Japanese Patent Publication No. 2001-184292
[0008] Patent Document 4: International Publication No. 2008 / 107984
[0009] Patent Document 5: Japanese Patent Publication No. 2008-072558
[0010] Patent Document 6: Japanese Patent Publication No. 2013-254305 Summary of the Invention
[0011] The problem to be solved by the present invention
[0012] At the same time, when multiple users are working together, there is a need to provide a better user experience when providing services to these multiple users using the devices owned by each user.
[0013] This technology was developed in light of this context and aims to provide a better user experience.
[0014] Solution to the problem
[0015] An information processing system according to one aspect of the present technology is an information processing system including a control unit configured to: set multiple users currently acting together as multiple users belonging to a specific community; and perform control such that, based on the same type of service available to each user, the multiple users can experience the same type of service at substantially the same time through each wireless device corresponding to each user.
[0016] According to one aspect of the present technology, an information processing method is as follows: the information processing method includes: setting multiple users currently acting together as multiple users belonging to a specific community through an information processing system; and performing control such that, based on the same type of service available to each user, the multiple users can experience the same type of service through each wireless device corresponding to each user at substantially the same time.
[0017] According to one aspect of the present technology, the recording medium is a recording medium for recording a program used to enable a computer to act as a control unit, the control unit being configured to: set multiple users currently acting together as multiple users belonging to a specific community; and execute control such that, based on the same type of service available to each user, the multiple users can experience the same type of service at substantially the same time through each wireless device corresponding to each user.
[0018] In an information processing system, information processing method, and recording medium according to one aspect of the present technology, multiple users currently acting together are configured as multiple users belonging to a specific community, and control is performed such that, based on the same type of service available to each user, the multiple users can experience the same type of service at substantially the same time through each wireless device corresponding to each user. Attached Figure Description
[0019] Figure 1 This is a representative diagram illustrating the outline of this technology.
[0020] Figure 2 This is a diagram illustrating an example configuration of an information processing system that applies this technology.
[0021] Figure 3 It is shown Figure 2 A diagram illustrating an example configuration of a management server.
[0022] Figure 4 It is shown Figure 2 The service provides a diagram illustrating the configuration of the server.
[0023] Figure 5 It is shown Figure 2 A diagram illustrating the configuration of a wireless device.
[0024] Figure 6 This is a diagram illustrating a first example of information processing in the first embodiment.
[0025] Figure 7 This is a diagram illustrating a first example of information processing in the first embodiment.
[0026] Figure 8This is a diagram illustrating a second example of information processing in the first embodiment.
[0027] Figure 9 This is a diagram illustrating a second example of information processing in the first embodiment.
[0028] Figure 10 This is a diagram illustrating a third example of information processing in the first embodiment.
[0029] Figure 11 This is a diagram illustrating a third example of information processing in the first embodiment.
[0030] Figure 12 This is a flowchart describing the overall image of information processing in the first embodiment.
[0031] Figure 13 This is a diagram illustrating an example of a user's usage status and permission handling for a music distribution service.
[0032] Figure 14 This is a diagram illustrating the process of song playback when using the same music distribution service.
[0033] Figure 15 This is a diagram illustrating the song playback process when using different music distribution services.
[0034] Figure 16 It is a diagram showing an overview of the community.
[0035] Figure 17 This is a diagram illustrating a first example of information processing in the second embodiment.
[0036] Figure 18 This is a diagram illustrating a second example of information processing in the second embodiment.
[0037] Figure 19 This is a diagram illustrating a third example of information processing in the second embodiment.
[0038] Figure 20 This is a diagram illustrating a fourth example of information processing in the second embodiment.
[0039] Figure 21 It is a flowchart used to describe the process of switching playback content corresponding to event-driven events.
[0040] Figure 22 This is a flowchart describing the overall picture of information processing in the second embodiment.
[0041] Figure 23 This is a flowchart describing the overall picture of information processing in the second embodiment.
[0042] Figure 24 This is a diagram illustrating an example of a content recommendation method.
[0043] Figure 25 It is a flowchart used to describe the process of content recommendation processing corresponding to the community.
[0044] Figure 26 This is a diagram illustrating an example of information collection using an agent.
[0045] Figure 27 This is a diagram illustrating an example of the configuration of an information processing system corresponding to the presentation of recommended songs.
[0046] Figure 28 This is a diagram illustrating an example of folder management corresponding to the community.
[0047] Figure 29 This is a flowchart describing the overall picture of information processing in the third embodiment.
[0048] Figure 30 This is a flowchart describing the overall picture of information processing in the fourth embodiment.
[0049] Figure 31 This is a flowchart describing the overall picture of information processing in the fifth embodiment.
[0050] Figure 32 This is a flowchart describing the overall picture of information processing in the sixth embodiment.
[0051] Figure 33 This is a diagram showing an example of the target area for content when generating a slide.
[0052] Figure 34 This is a diagram showing an example of content posted on social media.
[0053] Figure 35 This is an image showing an example of posting captured images on social media.
[0054] Figure 36 This is a diagram showing a summary of content posted on a community SNS.
[0055] Figure 37 It is a flowchart used to describe the process of posting on a community social networking site (SNS).
[0056] Figure 38 This is a flowchart describing the overall picture of information processing in the seventh embodiment.
[0057] Figure 39 This is a flowchart describing the overall picture of information processing in the seventh embodiment.
[0058] Figure 40 This is a flowchart describing the overall screen of information processing in the eighth embodiment.
[0059] Figure 41 It is a diagram that schematically illustrates a situation where some users in a community are separated by a certain distance.
[0060] Figure 42 This is a flowchart describing the overall picture of information processing in the ninth embodiment.
[0061] Figure 43 This is a diagram illustrating an example configuration where AR information is shared.
[0062] Figure 44 This is a diagram illustrating an example of a dialogue between users inside and outside the community.
[0063] Figure 45 This is a flowchart describing the overall picture of information processing in the tenth embodiment.
[0064] Figure 46 This is a diagram illustrating an example of generating a playlist based on conversations in a community.
[0065] Figure 47 This is a flowchart describing the overall picture of information processing in the eleventh embodiment.
[0066] Figure 48 This is a diagram illustrating an example of behavior when users in a community take individual actions.
[0067] Figure 49 This is a diagram showing an example of a user connection display.
[0068] Figure 50 This is a diagram showing an example of a computer configuration. Detailed Implementation
[0069] In the following description, embodiments of the present technology will be described with reference to the accompanying drawings. Note that the description will be given in the following order.
[0070] 1. First Implementation Method: Basic Configuration
[0071] 2. Second Implementation Method: Configuration Corresponding to Music Distribution Service
[0072] 3. Third implementation method: Configuration corresponding to the selection of recommended content
[0073] 4. Fourth Implementation Method: Configuration Corresponding to the Automatic Formation of the Community
[0074] 5. Fifth Implementation Method: Configuration Corresponding to Community Support
[0075] 6. Sixth implementation method: Configuration corresponding to playback control suitable for the external environment
[0076] 7. Seventh Implementation Method: Configuration Corresponding to Slides, etc.
[0077] 8. Eighth Implementation Method: Configuration Corresponding to Content Evaluation Results
[0078] 9. Ninth Implementation Method: Configuration Corresponding to the Separation of Members
[0079] 10. Tenth Implementation Method: Configuration Corresponding to the Display of AR Information
[0080] 11. Eleventh Implementation Method: Configuration Corresponding to Playlists Generated by Members
[0081] 12. Modification
[0082] 13. Computer Configuration
[0083] (Representative image)
[0084] Figure 1 This is a representative diagram illustrating the outline of this technology.
[0085] This technology provides a better user experience by enabling multiple users acting together to experience the same type of service at substantially the same time, through each user's wireless device, based on the same type of service available to each user.
[0086] exist Figure 1 In the image, a couple on a date takes a walk while listening to music. Each of them is wearing headphones that allow them to hear both music and external sounds, such as open-back headphones that don't block out the ears and allow them to hear ambient sounds or enjoy conversations with their partner while listening to music.
[0087] Here, although the man and the woman listen to the same music, each of them uses their own device, such as a smartphone, to play the song (music), thus the devices used for playback are different. Furthermore, each of the man and the woman subscribes to a music distribution service.
[0088] This technology enables dating couples to experience music distribution services at essentially the same time, using their own devices such as smartphones (via open-back headphones connected to the device via wireless communication), based on music distribution services available to both men and women.
[0089] This can provide a better user experience, allowing music that can only be listened to by two people to create a space exclusively for two people, or music to set the mood for a date.
[0090] <1. First Implementation Method>
[0091] (System configuration example)
[0092] Figure 2 An example configuration of an information processing system applying this technology is shown.
[0093] The information processing system 1 includes a management server 10, service providing servers 20-1 to 20-N (N: 1 or a larger integer), application distribution server 21, and wireless devices 30-1 to 30-M (M: 1 or a larger integer).
[0094] Furthermore, in the information processing system 1, service providing servers 20-1 to 20-N, application distribution server 21, and wireless devices 30-1 to 30-M are interconnected via network 40.
[0095] Management server 10 includes one or more server devices for managing data such as databases, and is installed in a data center or similar location. Management server 10 manages information about the community and its members. Management server 10 provides managed information in response to requests from wireless devices 30-1 to 30-M.
[0096] Service providing server 20-1 includes one or more server devices for providing various services such as music distribution services, and is installed in a data center or similar location. Service providing server 20-1 provides various services in response to requests from wireless devices 30-1 to 30-M.
[0097] Similar to service provider server 20-1, service provider servers 20-2 to 20-N respond to requests from wireless devices 30-1 to 30-M to provide various services. Note that in the following description, unless there is a need to distinguish between service provider servers 20-1 to 20-N, they will be referred to as service provider server 20.
[0098] Application distribution server 21 includes one or more server devices for distributing applications used to provide various services, and is installed in a data center or similar location. Application distribution server 21 distributes applications in response to requests from wireless devices 30-1 to 30-M.
[0099] Wireless devices 30-1 include information devices, such as smartphones, mobile phones, tablets, wearable devices, portable music players, game consoles, or personal computers.
[0100] Wireless device 30-1 performs processing related to the community and its members based on information managed by management server 10. Furthermore, wireless device 30-1 performs processing according to various services provided by service provider server 20. Additionally, wireless device 30-1 accesses application distribution server 21 to download applications.
[0101] Similar to wireless device 30-1, wireless devices 30-2 to 30-M exchange various types of data with management server 10, service providing server 20, and application distribution server 21 to perform various types of processing. Note that in the following description, unless there is a need to distinguish between wireless devices 30-1 to 30-M, they will be referred to as wireless device 30.
[0102] (Configuration example for the management server)
[0103] Figure 3 It shows Figure 2 Example of the configuration of management server 10.
[0104] exist Figure 3 In the middle, the management server 10 includes a control unit 100, an input unit 101, an output unit 102, a storage unit 103, and a communication unit 104.
[0105] The control unit 100 includes, for example, a processor, such as a central processing unit (CPU). The control unit 100 is the main processing device that controls the operation of each unit and performs various types of arithmetic processing.
[0106] The input unit 101 includes an input device, such as a mouse or keyboard. The input unit 101 supplies operation signals corresponding to user operations to the control unit 100.
[0107] The output unit 102 includes an output device, such as a display or a speaker. Under the control of the control unit 100, the output unit 102 outputs video, audio, etc.
[0108] Storage unit 103 includes a high-capacity storage device, such as a semiconductor memory including non-volatile memory or volatile memory, or a hard disk drive (HDD). Storage unit 103 stores various types of data under the control of control unit 100.
[0109] The communication unit 104 includes a communication module compatible with wireless or wired communication conforming to a predetermined standard. Under the control of the control unit 100, the communication unit 104 communicates with other devices via the network 40.
[0110] (Service provider server configuration example)
[0111] Figure 4 It shows Figure 2The service provides an example configuration of server 20.
[0112] exist Figure 4 In the middle, the service providing server 20 includes a control unit 200, an input unit 201, an output unit 202, a storage unit 203, and a communication unit 204.
[0113] The control unit 200 includes a processor, such as a CPU. The control unit 200 is the main processing device that controls the operation of each unit and performs various types of arithmetic processing.
[0114] The input unit 201 includes an input device, such as a mouse or keyboard. The input unit 201 supplies operation signals corresponding to user operations to the control unit 200.
[0115] The output unit 202 includes an output device, such as a display or a speaker. Under the control of the control unit 200, the output unit 202 outputs information based on various data.
[0116] Storage unit 203 includes semiconductor memory, such as non-volatile memory. Storage unit 203 stores various types of data under the control of control unit 200.
[0117] The communication unit 204 includes a communication module compatible with wireless or wired communication conforming to a predetermined standard. Under the control of the control unit 200, the communication unit 204 communicates with other devices via the network 40.
[0118] (Example of wireless device configuration)
[0119] Figure 5 It shows Figure 2 Example of the configuration of wireless device 30.
[0120] exist Figure 5 In the wireless device 30, there are control unit 300, input unit 301, output unit 302, storage unit 303, communication unit 304, wireless communication unit 305, sensor unit 306, camera unit 307 and power supply unit 308.
[0121] The control unit 300 includes a processor, such as a CPU. The control unit 300 is the main processing device that controls the operation of each unit and performs various types of arithmetic processing.
[0122] Input unit 301 includes input devices, such as physical buttons 321 and microphone 322. Input unit 301 supplies operation signals corresponding to user operations or actions to control unit 300. Control unit 300 controls the operation of each unit based on the operation signals from input unit 301.
[0123] The output unit 302 includes output devices, such as a display 331 and a speaker 332. Under the control of the control unit 300, the output unit 302 outputs information based on various data.
[0124] Display 331 displays video corresponding to video data from control unit 300, which has video playback functionality, such as video data decoding. Speaker 332 outputs sound (music, etc.) corresponding to sound data (song data, etc.) from control unit 300, which has sound playback functionality, such as sound data decoding.
[0125] Storage unit 303 includes semiconductor memory, such as non-volatile memory. Storage unit 303 stores various types of data under the control of control unit 300.
[0126] Communication unit 304 is configured as a communication module compatible with wireless communication such as wireless local area network (LAN) or cellular communication (e.g., LTE-Advanced, 5G, etc.). Communication unit 304 communicates with other devices via network 40 under the control of control unit 300.
[0127] The wireless communication unit 305 is connected to the earphone 31 via wireless communication corresponding to a standard such as Bluetooth (registered trademark), and can output music (sound) from the earphone 31 worn on the user's ears.
[0128] The headphones 31 can be open-back headphones that do not block the ears, headphones with a microphone that receives external sounds (e.g., ambient sounds or human voices) and superimposes the external sounds onto the music, etc. By using open-back headphones or headphones that allow users to listen to external sounds, such as headphones with the function of receiving external sounds and superimposing them onto the music, users can listen to ambient sounds or conversations with companions while listening to music.
[0129] Note that the headphones 31 are not limited to wireless connection, but can also be connected to the wireless device 30 via a wired connection. Furthermore, in addition to headphones, electroacoustic transducers such as over-ear headphones can also be used.
[0130] The sensor unit 306 includes various sensor devices. The sensor unit 306 performs sensing of the user and their surrounding environment, and supplies sensor data corresponding to the sensing results to the control unit 300. The control unit 300 performs various types of processing based on the sensor data from the sensor unit 306.
[0131] Here, sensor unit 306 may include: an accelerometer for measuring acceleration; a gyroscope for measuring angle (attitude), angular velocity, and angular acceleration; a biosensor for measuring information such as heart rate, body temperature, or the posture of an organism; a magnetic sensor for measuring the amplitude and direction of a magnetic field; a proximity sensor for measuring the proximity of an object, etc.
[0132] The camera unit 307 includes an optical system, an image sensor, signal processing circuitry, etc. The camera unit 307 supplies image data obtained from the captured object to the control unit 300. The control unit 300 records the image data from the camera unit 307 in the storage unit 303 and displays the image data on the display 331.
[0133] The power supply unit 308 includes a battery such as a secondary battery and power management circuitry, and supplies power to each unit including the control unit 300.
[0134] Note that the configuration of the management server 10, service provider server 20 and wireless device 30 described above is only an example, and some components may be removed or other components may be added.
[0135] Information processing system 1 is configured as described above. The specific details of the information processing performed by information processing system 1 will be described below.
[0136] (First example)
[0137] First, refer to Figure 6 and Figure 7 A first example of information processing in the first embodiment is described.
[0138] The first example illustrates a scenario where music playback is performed by wireless devices 30-1 and 30-2 of users A and B, both belonging to community A, when they meet. Note that it can also be said that users A and B are members of community A. In this case, it is expected that music will be played back according to the same playlist so that users A and B have the same experience.
[0139] exist Figure 6 In the middle, the management server 10 (the control unit 100) includes an execution progress planning unit 151 for planning the execution progress of the community, a joint management unit 152 for managing events, and a community management unit 153 for managing the community.
[0140] Service provider server 20-1 is a server that provides music distribution services. The control unit 200 of service provider server 20-1 includes an execution processing unit 251 that performs processing related to the music distribution service and a synchronization processing unit 252 that performs synchronization processing with another music distribution service. Note that the synchronization processing unit 252 is unnecessary if synchronization with another music distribution service is not required.
[0141] The wireless device 30-1 (control unit 300) corresponding to user A includes a command application 351-1 used as a command generator and an execution processing unit 352-1 for executing music applications, etc. The command application 351-1 includes a detection unit 361 for detecting events and an execution management unit 362 for managing the execution of applications.
[0142] Furthermore, similar to the control unit 300 of wireless device 30-1, the control unit 300 of wireless device 30-2 corresponding to user B includes a command application 351-2 and an execution processing unit 352-2. Note that the command applications 351-1 and 351-2 may be pre-installed in wireless devices 30-1 and 30-2, or may be downloaded from application distribution server 21 via network 40.
[0143] Here, upon detecting an event, wireless devices 30-1 and 30-2 send a request including the detected event to management server 10 via network 40 (S111).
[0144] Note that the event can be detected on the management server 10 side. That is, sensor data acquired by sensor unit 306 installed on wireless device 30-1 or wireless device 30-2, the implemented application, information from management server 10, service provider server 20-1, etc. are collected and analyzed, and the event can be detected when the conditions set for each event—for example, "members have met" or "picture taken"—are met.
[0145] In the event of a pre-registered event based on a detection event from wireless devices 30-1 and 30-2, the management server 10 performs the processing corresponding to that event.
[0146] Here, as Figure 7 As shown, events such as community-related events (community events) or events related to the actions of users belonging to the community (action events) occur (S111).
[0147] In the first example, based on the detected event, the event "everyone is present" has already occurred as a community event. Furthermore, at this point, information about "which members are currently together"—for example, user A and user B are together—is managed.
[0148] In addition, such as Figure 7 As shown, based on the pre-registered execution plan, the "music playback" (S112) associated with the "when already encountered" of the event (community event) that has already occurred is selected.
[0149] Back Figure 6 As described above, the management server 10 sends a response, including a selection event, to wireless devices 30-1 and 30-2 via network 40 (S112).
[0150] In wireless device 30-1, command application 351-1 supplies selection events from management server 10 from detection unit 361 to execution management unit 362 (S113). Execution management unit 362 controls execution processing unit 352-1 based on the selection events (S114).
[0151] Here, as Figure 7 As shown, based on the "music playback" selection event, music distribution service A subscribed to by user A is selected from music distribution services A to C, and the operation of the music application provided by music distribution service A is controlled (S114).
[0152] Back Figure 6 The description states that the execution processing unit 352-1 executes the music application of music distribution service A under the control of the command application 351-1 (S115). When the music application is executed, the song A distributed from the service providing server 20-1 of music distribution service A is played back. As a result, user A can listen to the song A played back by wireless device 30-1.
[0153] Meanwhile, in wireless device 30-2, similar to wireless device 30-1, the command application 351-2 controls the execution processing unit 352-2 to cause the music application to play song A distributed from service provider server 20-1. As a result, user B can listen to song A played back by wireless device 30-2 (the same music that user A is currently listening to).
[0154] At this point, the expectation is to replay songs based on the same playlist, and to replay the same songs sequentially after song A, so that users A and B have the same experience.
[0155] In this way, when users A and B, who belong to community A, act together, they can experience essentially the same music distribution service A, through user A's wireless device 30-1 and user B's wireless device 30-2.
[0156] (Second example)
[0157] Next, we will refer to Figure 8 and Figure 9 A second example of information processing described in the first embodiment.
[0158] The second example illustrates the following scenario: when one of users A and B, who belong to community A and act together, makes a payment, wireless devices 30 of users A and B perform bill splitting.
[0159] exist Figure 8 In this context, the service provider server 20-2 is a server that provides settlement services. The control unit 200 of the service provider server 20-2 includes an execution processing unit 251 that performs processing related to the settlement service and a synchronization processing unit 252 that performs synchronization processing with another settlement service.
[0160] The wireless device 30-1 (control unit 300) corresponding to user A includes a command application 351-1 and an execution processing unit 352-1, and the execution processing unit 352-1 can execute a settlement application. Furthermore, the wireless device 30-2 (control unit 300) corresponding to user B is similarly configured as the wireless device 30-1 (control unit 300).
[0161] Here, let's assume the following situation: User A and User B, both belonging to community A, have a meal together. User A uses a payment application to jointly pay for the meal and charges User B a split amount.
[0162] In the wireless device 30-1, the execution processing unit 352-1 notifies the command application 351-1 of an action event based on the settlement processing performed by the settlement application (S121). The command application 351-1 performs processing based on the action event from the execution processing unit 352-1.
[0163] Here, as Figure 9 As shown, the "payment" action event has occurred (S121). Note that at this point, information about "which members are currently together"—for example, user A and user B are together—can be managed.
[0164] In addition, such as Figure 9 As shown, select the "Bill Split" (S122) corresponding to "When Payment" based on the events that have already occurred (action events).
[0165] Back Figure 6 As described above, in the command application 351-1, the execution management unit 362 provides a notification of a selection event to the detection unit 361 (S122). Then, the wireless device 30-1 sends a request including the selection event to the management server 10 via the network 40 (S123). Note that information about the split amount and payment destination is added to the request including the selection event.
[0166] Management server 10 receives a selection event sent from wireless device 30-1. Management server 10 knows that users A and B, who belong to community A, are together, and sends a response including the selection event from wireless device 30-1 to wireless device 30-2 via network 40 (S124). Note that information about the split amount and payment destination is added to the response including the selection event.
[0167] In wireless device 30-2, the command application 351-2 supplies selection events from management server 10 from detection unit 361 to execution management unit 362 (S125). Execution management unit 362 controls execution processing unit 352-2 based on the selection events (S126).
[0168] Here, as Figure 9 As shown, based on the "Bill Split" selection event, the billing service A subscribed to by user B is selected from billing services A and B, and the operation of the billing application provided by billing service A is controlled (S126).
[0169] Back Figure 8 As described, the execution processing unit 352-2 executes the settlement application of settlement service A (S127) under the control of the command application 351-2. By executing the settlement application, the split amount received is paid from user B to user A. As a result, payment can be easily executed through bill splitting. Here, it is expected that the settlement processing from user B to user A will be executed after user B's approval.
[0170] In this way, users A and B, who belong to community A, can experience the billing service (bill splitting service) through user A's wireless device 30-1 and user B's wireless device 30-2, based on the available billing service (bill splitting service).
[0171] Note that, for example, if the number of members used for bill splitting increases, the payment amount may increase. In such cases, there may be insufficient funds when paying stores, etc. In such situations, the payment can be completed by performing post-settlement processing or by performing settlement after issuing bill splitting requests to all members.
[0172] (Third example)
[0173] Next, we will refer to Figure 10 and Figure 11 A third example of information processing in the first embodiment is described.
[0174] The third example illustrates the following situation: when either wireless devices 30-1 and 30-2 belonging to user A and user B of community A capture an image, the captured image (moving image, still image, etc.) is shared.
[0175] Service provider server 20-3 is a server that provides social networking service (SNS) services. The control unit 200 of service provider server 20-3 includes an execution processing unit 251 that performs processing related to SNS services.
[0176] The wireless device 30-1 (control unit 300) corresponding to user A includes a command application 351-1 and execution processing units 352-11 and 352-12, and the execution processing units 352-11 and 352-12 can execute camera device applications and SNS applications.
[0177] In addition, the wireless device 30-2 (control unit 300) corresponding to user B includes a command application 351-2, but at least no camera application or SNS application is installed.
[0178] Here, assume that user A, who belongs to community A, captures an image using wireless device 30-1 and posts the captured image on community A's SNS.
[0179] In the wireless device 30-1, the execution processing unit 352-11 notifies the command application 351-1 of the action event according to the capture processing of the camera device (S131). In the command application 351-1, the action event from the execution processing unit 352-11 is supplied from the execution management unit 362 to the detection unit 361 (S132).
[0180] Wireless device 30-1 sends a request, including action events, to management server 10 via network 40 (S133).
[0181] Management server 10 performs processing based on action events from wireless device 30-1.
[0182] Here, as Figure 11 As shown, the "picture taken" action event occurs (S134). Note that at this time, information about "which members are currently together"—for example, user A and user B are together—can be managed.
[0183] Back Figure 10 As described above, the management server 10 sends a response, including action events, to wireless devices 30-1 and 30-2 via network 40 (S134).
[0184] In wireless device 30-1, command application 351-1 supplies action events from management server 10 from detection unit 361 to execution management unit 362 (S135). Execution management unit 362 controls execution processing unit 352-12 based on the action events (S136).
[0185] Here, as Figure 11 As shown, the "Image Sharing" option corresponding to "When an image has been taken" is selected based on the event that has already occurred (action event) (S136). Furthermore, here, based on the "Image Sharing" selection event, the SNS service A registered by user A is selected from SNS services A to C, and the operation of the SNS application provided by SNS service A is controlled (S136).
[0186] Back Figure 10 The description states that the execution processing unit 352-12 controls the SNS application of SNS service A according to the control from the command application 351-1. When the SNS application is executed, the captured image by the camera device application is sent to the service providing server 20-3 providing SNS service A (S137 and S138). As a result, the uploaded captured image is published on SNS service A and can be shared with other members (published images).
[0187] Meanwhile, wireless device 30-2 can determine from the action events from management server 10 that the captured image was shared by user A, but no corresponding SNS application was installed.
[0188] Therefore, in response to the SNS application installation request, the command application 351-1 controls the communication unit 304 to access the application distribution server 21 via the network 40 and download the SNS application of SNS service A (S139). As a result, in the wireless device 30-2, the SNS application of SNS service A is installed and started, and user B can view the images posted by user A.
[0189] Here, in order for user B to view the image posted by user A, user B needs to be invited to (a group) of SNS services A. User A, who can log in to SNS service A, can create a new group within SNS service A and invite user B to that group.
[0190] However, since User B does not have an account with SNS Service A, the following measures can be taken to invite User B to SNS Service A. That is, a temporary number is issued to User B based on a community-managed ID, and after User B obtains an account with SNS Service A, that account is associated with the temporary number, and User B is invited to SNS Service A again.
[0191] Note that in the third example, the scenario where the SNS application for SNS service A is not installed on wireless device 30-2 has already been described. However, if the SNS application is already installed and user B has an account with SNS service A, the published captured image can be immediately displayed using the installed SNS application.
[0192] Furthermore, when multiple relevant SNS applications exist, for example, one can prioritize SNS applications used by all or many members of the community, or one can choose SNS applications prioritized by each individual. In the former case, information about the services used by community members can be used to narrow down the relevant SNS applications.
[0193] As described above, when user A and user B, who belong to community A, act together, the captured images are published to the SNS service by user A's wireless device 30-1 and user B's wireless device 30-2 according to the available SNS service (the newly installed SNS service if no SNS service is installed), and the published images can be shared with other members of community A.
[0194] (The overall image after processing)
[0195] Finally, refer to Figure 12 The flowchart in the first embodiment describes the overall picture of information processing.
[0196] Figure 12 The information processing shown is achieved through the cooperation of at least the management server 10 (control unit 100), the service providing server 20 (control unit 200), and the wireless device 30 (control unit 300) in the information processing system 1. That is, the information processing is performed by at least one of the control unit 100, control unit 200, or control unit 300.
[0197] like Figure 12 As shown, in information processing system 1, multiple users (users A, B, etc.) currently acting together are specified (S151), and the specified multiple users are set as multiple users belonging to a specific community (community A, etc.) (S152).
[0198] Here, for example, the location information of users registered in the service can be managed by the management server 10, and multiple users (users A, B, etc.) who move continuously for a specific period of time (e.g., 5 minutes) in a location relationship that is closer to each other than a predetermined distance (e.g., 3m) can be designated as multiple users acting together.
[0199] Furthermore, in the information processing system 1, the same type of service (music distribution service, billing service, SNS service, etc.) available to each user is determined (S153), and control is performed so that multiple users can experience the same type of service at substantially the same time through the user's wireless device 30 (wireless devices 30-1 and 30-2 of users A and B, etc.) (S154).
[0200] As described above, in information processing system 1, since multiple users acting together can experience the same type of service at essentially the same time based on the same type of service available to each user and through each user's wireless device, a better user experience can be provided.
[0201] <2. Second Implementation Method>
[0202] In recent years, subscription services have become widespread. In particular, subscriptions have become the mainstream in music distribution services. Furthermore, currently, and even in the future, a single music distribution service will not dominate all users; instead, multiple music distribution services will be offered. Therefore, users will choose the music distribution service that best suits their needs.
[0203] In addition, music distribution services offer various plans, such as paid and free plans, and the sound quality, available features, and presence of ads during playback vary depending on the plan.
[0204] In wireless device 30, when an application (music application) provided by a music distribution service is installed and launched, and a user account is entered to log in, the user can receive a service with low sound quality and limited functionality provided by the free plan. Conversely, when the user subscribes to a paid plan, wireless device 30 can receive a service with high sound quality and where the functional limitations are removed.
[0205] For this reason, when multiple users use the music distribution service, various usage states are assumed, and permission processing based on the usage state needs to be implemented.
[0206] (Example of service usage status and permission handling)
[0207] Figure 13 This shows an example of a user's usage status and permission handling for the music distribution service.
[0208] Figure 13 The illustration shows a scenario where user A and user B use one of music distribution services A and music distribution service B, and there are paid and free plans available, as well as examples of the content processed based on their combined permissions.
[0209] In the first scenario, suppose both user A and user B use a paid plan on music distribution service A. In this case, since both user A and user B subscribe to the same paid plan on the same music distribution service A, it's simple to distribute songs to both users using their respective permissions.
[0210] In the second scenario, suppose both user A and user B use music distribution service A, but user A uses a paid plan while user B uses a free plan.
[0211] In this scenario, a song playback command is executed from user A's wireless device 30, who has a paid plan account, and temporary billing processing is performed. This billing processing can be considered as pairlistening billing. Furthermore, at this time, user B's wireless device 30, who has a free plan, cannot specify or play songs.
[0212] In the third scenario, suppose user A subscribes to a paid plan for music distribution service A, but user B does not use the music distribution service.
[0213] In this case, similar to the second case above, a song playback instruction is executed from the wireless device 30 of user A, who has an account with a paid plan for music distribution service A, and temporary billing processing is performed.
[0214] However, since the music application of music distribution service A is not installed on user B's wireless device 30, separate processing is required, such as launching a web browser and playing back the song from the site of music distribution service A.
[0215] In the fourth scenario, suppose user A subscribes to a paid plan for music distribution service A and user B subscribes to a paid plan for music distribution service B. In this case, there are two possible responses.
[0216] First, similar to the second scenario described above, a song playback command is executed from user A's wireless device 30, which has an account with a paid plan for music distribution service A, and temporary billing processing is performed. Note that, as mentioned above, separate processing is required on user B's wireless device 30 side.
[0217] Second, use the corresponding account permissions of User A's music distribution service A's paid plan and User B's music distribution service A's paid plan to play back the song. Note that processing for playing back the same song is required on both User A's wireless device 30 and User B's wireless device 30.
[0218] In the fifth scenario, suppose both User A and User B use the free plan offered by music distribution service A. In this case, they use the free trial provided by music distribution service A. The content of the free trial varies for each music distribution service, but a free trial period of, for example, one month is available.
[0219] In the sixth scenario, suppose user A uses the free plan of music distribution service A, and user B uses the free plan of music distribution service B. In this case, similar to the fifth scenario above, a free trial period could be used.
[0220] (Replay process)
[0221] Next, we will describe the process of song playback when multiple users use the same or different music distribution services.
[0222] Figure 14 This illustrates the playback process of the same song when two users, A and B, use the same music distribution service, A. That is, Figure 14 The playback process shown is the same as Figure 13 The first case corresponds to this.
[0223] exist Figure 14 In the above scenario, on user A's wireless device 30, music application 352-1 provided by music distribution service A is launched, and the user logs in using user A's account (UserID_A). Furthermore, on user B's wireless device 30, music application 352-2 provided by music distribution service A is launched, and the user logs in using user B's account (UserID_B).
[0224] At this point, music application 352-1 sends a request, including a song distribution instruction, to service provider server 20-1 via network 40 (S211). Note that the distribution instruction is awaiting notification from user B.
[0225] In addition, music application 352-1 notifies music application 352-2 of the user ID (UserID_A) (S212). Then, upon receiving the notification of the ID from music application 352-1, music application 352-2 sends a request including song distribution instructions for user A and user B to service provider server 20-1 via network 40 (S213).
[0226] Service provider server 20-1 retrieves data of a specified song from song DB 221 according to distribution instructions from music application 352-1 and music application 352-2. Service provider server 20-1 distributes the song data to music application 352-1 and music application 352-2 via network 40 (S214).
[0227] In this way, when user A and user B use the same music distribution service A, the songs to be played are synchronized by one user notifying the other user of their user ID.
[0228] Figure 15 This illustrates the process of playing the same song when two users, A and B, are using different music distribution services, A and B. In other words, Figure 15 The playback process shown is the same as Figure 13 The fourth case corresponds to this.
[0229] exist Figure 15 In the above scenario, on user A's wireless device 30, music application 352-1 provided by music distribution service A is launched, and user A (UserID_A) logs in. Simultaneously, on user B's wireless device 30, music application 352-2 provided by music distribution service B is launched, and user B (UserID_B) logs in.
[0230] At this time, music application 352-1 sends a request including a song distribution instruction to service provider server 20-1A via network 40 (S221). Note that the distribution instruction is awaiting notification from user B.
[0231] Furthermore, music application 352-1 notifies music application 352-2 of the user ID (UserID_A) and service ID (ServiceID_A) (S222). Then, upon receiving the notification of the ID from music application 352-1, music application 352-2 sends a request including the synchronization request with user A and the service ID to service provider server 20-1B via network 40 (S223).
[0232] Service provider server 20-1B sends a synchronization request with user A to service provider server 20-1A based on the request from music application 352-2 (S224). Service provider server 20-1A performs synchronization processing between user A and user B based on the synchronization request from service provider server 20-1B, and sends the resulting song distribution list to service provider server 20-1B (S225).
[0233] Thus, in service providing servers 20-1A and 20-1B, the data of the same song is distributed to music applications 352-1 and 352-2 via network 40 (S226).
[0234] As described above, when user A and user B use different music distribution services A and B, one user notifies the other user of their user ID and service ID, so that music distribution services A and B can synchronize with each other and the songs to be played back can also be synchronized.
[0235] (Community Overview)
[0236] Although Figures 13 to 15 While no community is described in this embodiment, similar to the first embodiment, the second embodiment is given under the assumption that the concept of a community is incorporated and that two users, A and B, belong to community A. That is, both user A and user B are members of community A.
[0237] Here, we will refer to Figure 16 Describe the community overview.
[0238] like Figure 16 As shown, in this technology, as a community-related process, the processing is performed in the order of community member pre-registration, user connection (community check), and community distribution. Here, community member pre-registration is not required, and multiple users acting together can be set as community members.
[0239] In other words, during the pre-registration of community members, users with a certain relationship are pre-registered as belonging to the same community. During this registration, users who wish to create their own communities can register with each other using a community-specific application launched on wireless devices such as 30.
[0240] In addition, not only do new users register for communities, but existing registered communities also exist. When a community is already registered, users can join it by, for example, applying to register as a member.
[0241] In a user connection, since it is not always necessary to synchronize with anyone, community members are pre-registered, and synchronization can be performed when a pre-registered member of the community is discovered.
[0242] Here, for example, you can pre-register the IDs of members who want to listen to music together, or you can prepare a community connection mode and enable features such as beacon search until community members are connected (connected by users). Simultaneously, you can prepare a community cancellation mode, allowing you to cancel synchronization (user connection) if users take individual actions or are geographically separated by a certain amount.
[0243] Furthermore, if a registered community exists (e.g., a music community), a user present at the event can be invited to that registered community. This invitation can detect the location of the invited user and can only invite users within a predetermined area.
[0244] Furthermore, users whose wireless devices 30 have received an invitation are notified whether they have received the invitation message, and only upon receiving an "OK" response can features such as song playback be provided to members of the community. In addition to the pre-defined actions, processing can also be performed by the user holding and shaking the wireless device 30.
[0245] After user connections are established in this manner, community distribution processing is performed. For example, in a music community, community distribution processing is performed to allow community members to listen to the same music simultaneously, connecting people listening to music together to achieve what is known as community listening. The community distribution processing (information processing) will be described in detail below.
[0246] (First example)
[0247] First, refer to Figure 17 A first example of information processing in the second embodiment is described.
[0248] The first example illustrates a scenario where user A and user B, both belonging to community A, can use the same paid plan for music distribution service A.
[0249] exist Figure 17 In this process, command application 351-1 is launched on user A's wireless device 30-1, and command application 351-2 is launched on user B's wireless device 30-2. Furthermore, in management server 10, information about the community and its members (community SNS ID, user ID, etc.) is pre-registered in management DB 121.
[0250] At this time, when playing the same song A, using the music distribution service A available for collaboration between users A and B, the management server 10 generates a check ID in response to a request from the command application 351-1 (S231), and sends the check ID to the command application 351-1 via the network 40 (S232).
[0251] When a notification of the check ID is received, the command application 351-1 notifies the command application 351-2 of the check ID information, which includes the check ID and the user ID (UserID_A) (S233). When a notification of the check ID information is received, the command application 351-2 obtains the check ID included in the check ID information and sends a request including the check ID and the user ID (UserID_B) to the management server 10 via the network 40 (S234).
[0252] The management server 10 checks the community based on information sent from the command application 351-1 and 351-2 and pre-registered information (S235). Here, it checks the existence of SNS and other information of the communities to which users A and B belong, and sends the check results to the command application 351-1 via the network 40 (S236).
[0253] Commander application 351-1 sends a request, including checking the ID and approval, to service provider server 20-1A via network 40 (S237). Furthermore, commander application 351-2 sends a request, including checking the ID, to service provider server 20-1A via network 40 (S238).
[0254] Service provider server 20-1A streams the data of song A to each of wireless devices 30-1 and 30-2 via network 40 based on requests (distribution requests) from command applications 351-1 and 351-2 (S239).
[0255] As described above, in the first example, when user A and user B, both belonging to community A, can use the same paid plan for music distribution service A, user A's wireless device 30-1 (commander application 351-1) sends a distribution request for song A specified by user A to the service provider server 20-1A that provides music distribution service A, and user B's wireless device 30-2 (commander application 351-2) sends a distribution request for song A to the service provider server 20-1A.
[0256] (Second example)
[0257] Next, we will refer to Figure 18 A second example of information processing in the second embodiment is described.
[0258] The second example shares similarities with the first example above in that users A and B, both belonging to community A, can use the same music distribution service A. However, unlike the first example, user A uses the paid plan of music distribution service A, while user B uses the free plan of music distribution service A.
[0259] At this point, when playing the same song A, the music distribution service A available to users A and B is used in conjunction to perform the processing steps S241 to S250.
[0260] In the processes of steps S241 to S250, and in the processes of steps S241 to S248, with Figure 17 The processing of steps S231 to S238 is similar, by exchanging the check ID and the user ID, sending a distribution request for the same song A from the command application 351-1 and 351-2.
[0261] When a distribution request is received from command applications 351-1 and 351-2, service provider server 20-1A performs billing processing (S249). In this billing processing, in addition to normal billing to user A who has subscribed to the paid plan, additional billing processing for paired listening is also performed.
[0262] Then, based on the distribution requests from the command applications 351-1 and 351-2, the service provider server 20-1A streams the data of song A to each of the wireless devices 30-1 and 30-2 via the network 40 (S250).
[0263] As described above, in the second example, when user A and user B, who belong to community A, can use the same music distribution service A and user A uses a paid plan while user B uses a free plan, user A's wireless device 30-1 (commander application 351-1) not only executes the song distribution request but also performs temporary billing processing and sends user B's wireless device 30-2 (commander application 351-2)'s song distribution request to service provider server 20-1A.
[0264] (Third example)
[0265] Next, we will refer to Figure 19 A third example of information processing in the second embodiment is described.
[0266] The third example illustrates a scenario where users A and B, belonging to community A, can use paid plans from different music distribution services A and B.
[0267] At this time, when playing the same song A, the music distribution service A available to user A and the music distribution service B available to user B are used in a coordinated manner (synchronized). The management server 10 generates a check ID in response to the request from the command application 351-1 and sends the check ID (S251 and S252).
[0268] Commander application 351-1 sends inspection ID information, including inspection ID, user ID, and service ID, to commander application 351-2 based on the inspection ID from management server 10 (S253). Commander application 351-2 notifies management server 10 of a request including inspection ID and user ID based on the inspection ID information from commander application 351-1 (S254).
[0269] The management server 10 checks the community based on the information sent from the command application 351-1 and 351-2 and the pre-registered information (S255), and sends the check results to the command application 351-1 (S256).
[0270] Commander application 351-1 sends a request, including checking the ID and approval, to service provider server 20-1A (S257). Furthermore, commander application 351-2 sends a request, including checking the ID, to service provider server 20-1B (S258).
[0271] Service provider server 20-1B sends the synchronization request from user A along with the check ID to service provider server 20-1A based on the request from command application 351-2 (S259).
[0272] Service provider server 20-1A performs synchronization processing between user A and user B based on the request from command application 351-1 and the check ID and synchronization request from service provider server 20-1B, and sends the resulting song distribution list to service provider server 20-2 (S260).
[0273] As a result, the data of song A from service provider server 20-1A and the data of song A from service provider server 20-1B are synchronized and streamed to each of wireless devices 30-1 and 30-2 via network 40 (S261).
[0274] As described above, in the third example, when users A and B, who belong to community A, can use different paid plans for music distribution services A and B, user A's wireless device 30-1 (commander application 351-1) sends a distribution request for song A specified by user A to service provider server 20-1A providing music distribution service A, and user B's wireless device 30-2 (commander application 351-2) sends a distribution request for song A to service provider server 20-1B providing music distribution service B.
[0275] (Fourth example)
[0276] Next, we will refer to Figure 20 A fourth example of information processing in the second embodiment is described.
[0277] The fourth example illustrates a scenario where neither user A nor user B, belonging to community A, has subscribed to the music distribution service.
[0278] At this point, when playing the same song, the music distribution service A, which neither user A nor user B has subscribed to, is used in conjunction with the processing of steps S271 to S280.
[0279] In the processes of steps S271 to S280, and in the processes of steps S271 to S278, with Figure 17The processing of steps S231 to S238 is similar, and the same song A distribution request is sent from the command application 351-1 and 351-2 by exchanging the check ID and user ID.
[0280] When the service provider server 20-1A is notified of the distribution request from command-line applications 351-1 and 351-2, distribution preparation processes such as checks, setup, and the start of the trial period are performed (S279). That is, even in the case of the free plan, it is difficult to operate the service without using an account, and therefore, here, the distribution preparation process is performed by treating the operation as a trial period of the free plan.
[0281] Then, the service provider server 20-1A streams the same song A to each of the wireless devices 30-1 and 30-2 via network 40 (S280). At this time, a notification regarding a subscription to the music distribution service A can be executed. Specifically, a notification can be made to request the download of the music application of the music distribution service A, issue a temporary ID, or prompt a switch to a paid service.
[0282] As described above, in the fourth example, when neither user A nor user B, who belong to community A, has subscribed to music distribution service A, user A's wireless device 30-1 sends a free trial distribution request for song A specified by user A to service provider server 20-1A that provides music distribution service A, and user B's wireless device 30-2 sends a free trial distribution request for song A to service provider server 20-1A.
[0283] (Event-driven song switching)
[0284] In the case of performing any of the community distribution processes (information processing) in the first to fourth examples above, and where user A and user B, who belong to community A, are listening to the same song A at substantially the same time, song A can be switched to song B that matches the scheduled event when the event has occurred.
[0285] For example, if the wireless device 30, such as a smartphone, has a camera function, at the time when the user uses the wireless device 30 to capture an object, the captured image is analyzed and the content of the event is analyzed, a song matching the event is searched, and the matching song is played back.
[0286] Specifically, in Figure 21 In the process flow shown in the flowchart, the song A being listened to by users A and B, who belong to community A, is switched to another song B.
[0287] In other words, in information processing system 1, the camera device application is activated by user A's wireless device 30-1 (S281), and when user A presses the shutter button, the content of the event is analyzed by analyzing the captured image obtained through the captured object (S282). In this analysis process, the objects included in the captured image are analyzed, and the content of the event is specified.
[0288] Then, in the information processing system 1, a song matching the specified event is searched (S283), and it is checked whether the currently playing song and the song to be played can be changed (S284). Here, if the target song A can be changed, song A is switched to the searched song B, and the wireless device 30-1 plays back song B that matches the specified event (S285).
[0289] As a result, for example, if "Tokyo Skytree" is captured as an object, search for songs related to "Tokyo Skytree", and the song can be changed to one that is more relevant to the event.
[0290] Furthermore, if a song is directly specified by both user A and user B, the playback will not change to the matching song. For example, if a song has already been specified, such as playing a song related to "Tokyo Tower" when a user is near Tokyo Tower, the playback of the matching song will not be performed. However, if the playback of the specified song has already been completed and another song is playing, the playback can be changed to the matching song.
[0291] Note that the song to be played can be changed at the time when the wireless device 30 with camera functionality faces the object, based on the analysis results of the captured image (capture location, capture time, object, etc.). Furthermore, the triggering of the event is not limited to the activation of the camera application, but can also use specific locations specified from Global Positioning System (GPS) information, timed payments using electronic money in stores, ticket gates, etc., location information obtained through beacon functions, etc.
[0292] As described above, in the first to fourth examples, when user A and user B, who belong to community A, are listening to the same music A at substantially the same time, the song A being played can be switched to the song B that matches the event at the time when user A's or user B's wireless device 30 captures the object with a camera.
[0293] (The overall image after processing)
[0294] Finally, refer to Figure 22 and Figure 23 The flowchart in the second embodiment describes the overall picture of information processing. Note that in... Figure 22 and Figure 23For ease of description, user A's wireless device 30-1 is referred to as "wireless device A", and user A's wireless device 30-2 is referred to as "wireless device B".
[0295] Figure 22 and Figure 23 The information processing shown is achieved through the cooperation of at least the management server 10 (control unit 100), the service providing server 20 (control unit 200), and the wireless device 30 (control unit 300) in the information processing system 1. That is, the information processing is performed by at least one of the control unit 100, control unit 200, or control unit 300.
[0296] like Figure 22 As shown, in information processing system 1, if user A and user B, who belong to a specific community (such as community A), can use the content service, it is determined whether they can use the same content service (such as music distribution service) (S291).
[0297] If a positive (yes) determination is made in step S291, the information processing system 1 determines whether billing is required when using the content service (S292).
[0298] If a negative (no) determination is made in the determination process of step S292, no billing is required, and therefore the processes of steps S293 and S294 are executed. This process is related to... Figure 17 The first example of information processing shown corresponds to this.
[0299] In other words, the execution control causes the wireless device 30-1 to send a distribution request for the content specified by user A to the content service (music distribution service A, etc.) (S293). Furthermore, the execution control causes the wireless device 30-2 to send a content distribution request to the content service (music distribution service A, etc.) (S294).
[0300] Furthermore, if a positive (yes) determination is made in the determination process of step S292, billing is required, and therefore the processes of steps S295 and S296 are executed. This process is related to... Figure 18 The second example of information processing shown corresponds to this.
[0301] In other words, the execution control causes the wireless device 30-1 to not only execute the content distribution request, but also to execute temporary billing processing for the content service (music distribution service A, etc.) (S295). In addition, the execution control causes the wireless device 30-1 to send the content distribution request for the wireless device 30-2 to the content service (music distribution service A, etc.) (S296).
[0302] Furthermore, if a negative (no) determination is made in the determination process of step S291, the processes of steps S297 and S298 are executed. This process is related to... Figure 19 The third example of information processing shown corresponds to this.
[0303] In other words, the execution control causes the wireless device 30-1 to send a distribution request for the content specified by user A to a content service (such as music distribution service A) available to user A (S297). Furthermore, the execution control causes the wireless device 30-2 to send a content distribution request to a content service (such as music distribution service B) available to user B (S298).
[0304] When the processing of step S294, step S296 or step S298 is completed, Figure 22 The information processing has ended.
[0305] In addition, such as Figure 23 As shown, in information processing system 1, it is determined whether user A and user B, who belong to a specific community (such as community A), do not have the authority to distribute content in the corresponding available content service (S2911).
[0306] If a positive (yes) determination is made in step S2911, and neither user A nor user B has subscribed to the content service, then steps S2912 and S2913 are executed. This process is related to... Figure 20 The fourth example of information processing shown corresponds to this.
[0307] In other words, the execution control causes wireless device 30-1 to send a free trial distribution request for content specified by user A to a content service (music distribution service A, etc.) available to user A (S2912). Furthermore, the execution control causes wireless device 30-2 to send a free trial content distribution request to a content service (music distribution service A, etc.) available to user B (S2913).
[0308] Note that if a negative determination is made during the determination process in step S2911, or after the processing in step S2913 is completed. Figure 23 The information processing has ended.
[0309] <3. Third Implementation Method>
[0310] (Song Recommendation Method)
[0311] Next, we will describe the song recommendation method used in the community listening.
[0312] In song recommendations, such as Figure 24 As shown, you can use the analysis results of profiles belonging to community members, usage, personal profiles, or past logs.
[0313] The analysis of member profiles can recommend songs that the members seem to like by analyzing factors such as the types of companions they spend time with. In addition to analyzing the input profiles, this analysis can also examine the interactions between the target member and other members.
[0314] The system can recommend songs that match the TPO (Time, Place, Occasion) based on the intended use, such as dating or driving. For the intended use, the TPO needs to be entered beforehand.
[0315] As a personal profile analysis, it can recommend songs that individuals like by analyzing their song playback logs, conversation records, and other data. The result can help peers understand you better.
[0316] In past log analysis, songs that evoke memories for two people can be recommended by analyzing the playback logs of songs they previously listened to.
[0317] In this way, songs can be recommended by analyzing member profiles, individual profiles, or for specific purposes. The key here is that the target users consider the recommended songs to be good songs.
[0318] (Input of community-related information)
[0319] As a method for recommending songs, the first step will be to describe a method that recommends songs based on inputs related to community information.
[0320] As information related to the community, such as Figure 25 As shown, information such as the situation, member information, conversations between members, and past replay trends can be used.
[0321] Specifically, since the songs to be listened to vary depending on the context of the actions of members belonging to the community, the context is entered as the place to go, such as an amusement park, or the purpose, such as a date, barbecue, or trip (S311).
[0322] In addition, since the songs to be listened to vary depending on the members of the community, information such as age group, gender and number of members can be entered (S312), or information about conversations between members can be entered, such as message exchanges on social media (S313).
[0323] Furthermore, since the trend of songs to be listened to is known from past playback trends, the playback history of songs listened to (songs other than recommended songs, etc.) is entered (S314). Note that here, songs that have been "liked" by community members, songs that excite everyone, songs that deepen the relationship between community members, etc., can all be included in past playback trends.
[0324] Then, when community-related information is entered during the processing of steps S311 to S314, recommended songs are selected based on the entered information (S315).
[0325] Note that here, you can appropriately select recommended songs, rather than presenting all selected recommended songs. Specifically, the songs recommended by an individual can be reflected on another member of the community, or songs with high priority can be selected based on their own analysis.
[0326] (Assisted by an agent)
[0327] In addition, agents can participate in community conversations and collect input information. Figure 26 An example of using an agent to collect input information is shown. This agent is a software agent with artificial intelligence capabilities.
[0328] exist Figure 26 In the input context, such as a date or amusement park (S311), member information such as number of people, gender or age (S312), past playback trends such as playback history of songs other than the last recommended song (S314), or dialogue between members such as communication on SNS (S313), the agent participates in the dialogue of the social media community, so that the intentional dialogue is included in the dialogue between members.
[0329] In other words, by analyzing the input information, good suggestions for community action are generated as questions (S316) and input into social media such as SNS (S317). As a result, for example, as described below, a dialogue (question and answer) is conducted on the SNS.
[0330] Agent: "○○ matches dating!" (○○: song title)
[0331] User: "Hmm, it doesn't sound very good."
[0332] In this example, when a recommended song is selected based on the input information, the song "○○" is excluded from the recommended songs by analyzing the conversation on the SNS and will not be played back (S315).
[0333] (System configuration example)
[0334] Figure 27 An example of the configuration of the information processing system 1 corresponding to the presentation of recommended songs is shown.
[0335] exist Figure 27 In the first example of the second embodiment described above ( Figure 17 Similarly, if user A and user B, both belonging to community A, can use the same paid plan for music distribution service A, wireless device 30-1 (commander application 351-1) sends a distribution request to service provider server 20-1A for song A specified by user A, and wireless device 30-2 (commander application 351-2) sends a distribution request to service provider server 20-1A for the same song A.
[0336] Thus, the playback player of wireless device 30-1 and the playback player of wireless device 30-2 play the same song A.
[0337] At this time, as a method for recommending songs, there is, for example, the following method. That is, the event analyzer 411 analyzes the event based on information from various sensors and various applications from wireless devices 30-1 and 30-2 and monitors whether a recommended song has been requested.
[0338] In addition, the analyzer 412 analyzes the information stored in databases such as shared content DB 421, member information management DB 422, dialogue history DB 423 and playback history DB 424, and supplies the analysis results to the recommended song generation unit 413.
[0339] The recommended song generation unit 413 generates recommended songs based on the analysis results from the analyzer 412 and information related to the songs stored in the song DB 425, and supplies the recommended songs to the distribution control unit 414.
[0340] The distribution control unit 414 provides the recommended songs from the recommended song generation unit 413 to the service provider server 20-1A based on the analysis results from the event analyzer 411. Thus, the service provider server 20-1A can distribute the recommended songs to wireless devices 30-1 and 30-2 via the network 40.
[0341] The information processing corresponding to the presentation of recommended songs can be performed by the management server 10, the service providing server 20-1A, etc., or by a newly provided server for recommendation. Furthermore, this information processing can be performed not only by a single server but also collaboratively by multiple servers.
[0342] Note that because the songs distributed by different music distribution services may differ, you can check with the services that members in the community have signed up for before starting playback to see if the recommended song can be played. If no recommended song is available, the recommendation can proceed to the next song.
[0343] (Example of folder management)
[0344] As a range of songs that multiple users within a community can choose from, songs can be selected for each community, and songs can be set for shared listening. In this case, assuming users share folders instead of playlists, and playlists can be included within those folders, etc.
[0345] Here, the folders provided for each community do not reflect the individual preferences of users belonging to that community, but rather the songs that users would like to listen to when multiple users belonging to the community come together. This protects the privacy of users who do not want other users to know their music preferences.
[0346] Figure 28 An example of folder management corresponding to the community is shown. Figure 28 The contents of the folder are shown for each of the tabs “Community A”, “Community B”, and “Personal Use”.
[0347] In the "Community A" folder, manage playlists for Community A. In the "Community B" folder, manage playlists for Community B.
[0348] In the "Personal Use" folder, manage playlists for individual use (per user). Here, publish playlists, songs, etc. from the Personal Use folder to the community folder (arrow A in the diagram), so that a playback list (playlists, songs, etc.) is generated in the community folder.
[0349] (The overall image after processing)
[0350] Finally, refer to Figure 29 The flowchart in the third embodiment describes the overall picture of information processing.
[0351] Figure 29 The information processing shown is achieved, at least through the cooperation of the management server 10 (control unit 100) and the service provision server 20 (control unit 200) in the information processing system 1. Note that, in the case of a newly provided server for recommendation, the server cooperatively performs the processing.
[0352] like Figure 29 As shown, information processing system 1 acquires community-related information (S321).
[0353] For example, one of the following can be obtained as community-related information: attribute information (age group, gender, etc.) of multiple users (users A and B, etc.) belonging to a specific community (community A, etc.), past communication content between multiple users (messages on social media, etc.), content playback history of multiple users (songs other than recommended songs that have been listened to), context in which content recommended by multiple users is played (places to go, such as amusement parks), and preferences of specific users belonging to a specific community (preferences of specific users for specific songs, etc.).
[0354] Then, the information processing system 1 performs analysis based on the acquired community-related information (S322), and selects recommended content (recommended songs, etc.) according to the analysis results (S323). Subsequently, the selected recommended content is presented to the wireless device 30 in the information processing system 1.
[0355] <4. Fourth Implementation Method>
[0356] Communities can be formed manually based on user actions or automatically at a predetermined time.
[0357] In other words, the communities (such as community C) to which users A and B belong can be automatically formed based on the communication between wireless device 30-1 used by user A and wireless device 30-2 used by user B.
[0358] By forming a community in this way, the playback of songs by multiple users in the community can be synchronized, and these users can listen to the same music.
[0359] When playing songs, playback can be controlled based on user actions or automatically controlled at a predetermined time.
[0360] Specifically, as a manual playback control, when any user among multiple users in the community issues a command to play a song, the song begins to play on the wireless device 30 used by that user, and the song also begins to play on the wireless devices 30 used by other users in the community.
[0361] In other words, when one member in the community performs a song playback operation, the playback operation is performed for all members.
[0362] Furthermore, as part of the automatic playback control, if user A and user B are detected moving together in the community based on location information from wireless devices 30-1 and 30-2, the same song will be simultaneously distributed to both wireless devices 30-1 and 30-2. Thus, user A and user B can listen to the same music while moving together.
[0363] Note that the information used to detect triggers in automatic playback control is not limited to location information, and other information such as sensor data acquired via wireless device 30 can be used. By using sensor data, the state when user A and user B's eyes meet or when user A and user B hold hands can be detected, and playback control can be executed based on the detection results.
[0364] (The overall image after processing)
[0365] Figure 30 The overall view of information processing in the fourth embodiment is shown.
[0366] Figure 30 The information processing shown is achieved at least through the cooperation of the management server 10 (control unit 100) and the wireless device 30 (control unit 300) in the information processing system 1.
[0367] like Figure 30 As shown, the information processing system 1 determines whether a predetermined communication is detected between the wireless device 30-1 used by user A and the wireless device 30-2 used by user B (S411).
[0368] If a positive determination is made in the determination process of step S411, the information processing system 1 automatically forms a specific community (community C, etc.) to which user A and user B belong based on the detected communication (S412).
[0369] Note that if a negative determination is made during the determination process in step S411, or after the processing in step S412 is completed. Figure 30 The information processing has ended.
[0370] <5. Fifth Implementation Method>
[0371] When members of the community are engaging in dialogue, the community can be supported by facilitating that dialogue.
[0372] In other words, as an aid to dialogue between members, it can appropriately amplify the speaker's voice and transmit it to the partner when members are having a conversation.
[0373] Specifically, if user A and user B, belonging to community A, are using wireless device 30-1 and wireless device 30-2 respectively and listening to the same song A, when user A and user B start a conversation, user A's (or user B's) voice can be amplified and transmitted to user B (or user A). Note that the amplification level here can be adjusted appropriately according to ambient sounds, etc.
[0374] In addition, when user A and user B start a conversation, the volume of the songs playing in wireless devices 30-1 and 30-2 can be reduced.
[0375] Here, since there are two users, User A and User B, when the stage where one of the two users starts speaking is detected, only the volume of wireless devices 30-1 and 30-2 can be reduced. This makes the conversation between the members—for example, a conversation between User A and User B—clear.
[0376] (The overall image after processing)
[0377] Figure 31 The overall view of information processing in the fifth embodiment is shown.
[0378] Figure 31 The information processing shown is achieved at least through the cooperation of the management server 10 (control unit 100) and the wireless device 30 (control unit 300) in the information processing system 1.
[0379] like Figure 31 As shown, in the information processing system 1, it is determined whether the voice emitted by at least one user (user A, user B, etc.) belonging to a specific community (community A, etc.) is detected (S511).
[0380] If a positive determination is made in the determination process of step S511, the information processing system 1 determines whether there are multiple users among multiple users belonging to a specific community who watch or listen to the same content at substantially the same time (S512).
[0381] If a positive confirmation is made in the determination process of step S512, the wireless device 30 acquires the voice message, overlays the voice message onto the content being played (song, etc.), and presents the voice message to the user (S513). At this time, the wireless device 30 may amplify the voice message and reduce the volume of the content.
[0382] On the other hand, if a negative determination is made in the determination process of step S512, the wireless device 30 acquires the voice speech, amplifies the voice speech, and presents the voice speech to the user (S514).
[0383] Note that if a negative determination is made during the determination process in step S511, or after the processing in step S513 or S514 has ended. Figure 31 The information processing has ended.
[0384] <6. Sixth Implementation Method>
[0385] Furthermore, playback control can be implemented to suit the external environment. For example, if user A goes to a specific place such as a coffee shop or cafe, it may sometimes be best not to play songs from wireless device 30-1. Here, specifically, it is assumed that headphones that allow user A to hear external sounds, such as open-ear headphones, will be used as the headphones 31 worn by user A.
[0386] For example, if user A stays in a specific place such as a coffee shop for a predetermined time, the music playing on wireless device 30 will automatically stop after a certain period of ambient music (BGM) is detected. As a result, user A can listen to music played as ambient music in the coffee shop, such as BGM, instead of the song (music) played back by wireless device 30-1.
[0387] In other words, here, when a predetermined condition is met when estimating user A's action, the song (music) being played in wireless device 30-1 is stopped.
[0388] Furthermore, if the music playback stops only when user A moves, the music might stop every time ambient music is detected from various stores while user A is walking through the shopping street, potentially causing discomfort for user A. Therefore, it is necessary to add the condition that user A has stopped or sat down for a certain period of time, or remained in a specific location for a predetermined period of time.
[0389] Note that user A's actions are detected based on sensor data from the sensor unit 306 built into the wireless device 30-1, such as whether user A has stopped or sat down for a certain period of time. Additionally, collected sound data gathered by the microphone 322 built into the wireless device 30-1 can be used to detect ambient music for a certain period of time.
[0390] Furthermore, in the example above, the case of immediately stopping the song playing on wireless device 30-1 when predetermined conditions are met has already been described. However, a message indicating that the song playing is to be stopped can be presented on wireless device 30-1. Then, the song playing is stopped on wireless device 30-1 only if user A, who has already checked the message, receives an instruction to stop the song playing.
[0391] Furthermore, when user A is wearing earphone 31 and listening to music, removing earphone 31 from the ear can stop the song playing on wireless device 30-2 and simultaneously stop the music being listened to by user B. On the other hand, when user A puts earphone 31 back on, the playback of the song on wireless devices 30-1 and 30-2 can be resumed when users A and B are ready.
[0392] (The overall image after processing)
[0393] Figure 32 The overall view of information processing in the sixth embodiment is shown.
[0394] Figure 32The information processing shown is achieved at least through the cooperation of the management server 10 (control unit 100) and the wireless device 30 (control unit 300) in the information processing system 1.
[0395] like Figure 32 As shown, in the information processing system 1, it is determined whether multiple users (user A and user B, etc.) belonging to a specific community (community A, etc.) have been detected to have stayed in the same location for a predetermined time and whether ambient music has been detected for a certain period of time (S611).
[0396] If a positive determination is made in the determination process of step S611, the information processing system 1 (the wireless device 30) automatically stops playing back the same content that multiple users belonging to a specific community are watching at substantially the same time (S612).
[0397] Note that if a negative determination is made during the determination process in step S611, or after the processing in step S612 is completed. Figure 32 The information processing has ended.
[0398] <7. Seventh Implementation Method>
[0399] Community support can be achieved by generating a slideshow based on a captured image taken by a member of the community and the music that member is listening to, and then posting the slideshow on social media.
[0400] (Slideshow generation)
[0401] First, the generation of the slides will be described. Specifically, suppose that users A and B, who belong to community A, go to a certain place and capture images using a wireless device 30, such as a smartphone, while listening to the same song.
[0402] In this scenario, by assigning metadata about “when,” “where,” “with whom,” and “for what” to the viewed song, a slideshow can be generated based on information such as time and location information by collecting captured images along with the music being listened to at the time.
[0403] In addition, when generating a slideshow, you can include multiple still and moving images captured when members of the community are working together, songs obtained by mixing multiple songs that were playing at the time, etc. Note that when selecting songs to use in the slideshow from multiple songs, you can prioritize songs that any member of the community or specific members "like".
[0404] In other words, such as Figure 33As shown, all music, still images, moving images, and other information associated with user A and user B's community A during the participation of user A and user B are set as the target area, and a slideshow is generated based on the information included in the target area.
[0405] Thus, users A and B can record the generated slideshow as a memory of a song they listened to in a certain place, and can recall the memory or listen to the song again in that place by viewing the slideshow. In other words, viewing music, still images, or moving images can enhance the recall of actions within the community.
[0406] In addition, various presentation formats can be used as methods for presenting this slide.
[0407] For example, by collecting the conversation between user A and user B, the conversation can be used as character information for the slideshow.
[0408] Note that in the event that a community is abandoned, still and moving images associated with that community can be prevented from being played back. Additionally, when a song is played back while a member is moving within a community, both still and moving images captured during that movement can be displayed simultaneously.
[0409] Furthermore, the aforementioned "like" can be given to songs that both users A and B find enjoyable. The "like" can be given if users A and B perform a predetermined action, or it can be given automatically based on sensor data quantified to determine information such as heart rate, threshold settings, and the assumption that both users agree that the song is good. As a result, users A and B can develop a shared appreciation.
[0410] Furthermore, the timing for giving a song a "like" can be a timed event where user A says "like" between users A and B. Note that scheduled notifications (notifications to sound, display, etc.) can be made when songs that users A and B have each "liked" are played. Using this notification, one user can identify another user's favorite song and resonate with it.
[0411] (Published on social media)
[0412] Next, we will describe the posting to social media. Specifically, let's assume that user A and user B, both belonging to community A, go to a certain place and listen to the same song.
[0413] In this case, since it can be identified that user A and user B are together based on the location information of wireless devices 30-1 and 30-2, the information can be correlated with the events of the two.
[0414] Figure 34This illustrates an example of users A and B posting content generated during activities in community A on social media platforms such as SNS.
[0415] exist Figure 34 In the process, the SNS application is launched on the wireless device 30 and information related to the date set by user A and user B on February 23 is displayed.
[0416] In other words, the system captured a scene of User A and User B eating at 18:25, and then captured a scene of the building they visited at 19:55. Therefore, a still image of that building is displayed. Furthermore, since User A and User B were listening to the same song while visiting the building, the history of the song "XXX" is also displayed.
[0417] Furthermore, since User A and User B exchanged text messages after the stated date, these messages were displayed as post-comments.
[0418] In this way, captured still and moving images, the history of replaying songs, post-event comments, and location information of visited places can be published on social media such as SNS, and users A and B can share their memories together.
[0419] Thus, users A and B can access social media and review memories like looking at a photo album. Furthermore, they can revisit songs that were unknown at the time of listening but left an impression, based on the history of song playback. Additionally, they can later replay the played songs in one go or add them to their favorites.
[0420] Furthermore, if all captured images, such as still images and moving images, are published, subsequent editing can be complex, and therefore, it is necessary to select which captured images to publish. For example, for a captured image that a wireless device 30 has automatically detected and determined to have a certain degree of camera shake, it can ask the user whether to publish the captured image, such as "Are you sure you want to publish this captured image?".
[0421] Figure 35 An example of posting captured images on social media is shown. Figure 35 A message is shown for confirming whether to post the captured image on social media when a wireless device 30, such as a smartphone, captures an object.
[0422] Users can publish captured images by confirming the message and performing a publish action. Publish actions include selecting "Yes" via button or touch panel operation, making a gesture such as nodding, or shaking the wireless device 30 itself. Conversely, if "No" is selected via button or touch panel operation, the captured images will not be published.
[0423] Note that if the captured image meets predetermined conditions—for example, two users A and B are included in the captured image—facial image recognition processing can be used to automatically publish the captured image. For example, since facial information used for unlocking is recorded in wireless device 30, it can be determined whether the two users have been captured by comparing that facial information with a predetermined area of the captured image in facial image recognition processing.
[0424] Next, we will refer to Figure 36 The flowchart describes the content publishing process. Furthermore, Figure 37 This shows an overall view of content posted on the community's social networking site, and will be appropriately referenced. Figure 37 Describe it.
[0425] In the wireless device 30, a camera device application or the like processes image data of an object captured by the camera device unit 307 to generate content such as still images or moving images (S711), and inspects the content (S712).
[0426] In addition, the wireless device 30 queries the management server 10 to check the community where the content is published (S713).
[0427] In other words, in management server 10, user management is performed based on the community ID and user ID stored in management DB 121, and management (connection management) is performed on the communities in which two users A and B are currently active. Figure 37 Therefore, in response to an inquiry from wireless device 30, management server 10 provides a notification regarding the community ID of community A in which user A and user B are currently active. Figure 37 ).
[0428] Wireless device 30 publishes content such as still images on the SNS of community A (S714), where community A is created on service provider server 20-3 that provides SNS services.
[0429] In other words, in wireless device 30, content such as still images and community IDs is supplied from the camera device application to the SNS application. Then, the SNS application sends the content such as still images and community IDs, along with user IDs, to the service provider server 20-3 via network 40. Figure 37 Note that here, information such as the history and location of a song playback can be sent along with content such as still images.
[0430] Thus, the captured still and moving images, the history of the replay of songs, post-event comments, and location information of the visited sites can be posted on social media such as SNS and shared by members of the community.
[0431] (The overall image after processing)
[0432] Finally, refer to Figure 38 and Figure 39 The flowchart in the seventh embodiment describes the overall picture of information processing.
[0433] Figure 38 and Figure 39 The information processing shown is achieved through the cooperation of at least the management server 10 (control unit 100), the service providing server 20 (control unit 200), and the wireless device 30 (control unit 300) in the information processing system 1.
[0434] like Figure 38 As shown, in information processing system 1, the community ID, the date and time of viewing, and location information indicating the viewing location are given to the first content (song, etc.) viewed by multiple users (users A and B, etc.) belonging to a specific community (community A, etc.) (S721). Note that here, it is sufficient to give at least the community ID, and whether or not to give time information and location information is arbitrary.
[0435] Then, in the information processing system 1 (the wireless device 30), while playing back the second content (still image, moving image, etc.) associated with at least the community ID, the first content (song, etc.) is played back (by slideshow) (S722).
[0436] In this way, users can experience memories of actions taken by members of a specific community through slideshows.
[0437] In addition, such as Figure 39 As shown, in information processing system 1, in step S731—similar to step S721 described above—after providing information about the community ID, the date and time of viewing, and the viewing location to the first content (song, etc.) viewed by multiple users belonging to a specific community, the processing in step S732 can be performed. Note that here, it is sufficient to provide at least the community ID to the first content, and whether or not time and location information are provided is arbitrary.
[0438] In other words, in the information processing system 1 (wireless device 30), on at least one user-accessible social media (SNS, etc.) account in a specific community, second content (still image, moving image, etc.) captured while viewing the first content (song, etc.) and information related to the first content (song, etc.) (such as the history of playing the song, etc.) are automatically published (S732).
[0439] Thus, users can experience memories of actions taken by members of the community on social media.
[0440] <8. Eighth Implementation>
[0441] As mentioned above, a "like" can be given to a song that two users A and B, belonging to community A, both think is good. Then, when listening to a song that has already received a positive review such as "like," a notification can be provided to the MC who said something like "You two like it." Note that this is not limited to positive reviews; notification can also be provided in cases where some reviews, such as negative reviews, have already been given.
[0442] Note that various variations are assumed for this type of MC, and examples can be given as follows.
[0443] In other words, when a song is directly specified, an MC (MC) can be inserted before the song playback begins, using the reason for playback such as "XXXX's request". Furthermore, if the song is a favorite of two users, an MC such as "You two like it" can be inserted.
[0444] Furthermore, when Tokyo Tower is captured in still images, moving images, etc., a short video titled "Looking at Tokyo Tower" can be inserted. Additionally, a short video titled "Tokyo Tower at night" can be inserted, taking time zones into account. Moreover, when playing songs that seem to be liked by all members of the community, a short video titled "Everyone likes it" can be inserted.
[0445] (The overall image after processing)
[0446] Figure 40 The overall view of information processing in the eighth embodiment is shown.
[0447] Figure 40 The information processing shown is achieved at least through the cooperation of the management server 10 (control unit 100) and the wireless device 30 (control unit 300) in the information processing system 1.
[0448] like Figure 40As shown, in information processing system 1, when presenting content (songs, etc.), it is determined whether the content (songs, etc.) is evaluated as positive or negative by a certain number of members among multiple users (users A and B, etc.) belonging to a specific community (community A, etc.). (S812)
[0449] If a positive decision is made in the determination process of step S812, the information processing system 1 (wireless device 30) is notified whether the content (song, etc.) is evaluated as positive or negative when viewing the content (S813). This notification may include MCs such as "You two like it".
[0450] Note that if a negative determination is made during the determination process in step S812, or after the processing in step S813 is completed. Figure 40 The information processing has ended.
[0451] <9. Ninth Implementation Method>
[0452] Even when members of a community act together, suppose some members are unable to act together for some reason. For example, there might be a user who gets separated from the group or takes another action temporarily.
[0453] Here, as a method to determine when some members become unable to act together, it can be based on whether the members are a certain distance apart. Alternatively, when members meet at a predetermined location, it can also be determined that no members who are within a certain distance of the predetermined location at the predetermined meeting time become unable to act together.
[0454] For example, such as Figure 41 As shown, if users A to D (the ellipse in the diagram) belonging to the community act together, assume that only user B moves away from the community by a distance d. Here, if the distance d exceeds a threshold, it is determined that user B is a certain distance or greater, and the situation becomes such that user B can start a conversation with users A, C, and D.
[0455] Here, the state in which a call can begin can be, for example, the following: In other words, if user B becomes separated from users A through D, the state in which user A has already used wireless device 30 to make a call in the community can be set to the state in which a call can begin.
[0456] Alternatively, if user B becomes separated from user A and user A is making a call using wireless device 30, a call cannot be initiated if none of the wireless devices 30 used by users B through D answer the call. Therefore, the state where each of the wireless devices 30 used by users B through D automatically answers the call from user A's wireless device 30 and initiates a call can be set to a state where a call can be initiated.
[0457] As a result, even if user B gets separated from the group or takes other actions, users A, C, and D can still find out the reason why user B is a certain distance away or even further away through their conversations. In other words, although the voice reaches users A, C, and D who are together, it will not reach user B who is a certain distance away or even further away. Therefore, they can have a conversation through a predetermined communication path.
[0458] In addition, in determining whether members are a certain distance apart, for example, in addition to using the location information from the wireless devices 30 owned by the user to determine the distance between the wireless devices 30, it is also possible to detect whether radio waves become unreachable to the wireless devices 30, or to detect whether the wireless devices 30 are outside the geofence assigned to the corresponding wireless devices 30.
[0459] Note that during a call between users, the conversation can be conducted using the headset 31 instead of using a wireless device 30, such as a smartphone. Furthermore, the headsets 31 worn by the users can communicate wirelessly with each other and allow for conversations between them.
[0460] Furthermore, in crowded places or shops, it is assumed that even if a member is nearby, their voice will not reach them, and therefore, the threshold used to determine the distance d can be adjusted. Additionally, if users B are a certain distance or greater apart, navigation information such as the wireless device 30 for members (users A to D) who are already traveling together can be specified regarding the location where these members can reunite in the shortest time. Therefore, the reunification of members can be smoothly achieved.
[0461] (The overall image after processing)
[0462] Figure 42 The overall view of information processing in the ninth embodiment is shown.
[0463] Figure 42 The information processing shown is achieved at least through the cooperation of the management server 10 (control unit 100) and the wireless device 30 (control unit 300) in the information processing system 1.
[0464] like Figure 42 As shown, in the information processing system 1, it is determined, based on location information from wireless device 30, whether multiple users (user A, user B, etc.) belonging to a specific community (community A, etc.) are already a certain distance or a greater distance apart (S911).
[0465] If a positive determination is made in the determination process of step S911, the information processing system 1 performs control so that the user's wireless device 30 can automatically initiate a call between multiple users (S912).
[0466] In other words, since the voice reaches nearby users, these users can have a conversation on the spot. However, since the voice does not reach users who are a certain distance away or further away, the conversation is made using a device such as wireless device 30 or headset 31 via a predetermined communication path.
[0467] Furthermore, in the process of step S911, when a call is made between multiple users, the voice and image of the call between the multiple users are located according to the relative positional relationship between the multiple users, so that the user making the call can identify the location of the user on the other end of the call.
[0468] Note that if a negative determination is made during the determination process in step S911, or after the processing in step S912 has ended. Figure 42 The information processing has ended.
[0469] <10. Tenth Implementation Method>
[0470] Incidentally, the above description mainly describes the situation where members of a community share the same song, but they can also share images (AR information) corresponding to augmented reality (AR).
[0471] (AR Information Sharing)
[0472] Figure 43 An example configuration is shown in the case of sharing AR information.
[0473] exist Figure 43 In the example, wireless device 30-1 used by user A and wireless device 30-2 used by user B are configured as augmented reality (AR) compatible glasses-type devices, i.e., AR compatible devices, such as AR headsets or AR glasses.
[0474] Wireless device 30-1 includes a command application 351-1 and an AR rendering system 353-1. Wireless device 30-2 includes a command application 351-2 and an AR rendering system 353-2. AR rendering systems 353-1 and 353-2 perform processing for rendering AR information based on information input to them—such as location and orientation information like GPS—and image data.
[0475] In this example, when user A searches for a desired ramen shop between user A and user B who belong to community A, the search results are displayed as AR information on wireless device 30-1.
[0476] At this point, by using the community detection function, the same AR information can be displayed on the AR glasses of all other members belonging to community A. Thus, the search results for the ramen shop specified by user A are displayed as AR information on wireless device 30-2.
[0477] Specifically, in the wireless device 30-1, the AR presentation system 353-1, under the control of the command application 351-1, sends a request including search criteria (ramen), location information, and community ID to the service provider server 20 via the network 40 (S1011).
[0478] Service provider server 20 searches for information about restaurants stored in restaurant information DB 231 based on search criteria (ramen) and location information from wireless device 30-1, and generates a list of ramen shops near user A's current location.
[0479] The response, including the list of ramen shops, is sent to wireless device 30-1 via network 40 (S1012). Furthermore, the list of ramen shops is stored in service provider server 20 in association with the community ID of community A.
[0480] In the wireless device 30-1, the command application 351-1 and the AR presentation system 353-1 collaboratively perform processing based on the list of ramen shops from the service provider server 20, thereby presenting AR information.
[0481] At this time, wireless device 30-1 (command application 351-1) and wireless device 30-2 (command application 351-2) cooperate with each other through management server 10, and wireless device 30-2 also performs the process of presenting the same AR information.
[0482] In other words, in the wireless device 30-2, the AR presentation system 353-2 sends a request including the community ID to the service provider server 20 via the network 40 under the control of the command application 351-2 (S1013).
[0483] Since the list of ramen shops associated with the community ID of community A is stored in the service provider server 20, a response including the list of ramen shops is sent in response to the request from the wireless device 30-2 (S1014).
[0484] In the wireless device 30-2, the command application 351-2 and the AR presentation system 353-2 collaboratively perform processing based on the list of ramen shops from the service provider server 20, thereby presenting AR information.
[0485] In this way, users A and B, who belong to community A, can learn about ramen shops around their current location by viewing the same AR information presented on wireless devices 30-1 and 30-2, such as AR headsets.
[0486] Furthermore, at this point, the conversation between user A and user B can be combined. In other words, since the management server 10 knows that user A and user B, who belong to community A, are connected, it can obtain and combine the conversation between user A and user B and analyze its meaning.
[0487] In this analysis, the speech content of users A and B wearing devices such as AR headsets or AR glasses can be obtained by using voiceprint analysis to pick up only the voices of users A and B. Note that vibrations from AR headsets can also be used to detect whether a user is speaking.
[0488] In addition, such as Figure 44 As shown, there may be situations where it is necessary to distinguish between conversations between members of community A and conversations with outsiders.
[0489] Figure 44 This shows a conversation between user A and user B, who belong to community A. Figure 44 Within the dotted lines, and the dialogue between user A, who belongs to community A, and external personnel who do not belong to community A. Figure 44 (single-dot dashed line in the text).
[0490] (First example)
[0491] In the first example, it is shown Figure 44 The dashed line in the image represents the dialogue between user A and user B.
[0492] User A: "Do you want to eat ramen?"
[0493] User B: "Yes!"
[0494] In the first example, since the conversation between user A and user B, who belong to the community, can be obtained, the same AR information based on the ramen shop list can be presented to wireless devices 30-1 and 30-2 by combining the conversation and analyzing its meaning (setting it as a search criterion).
[0495] (Second example)
[0496] In the second example, it is shown Figure 44 The single-dotted line in the image represents the dialogue between user A and an external person.
[0497] User A: "How much is this?"
[0498] External staff (store clerk): 980 yen
[0499] In this second example, assuming there is no speech from user B and user B is conversing with another person, let's assume user B speaks before user A finishes speaking or remains silent. Therefore, such a conversation can be distinguished from a conversation with an external person. In this case, it is not necessary to present the same AR information.
[0500] Note that responses can occur without words during a conversation. For example, a conversation can be distinguished from one with outsiders who are not part of community A by obtaining nods (agreement, etc.) or shakes (denial, refusal, etc.) from sensor data, etc.
[0501] (The overall image after processing)
[0502] Figure 45 The overall view of information processing in the tenth embodiment is shown.
[0503] Figure 45 The information processing shown is achieved at least through the cooperation of the management server 10 (control unit 100) and the wireless device 30 (control unit 300) in the information processing system 1.
[0504] like Figure 45 As shown, in information processing system 1, multiple users currently acting together (users A and B, etc.) are specified (S1021), and the specified multiple users are set as multiple users belonging to a specific community (community A, etc.) (S1022).
[0505] Furthermore, in the information processing system 1, information (such as a list of ramen shops) displayed as AR information for each user is obtained (S1023), and control is performed based on the obtained information so that multiple users can experience the same type of service at essentially the same time by using AR information displayed on AR-compatible devices (AR headsets, AR glasses, etc.) corresponding to the respective users (S1024).
[0506] <11. Eleventh Implementation Method>
[0507] Song playlists can be generated through conversations among community members. In other words, playlists can be created collaboratively by community members. Conversations with proxies on social networking applications can then be added to the playlist.
[0508] (Playlist generation)
[0509] Figure 46 An example of generating playlists based on conversations in the community is shown.
[0510] In this example, users A and B, who belong to community B (the community of Atami travel), communicate by sending messages to an SNS application launched by a wireless device 30, such as a smartphone, about the songs they want to listen to during their trip.
[0511] In addition, the conversation includes messages from the agent, who suggests songs suitable for the context based on messages from user A and modifies the suggested songs based on requests from user B.
[0512] Playlists (so-called community listening playlists) are generated by taking into account such conversational exchanges in SNS applications.
[0513] Then, on the day of the trip, the songs are played back on wireless devices 30-1 and 30-2 based on the playlist. Therefore, in the scenario specified in the previous conversation, user A and user B can listen to the specified songs together.
[0514] (The overall image after processing)
[0515] Figure 47 The overall view of information processing in the eleventh embodiment is shown.
[0516] Figure 47 The information processing shown is achieved at least through the cooperation of the management server 10 (control unit 100), the service providing server 20 (control unit 200), and the wireless device 30 (control unit 300) in the information processing system 1.
[0517] like Figure 47 As shown, in information processing system 1, the conversations of multiple users (users A and B, etc.) belonging to a specific community (community B, etc.) are obtained (S1111). The conversations of the specific community are not limited to conversations between multiple users in an SNS application, and may also include conversations with agents.
[0518] Furthermore, the information processing system 1 generates a playlist by considering the dialogue of a specific community (S1112). Here, the content (songs, etc.) to be played back in a specified context is considered as the content of the dialogue.
[0519] If a playlist was generated in step S1112, the process proceeds to step S1113. Then, the information processing system 1 determines whether the scenario specified in the dialogue has occurred (S1113).
[0520] If a positive determination is made in the determination process of step S1113, the information processing system 1 (the wireless device 30) plays back the content (songs, etc.) specified in the dialogue based on the generated playlist.
[0521] As a result, users can view the expected content to be replayed if conditions specified in previous conversations with members belonging to a specific community are met.
[0522] <12. Revision>
[0523] (Playback of different content)
[0524] When users A and B, who belong to community A, are together, wireless devices 30-1 and 30-2 play the same song, but when they take separate actions, they do not always need to play the same song.
[0525] Figure 48 This shows an example of the behavior when users A and B, who belong to community A, take separate actions.
[0526] Figure 48 Suppose that user A and user B are on a date. Here, during the date from time t1 to time t4, user A and user B take separate actions from time t2 to time t3.
[0527] At this point, since users A and B are together from time t1 to time t2 and from time t3 to time t4, they can play the same song A. However, since users A and B are not together between time t2 and time t3, they can play different songs B and C.
[0528] Note that even if users A and B, who belong to community A, are together, it is assumed that their private time is guaranteed. Therefore, in such a case, synchronization of song playback between wireless devices 30-1 and 30-2 can be canceled. Furthermore, if wireless devices 30-1 and 30-2 are synchronized with multiple services, including music distribution services, synchronization of some services can be canceled.
[0529] (Usage of user connections)
[0530] Since the management server 10 has knowledge of the actions taken by members of the community, it can share information generated during that time period or use that information to determine the priority of communication paths.
[0531] Figure 49 An example of a user connection display is shown. Figure 49 In the middle, the selection display order of potential contact partners (connected partner groups) among members belonging to the community is improved and displayed. Note that when the headsets 31 communicate directly with each other, information related to switching the connection destination community can be displayed.
[0532] (Bill splitting in the community)
[0533] In the first embodiment (second example) described above, bill splitting processing when a member belonging to the community makes a payment has been described. However, bill splitting processing can be performed similarly even when a payment is made using a QR code (registered trademark).
[0534] In other words, when a reader reads a QR code displayed on the screen of a wireless device 30, such as a smartphone, and makes a payment, a bill split request can be sent to members in the community when the "community bill split button" is pressed and a payment is made.
[0535] (Log analysis for each community)
[0536] When two or more people are listening to music, the intended use and musical preferences differ compared to when one person is listening alone. Therefore, the playback history of songs listened to by two or more people is analyzed for each community, and the best music can be recommended based on the analysis results. Meanwhile, when one person listens to music alone, the playback history of songs listened to by two or more people is not added to the music playback history.
[0537] However, if a user gives a positive rating such as "like" to a song listened to by two or more people, the song's playback history can be added as a playback history of the music when one person listens to it alone.
[0538] (Another configuration example)
[0539] The above description has described an information processing system 1 including a management server 10, a service providing server 20, and a wireless device 30. However, alternative configurations, such as adding additional devices or servers, may be used.
[0540] Specifically, the management server 10, which is an information processing device, can be configured as multiple information processing devices by being divided into servers for managing communities, database servers, etc. Similarly, the service providing server 20 or the wireless device 30 can be configured not only as one information processing device but also as multiple information processing devices.
[0541] Furthermore, in information processing system 1, which device comprises the configuration elements (control units) of each of the management server 10, service provider server 20, or wireless device 30 is arbitrary. For example, using edge computing technology, some of the processing in information processing performed by management server 10 can be performed by service provider server 20 or by an edge server connected to a network (peripheral unit) close to wireless device 30.
[0542] In other words, the term "system" refers to a group of multiple configuration elements (devices, modules (components), etc.), regardless of whether all configuration elements are housed in the same enclosure. Therefore, both multiple devices housed in separate enclosures and connected via a network, and a single device housing multiple modules in one enclosure, are systems.
[0543] Furthermore, the communication method for each configuration element is also arbitrary. In other words, in addition to communication lines such as the Internet or mobile phone networks serving as network 40, each configuration element can also be connected via a local area network (LAN or WAN). Moreover, each configuration element can be connected via wired or wireless means.
[0544] As described above, in this technology, multiple users acting together can experience the same type of service at substantially the same time, through each user's wireless device, based on the same type of service available to each user.
[0545] Note that Patent Documents 1 and 2 disclose a system capable of simultaneously distributing karaoke songs to multiple mobile phone terminals. Furthermore, Patent Document 3 discloses a service providing device that simultaneously sends data to devices belonging to the same group upon request, allowing multiple users to play the same music data simultaneously.
[0546] Furthermore, Patent Document 4 discloses a portable terminal device that, upon receiving an identification signal including device identification information, emits music to provide a notification of the device's proximity. Additionally, Patent Document 5 discloses a television receiver with a volume control function that, upon detecting a user's voice, lowers the volume of the currently viewed program to a predetermined volume.
[0547] In addition, the aforementioned patent document 6 discloses a service that automatically groups multiple users who meet predetermined conditions when users with matching behaviors, hobbies, tastes, etc. are automatically presented or grouped in an SNS and enables information sharing within the group.
[0548] However, even using the technology disclosed in Patent Documents 1 to 6, it is difficult to say that a good user experience can be provided when providing services to multiple users acting together using devices owned by each user, and it is required to provide a better user experience.
[0549] Therefore, this technology enables multiple users acting together to experience the same type of service at substantially the same time, through each user's wireless device, based on the same type of service available to each user, thereby providing a better user experience.
[0550] <13. Computer Configuration>
[0551] The above series of processes (e.g., Figure 12 The information processing shown (e.g., as illustrated) can be executed by hardware or by software. In the case where the series of processes are executed by software, the software configuration program is installed in the computer of each device. Figure 50 This is a diagram illustrating an example of the hardware configuration of a computer that performs the above series of processes through a program.
[0552] In the computer, the Central Processing Unit (CPU) 1001, Read-Only Memory (ROM) 1002, and Random Access Memory (RAM) 1003 are interconnected via a bus 1004. Furthermore, an input / output interface 1005 is connected to the bus 1004. An input unit 1006, an output unit 1007, a storage unit 1008, a communication unit 1009, and a driver 1010 are connected to the input / output interface 1005.
[0553] Input unit 1006 includes a microphone, keyboard, mouse, etc. Output unit 1007 includes a speaker, display, etc. Storage unit 1008 includes a hard disk, non-volatile memory, etc. Communication unit 1009 includes a network interface, etc. Driver 1010 drives removable recording media 1011, such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory.
[0554] In the computer configured as described above, the CPU 1001 loads the program recorded in the ROM 1002 or storage unit 1008 into the RAM 1003 via the input / output interface 1005 and the bus 1004 and executes the program, thereby performing the series of processes described above.
[0555] The program to be executed by the computer (CPU 1001) can be recorded in a removable recording medium 1011, such as a packaging medium, and provided. Alternatively, the program can be provided via a wired or wireless transmission medium, such as a local area network, the Internet, or digital satellite broadcasting.
[0556] In a computer, by attaching the removable recording medium 1011 to the drive 1010, a program can be installed into the storage unit 1008 via the input / output interface 1005. Alternatively, a program can be received via a wired or wireless transmission medium through the communication unit 1009 and installed into the storage unit 1008. In addition to the methods described above, the program can be pre-installed in the ROM 1002 or the storage unit 1008.
[0557] In this specification, the processing performed by the computer according to the program need not be executed sequentially according to the order described in the flowchart. In other words, the processing performed by the computer according to the program also includes parallel or individual processing (e.g., parallel processing or object-based processing). Furthermore, the program can be processed by a single computer (processor), or it can be distributed across multiple computers and processed by multiple computers.
[0558] Note that the implementation of this technology is not limited to the above-described implementation, and various modifications can be made without departing from the spirit of this technology.
[0559] also, Figure 12 The information processing steps shown in the figures can be performed by one device or can be shared and performed by multiple devices. Furthermore, in cases where a step includes multiple processes, the multiple processes included in that step can be performed by one device or can be shared and performed by multiple devices.
[0560] Note that this technology can be configured as follows. (1)
[0562] An information processing system, comprising:
[0563] The control unit is configured to:
[0564] Set multiple users currently acting together as multiple users belonging to a specific community; and
[0565] The system implements control to enable the multiple users to experience the same type of service at substantially the same time interval through each wireless device corresponding to each user, based on the same type of service available to each user. (2)
[0567] According to the information processing system in (1), where,
[0568] When the first and second users belonging to a specific community can use the same content services.
[0569] Control unit:
[0570] The execution control causes the first wireless device corresponding to the first user to send a content distribution request specified by the first user to the content service, and
[0571] The execution control causes the second wireless device corresponding to the second user to send a content distribution request to the content service. (3)
[0573] According to the information processing system in (2), where,
[0574] The first user has the authority to distribute content across available content services, and
[0575] The second user needs billing processing in order to have the authority to distribute content within the available content services.
[0576] Control unit:
[0577] The execution control enables the first wireless device to not only execute the content distribution request but also perform temporary billing processing, and send a content distribution request for the second wireless device to the content service. (4)
[0579] According to the information processing system in (1), where,
[0580] In cases where the content services available to the first and second users belonging to a specific community are different.
[0581] Control unit:
[0582] The execution control causes the first wireless device corresponding to the first user to send a distribution request for content specified by the first user to a content service available to the first user, and
[0583] The execution control causes the second wireless device corresponding to the second user to send a content distribution request to the content service available to the second user. (5)
[0585] According to any one of (1) to (4) of the information processing system, wherein,
[0586] In the case where multiple users belonging to a specific community watch or listen to the same content at essentially the same time,
[0587] The control unit switches services at a timed point when the camera captures a video feed, which is executed on the wireless device corresponding to one of the plurality of users. (6)
[0589] According to the information processing system in (1), where,
[0590] In cases where neither the first user nor the second user belonging to a specific community has permission to distribute content on available content services.
[0591] Control unit:
[0592] The execution control causes the first wireless device corresponding to the first user to send a content free trial distribution request specified by the first user to the content service available to the first user, and
[0593] The control is executed to cause the second wireless device corresponding to the second user to send a content free trial distribution request to the content service available to the second user. (7)
[0595] According to the information processing system in (1), where,
[0596] In cases where the first user belonging to a specific community cannot use a specific service.
[0597] The control unit causes the first wireless device corresponding to the first user to use a specific service. (8)
[0599] According to the information processing system in (7), where,
[0600] The control unit performs control to enable the first wireless device to receive a specific service. (9)
[0602] According to the information processing system in (1), where,
[0603] When a specific service is used on a wireless device corresponding to a user belonging to a specific community, the control unit requests the use of the specific service on wireless devices corresponding to other users belonging to the same specific community. (10)
[0605] According to any one of (1) to (6) of the information processing system, wherein,
[0606] The control unit selects recommended content based on any of the following: attribute information of the multiple users belonging to a specific community, past communication content between the multiple users, content playback history of the multiple users, context in which the multiple users replay the recommended content, and preferences of the specific user belonging to the specific community. (11)
[0608] According to the information processing system of (10), in which,
[0609] Control unit:
[0610] Manage the IDs of the recommended content in folders for each specific community, and
[0611] A playlist is generated based on the IDs of recommended content stored in folders corresponding to specific communities. (12)
[0613] According to the information processing system of (10), in which,
[0614] Control unit:
[0615] Obtain answers from users related to any question by asking questions or support questions to users belonging to a specific community, and
[0616] Recommended content will be selected based on the answers. (13)
[0618] According to any one of (1) to (12) of the information processing system, wherein,
[0619] The control unit forms a specific community to which the first user corresponding to the first wireless device and the second user corresponding to the second wireless device belong, based on the communication between the first wireless device and the second wireless device. (14)
[0621] According to any one of (1) to (13) of the information processing system, wherein,
[0622] Upon detecting voice utterances from at least one user belonging to a specific community, the control unit acquires the voice utterances and performs control to present the voice utterances to the user. (15)
[0624] According to the information processing system of (14), in which,
[0625] In the case where multiple users belonging to a specific community watch or listen to the same content at essentially the same time,
[0626] Upon detecting voice speech belonging to at least one user from a specific community, the control unit acquires the voice speech and performs control to overlay the voice speech onto the content. (16)
[0628] According to any one of (1) to (13) of the information processing system, wherein,
[0629] In the case where multiple users belonging to a specific community watch or listen to the same content at essentially the same time,
[0630] If the control unit detects that multiple users belonging to a specific community have stayed in essentially the same location for a predetermined time and that ambient music has been playing for a certain period of time, the control unit stops playing the content. (17)
[0632] According to the information processing system in (1), where,
[0633] Control unit:
[0634] At least assign the ID of a specific community to the first content viewed or listened to by the multiple users belonging to that specific community, and
[0635] While replaying the second content, which is at least associated with an ID specific to a particular community, the first content is also replayed. (18)
[0637] According to the information processing system in (1), where,
[0638] Control unit:
[0639] At least assign the ID of a specific community to the first content viewed or listened to by the multiple users belonging to that specific community, and
[0640] The second content captured during the viewing of the first content, along with information about the first content, will be published to a social media account accessible to at least one user from a specific community. (19)
[0642] According to the information processing system in (1), where,
[0643] When viewing audiovisual content, the control unit provides the following notification: a specific number or more of the users belonging to a specific community have given positive or negative feedback on the content. (20)
[0645] According to any one of (1) to (13) of the information processing system, wherein,
[0646] When multiple users belonging to a specific community are spaced a certain amount or more apart, the control unit performs control to enable the multiple users to start a call. (twenty one)
[0648] According to the information processing system of (20), in which,
[0649] The control unit locates the voice and image of the conversation between the multiple users based on the relative positional relationship between the multiple users, so that the user making the conversation can identify the location of the user on the other end of the conversation. (twenty two)
[0651] According to any one of (1) to (21) of the information processing system, wherein,
[0652] Similar types of services include music distribution services, and
[0653] The control unit performs control so that the multiple users can experience the music distribution service at substantially the same time by listening to music from headphones corresponding to each user and capable of receiving external sounds. (twenty three)
[0655] According to the information processing system in (1), where,
[0656] The control unit performs control so that the multiple users can experience the same type of service at substantially the same time, based on AR information displayed by AR-compatible devices corresponding to each user. (twenty four)
[0658] According to the information processing system in (1), where,
[0659] Control unit:
[0660] Obtain conversations from specific communities.
[0661] Generate community-specific playlists by considering the conversations within those communities, and
[0662] When a specific context appears in a conversation within a particular community, the content specified in the conversation is replayed based on a playlist. (25)
[0664] An information processing method, comprising:
[0665] Through information processing systems,
[0666] Set multiple users currently acting together as multiple users belonging to a specific community; and
[0667] The system implements control to enable the multiple users to experience the same type of service at substantially the same time interval through each wireless device corresponding to each user, based on the same type of service available to each user. (26)
[0669] A recording medium containing a program for using a computer as a control unit, the control unit being configured to:
[0670] Set multiple users currently acting together as multiple users belonging to a specific community; and
[0671] The system implements control to enable the multiple users to experience the same type of service at substantially the same time interval through each wireless device corresponding to each user, based on the same type of service available to each user.
[0672] List of reference numerals
[0673] 1. Information Processing System
[0674] 10 Management Server
[0675] 20 and 20-1 to 20-N service provider servers
[0676] 21 Application Distribution Server
[0677] 30 and 40-1 to 50-N wireless devices
[0678] 31 Headphones
[0679] 40 Network
[0680] 100 Control Unit
[0681] 101 Input Unit
[0682] 102 Output Unit
[0683] 103 storage units
[0684] 104 Communication Units
[0685] 121 Managing the DB
[0686] 151 Execution Schedule Unit
[0687] 152 Joint Management Unit
[0688] 153 Community Management Unit
[0689] 200 control unit
[0690] 201 Input Unit
[0691] 202 Output Unit
[0692] 203 Control Unit
[0693] 204 Communication Units
[0694] 221 Songs DB
[0695] 231 Restaurant Information DB
[0696] 251 Execution Processing Unit
[0697] 252 Synchronization Processing Units
[0698] 300 Control Unit
[0699] 301 Input Unit
[0700] 302 Output Unit
[0701] 303 storage unit
[0702] 304 Communication Unit
[0703] 305 Wireless Communication Unit
[0704] 306 Sensor Unit
[0705] 307 Camera Unit
[0706] 308 power supply unit
[0707] Button 321
[0708] 322 microphone
[0709] 331 Monitor
[0710] 332 loudspeakers
[0711] Applications of Commanders 351, 351-1, and 351-2
[0712] Execution processing units 352, 352-1, and 352-2
[0713] 353-1, 353-2 AR Presentation System
[0714] 361 Detection Unit
[0715] 362 Execution Management Unit
[0716] 1001 CPU
Claims
1. An information processing system, comprising: The control unit is configured to: under the following first condition: First and second users belonging to a specific community can use the same content service. The first user uses the same paid plan for the same content service, and The second user uses the free plan for the same content service. The control is executed such that a first wireless device corresponding to the first user sends a check ID information, including a check ID, to a second wireless device corresponding to the second user, so that the first user and the second user can experience content distributed in the same content service based on the check ID through the first user's first wireless device and the second user's second wireless device at substantially the same time.
2. The information processing system according to claim 1, wherein, In the case that the first user and the second user, who belong to the specific community, can use the same content service without incurring charges, The control unit: The execution control causes the first wireless device corresponding to the first user to send a second content distribution request specified by the first user to the same content service, and The control is executed to cause the second wireless device corresponding to the second user to send the second content distribution request to the same content service.
3. The information processing system according to claim 1, wherein, The control unit is configured to perform billing processing under the first condition, wherein, in addition to normal billing to the first user, additional billing processing for paired listening is also performed.
4. The information processing system according to claim 1, wherein, In the case where the content services available to the first user and the second user belonging to the specific community are different. The control unit: The execution control causes the first wireless device corresponding to the first user to send a third content distribution request specified by the first user to the content service available to the first user, and The control is executed to cause the second wireless device corresponding to the second user to send the third content distribution request to the content service available to the second user.
5. The information processing system according to claim 1, wherein, When multiple users belonging to the specific community watch or listen to the same content at essentially the same time, The control unit switches the service at a timed point when the camera captures a video recording on the wireless device corresponding to one of the plurality of users.
6. The information processing system according to claim 1, wherein, In cases where neither the first user nor the second user, belonging to the specific community, has permission to distribute content on available content services. The control unit: The execution control causes the first wireless device corresponding to the first user to send a content free trial distribution request specified by the first user to the content service available to the first user, and The control is executed to cause the second wireless device corresponding to the second user to send a content free trial distribution request to the content service available to the second user.
7. The information processing system according to claim 1, wherein, In the event that the first user belonging to the specific community cannot use the specific service. The control unit causes the first wireless device corresponding to the first user to use the specific service.
8. The information processing system according to claim 7, wherein, The control unit performs control to enable the first wireless device to receive the specific service.
9. The information processing system according to claim 1, wherein, When a specific service is used in a wireless device corresponding to a user belonging to the specific community, the control unit requests the use of the specific service in wireless devices corresponding to other users belonging to the specific community.
10. The information processing system according to claim 1, wherein, The control unit selects recommended content based on any of the following: attribute information of multiple users belonging to the specific community, past communication content between the multiple users, content playback history of the multiple users, context in which the multiple users play the recommended content, and preferences of specific users belonging to the specific community.
11. The information processing system according to claim 10, wherein, The control unit: Manage the IDs of the recommended content in folders for each of the aforementioned specific communities, and Based on the IDs of the recommended content stored in the folder corresponding to the specific community, a playlist is generated for the specific community.
12. The information processing system according to claim 10, wherein, The control unit: Obtain answers related to any question from users by asking questions or supporting questions to users belonging to the specific community, and The recommended content will be selected based on the answers provided.
13. The information processing system according to claim 1, wherein, The control unit forms a specific community to which the first user corresponding to the first wireless device and the second user corresponding to the second wireless device belong, based on the communication between the first wireless device and the second wireless device.
14. The information processing system according to claim 1, wherein, Upon detecting a voice utterance belonging to at least one user of the specific community, the control unit acquires the voice utterance and performs control to present the voice utterance to the user.
15. The information processing system according to claim 14, wherein, When multiple users belonging to the specific community watch or listen to the same content at essentially the same time, Upon detecting voice utterances belonging to at least one user of the specific community, the control unit acquires the voice utterances and performs control to overlay the voice utterances onto the content.
16. The information processing system according to claim 1, wherein, When multiple users belonging to the specific community watch or listen to the same content at essentially the same time, If the control unit detects that multiple users belonging to the specific community have stayed in the same location for a predetermined time and that ambient music has been playing for a certain period of time, the control unit stops playing the content.
17. The information processing system according to claim 1, wherein, The control unit: At least the ID of the specific community shall be assigned to the first content viewed or listened to by multiple users belonging to the specific community, and While replaying the second content, which is at least associated with the ID of the specific community, the first content is also replayed.
18. The information processing system according to claim 1, wherein, The control unit: At least the ID of the specific community shall be assigned to the first content viewed or listened to by multiple users belonging to the specific community, and The second content captured while the first content is being viewed, along with information about the first content, will be published to a social media account accessible to at least one user of the specific community.
19. The information processing system according to claim 1, wherein, When viewing audiovisual content, the control unit provides the following notification: a specific number or more of users belonging to the specific community have given positive or negative feedback on the content.
20. The information processing system according to claim 1, wherein, When multiple users belonging to the specific community are spaced a certain amount or more apart, the control unit performs control to enable the multiple users to start a call.
21. The information processing system according to claim 20, wherein, The control unit locates the audio and video of the conversation between the multiple users based on their relative positions, so that the user making the conversation can identify the location of the user at the other end of the conversation.
22. The information processing system according to claim 1, wherein, The same content service includes music distribution services, and The control unit performs control so that multiple users belonging to the specific community can experience the music distribution service at substantially the same time by listening to music output from headphones corresponding to each user and capable of receiving external sounds.
23. The information processing system according to claim 1, wherein, The control unit performs control so that multiple users belonging to the specific community can experience the same content service at substantially the same time based on AR information displayed by AR-compatible devices corresponding to each user.
24. The information processing system according to claim 1, wherein, The control unit: Obtain the conversations of the specific community. By considering the conversations within that specific community, a playlist is generated for that specific community. When a specific scenario occurs in a conversation within the specific community, the content specified in the conversation is replayed based on the playlist.
25. An information processing method, comprising: Through the information processing system, under the following first condition: First and second users belonging to a specific community can use the same content service. The first user uses the same paid plan for the same content service, and The second user uses the free plan for the same content service. The control is executed such that a first wireless device corresponding to the first user sends a check ID information, including a check ID, to a second wireless device corresponding to the second user, so that the first user and the second user can experience content distributed in the same content service based on the check ID through the first user's first wireless device and the second user's second wireless device at substantially the same time.
26. A recording medium having a program recorded thereon for enabling a computer to function as a control unit, the control unit being configured to: under the following first condition: First and second users belonging to a specific community can use the same content service. The first user uses the same paid plan for the same content service, and The second user uses the free plan for the same content service. The control is executed such that a first wireless device corresponding to the first user sends a check ID information, including a check ID, to a second wireless device corresponding to the second user, so that the first user and the second user can experience content distributed in the same content service based on the check ID through the first user's first wireless device and the second user's second wireless device at substantially the same time.
Citation Information
Patent Citations
Mobile terminal device and mobile terminal system
WO2008107984A1
Information providing system and information providing method
WO2006085383A1