Content providing device

Abstract

Provided is a content providing device for providing content selected on the basis of personal information of a person in a predetermined space as content to be played in the space, the content providing device being provided with: a personal information acquisition unit for acquiring personal information of each of a plurality of persons in the space; a first list creation unit that selects a plurality of contents on the basis of a playlist, which is personal information for each person in the space, and creates a first list in which the selected plurality of contents are described; and a second list creation unit that creates a second list in which content not included in the playlist for each person is inserted in a predetermined number of first lists, and the content provision device provides the content selected on the basis of the second list as the content to be played in the space.

Description

Technical Field

[0001] This invention relates to a content provisioning device for providing playback content. Background Technology

[0002] As such a technology, there is a known technique that proposes to play content with attributes corresponding to the vehicle's driving conditions (see Patent Document 1).

[0003] Existing technical documents Patent documents Patent document 1: Japanese Patent Application Publication No. 2018-63133 (JP2018063133A). Summary of the Invention

[0004] The problem the invention aims to solve In existing technologies, suggestions are made in response to driving conditions, so they may not necessarily be selected based on what the people inside the vehicle like.

[0005] Solution for solving the problem One technical solution of the present invention is a content providing device that provides content selected based on the personal information of people in a defined space as content to be played in that space. It comprises: a personal information acquisition unit that acquires the personal information of multiple people in the space; a first list creation unit that selects multiple contents based on playlists containing the personal information of each person in the space and creates a first list containing the selected contents; and a second list creation unit that creates a second list in the first list containing contents not included in each person's playlist at a predetermined number of positions. The content providing device provides content selected based on the second list as content to be played in the space.

[0006] Invention Effects Using this invention, appropriate content can be provided to the recipient within a space. Attached Figure Description

[0007] Figure 1 This is a schematic diagram illustrating an example of a system containing content providing devices; Figure 2A This is a schematic diagram showing an example of a steering control component; Figure 2B This is a schematic diagram illustrating other examples of operating components; Figure 3A This is a block diagram showing the main structural components of the content providing device; Figure 3B This is a block diagram illustrating the main structural components of the terminal; Figure 3C This is a block diagram illustrating the main structural components of a vehicle sensor array and an in-space camera. Figure 3D This is a block diagram illustrating the main structural components of the operating parts and output device; Figure 4 This is a flowchart illustrating the process of providing processing according to the content executed by the program; Figure 5 This is a flowchart illustrating the process of processing the content of Variation Example 1. Detailed Implementation

[0008] The embodiments of the invention will now be described with reference to the accompanying drawings.

[0009] <Overview of Content Provisioning Devices> The content providing device based on the implementation method provides content to people in a space, such as the cabin of a mobile vehicle like a car. The provided content is content that can be played as sound and / or video by a playback device (or output device) present in the space.

[0010] Suppose that multiple people (e.g., four people), including the driver, are riding in the space. The content providing device obtains each person's personal information from their smartphone or other wireless communication terminal (hereinafter referred to as the terminal) and provides content selected based on the obtained personal information. Personal information includes, for example, the titles of content played more frequently than a specified value on each person's terminal, the types of content played more frequently than a specified value, or playlists of content stored on the terminal. If it is not possible to obtain any of the titles, types, or playlists from the terminal, the age and gender of each person stored on the terminal can also be obtained as personal information.

[0011] The content providing device in this implementation aims to provide content that can be enjoyed by multiple people in the space. Furthermore, it is configured so that the driver can easily switch between operating content. The content providing device will be described in more detail below.

[0012] <System Architecture Example> Figure 1 This is a schematic diagram illustrating an example of a system including a content providing device. The content providing system includes a content providing device 20, a vehicle sensor group 12 of a vehicle 100 as a moving body, a display unit 51, a projection unit 52 and a sound playback unit 53 constituting an output device 50 provided in the vehicle 100, a steering operation unit 11 (not shown) provided in a steering device of the vehicle 100, cameras 13 (front seat camera 131 and rear seat camera 132) provided in the space of the vehicle 100, a wireless terminal 2A for use by the front seat occupant and a wireless terminal 2B for use by the rear seat occupant.

[0013] The content providing device 20 and terminals 2A and 2B are configured to enable wireless communication. The content providing device 20, output device 50, operating component 11, vehicle sensor group 12, and space camera 13 are configured to enable wired communication via CAN (Controller Area Network) or the like.

[0014] Terminals 2A and 2B are each composed of a personal smartphone or similar device. 2A and 2B can be held in place by a bracket (not shown), which is installed in the seat where each person sits. Two terminals 2A and 2B are shown as terminals for occupant use, but the actual number of terminals is four when there are four occupants. Furthermore, the number of cameras constituting camera 13 within the space can be appropriately varied based on the number of occupants.

[0015] Figure 2A This is a schematic diagram showing an example of the steering operation component 11. In the embodiment, the steering device (not shown) operation component 11 of the vehicle 100 also functions as an operation component for changing the content to be played on the content providing device 20. The operation component 11 is usually used for steering, but it functions as an operation component for changing the content to be played when the vehicle 100 is in automatic driving mode or when the vehicle 100 is parked.

[0016] Figure 2A The operating component 11 includes an operating detection unit 111 ( Figure 3D The operating unit 11 includes a light-emitting part 112. The area between the right handlebar RG and the left handlebar LG where the light-emitting part 112 is located is the touch operation receiving area of ​​the operating unit 11. The light-emitting part 112 is composed of multiple light-emitting elements arranged in the touch operation receiving area.

[0017] When a front-seat occupant requests changes to the content displayed on the content providing device 20, they may touch the touch operation receiving area of ​​the operation unit 11. The operation detection unit 111 detects the touch position on the touch operation receiving area, for example, using a capacitive sensor. The operation detection unit 111 outputs detection information, such as the length of the detected contact time or the length of the movement distance of the contact position, to the vehicle information acquisition unit 206.

[0018] During playback, an occupant can slide the touch position on the operation detection unit 111 to the right to indicate that the currently playing content in the playlist should be switched to the next content. Conversely, during playback, an occupant in the front seat can slide the touch position on the operation detection unit 111 to the left to indicate that the currently playing content in the playlist should be switched to the previous content.

[0019] The content selection unit 214 can also establish a correspondence between the length of the contact time or the length of the movement distance of the contact position obtained by the vehicle information acquisition unit 206 and the similarity of the content being played, and select the content to be played. For example, when the contact time or the movement distance of the contact position is short, content with high similarity is selected, and when the contact time or the movement distance of the contact position is long, content with low similarity is selected.

[0020] The light-emitting unit 112 causes a light-emitting element (e.g., the light-emitting element closest to the touch position) located at a touch position detected by the operation detection unit 111 to emit light. If the operation detection unit 111 does not detect a touch operation on the position corresponding to the light-emitting element, the light-emitting unit 112 turns off the light-emitting element at that position.

[0021] Figure 2B This is a schematic diagram showing another example of the operating member 11. In other examples, a touch operation receiving area is provided at the center of the circular operating member 11, which is supported and can rotate. Figure 2B The operating component 11 also includes an operating detection unit 111 and a light-emitting unit 112.

[0022] because Figure 2B The touch operation receiving area of ​​the operating component 11 is more than Figure 2A The range of light-emitting elements is wide, so the multiple light-emitting elements constituting the light-emitting part 112 are arranged in a matrix.

[0023] The passenger in the front seat can indicate a switch from the playlist containing the currently playing content to the next playlist by sliding the touch position on the operation detection unit 111 downwards during playback. Conversely, during playback, the passenger can indicate a switch from the playlist containing the currently playing content to the previous playlist by sliding the touch position on the operation detection unit 111 upwards.

[0024] Furthermore, during playback, sliding the touch position on the operation detection unit 111 to the right indicates that the currently playing content in the playlist should be switched to the next content in the playlist. Conversely, during playback, sliding the touch position on the operation detection unit 111 to the left indicates that the currently playing content in the playlist should be switched to a previous content in the playlist.

[0025] The content selection unit 214 can also establish a correspondence between the length of the contact time or the length of the movement distance of the contact position obtained by the vehicle information acquisition unit 206 and the similarity of the content being played, and select the content to be played. For example, when the contact time or the movement distance of the contact position is short, content with high similarity is selected, and when the contact time or the movement distance of the contact position is long, content with low similarity is selected. In addition, when the area of ​​the contact range surrounded by the movement of the contact position is larger than a predetermined area, content with low similarity can also be selected.

[0026] The operation detection unit 111 can also detect the rotation amount of the circular operation component 11. The content selection unit 214 can also select content with high similarity when the rotation amount of the circular operation component 11 is small, and select content with low similarity when the rotation amount of the circular operation component 11 is large.

[0027] Figure 2B The light-emitting part 112 and Figure 2A In the same case, the light-emitting element located at the touch position detected by the operation detection unit 111 (e.g., the light-emitting element closest to the touch position) is made to emit light. In addition, when the touch operation is performed in such a way that a closed loop is drawn in the touch operation receiving area, the light-emitting unit 112 illuminates the light-emitting element at the position corresponding to the inner side of the closed loop for a predetermined time.

[0028] Reference box Figures 3A to 3D illustrate Figure 1 Examples of the structure of each part.

[0029] <Content providing device> Figure 3A This is a block diagram showing the main structure of the content providing device 20. The content providing device 20 includes an arithmetic processing unit such as an MPU (Micro Processing Unit) not shown, and performs various information processing, control processing, etc. required by the content providing device 20 by reading and executing a predetermined program stored in a storage unit not shown.

[0030] The content providing device 20 includes a personal information acquisition unit 201, a relationship information acquisition unit 202, a content acquisition unit 203, a biological information acquisition unit 204, an emotion estimation unit 205, a vehicle information acquisition unit 206, a gaze detection unit 207, an object estimation unit 208, a first list creation unit 209, a second list creation unit 210, a personal information exclusion unit 211, an analysis unit 212, an evaluation unit 213, a content selection unit 214, and a communication unit 215 as a functional structure.

[0031] (Personal Information Acquisition Department) The personal information acquisition unit 201 acquires each person's personal information from the terminals 2A and 2B used by multiple people in the space via the communication unit 215. As described above, the personal information includes titles of frequently played content (e.g., the top 20 titles), types of frequently played content (e.g., the top 10 types), or playlists of content stored in each person's terminals 2A and 2B.

[0032] (Relationship Information Acquisition Department) The relationship information acquisition unit 202 acquires the relationship information of each person from the terminals 2A and 2B used by multiple people in the space via the communication unit 215. The relationship information is information representing the degree of intimacy between each person in the space. Based on the call history between terminals 2A and 2B over a specified period (e.g., the last 30 days) or the usage history of the messaging application used between terminals 2A and 2B, the degree of intimacy is represented by, for example, three levels (high, normal, and low).

[0033] (Content Acquisition Department) Content acquisition unit 203 acquires content from terminals 2A and 2B used by multiple individuals in space via communication unit 215. Content acquisition unit 203 can acquire content not only from terminals 2A and 2B, but also from an external content management server via a communication network (not shown).

[0034] In this implementation, the content acquisition unit 203 acquires content provided by the content providing device 20 from terminals 2A, 2B, etc., each time. Generally, the communication unit 215 requires a predetermined amount of time to establish communication with terminal 2A or terminal 2B. Therefore, for example, when playing music M1, which is content acquired from terminal 2A, and then playing music M2, which is content acquired from terminal 2B, communication between the communication unit 215 and terminal 2B is established before music M1 finishes playing, and music M2 begins playing quickly when music M1 finishes playing. The same applies when the communication unit 215 acquires music as content from an external content management server.

[0035] (Biobiotechnology Information Acquisition Department) The biometric information acquisition unit 204 acquires biometric information from terminals 2A and 2B used by multiple individuals in space via the communication unit 215. The biometric information includes, for example, heart rate information acquired by a heart rate sensor that acquires each individual's heart rate, respiratory rate information acquired by a respiratory sensor that acquires respiratory rate, blood flow velocity information acquired by a blood flow velocity sensor that acquires blood flow velocity, and skin resistance value information acquired by a skin resistance sensor that acquires skin resistance value.

[0036] Furthermore, the biometric information acquisition unit 204 acquires image information of the upper body of each person captured by the in-space cameras 13 (front seat camera 131, rear seat camera 132) via the communication unit 215. The upper body image information can be used to extract facial images for expression determination. Additionally, the iris portion of the eyes can be magnified for detection to determine pupil size and gaze direction. Furthermore, posture can be determined based on the image's center of gravity and the shape of the upper body.

[0037] (Emotional Prediction Department) The emotion estimation unit 205 estimates the emotions of occupants in the space based on the biological information acquired by the biological information acquisition unit 204, using a pre-defined learning process. Here, the algorithm used in the learning process is selected from, for example, SVM (Support Vector Machine), decision tree, k-nearest neighbor method, etc.

[0038] First, the emotion estimation unit 205 detects each person's comfort and discomfort based on image information from the spatial cameras 13 (front seat camera 131 and rear seat camera 132) acquired by the biometric information acquisition unit 204. For example, a sequence of facial expressions is prepared in advance, ordered from highest to lowest comfort level, and a comfort level is assigned based on this sequence. In this way, by comparing the image information of each person's upper body with the main images, the comfort level of each person is detected separately.

[0039] In addition to facial expressions, comfort is also related to the number of changes in gaze direction, the number of changes in posture, and the pupil diameter. Therefore, comfort can be adjusted based on these factors.

[0040] Next, the emotion estimation unit 205 detects activity level and inactivity level based on the biological information (heart rate) acquired by the biological information acquisition unit 204. For example, since a higher heart rate indicates higher activity level and a lower heart rate indicates lower activity level, the activity level of each person is determined by the heart rate.

[0041] Besides heart rate, activity level is also related to respiratory rate, blood flow velocity, and skin resistance. Therefore, activity level can also be modified using these factors.

[0042] The Emotion Prediction Department 205 also uses known methods to represent each person's total emotions (mental state) on a plane with two axes (Russell's emotional circle model) of comfort and discomfort (horizontal axis) and activity and inactivity (vertical axis), and predicts each person's emotions separately.

[0043] The emotion estimation unit 205 can also estimate each person's emotion towards the person reflected in the projection image based on each person's reaction to the projection image of each person's face in the space projected from the projection unit 52.

[0044] (Vehicle Information Acquisition Department) The vehicle information acquisition unit 206 acquires vehicle speed information, position information, and image information obtained by capturing images of the exterior of the vehicle 100 from the vehicle sensor group 12 via the communication unit 215. Additionally, the vehicle information acquisition unit 206 acquires detection information detected by the operation detection unit 111 of the operation component 11.

[0045] (Gaze Inspection Department) The gaze detection unit 207 detects each person's gaze based on image information from the spatial cameras 13 (front seat camera 131, rear seat camera 132) acquired by the biometric information acquisition unit 204. For example, it finds the non-moving parts (reference points) and moving parts (moving points) of each person's eyes from the images, and detects the gaze based on the position of the moving points relative to the reference points.

[0046] (Object Prediction Section) The object estimation unit 208 estimates the object in front of each person's line of sight as detected by the gaze detection unit 207. In this embodiment, the object estimation unit 208 estimates at least one occupant being looked at by each person. First, using, for example, the direction detection function of a wireless communication method called Bluetooth (registered trademark), the communication unit 215 detects the direction of terminals 2A and 2B as observed from the communication unit 215. Then, it compares this direction with the gaze direction of each person detected by the gaze detection unit 207. For example, if an occupant using terminal 2B is looking at an occupant using terminal 2A, the gaze direction of the occupant using terminal 2B intersects with the direction of terminal 2A as seen from the communication unit 215.

[0047] (First List Creation Department) The first playlist creation unit 209 creates a first playlist (hereinafter referred to as the first playlist) of content provided to people in the space based on the personal information of each person in the space obtained by the personal information acquisition unit 201. Details will be explained later.

[0048] (Second List Creation Department) The second playlist creation unit 210 creates a second playlist (hereinafter referred to as the second playlist) based on the first playlist created by the first playlist creation unit 209, providing content to people within the space. Details will be explained later.

[0049] (Personal Information Exclusion Department) The Personal Information Exclusion Section 211 excludes personal information of at least one person within the space from the personal information of each person obtained by the Personal Information Acquisition Section 201. Details will be explained later.

[0050] (Analysis Department) Analysis unit 212 analyzes the similarity of personal information of each person within the space acquired by personal information acquisition unit 201. For example, if the titles, types, or artists of the content contained in the playlists of each person as personal information are common, then the personal information is judged to be similar. Alternatively, known procedures can be used to analyze the melody of the music that is the content, and based on the characteristics of the music such as rhythm and balance, the personal information can be judged to be similar / dissimilar.

[0051] In addition, if only each person's age and gender are obtained as personal information, it is possible to determine that the personal information is similar if the ages are close (e.g., ±2).

[0052] (Evaluation Department) Evaluation unit 213 evaluates the popularity of the content recorded in the first list created by the first list creation unit 209. For example, it calculates the proportion of content recorded in the first list that is among the top (e.g., 300) of the published content's play count ranking as an evaluation value. Regarding play count ranking information, ranking information periodically obtained by communication unit 215 from an external ranking information management server via a communication network (not shown) can be stored in a storage unit (not shown) within evaluation unit 213. Alternatively, communication unit 215 can obtain the information from the aforementioned ranking information management server each time.

[0053] (Content Selection Department) The content selection unit 214 selects content based on the second list if the second list has been created by the second list creation unit 210, and based on the first list created by the first list creation unit 209 if the second list has not been created. For example, content can be selected in descending order, ascending order, or randomly from each list.

[0054] The content selection unit 214 can also establish a correspondence between the length of the contact time, the length of the movement distance of the contact position, or the area of ​​the contact range surrounded by the movement of the contact position detected by the operation detection unit 111 and the similarity with the selected content, and select the content to be played.

[0055] (Ministry of Communications) The communication unit 215 includes a short-range wireless communication module (not shown) for wireless communication with terminals 2A and 2B, and a wired communication module (not shown) for wired communication via CAN or the like. The short-range wireless communication module employs a wireless communication method with the aforementioned direction detection function.

[0056] <Terminal> Figure 3B This is a block diagram illustrating the main structural components of terminal 2A. The structure of terminal 2B is the same as that of terminal 2A, so it is omitted from the diagram. Terminal 2A includes an arithmetic processing unit such as an MPU (not shown), which reads and executes a specified program (also called an application program) stored in a storage unit (not shown) to perform various information processing, control processing, etc., required for the functional structure described below.

[0057] Terminal 2A includes a personal information storage unit 21, a relationship information storage unit 22, a content storage unit 23, a biosensor group 24, and a communication unit 25 as its functional structure. Generally, smartphones have a display unit, an input unit, a sound playback unit, a camera, and a location detection unit, but their illustrations and descriptions are omitted.

[0058] (Personal Information Storage Department) The personal information storage unit 21 stores the personal information of the occupants using the terminal 2A. As described above, the personal information includes titles of frequently played content on the terminal 2A (e.g., the top 20 titles), types of frequently played content (e.g., the top 10 types), or playlists of content stored on the terminal 2A.

[0059] (Relationship Information Storage Department) The relationship information storage unit 22 acquires the relationship information of the occupants using the terminal 2A. As described above, the relationship information is information indicating the closeness with other occupants. Based on the call history of the terminal 2A during a specified period or the usage history of the messaging application used in the terminal 2A, the closeness is divided into three levels (high, normal, and low).

[0060] (Content Storage Department) Content storage unit 23 stores content collected by the occupants using terminal 2A.

[0061] (Biosensor group) The biosensor group 24 includes: a heart rate sensor for acquiring heart rate, a respiratory sensor for acquiring respiratory rate, a blood flow velocity sensor for acquiring blood flow velocity, and a skin resistance sensor for acquiring skin resistance value (all figures omitted).

[0062] (Ministry of Communications) The communication unit 25 includes a short-range wireless communication module (not shown) that communicates wirelessly with the content providing device 20 and a wired communication module (not shown) that communicates via CAN or the like.

[0063] Figure 3C This is a block diagram illustrating the main structural components of the vehicle sensor group 12 and the space camera 13 of the vehicle 100.

[0064] <Vehicle Sensor Group> The vehicle sensor group 12 includes a vehicle speed sensor 121, a positioning sensor 122, and a camera 123. Typically, the vehicle 100 is equipped with sensors such as an acceleration sensor and radar, but illustrations and descriptions of these sensors are omitted.

[0065] (Vehicle speed sensor) The vehicle speed sensor 121 detects the vehicle speed of the vehicle 100 and outputs the vehicle speed information to the vehicle information acquisition unit 206.

[0066] (Positioning sensor) The positioning sensor 122 detects the current position of the vehicle 100 based on positioning signals from GPS (Global Positioning System) satellites, quasi-zenith satellites, etc. The positioning sensor 122 outputs the signal representing the current position as position information to the vehicle information acquisition unit 206.

[0067] (camera) Camera 123 captures images of the area around vehicle 100. Camera 123 outputs the image data as image information to vehicle information acquisition unit 206. Camera 123 can capture both still images and moving images.

[0068] <In-space camera> The in-space camera 13 includes a front seat camera 131 and a rear seat camera 132. The front seat camera 131 captures images of the upper body of the occupant sitting in the front seat and outputs the captured image data as image information to the biometric information acquisition unit 204. The rear seat camera 132 captures images of the upper body of the occupant sitting in the rear seat and outputs the captured image data as image information to the biometric information acquisition unit 204.

[0069] Figure 3D This is a block diagram illustrating the main structural components of the operating parts 11 and output device 50 of the vehicle 100.

[0070] <Operating Components> For reference Figure 2A , 2B The operating component 11 includes an operating detection unit 111 and a light-emitting part 112. Generally, in a vehicle 100, operating components include power on / off switches, lighting switches, wiper switches, brake pedals, accelerator pedals, and other operating components covering multiple aspects, but their illustrations and descriptions are omitted.

[0071] (Operation and Inspection Department) When a passenger in the front seat changes the content to be played as instructed by the content providing device 20, they touch the touch operation receiving area of ​​the operation unit 11. The operation detection unit 111 detects the touch position on the receiving area.

[0072] (Light-emitting part) The light-emitting unit 112 includes a plurality of light-emitting elements disposed on the aforementioned touch operation receiving area, and a light-emitting control unit (not shown) that controls the lighting and extinguishing of these light-emitting elements respectively. As described above, the light-emitting unit 112 illuminates the light-emitting element closest to the touch position detected by the operation detection unit 111. If the operation detection unit 111 does not detect a touch operation on the position corresponding to the illuminated light-emitting element, the light-emitting unit 112 extinguishes the light-emitting element at that position.

[0073] <Output Device> The output device 50 includes a display unit 51, a projection unit 52, and a sound playback unit 53.

[0074] (Display Department) The display unit 51 has a screen such as a liquid crystal display, and displays images (moving images, still images, text display, icon display, graphic display, etc.) based on display signals output from the content providing device 20.

[0075] (Projection section) The projection unit 52 is, for example, a head-up display (HUD) that projects onto a windshield or the like, and projects images (moving images, still images, text displays, icon displays, graphic displays, etc.) based on projection signals output from the content providing device 20.

[0076] (Audio Playback Department) The sound playback unit 53 is configured as a speaker that plays output sound, etc., and plays content based on the playback signal output from the content providing device 20. It should be noted that a sound output unit that outputs content playback signals to headphones or the like (not shown) may also be included.

[0077] <Flowchart Explanation> Figure 4 This is a flowchart illustrating the flow of content delivery processing executed according to a program run by the MPU of the content delivery device 20. When the content delivery device 20 is started, the MPU of the content delivery device 20 executes the... Figure 4 The procedure shown is for processing.

[0078] exist Figure 4 In step S10, the content providing device 20 obtains personal information from the terminals 2A and 2B used by multiple people in the space through the personal information acquisition unit 201, and then proceeds to step S20.

[0079] In step S20, the content providing device 20 obtains relationship information from the terminals 2A and 2B used by multiple people in the space through the relationship information acquisition unit 202, and then proceeds to step S30.

[0080] In step S30, the content providing device 20 acquires biometric information from the terminals 2A and 2B used by each of the multiple people in the space via the biometric information acquisition unit 204. Additionally, the biometric information acquisition unit 204 acquires image information obtained from the space camera 13 that captures images of each person's upper body as biometric information, and proceeds to step S40.

[0081] In step S40, the content providing device 20 estimates the emotions of the occupants in the space based on the biological information obtained by the biological information acquisition unit 204 through the emotion estimation unit 205, and proceeds to step S50.

[0082] In step S50, the content providing device 20 acquires vehicle speed information, location information, and image information obtained by taking pictures of the outside of the vehicle through the vehicle information acquisition unit 206, and proceeds to step S60.

[0083] In step S60, the content providing device 20 detects the gaze of the occupants in the space based on the image information of the space camera 13 acquired by the biometric information acquisition unit 204 through the gaze detection unit 207, and proceeds to step S70.

[0084] In step S70, the content providing device 20 estimates the object in front of each person's line of sight detected by the line of sight detection unit 207 through the object estimation unit 208, and proceeds to step S80.

[0085] In step S80, the content providing device 20 creates a first list through the first list creation unit 209.

[0086] The first playlist creation unit 209 selects multiple items based on the playlists containing the personal information of each person in the space, and creates a first playlist containing the selected multiple items.

[0087] By constructing it in this way, for example, it is possible to select a specified number of contents from a playlist that represents the personal information of everyone in the space, and create a first list containing the selected specified number of contents.

[0088] After the content providing device 20 creates the first list according to the above description, it proceeds to step S90.

[0089] In step S90, the content providing device 20 creates a second list through the second list creation unit 210.

[0090] In step S90, as a first example of the second list, the second list creation unit 210 excludes playlists containing personal information of at least one of multiple people in the space from the personal information exclusion unit 211. Based on the playlists of multiple people not excluded from the personal information exclusion unit 211, it selects multiple items and creates a second list containing the selected items. If the evaluation value (evaluated by the evaluation unit 213) of the multiple items recorded in the first list exceeds a predetermined value, the personal information of at least one person is excluded. Furthermore, the personal information exclusion unit 211 adjusts the number of people whose personal information is excluded based on the evaluation value from the evaluation unit 213. For example, a higher evaluation value results in more people being excluded, and a lower evaluation value results in fewer people being excluded.

[0091] Furthermore, in step S90, as a second example of the second list, the second list creation unit 210 can create a second list in which content not included in each person's playlist is inserted at a predetermined number of positions of the second example of the first list created in step S80.

[0092] For example, a second list could be created by interspersing different content (such as stand-up comedy) between multiple musical pieces.

[0093] Furthermore, as a third example of the second list created in step S90, the second list creation unit 210 can determine the content to be inserted based on the melody of the music that is the first predetermined number -1 and the second predetermined number of content in the second example of the first list created in step S80.

[0094] For example, in the pre-preceding (-1)th piece of music, the inserted piece of music, and the post-preceding (+1)th piece of music, the content to be inserted at the preceding position is determined by the continuous change of the melody of the piece of music that serves as the content.

[0095] Furthermore, as a fourth example of the second list created in step S90, the second list creation unit 210 can determine the content that is common to the content and features of the playlists of each person included in the space as the content to be inserted.

[0096] For example, when the title, type, artist, or year of creation of the content are common, that content is determined to be the content to be inserted.

[0097] Furthermore, as a fifth example of the second list created in step S90, the second list creation unit 210 can determine the first song whose characteristics are different from those of the songs included in the playlists of each person in the space as the inserted content.

[0098] For example, if the title, genre, composer, or era of the first piece of music differs, the first piece should be chosen as the inserted content.

[0099] Furthermore, in the fifth example above, in the second example of the first list created in step S80, if the melodies of the musical pieces that are the -1th and the 1st content are similar, the second list creation unit 210 may also decide to insert the content of the first musical piece that is different from these similar melodies.

[0100] Furthermore, as a sixth example of the second list created in step S90, the second list creation unit 210 can determine the content of phrases commonly contained in the music that are included in the second example of the first list created in step S80 (the -1th and the -1st content) as the content to be inserted.

[0101] For example, if the lyrics of a piece of music that is the -1st and the 1st content contain the character "shiba," then "Shibahama," which contains "shiba" in the title of the stand-up comedy piece that is the content, will be selected as the inserted content. By including the common character "shiba" in the title of the content, the content becomes easier to listen to.

[0102] Furthermore, as a seventh example of the second list created in step S90, the second list creation unit 210 can determine the content associated with the location where the vehicle 100, as a mobile body with space, is moving as the content to be inserted.

[0103] For example, the content to be inserted may include a title that contains the name of the moving location or a title associated with the moving location.

[0104] When the content providing device 20 creates any of the second lists exemplified above, it proceeds to step S100.

[0105] In step S100, the content providing device 20 selects content through the content selection unit 214.

[0106] As a first example of content selection, when a second list is created in step S90, the content selection unit 214 selects content based on the second list; when no second list is created, the content selection unit 214 selects content based on the first list.

[0107] As a second example of content selection, the content selection unit 214 can select content to be provided to people in the space based on any of the second to seventh examples of the second list created in step S90.

[0108] When the content selection unit 214 selects content based on the first or second example described above, it proceeds to step S110.

[0109] In step S110, the content providing device 20 acquires the content selected in step S100 through the content acquisition unit 203 and proceeds to step S120.

[0110] In step S120, the content providing device 20 outputs the content to the output device 50, ending the process based on... Figure 4 The output device 50 plays content from at least one of the display unit 51, projection unit 52, and sound playback unit 53 based on the content acquired by the content acquisition unit 203.

[0111] The implementation method described above achieves the following effects.

[0112] (1) The content providing device 20 provides content selected based on the personal information of the people in the cabin of the vehicle 100, which is a designated space, as content to be played in the cabin. It includes: a personal information acquisition unit 201, which acquires the personal information of multiple occupants in the cabin; a first list creation unit 209, which selects multiple contents based on the playlists of each person in the cabin and creates a first list containing the selected contents; and a second list creation unit 210, which creates a second list in the first list with contents not included in each person's playlist inserted at a predetermined number of positions. The content providing device 20 provides the content selected based on the second list as content to be played in the cabin.

[0113] Because of this configuration, it is possible to create a second playlist for the people in the cabin, containing new content that is not in each person's playlist, and to provide content based on the selections made from the second playlist.

[0114] (2) In the content providing device 20 of (1) above, the second list creation unit 210 determines the content to be inserted based on the melody of the music that is the first-1st and the first-1st content in the first list.

[0115] Because of this configuration, it is possible to insert, for example, music with continuous changes in melody between pieces, creating a second playlist that does not create a sense of disharmony for the people in the cabin.

[0116] (3) In the content providing device 20 of (1) above, the second list creation unit 210 determines the content that is common to the features and the content in the playlists of each person in the cabin as the content to be inserted.

[0117] Because of this structure, it is possible to insert content that feels familiar to everyone in the cockpit to create a second list.

[0118] (4) In the content providing device 20 of (1) above, the second list creation unit 210 determines the first song whose features are different from those of the songs included in the playlists of each person in the cabin as the content to be inserted.

[0119] Because of this configuration, it is possible to insert a new first piece of music that is unfamiliar to everyone in the cockpit, creating a second playlist.

[0120] (5) In the content providing device 20 of (4) above, the second list creation unit 210 determines the first piece of music as the content to be inserted when the tunes of the music that is the first specified number-1 and the first specified number of content in the first list are similar.

[0121] Because of this structure, even if the change in melody from the -1th piece to the inserted first piece creates a sense of disharmony for the people in the space, it is possible to create a second list that can restore the sense of disharmony by returning the melody to a piece similar to the -1th piece after the first piece.

[0122] (6) In the content providing device 20 of (1) above, the second list creation unit 210 determines the content of the musical piece that contains the sentences commonly included in the first list as the predetermined number-1 and predetermined number of contents as the inserted content.

[0123] Because of this design, it is easy for people inside the cabin to hear the inserted content.

[0124] (7) In the content providing device 20 of (1) above, the specified cabin is the cabin in the mobile body, and the second list creation unit 210 determines the content associated with the location where the mobile body is moving as the content to be inserted.

[0125] Because of this structure, it is possible to create a second list with so-called local-related content.

[0126] (8) The content providing device 20, which is a content selection device for playing content in the cockpit of a moving body, includes: a second list creation unit 210, which, as a playlist acquisition unit, acquires a list of playable content; a vehicle information acquisition unit 206, which acquires detection information from an operation detection unit 111 that detects the contact state of an operation component 11 of a device for detecting and steering the moving body; and a content selection unit 214, which selects the content to be played from the second list, which is a playlist, based on the detection information acquired by the vehicle information acquisition unit 206.

[0127] Because of this configuration, occupants in the cockpit can indicate the switching of content played from the second playlist simply by touching the control unit 11 next to them.

[0128] (9) In the content providing device 20 of (8) above, the operation detection unit 111 detects the contact time and contact position of the operation component 11, and the content selection unit 214 establishes a correspondence between the length of the contact time detected by the operation detection unit 111, the length of the movement distance of the contact position, or the width of the contact range surrounded by the movement of the contact position and the similarity with the selected content, and selects the content to be played.

[0129] Because of this configuration, occupants in the cabin can intuitively switch between the content played from the second playlist by touching the control unit 11 next to them.

[0130] (10) In the content providing device 20 of (8) above, the operation detection unit 111 detects multiple contacts and contact intervals of the operation member 11, and the content selection unit 214 selects the content to be played based on the length of the contact interval detected by the operation detection unit 111.

[0131] Because of this configuration, occupants in the cabin can intuitively switch between the content played from the second playlist by touching the control unit 11 next to them.

[0132] (11) In the content providing device 20 of (8) above, the operation detection unit 111 detects the contact state with the operation component 11 without affecting the steering of the device that is steering.

[0133] Because of this configuration, for example, when the vehicle 100 is in autonomous driving mode or when the vehicle 100 is parked, the switching of content played from the second list can be indicated by intuitive touch operation of the operating component 11.

[0134] (12) In the content providing device 20 of (8) above, the operation member 11 includes a light-emitting part 112 that makes the contact position light up, the operation detection part 111 detects the contact position of the operation member 11, and the light-emitting part 112 makes the area corresponding to the contact position detected by the operation detection part 111 light up.

[0135] Because of this configuration, occupants in the cabin can visually identify the location where they have touched the control component 11.

[0136] (13) In the content providing device 20 of (8) above, the operating component 11 of the device for steering the moving body is a steering wheel or a handle.

[0137] Because of this configuration, occupants in the cabin can switch the content being played by using the control unit 11 next to them.

[0138] (14) The content providing device 20, which is a content selection device for playing content in the cockpit of a moving body, includes: a vehicle information acquisition unit 206 that acquires detection information from an operation detection unit 111, which detects the amount of rotation of a steering wheel, which is an operation component 11 for steering the moving body; and a content selection unit 214 that selects the content to be played based on the amount of rotation represented by the detection information acquired by the vehicle information acquisition unit 206.

[0139] Because of this configuration, occupants in the cabin can switch the content being played by using the control unit 11 next to them.

[0140] (15) The content providing device 20 provides content selected based on the personal information of a person in a specified cabin as content to be played in the cabin, comprising: a first playlist creation unit 209, which selects multiple contents based on playlists which are the personal information of each person in the cabin and creates a first playlist containing the selected multiple contents; an evaluation unit 213, which evaluates the popularity of the multiple contents recorded in the first playlist; a personal information exclusion unit 211, which excludes the playlist of at least one of the multiple people in the cabin if the evaluation value of the evaluation unit 213 exceeds a predetermined value; and a second playlist creation unit 210, which selects multiple contents based on the playlists of the multiple people not excluded by the personal information exclusion unit 211 and creates a second playlist containing the selected multiple contents, and provides content selected based on the second playlist when the second playlist is created, and provides content selected based on the first playlist as content to be played in the cabin when the second playlist is not created.

[0141] Because of this configuration, by reducing the amount of content from each person's playlist in the cabin, it is possible to provide personalized (in other words, uncommon) content to each person in the cabin according to their preferences.

[0142] The above-described embodiments can be modified in various ways. The following describes some modifications.

[0143] (Variation Example 1) In Variation 1, the content providing device 20 selects multiple pieces of content based on the personal information of persons not excluded by the personal information exclusion unit 211, and creates a first list containing the selected multiple pieces of content.

[0144] Figure 5 This is a flowchart illustrating the content provisioning process executed by the MPU of the content provisioning device 20 in Modified Example 1. When the content provisioning device 20 is started, the MPU of the content provisioning device 20 executes the content provisioning process. Figure 5 The procedure shown is for processing. (And...) Figure 4 Compared to the flowchart, Figure 4 The processing steps S80 to S100 are changed to Figure 5 The processing of steps S80' and S100' differs in this respect, so the explanation will focus on these differences.

[0145] exist Figure 5 In step S80', the content providing device 20 creates a first list through the first list creation unit 209.

[0146] The first list creation unit 209 selects multiple items based on the personal information of persons not excluded by the personal information exclusion unit 211, and creates a first list containing the selected multiple items.

[0147] As the first example of excluding personal information, the personal information exclusion unit 211 can also exclude the personal information of people who are unable to enjoy the content due to sleeping or other reasons based on the status of each person in the space detected by the terminals 2A and 2B, which are biometric information detection units, and the space camera 13.

[0148] In addition, as a second example of excluding personal information, the personal information exclusion unit 211 may also exclude at least one of the similar personal information based on the similarity of the personal information analyzed by the analysis unit 212.

[0149] As a third example of excluding personal information, the personal information exclusion unit 211 can also exclude the personal information of at least one person based on relationship information representing the relationship between multiple people in the space obtained by the relationship information acquisition unit 202.

[0150] As a fourth example of the exclusion of personal information, the Personal Information Exclusion Section 211 may also change the excluded personal information after a specified period of time.

[0151] As a fifth example of excluding personal information, the personal information exclusion unit 211 can also exclude personal information of people whose emotions are separated or not separated, as estimated by the emotion estimation unit 205, based on the status of each person in the space detected by the terminals 2A and 2B, which are biometric information detection units, and the space camera 13.

[0152] The aforementioned emotion estimation unit 205 can also estimate the emotions of each person in the space towards the person reflected in the projection image based on the reaction to the projected image of each person's face in the space projected by the projection unit 52 (changes in each person's state, etc.).

[0153] As a sixth example of excluding personal information, the personal information exclusion unit 211 may also exclude personal information of a person in front of the line of sight as presumed by the object presumption unit 208 and detected by the line of sight detection unit 207. Alternatively, it may not exclude personal information.

[0154] As a seventh example of excluding personal information, the personal information exclusion unit 211 can also exclude personal information based on the movement of the driver's gaze of the vehicle 100 detected by the gaze detection unit 207.

[0155] After the content providing device 20 creates the first list as described above, it proceeds to step S100'.

[0156] In step S100', the content providing device 20 selects content based on the first list through the content selection unit 214.

[0157] As the first example of content selection, the content selection unit 214 can select highly similar content from the personal information of multiple individuals that have not been excluded by the personal information exclusion unit 211.

[0158] For example, pieces of music with similar content, common genres, rhythms, or beats constitute similar musical compositions.

[0159] In addition, as a second example of content selection, the content selection unit 214 can also select content based on the state of each person in the space (changes in posture, changes in gaze direction, heart rate, respiratory rate, etc.) detected by the terminals 2A and 2B, which are biological information detection units, and the space camera 13.

[0160] Furthermore, as a third example of content selection, the content selection unit 214 can select content based on the position or speed of the vehicle 100, which is a moving body.

[0161] For example, when the time spent moving between positions is short, in other words, when the movement speed is fast, choose a fast-paced piece of music; when the time spent moving between positions is long, in other words, when the movement speed is slow, choose a slow-paced piece of music.

[0162] When the content selection unit 214 selects any of the content examples above, it proceeds to step S110. Then, it... Figure 4 The situation is the same.

[0163] The modified example 1 described above achieves the following effects.

[0164] (1) The content providing device 20 provides content selected based on the personal information of a person in the cabin of the vehicle 100, which is a designated space, as content to be played in the cabin. It includes: a personal information acquisition unit 201, which acquires the personal information of multiple people in the cabin; a personal information exclusion unit 211, which excludes the personal information of at least one person in the cabin; a first list creation unit 209, which selects multiple contents based on the personal information of persons not excluded by the personal information exclusion unit 211 and creates a first list containing the selected multiple contents; and a content selection unit 214, which selects content based on the first list. The content providing device 20 provides the content selected by the content selection unit 214 as content to be played in the cabin.

[0165] Because of this structure, compared to creating a first list based on the personal information of all people in the cabin, it is possible to create a first list that reduces the amount of content provided to the people in the cabin. Therefore, personalized content can be provided according to the preferences of the people in the cabin.

[0166] (2) In the content providing device 20 described in (1) above, a biometric information acquisition unit 204 is also provided. The biometric information acquisition unit 204 acquires biometric information from terminals 2A and 2B, which are biometric information detection units that detect the state of people in the cabin. The personal information exclusion unit 211 excludes the personal information of people who cannot enjoy the content based on the state of each person in the cabin acquired by the biometric information acquisition unit 204.

[0167] Because of this configuration, it is possible to detect, for example, people who are sleeping or people who are focused on watching or listening to video using personal video-visual devices. Furthermore, by excluding the personal information of detected individuals, it is possible to provide content targeted at people who are likely to enjoy the content.

[0168] (3) In the content providing device 20 of (1) above, there is also an analysis unit 212 that analyzes the similarity of personal information of multiple people, and a personal information exclusion unit 211 excludes at least one of the similar personal information based on the analysis results of the analysis unit 212.

[0169] Because of this structure, it is possible to reduce the amount of personal information containing the same content. As a result, it is possible to provide a wide range of unbiased content to people in the cabin.

[0170] (4) In the content providing device 20 described in (1) above, the content selection unit 214 selects content with high similarity from multiple personal information that has not been excluded by the personal information exclusion unit 211.

[0171] Because of this configuration, it is possible to select content that suits the preferences of many individuals in the cabin (such as music with common content, music of common type, music with similar rhythm or beat).

[0172] (5) In the content providing device 20 of (1) above, there is also a relationship information acquisition unit 202, which acquires relationship information representing the relationship between multiple people in the cabin, and the personal information exclusion unit 211 excludes the personal information of at least one person based on the relationship information.

[0173] Because of this configuration, for example, even excluding the personal information of people with high intimacy in the cabin (in other words, not excluding the personal information of people with low intimacy), it is possible to provide content to people in the cabin based on the personal information of people with low intimacy. As a result, it is possible to provide clues that deepen mutual understanding among people in the cabin.

[0174] (6) In the content providing device 20 of (1) above, when a predetermined time has elapsed, the personal information exclusion unit 211 changes the excluded personal information.

[0175] Because of this configuration, it is possible to provide a variety of content based on a variety of personal information to the people in the cabin.

[0176] (7) In the content providing device 20 described in (1) above, a biological information acquisition unit 204 is also provided. The biological information acquisition unit 204 acquires biological information from terminals 2A and 2B, which are biological information detection units that detect the state of people in the cabin. The content selection unit 214 selects content based on the state of each person in the cabin acquired by the biological information acquisition unit 204.

[0177] Because of this configuration, it is possible to simultaneously monitor the state of people such as those who are sleeping or those who are focused on video or audio-visual content through their personal video or audio-visual terminals, and select the content to be provided to the people in the cabin.

[0178] (8) In the content providing device 20 of (7) above, there is also an emotion estimation unit 205, which estimates the emotion of each person based on the state of each person obtained by the biometric information acquisition unit 204, and the personal information exclusion unit 211 excludes the personal information of persons whose emotions are separated or not separated as estimated by the emotion estimation unit 205.

[0179] Because of this structure, it is possible to provide content suitable for people who share common feelings within the cabin, while excluding personal information of people whose emotions are separated in Russell's emotional circle model. Furthermore, it is possible to provide content that reduces the sense of isolation for people who feel isolated within the cabin, while not excluding personal information of people whose emotions are separated in Russell's emotional circle model (in other words, excluding personal information of people with similar emotions).

[0180] (9) The content providing device 20 described in (8) above also includes a projection unit 52, which is a projection device that projects an image of a person in the cabin onto the cabin. The emotion estimation unit 205 also estimates the emotion of the person in the cabin towards the person reflected in the projection image based on the reaction to the projected image of the projection unit 52.

[0181] Because of this structure, it is possible to make inferences while taking into account social factors, compared to situations where feelings towards a person are inferred based on reactions upon directly seeing their face.

[0182] (10) In the content providing device 20 of (9) above, the projection unit 52 projects images of multiple people in the cabin into the cabin.

[0183] Because of this structure, it is possible to make inferences while taking into account social factors, compared to situations where feelings towards a person are inferred based on reactions upon directly seeing their face.

[0184] (11) The content providing device 20 described in (1) above further includes: a line of sight detection unit 207 that detects the line of sight of a person in the cockpit; and a subject estimation unit 208 that estimates the person in front of the line of sight detected by the line of sight detection unit 207, and a personal information exclusion unit 211 that excludes or does not exclude the personal information of the person estimated by the subject estimation unit 208.

[0185] Because of this structure, it is possible to provide instructions while taking into account social considerations, compared to situations where language is used to indicate whether to exclude the personal information of a specific person.

[0186] (12) In the content providing device 20 of (1) above, the space specified is the cabin in the vehicle 100, which is a mobile body.

[0187] Because of this configuration, it is possible to provide personalized content according to the preferences of the people inside the moving vehicle 100.

[0188] (13) The content providing device 20 described in (12) above also includes a gaze detection unit 207, which detects the gaze of the driver of the vehicle 100, and the personal information exclusion unit 211 excludes personal information based on the movement of the gaze detected by the gaze detection unit 207.

[0189] Because of this structure, drivers are able to instruct on the personal information of specific individuals while making social considerations.

[0190] (14) The content providing device 20 described in (12) above also includes a vehicle information acquisition unit 206, which acquires information indicating the position or speed of the vehicle 100, and the content selection unit 214 selects content based on the position or speed of the vehicle 100.

[0191] Because of this configuration, it is possible to provide the people in the cabin with information corresponding to the driving status of the vehicle 100.

[0192] (Variation Example 2) In the above-described embodiments and variations 1, the cabin of a vehicle 100, which is a mobile body, is exemplified as an example of a space where content is provided by the content providing device 20. However, the space can be any space other than the cabin, as long as it is a space that can accommodate multiple people.

[0193] (Variation Example 3) The above description illustrates an example of using the steering control unit 11 installed in the vehicle 100 to instruct the content providing device 20 to change the playback content. This is not limited to changes in content or playlists; it can also include instructions to change the playback volume or playback speed. Furthermore, the control unit 11 for instructing the content providing device 20 is not limited to vehicles 100 for multiple passengers; it can also be installed in two-wheeled vehicles or small mobile vehicles.

[0194] The above description is merely an example, and the above embodiments and modifications do not limit the invention as long as they do not destroy its features. One or more of the above embodiments and modifications can be combined in any way, and modifications can also be combined with each other.

[0195] Explanation of reference numerals in the attached figures 2A, 2B: Terminal; 11: Operating component; 12: Vehicle sensor group; 13: In-space camera; 20: Content providing device; 21: Personal information storage unit; 22: Relationship information storage unit; 23: Content storage unit; 24: Biosensor group; 25, 215: Communication unit; 50: Output device; 51: Display unit; 52: Projection unit; 53: Sound playback unit; 100: Vehicle; 111: Operation detection unit; 112: Light emitting unit; 121: Vehicle speed sensor; 122: Positioning sensor; 1 23: Camera; 131: Front seat camera; 132: Rear seat camera; 201: Personal information acquisition department; 202: Relationship information acquisition department; 203: Content acquisition department; 204: Biological information acquisition department; 205: Emotional estimation department; 206: Vehicle information acquisition department; 207: Gaze detection department; 208: Object estimation department; 209: First list creation department; 210: Second list creation department; 211: Personal information exclusion department; 212: Analysis department; 213: Evaluation department; 214: Content selection department.

Claims

1. A content providing device that provides content selected based on the personal information of a person in a defined space as content to be played in that space, characterized in that, have: A personal information acquisition unit, which acquires the personal information of multiple individuals in the space; The first list creation unit selects multiple contents based on the playlist, which is the personal information of each person in the space, and creates a first list containing the selected multiple contents; as well as The second list creation unit creates a second list at a predetermined number of positions in the first list, containing content not included in the playlist of each individual. The content providing device provides content selected from the second list as content to be played in the space.

2. The content providing device according to claim 1, characterized in that, The second list creation unit determines the content to be inserted based on the melody of the music that is the -1th and the -1th content in the first list.

3. The content providing device according to claim 1, characterized in that, The second list creation unit determines the content to be inserted as the content that is common to the features and the content contained in the playlist of each person in the space.

4. The content providing device according to claim 1, characterized in that, The second list creation unit determines the inserted content as a first song whose characteristics differ from those of the songs included in the playlists of each person in the space.

5. The content providing device according to claim 4, characterized in that, If the melody of the music that is the -1th and the -1th content in the first list is similar to that of the music in the first list, the second list creation unit will determine the first music as the content to be inserted.

6. The content providing apparatus according to claim 1, characterized in that, The second list creation unit determines the content to be inserted as the content that includes statements commonly contained in the music that are the -1th and the -1th content in the first list.

7. The content providing apparatus according to claim 1, characterized in that, The specified space is the space within the moving body. The second list creation unit determines the content related to the location where the moving body is moving as the content to be inserted.

Images