Information processor, information generator, information processing method, and information processing program
The information processing apparatus determines passenger excitement caused by scenery using current and area information, addressing the challenge of misgenerated synthetic images by accurately assessing mood or emotion changes, thereby generating appropriate images.
Patent Information
- Application Number
- JP2023210196
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-13
- Publication Date
- 2025-06-25
AI Technical Summary
Existing technologies struggle to accurately determine whether the excitement inside a vehicle is caused by the scenery, leading to potential misgeneration of desired synthetic images.
An information processing apparatus that acquires current position information, passenger information, and area information to determine if the passenger's mood or emotion change is due to scenery, using current position information acquisition means, passenger information acquisition means, and area information acquisition means, along with determination means to assess the geographical density of mood or emotion changes.
Enables easy and sure determination of whether passenger excitement is caused by scenery, allowing generation of appropriate synthetic images based on current position and area information, ensuring accurate representation of passenger emotions and scenery.
Smart Images

Figure 2025094567000001_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the technical field of information processing apparatuses, information generation apparatuses, information processing methods, and information processing programs. More specifically, it belongs to the technical field of information processing apparatuses, information generation apparatuses, information processing methods, and programs for the information processing apparatus that perform information processing related to passengers during movement.
Background Art
[0002] In recent years, technologies have been developed that use in-vehicle cameras to photograph the inside or outside of a vehicle and perform information processing related to the passengers of the vehicle (i.e., the driver or passengers of the vehicle) based on the results of the photographing. As a document showing prior art corresponding to such a current situation, for example, the following Patent Document 1 can be cited.
[0003] The prior art disclosed in this Patent Document 1 aims to "appropriately store information according to the situation inside the vehicle." Under this purpose, the prior art has a configuration in which "when extracting the face of a passenger and generating and recording a composite video of an enlarged face image and an outside scenery image of the vehicle, if there is an excited conversation regarding the scenery, the composite video of the outside scenery image and the face image is recorded, and if there is no such conversation, only the outside scenery image is recorded."
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0005] However, since there are various types of conversations indicating the excitement inside the vehicle, it is realistically difficult for the prior art disclosed in Patent Document 1 to timely determine whether the excitement depends on the scenery. Therefore, there is a problem that the desired synthetic image may not be generated.
[0006] Therefore, the present application has been made in view of the above problems. An example of the problem is to provide an information processing apparatus, an information generation apparatus, an information processing method, and a program for the information processing apparatus that can easily and surely determine whether the excitement inside the vehicle is caused by the scenery.
Means for Solving the Problem
[0007] In order to solve the above problems, the invention according to claim 1 includes current position information acquisition means for acquiring current position information indicating the current position of the moving body, passenger information acquisition means for acquiring passenger information related to the current mood or emotion of the passengers of the moving body, and an area where the geographical density of points where it is determined that the mood or emotion of a plurality of persons other than the passengers has changed between the time retroactively set by a preset period from the current time and the current time is equal to or higher than a preset standard is shown as an area information acquisition means for acquiring area information of a scenic area of interest where a scenic view to be noted exists, and determination means for determining whether the change in the mood or emotion is caused by the scenery at the current position based on the current position information, the passenger information, and the area information.
[0008] In order to solve the above problems, the invention according to claim 9 includes: a collecting means for collecting change point information indicating a point where the emotion of a mover has changed from a plurality of terminal devices that move together with each of the plurality of movers and can detect changes in the mood or emotion of the mover; a specifying means for specifying an area where the geographical density of the points where the mood or emotion of the mover has changed is equal to or greater than a preset standard based on the plurality of pieces of change point information collected by the collecting means between a time retroactively set by a preset period from the present and the present; and a storing means for associating and storing area information indicating the area specified by the specifying means with map information as attention scenery area information indicating an attention scenery area where there is a scenery to be noted.
[0009] In order to solve the above problems, the invention according to claim 12 is an information processing method executed in an information processing apparatus including a current position information acquisition means, a passenger information acquisition means, an area information acquisition means, and a determination means. The method includes: a current position information acquisition step of acquiring current position information indicating the current position of a moving body by the current position information acquisition means; a passenger information acquisition step of acquiring passenger information related to the current mood or emotion of a passenger of the moving body by the passenger information acquisition means; an area information acquisition step of acquiring, by the area information acquisition means, area information indicating, as an attention scenery area where there is a scenery to be noted, an area where the geographical density of points where the mood or emotion of a plurality of persons other than the passenger has been determined to have changed between a time retroactively set by a preset period from the present and the present is equal to or greater than a preset standard; and a determination step of determining, by the determination means, whether or not the change in the mood or emotion is caused by the scenery at the current position based on the current position information, the passenger information, and the area information.
[0010] In order to solve the above problems, the invention according to claim 13 causes a computer to function as current position information acquisition means for acquiring current position information indicating the current position of a moving body, passenger information acquisition means for acquiring passenger information related to the current mood or emotion of a passenger of the moving body, area information acquisition means for acquiring area information indicating, as a scenic area of interest where there is a scenic view to be noted, an area where the geographical density of points at which it is determined that the moods or emotions of a plurality of persons other than the passenger have changed between a time retroactively set by a preset period from the current time and the current time is equal to or higher than a preset criterion, and determination means for determining, based on the current position information, the passenger information, and the area information, whether or not the change in the mood or emotion is caused by the scenery at the current position.
Brief Description of the Drawings
[0011]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Embodiments for Carrying Out the Invention
[0012] Next, embodiments for carrying out the present application will be described with reference to FIG. 1. Note that FIG. 1 is a block diagram showing the schematic configuration of the information processing apparatus of the embodiment.
[0013] As shown in FIG. 1, the information processing apparatus S of the embodiment includes a current position information acquisition unit 1, a passenger information acquisition unit 2, an area information acquisition unit 3, and a determination unit 4.
[0014] In this configuration, the current position information acquisition unit 1 acquires current position information indicating the current position of the moving body. On the other hand, the passenger information acquisition unit 2 acquires passenger information related to the current mood or emotion of the passenger of the moving body. Further, the area information acquisition unit 3 acquires area information indicating, as a notable scenery area where there is a notable scenery, an area where the geographical density of points where it is determined that the moods or emotions of a plurality of persons other than the passenger have changed between the time retroactively set from the current time by a preset period and the current time is equal to or greater than a preset criterion.
[0015] Based on these, the determination unit 4 determines whether or not the change in the mood or emotion of the passenger is caused by the scenery at the current position of the moving body, based on the current position information acquired by the current position information acquisition unit 1, the passenger information acquired by the passenger information acquisition unit 2, and the area information acquired by the area information acquisition unit 3.
[0016] As described above, according to the operation of the information processing apparatus S of the embodiment, based on the current position information indicating the current position of the moving body, the passenger information related to the current mood or emotion of the passenger of the moving body, and the area information indicating the notable scenery area, it is determined whether or not the change in the current mood or emotion of the passenger is caused by the scenery at the current position. Therefore, it is possible to easily and surely determine whether or not the change in the mood or emotion of the passenger of the moving body is caused by the scenery.
Example
[0017] Next, specific examples corresponding to the above-described embodiment will be described with reference to FIGS. 2 to 5. The examples described below are examples in the case where the embodiment is applied to an in-vehicle device mounted on a vehicle and performing information processing for the passengers of the vehicle. In the following description, the vehicle equipped with the in-vehicle device of the example is simply referred to as the "equipped vehicle".
[0018] Further, FIG. 2 is a block diagram or the like showing the schematic configuration of the heat map generation device of the embodiment, FIG. 3 is a block diagram showing the schematic configuration of the in-vehicle device of the embodiment, FIG. 4 is a flowchart showing the image generation process of the embodiment, and FIG. 5 is a diagram showing an example of an image generated by the image generation process. At this time, in FIG. 3, for each component of the embodiment corresponding to each component in the information processing device S of the embodiment shown in FIG. 1, the same component numbers as those of the components in the information processing device S are used.
[0019] (1) Regarding the configuration and operation of the heat map generation device of the embodiment First, the configuration and operation of the heat map generation device of the embodiment will be described with reference to FIG. 2. Here, the heat map of the embodiment is obtained by associating and recording location information indicating a location where a person other than the passenger of the vehicle equipped with the in-vehicle device of the embodiment has sent and where the person's mood or emotion has risen (or become excited) with a map. Although the above-mentioned rise in mood or emotion varies from person to person, on the other hand, in an area having a scenery preferred by people, for example, the mood or emotion of many people will rise. Therefore, if the above-mentioned location information transmitted from a plurality of people is associated and recorded with a map, an area with a scenery where mood or emotion generally rises will inevitably be specified.
[0020] Next, the configuration and operation of the heat map generation device of the embodiment for generating the above-described heat map will be described. As shown in FIG. 2(a), the heat map generation device HS of the embodiment includes a processing unit 20 composed of a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc., a non-volatile recording unit 21 composed of an HDD (Hard Disc Drive) or an SSD (Solid State Drive), etc., an operation unit 22 composed of a keyboard and a mouse, etc., a display 23 composed of a liquid crystal display, etc., and an interface 24.
[0021] The processing unit 20 further includes a collection unit 20A, a specification unit 20B, and a storage control unit 20C. At this time, the collection unit 20A, the specification unit 20B, and the storage control unit 20C may be realized by a hardware logic circuit such as the above-mentioned CPU that constitutes the processing unit 20, or may be realized software-wise by the CPU reading a program corresponding to the process of generating the heat map from the recording unit 21 and executing it.
[0022] In the above configuration, the collection unit 20A of the processing unit 20 obtains, from each terminal device that can be carried by a plurality of moving persons other than the above-mentioned passengers and can detect that the mood or emotion of the person has risen, location information indicating the location where the mood or emotion of the person has risen, via the interface 24 and a network such as the Internet (not shown). Next, the specification unit 20B specifies, on the map, an area where the geographical density of the locations where the mood or emotion of each person has risen is equal to or higher than a preset criterion, based on a plurality of pieces of the above-mentioned location information collected by the collection unit 20A between the time retroactively set by a preset period from the present and the present. Thereafter, the storage control unit 20C non-volatily stores, in the recording unit 21 in association with the map, area information indicating the area specified by the specification unit 10B as a heat map of an example indicating a notable scenic area where there is a scenery that many general persons should pay attention to. As a result, heat map data H corresponding to the heat map is non-volatily recorded in the recording unit 21.
[0023] The heat map HM stored by the operation of the above heat map generation device HS is, as shown in, for example, FIG. 2(b), a heat map in which a plurality of points SP where the feelings or emotions of a plurality of persons carrying the terminal device are heightened are marked on the map MP. Then, when the attention scenic area AR illustrated in, for example, FIG. 2(b) is specified by the specifying unit 20B, the area information indicating the attention scenic area AR (more specifically, for example, area information indicating the position, size, or shape of the attention scenic area AR) is stored in the recording unit 21 as the heat map HM. Then, the heat map data H corresponding to the stored heat map HM is supplied to the in-vehicle device of the embodiment described later via the network and used for the image generation process of the embodiment in the in-vehicle device.
[0024] (2) Regarding the configuration and operation of the in-vehicle device of the embodiment Next, the configuration and operation of the in-vehicle device of the embodiment will be described with reference to FIG. 3.
[0025] As shown in FIG. 3, the in-vehicle device T of the embodiment mounted on a mounted vehicle which is an example of the mobile body of the embodiment includes a processing unit 1 composed of a CPU, a ROM, a RAM, etc., a non-volatile recording unit 10 composed of an HDD or an SSD, etc., an outside vehicle camera CO and an inside vehicle camera CI composed of a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) element, etc., an operation unit 11 composed of an operation button or a touch panel, etc., a microphone 12, a sensor unit 13 including a GNSS (Global Navigation Satellite System) sensor, etc., a display 14 composed of a liquid crystal display, etc., a speaker 15, and an interface 16.
[0026] The processing unit 1 further includes a determination unit 4 and an image generation unit 5. At this time, the determination unit 4 and the image generation unit 5 may be realized by a hardware logic circuit such as the CPU that constitutes the processing unit 1, or may be realized software-wise by the CPU reading a program corresponding to a flowchart (see FIG. 4) showing the image generation process of the embodiment described later from the recording unit 10 and executing it. Further, the in-vehicle camera CI corresponds to an example of the passenger information acquisition means 2 of the embodiment, the processing unit 1 corresponds to an example of the current position information acquisition means 1 and an example of the area information acquisition means 3 of the embodiment, and the determination unit 4 corresponds to an example of the determination means 4 of the embodiment. Further, as shown by the dashed line in FIG. 3, the processing unit 1 and the determination unit 4 constitute an example of the information processing apparatus S of the embodiment.
[0027] In the above configuration, the heat map data H previously acquired from the heat map generation device HS of the embodiment is non-volatilely recorded in the recording unit 10. This heat map data H is read by the processing unit 1 as necessary and used for the image generation process of the embodiment. In addition to this, posting data U including the data of the image generated by the image generation process of the embodiment described later is also non-volatilely recorded in the recording unit 10. This posting data U is posted to a preset SNS (Social Network Service) by an operation by a passenger or the like of the mounted vehicle or based on preset schedule information.
[0028] On the other hand, the outside vehicle camera CO has the outside of the mounted vehicle as its shooting range. In contrast, the in-vehicle camera CI has the inside of the mounted vehicle as its shooting range. Then, the outside vehicle camera CO and the in-vehicle camera CI generate image data corresponding to the images of their respective shooting ranges and output them to the processing unit 1.
[0029] On the other hand, the sensor unit 13 identifies the current position of the in-vehicle device T (in other words, the current position of the vehicle on which it is mounted) using, for example, GNSS or self-contained sensors including the above GNSS sensor, generates current position data indicating the current position, and outputs the data to the processing unit 1. On the other hand, under the control of the processing unit 1, the interface 16 acquires, via the network, data necessary for guidance processing and the like performed using the in-vehicle device T from an external server device (not shown) and the like, and also acquires the heat map data H of the embodiment from the heat map generation device HS via the network.
[0030] Then, based on the current position data, the heat map data H, and the image data from the in-vehicle camera CI, the processing unit 1, the determination unit 4, and the image generation unit 5 generate an image included in the posting data U as the image generation process of the embodiment. The image generation process of the embodiment will be described in detail later.
[0031] Furthermore, the microphone 12 collects, for example, the sound inside the vehicle on which it is mounted under the control of the processing unit 1, and outputs the collected result to the processing unit 1 as a sound signal. Also, the speaker 15 emits necessary voices and the like inside the vehicle on which it is mounted under the control of the processing unit 1. Then, in addition to the image generation process of the embodiment, the processing unit 1 executes guidance processing and the like for guiding the movement of the vehicle on which it is mounted based on the image data from the outside vehicle camera CO and the in-vehicle camera CI, the current position data, and the sound signal and the like. At this time, information to be presented (notified) to the passengers of the vehicle on which it is mounted as the guidance processing and the like is presented to the passengers by display using the display 14 or sound emission using the speaker 15. Furthermore, when an operation necessary for causing the in-vehicle device T to perform an operation including the image generation process of the embodiment is executed at the operation unit 11, the operation unit 11 generates an operation signal corresponding to the operation and outputs the signal to the processing unit 1. Thereby, the processing unit 1 comprehensively controls the above operation of the in-vehicle device T including the image generation process of the embodiment based on the operation signal.
[0032] (3) Regarding the image generation process of the embodiment Next, the image generation process of the embodiment executed centering on the processing unit 1, the determination unit 4, and the image generation unit 5 of the in-vehicle device T having the configuration described above will be described with reference to FIGS. 3 to 5.
[0033] The image generation process of the embodiment is started, for example, at preset time intervals when the vehicle on which it is mounted is moving and the in-vehicle device T is operating. Then, as shown in FIG. 4, when the image generation process of the embodiment is started, the processing unit 1 acquires the current position of the in-vehicle device T based on the current position data (step S1). In parallel with this, the processing unit 1 detects the excitement of the passengers in the vehicle (in other words, the change in the mood or emotion of the passengers) based on the image data from the in-vehicle camera CI and the sound signal from the microphone 12, etc. (step S2). As this step S2, for example, when there are many smiling faces in the image corresponding to the image data from the in-vehicle camera CI, when the laughter of the passengers is emitted by the sound signal from the microphone 12, or when a specific term indicating the excitement is emitted in the conversation between the passengers, the processing unit 1 determines that the inside of the vehicle on which it is mounted is excited and detects this.
[0034] Next, the determination unit 4 of the processing unit 1 determines whether the current position of the vehicle on which the system is mounted, acquired in step S1 above, is within the attention scenic area AR (see Fig. 2(b)) of the heat map HM corresponding to the heat map data H recorded in the recording unit 10 (step S3). In the determination of step S3, if the current position of the vehicle on which the system is mounted is within any of the attention scenic areas AR (step S3: YES), the determination unit 4 then determines whether the excitement inside the vehicle on which the system is mounted has been detected in step S2 above (step S8). In the determination of step S8, if the excitement inside the vehicle on which the system is mounted has been detected (step S8: YES), the determination unit 4 determines that the excitement is due to the scenery within the attention scenic area AR. Then, based on the determination by the determination unit 4, the image generation unit 5 of the processing unit 1 generates a posting image including an in-vehicle image showing the situation inside the vehicle on which the system is mounted and an out-of-vehicle image showing the scenery outside the vehicle on which the system is mounted, using the image data from the in-vehicle camera CI and the image data from the out-of-vehicle camera CO at that time, respectively (step S9). The posting image generated in step S9 becomes a posting image GIO that evenly includes the in-vehicle image GI and the out-of-vehicle image GO, as exemplified in Fig. 5(a) for example. Then, the processing unit 1 records the posting image GIO generated in step S9 in the recording unit 10 as posting data U (step S7). After that, the processing unit 1 returns to other processes as the in-vehicle device T (for example, the above guidance process, etc.) and continues the other processes.
[0035] On the one hand, in the determination of step S8, when the excitement inside the vehicle of the vehicle being mounted is not detected (step S8: NO), the image generation unit 5 of the processing unit 1 uses the image data from the external camera CO at that time to generate a posting image mainly including an external image of the scenery outside the vehicle being mounted (step S10). The posting image generated in this step S10 becomes a posting image mainly including the external image GO as exemplified in FIG. 5(b), for example. At this time, the image generation unit 5 may generate the posting image by slightly overlapping the in-vehicle image GI at that time on a part of the external image GO. Then, the processing unit 1 records the posting image GO generated in step S10 in the recording unit 10 as posting data U (step S7). After that, the processing unit 1 returns to the other processing as the in-vehicle device T and continues the other processing.
[0036] On the other hand, in the determination of step S3, when the current position of the vehicle being mounted is not within any of the scenic areas of interest AR (step S3: NO), the determination unit 4 then determines whether the excitement inside the vehicle of the vehicle being mounted has been detected in step S2 (step S4). In the determination of step S4, when the excitement inside the vehicle of the vehicle being mounted is detected (step S4: YES), the determination unit 4 determines that the excitement is irrelevant to the scenery outside. Then, based on the determination by the determination unit 4, the image generation unit 5 of the processing unit 1 uses the image data from the in-vehicle camera CI at that time to generate a posting image mainly including an in-vehicle image GI showing the situation inside the vehicle being mounted (step S5). The posting image generated in this step S5 becomes a posting image mainly including the in-vehicle image GI as exemplified in FIG. 5(c), for example. At this time, the image generation unit 5 may generate the posting image by slightly overlapping the external image GO at that time on a part of the in-vehicle image GI. Then, the processing unit 1 records the posting image generated in step S5 in the recording unit 10 as posting data U (step S7). After that, the processing unit 1 returns to the other processing as the in-vehicle device T and continues the other processing.
[0037] On the other hand, in the determination of step S4, when the excitement inside the vehicle of the mounted vehicle is not detected (step S4: NO), the image generation unit 5 of the processing unit 1 uses the image data from the outside camera CO and the image data from the inside camera CI at that time to generate a moving record image (an image that should be recorded as a conventional so-called drive recorder) (step S6). Then, the processing unit 1 records the moving record image generated in step S6 in the recording area of the recording unit 10 that is different from the posting data U (step S7). In this step S7, the processing unit 1 may record the moving record image generated in step S6 in the recording unit 10 as a file different from the posting data U. Then, the processing unit 1 returns to the above other processing as the in-vehicle device T and continues the other processing.
[0038] As described above, according to the image generation process in the in-vehicle device T of the embodiment, based on the current position of the mounted vehicle, the determination of whether the passengers of the mounted vehicle are currently excited, and the attention scenic area AR, it is determined whether the current excitement of the passengers is caused by the scenery at the current position (see steps S3, S4, and S8 in FIG. 4). Therefore, it is possible to easily and surely determine whether the excitement of the passengers of the mounted vehicle is caused by the scenery.
[0039] In addition, since the outside image G0 and the inside image GI are respectively acquired, and a posting image (see FIG. 5) including at least one of the outside image GO and the inside image GI is generated based on the determination result by the determination unit 4, a posting image corresponding to the determination result of whether the excitement of the passengers is caused by the scenery can be automatically generated.
[0040] Furthermore, when the current excitement of the passengers is caused by the scenery at the current position of the mounted vehicle (see steps S3: YES and S8: YES in FIG. 4), a posting image including the outside image GO and the inside image GI is generated (see step S9 in FIG. 4). Therefore, a posting image that can understand both the scenery and the resulting excitement of the passengers can be generated.
[0041] Furthermore, when the excitement of the passengers is not caused by the scenery at the current position of the vehicle being boarded (see FIG. 4, step S3: NO, step S4: YES), a posting image (see FIG. 5(c)) including at least the in-vehicle image GI is generated. Thus, it is possible to generate a posting image that can understand the excitement of the passengers regardless of the scenery.
[0042] Also, when it is determined that the current position of the vehicle being boarded is within the attention scenery area AR and there is no excitement of the passengers (see FIG. 4, step S3: YES, step S8: NO), a posting image (see FIG. 5(b)) including at least the out-of-vehicle image GO is generated. Thus, it is possible to generate a posting image that can understand the scenery to be noted regardless of the excitement of the passengers.
[0043] Furthermore, when it is determined that the current position of the vehicle being boarded is outside the attention scenery area AR and there is no excitement of the passengers (see FIG. 4, step S3: NO, step S4: NO), an image for recording the movement of the vehicle being boarded is generated (see FIG. 4, step S6). Thus, it is possible to generate an image for movement recording regardless of the excitement of the passengers and the scenery.
[0044] Furthermore, since the above image for movement recording is non-volatilely recorded in the recording unit 10 separately from the posting data U, it is possible to surely record (leave) the image for movement recording.
[0045] Also, according to the configuration of the heat map generation device HS of the embodiment, it is possible to efficiently collect and save information on the attention scenery area AR that excites persons other than the passengers of the vehicle being boarded. [Modification Example]
[0046] Next, a modification example corresponding to the embodiment will be described. In the following description of the modification example, the same members as those in the embodiment, such as component members, are given the same member numbers and detailed descriptions thereof are omitted.
[0047] (1) First Modification Example First, a first modification example corresponding to the embodiment will be described. In the above-described embodiment, an image for movement recording is generated using the image data from the outside vehicle camera CO and the image data from the inside vehicle camera CI (see step S6 in FIG. 4). However, in addition to this, the in-vehicle device T may be provided with a dedicated camera for generating an image for movement recording. In this case, an image for movement recording can be surely generated and recorded regardless of the image for posting.
[0048] (2) Second Modification Example Next, as a second modification example corresponding to the embodiment, the heat map HM of the embodiment may be configured to be generated for each time zone or for each weather condition. In this case, the collection unit 20A, the specifying unit 20B, and the storage control unit 20C of the heat map generation device HS may execute their respective functions for each time zone or for each weather condition. In this case, information on the attention scenic area AR can be conveniently stored.
[0049] (3) Other Modification Examples Finally, as another modification example corresponding to the embodiment, the image generation process of the embodiment is configured to be executed only by the in-vehicle device T. However, in addition to this, the image generation process of the embodiment can also be configured to be executed centering on a fixed server device connected via a network such as the Internet to an in-vehicle device equipped with an in-vehicle camera similar to the in-vehicle camera CI of the embodiment and mounted on the vehicle.
[0050] Also, a program corresponding to the flowchart shown in FIG. 4 is recorded on a recording medium such as an optical disk or a hard disk, or is acquired via a network such as the Internet, and is read out and executed by a general-purpose microcomputer or the like, whereby the general-purpose microcomputer or the like can function as the processing unit 1, the determination unit 4, or the image generation unit 5 of the embodiment.
Description of Reference Numerals
[0051] 1 Current position information acquisition means (processing unit) 2 Occupant information acquisition means 3 Area information acquisition means 4 Determination means (determination unit) CI In-vehicle camera CO Out-of-vehicle camera HM Heat map AR Area of interest
Claims
1. Current position information acquisition means for acquiring current position information indicating the current position of the moving body; Passenger information acquisition means for acquiring passenger information related to the current mood or emotion of the passenger of the moving body; Area information acquisition means for acquiring area information indicating, as a notable scenery area where notable scenery exists, an area where the geographical density at a point where it is determined that the moods or emotions of a plurality of persons other than the passenger have changed between a time retroactively set by a preset period from the current time and the current time is equal to or higher than a preset standard; Judgment means for judging whether or not the change in the mood or emotion is caused by the scenery at the current position based on the current position information, the passenger information, and the area information; An information processing apparatus comprising the same.
2. In the information processing apparatus according to Claim 1, Image information acquisition means for acquiring, respectively, image information of an external moving body image obtained by photographing outside the moving body and image information of an internal moving body image obtained by photographing inside the moving body; Generation means for generating an image including at least one of the external moving body image and the internal moving body image based on a judgment result by the judgment means; An information processing apparatus comprising the same.
3. In the information processing apparatus according to Claim 2, When the change in the mood or emotion is caused by the scenery at the current position, the generation means generates the image including the external moving body image and the internal moving body image. An information processing apparatus characterized by this.
4. In the information processing apparatus according to Claim 2, When the change in the mood or emotion is not caused by the scenery at the current position, the generation means generates the image including at least the internal moving body image. An information processing apparatus characterized by this.
5. In the information processing apparatus according to Claim 2, When it is determined that the current position is within the notable scenery area and there is no change in the mood or emotion, the generation means generates the image including at least the external moving body image. An information processing apparatus characterized by this.
6. In the information processing apparatus according to Claim 2, When it is determined that the current position is outside the notable scenery area and there is no change in the mood or emotion, the generation means generates the image for recording the movement of the moving body. An information processing apparatus characterized by this.
7. In the information processing apparatus according to Claim 6, The information processing apparatus further comprises a recording means for separately and non-volatilely recording the image for movement recording from the image generated when it is determined that the current position is within the scenic area of interest and the image generated when it is determined that there is a change in the mood or emotion.
8. In the information processing apparatus according to claim 6 or claim 7, A recording image generation means that only generates the image for movement recording is provided separately from the generation means that generates the image when it is determined that the current position is within the scenic area of interest and the generation means that generates the image when it is determined that there is a change in the mood or emotion. The information processing apparatus is characterized by this.
9. Collecting means for collecting change point information indicating the point where the emotion of the mobile person has changed from a plurality of terminal devices that move with each of the plurality of mobile persons and can detect changes in the mood or emotion of the mobile person, Based on a plurality of pieces of the change point information collected by the collecting means between the time retroactively set by a preset period from the present and the present, a geographical density of the point where the mood or emotion of the mobile person has changed is a preset standard or more. Specifying means for specifying an area to be reached, Storage means for storing area information indicating the area specified by the specifying means in association with map information as scenic area information indicating a scenic area of interest where a scenic view to be noted exists, An information generation apparatus characterized by comprising:
10. In the information generation apparatus according to claim 9, The collecting means collects the change point information for each time zone, The specifying means specifies the area for each time zone, The storage means stores the scenic area of interest in association with the map information for each time zone. The information generation apparatus is characterized by this.
11. In the information generation apparatus according to claim 9, The collecting means collects the change point information for each weather condition, The specifying means specifies the area for each weather condition, The storage means stores the scenic area of interest in association with the map information for each weather condition. The information generation apparatus is characterized by this.
12. An information processing method executed in an information processing apparatus including current position information acquisition means, passenger information acquisition means, area information acquisition means, and determination means, A current position information acquisition step of acquiring current position information indicating the current position of the moving body by the current position information acquisition means; A passenger information acquisition step of acquiring passenger information related to the current mood or emotion of the passenger of the moving body by the passenger information acquisition means; An area information acquisition step of acquiring, by the area information acquisition means, area information indicating, as a scenic area of interest where there is a scenic view to be noted, an area where the geographical density of points where it is determined that the moods or emotions of a plurality of persons other than the passenger have changed between the time retroactively set by a preset period from the current time and the current time is equal to or higher than a preset standard; A determination step of determining, by the determination means, whether or not the change in the mood or emotion is caused by the scenery at the current position based on the current position information, the passenger information, and the area information; An information processing method characterized by including the above.
13. A computer, A current position information acquisition means for acquiring current position information indicating the current position of the moving body, A passenger information acquisition means for acquiring passenger information related to the current mood or emotion of the passenger of the moving body, An area information acquisition means for acquiring area information indicating, as a scenic area of interest where there is a scenic view to be noted, an area where the geographical density of points where it is determined that the moods or emotions of a plurality of persons other than the passenger have changed between the time retroactively set by a preset period from the current time and the current time is equal to or higher than a preset standard, and A determination means for determining whether or not the change in the mood or emotion is caused by the scenery at the current position based on the current position information, the passenger information, and the area information, A program for information processing, characterized in that it functions as the above.
Citation Information
Patent Citations
Video image control device, vehicle photographing device, video image control method, and program
JP2019186790A