Information processing apparatus

The information processing device addresses user embarrassment by detecting unnatural behavior and surroundings, issuing alerts to prevent awkward situations in public using cameras and sensors.

JP2026017696APending Publication Date: 2026-02-05JVC KENWOOD CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024118594
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-07-24
Publication Date
2026-02-05

AI Technical Summary

Technical Problem

Users wearing head-mounted displays may exhibit unnatural behavior in public places, leading to embarrassment due to their immersion in images or audio, which can be noticed by others, causing strange looks.

Method used

An information processing device that detects user behavior and surroundings to determine potential embarrassment, using components like cameras, sensors, and processors to issue notifications such as 'There are people around' or 'This is a public place' to alert the user.

Benefits of technology

The device effectively detects situations where a user may feel embarrassed and provides timely notifications to mitigate embarrassment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026017696000001_ABST
    Figure 2026017696000001_ABST
Patent Text Reader

Abstract

To provide an information processor capable of detecting a situation in which a user may feel embarrassment and notifying the user of the situation.SOLUTION: The information processing device 100 according to the present disclosure includes the degree-of-attention determination unit 170 that determines the degree of attention to which the user is paying attention to the surroundings, the current position acquisition unit 140 that acquires the current position information of the user, the place type determination unit 150 that determines whether or not the current position is a public place, and the notification unit 110 that performs notification including information regarding the degree of attention to the user in a case where the degree of attention is less than a predetermined level and the current position is a public place.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device. [Background technology]

[0002] Head-mounted displays that are worn by a user and allow the user to view a virtual space, providing a sense of immersion, have been developed in recent years. When using a head-mounted display in a public place, etc., if the user is immersed in the images and sounds displayed on the head-mounted display, there is a risk that the user will not notice even if the surrounding situation is dangerous to the user. Therefore, the technology disclosed in Patent Document 1 determines whether the user is in a dangerous situation based on the user's location or surrounding situation and the user's behavior. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2020 / 230892 Summary of the Invention [Problem to be solved by the invention]

[0004] When a user is immersed in images or music displayed on a head-mounted display, the user may exhibit unnatural behavior, such as moving their body or raising their voice in response to the images or sounds provided by the display. If the user exhibits unnatural behavior in a public place, people around the user may look at the user strangely, which may make the user feel embarrassed. Therefore, in situations where the user may feel embarrassed, it may be preferable to notify the user of this.

[0005] The present disclosure has been made in consideration of such problems, and provides an information processing device that can detect situations in which a user who is immersed in images or audio displayed on a head-mounted display may feel embarrassed, and alert the user. [Means for solving the problem]

[0006] The information processing device according to the present disclosure includes: an attention level determination unit that determines the level of attention that a user is paying to their surroundings; a current location acquisition unit that acquires current location information of the user; a place type determination unit that determines whether the current location is a public place; a notification unit that, when the degree of caution is less than a predetermined level and the current location is in a public place, issues a notification including information regarding the degree of caution to the user; Equipped with. [Effects of the Invention]

[0007] According to the present disclosure, it is possible to provide an information processing device that is capable of detecting a situation in which a user may feel embarrassed and notifying the user. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram illustrating a configuration example of an information processing device according to the present disclosure. [Figure 2] 1 is a flowchart illustrating a flow of an example of a notification method according to the present disclosure. [Figure 3] 1 is a flowchart illustrating a flow of an example of a notification method according to the present disclosure. [Figure 4] 1 is a flowchart illustrating a flow of an example of a notification method according to the present disclosure. [Figure 5] 1 is a flowchart illustrating a flow of an example of a notification method according to the present disclosure. [Figure 6] 1 is a flowchart illustrating a flow of an example of a notification method according to the present disclosure. [Figure 7]1 is a flowchart illustrating a flow of an example of a notification method according to the present disclosure. [Figure 8] 1 is a flowchart illustrating a flow of an example of a notification method according to the present disclosure. [Figure 9] 1 is a block diagram illustrating a configuration example of a notification system according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0009] <Embodiment 1> First, the configuration of an information processing device 100 according to the present disclosure will be described with reference to FIG. 1. The information processing device 100 is mounted on a display device that is worn or placed on the head or in front of the eyes of a user, for example, and detects when a user who is immersed in the video and audio displayed on the display device is behaving unnaturally and may feel embarrassed, and notifies the user of this. An example of a display device here is a head-mounted display. Below, with reference to FIG. 1, a case where the information processing device 100 is mounted on a head-mounted display 10 will be described as an example of the information processing device 100. Note that the information processing device 100 may be built into the head-mounted display 10 as one of the functions of the head-mounted display 10, or may be a device independent of the head-mounted display 10.

[0010] The head-mounted display 10 is attached to the user's head and provides the user with video and audio. The head-mounted display 10 is attached, for example, so as to cover the user's eyes and ears. Therefore, when the head-mounted display 10 is attached, the user may have difficulty perceiving the surroundings compared to when the head-mounted display 10 is not attached. The user may behave unnaturally, such as moving their body or speaking, in response to the video and audio provided by the head-mounted display 10. When using the head-mounted display 10 in a public place, there may be other people around the user. If a user wearing the head-mounted display 10 behaves unnaturally, people around them may look at the user strangely, which may cause the user to feel embarrassed. Therefore, the information processing device 100 according to the present disclosure detects situations in which the user may feel embarrassed and notifies the user.

[0011] The information processing device 100 includes at least an alarm unit 110, and may further include one or more of an image acquisition unit 120, an attention level determination unit 130, a current position acquisition unit 140, a location type determination unit 150, a behavior detection unit 160, and an attention level determination unit 170.

[0012] The notification unit 110 notifies the user when it is determined that the situation is such that the user may feel embarrassed. Specifically, the notification unit 110 is a display or a speaker that notifies the user with video or audio including messages such as "There are people around," "This is a public place," or "Please be careful of your surroundings" that alert the user to their surroundings. The notification unit 110 may be a light-emitting unit or a buzzer that alerts the user by emitting light or making a buzzer sound. Here, a situation in which the user may feel embarrassed is a situation in which another person is watching the user's unnatural behavior in response to the video or audio displayed on the head-mounted display 10, for example.

[0013] The image acquisition unit 120 acquires images of people around the user. The image acquisition unit 120 is, for example, a camera that can acquire images including people around the user by capturing an image of the area around the information processing device 100.

[0014] The gaze degree determination unit 130 determines the degree of gaze of a person around the user, based on the image acquired by the image acquisition unit 120. Here, "gazing" may mean strictly determining whether the person is looking at the user, or may include determining whether the person is looking toward the user based on the direction of the person's face and determining that the person is gazing at the user. For example, the gaze degree determination unit 130 may perform image recognition of the person and the person's head in the image acquired by the image acquisition unit 120, and determine that the person is gazing at the user if the time the person's face is facing forward is equal to or longer than a threshold, such as 5 seconds. If the person is looking toward the user, the user may be in the person's field of vision, making it easier for the person to notice if the user exhibits unnatural behavior.

[0015] The degree of attention is determined in multiple levels, such as three or five levels. The level of attention is, for example, level 1, which is the lowest level when no one around the user is looking at the user at all; level 2, which is when the people around the user are looking at the user for a short period of time that is less than a predetermined time; and level 3, which is the highest level when the people around the user are looking at the user for a predetermined period of time or more. The number of people around the user who are looking at the user may also be used as a parameter for determining the level.

[0016] The current position acquisition unit 140 acquires the user's current position information. The current position acquisition unit 140 may detect the user's current position information using a GNSS (Global Navigation Satellite System) such as a GPS (Global Positioning System). In this case, the current position acquisition unit 140 receives radio waves including transmission times from each of a plurality of GNSS satellites. Then, the current position acquisition unit 140 calculates the latitude, longitude, altitude, etc. of the reception point, i.e., the user's current position, based on the transmission times included in each of the plurality of received radio waves.

[0017] The current location acquisition unit 140 may also acquire the user's current location information by acquiring the communication history of the information processing device 100 or the history of entry and exit to a facility or the like. The communication history of the information processing device 100 is, for example, a communication history of which access points the information processing device 100 is communicating with in Wi-Fi (registered trademark) or mobile communication. The entry and exit history to a facility or the like is, for example, a history of passing through a security gate installed at the entrance to a home or a conference room, or the open / closed state or lock state of a private room door or a vehicle door. The current location acquisition unit 140 acquires, as the user's current location, the vicinity of the access point with which the information processing device 100 is communicating, or the inside of a locked door, or the like.

[0018] The place type determination unit 150 determines whether the current location information acquired by the current location acquisition unit 140 indicates a public place. Here, a public place is a space that other people can enter, such as a train, a park, or a street. A public place may also refer to a space other than a private space, such as a home, a private room, a car cabin, or a facility or area that only limited members can enter. The place type determination unit 150 may compare current location information, such as the latitude and longitude of the current location, with map information to determine whether the user's current location is a public place. The place type determination unit 150 may also compare current location information, such as the latitude and longitude of the current location, with a place that the user has previously registered as a private space, such as a home, to determine whether the user's current location is a public place.

[0019] Furthermore, the place type determination unit 150 may determine whether the user's current location is a public place based on the communication history of the information processing device 100 or the history of entering and exiting a facility or the like. The place type determination unit 150 may determine that the user's current location is a private space and not a public place based on information on the usage status of various devices, such as whether the lights in the user's private room are on or whether the electrical devices in the user's private room are in use. The place type determination unit 150 may recognize whether there are people other than the user in the surrounding area based on images, sounds, or the like, and determine that the user is in a private space if there are no people other than the user in the surrounding area.

[0020] The behavior detection unit 160 detects the user's behavior. Here, the user's behavior refers to the user's reaction to the video and audio provided from the information processing device 100 installed in the head-mounted display 10, specifically the user's body movements and vocalizations. The behavior detection unit 160 may, for example, determine whether the user's body movements and vocalizations detected by an acceleration sensor, a microphone, or the like built into the information processing device 100 are occurring in correspondence with the video and audio provided from the information processing device 100. The behavior detection unit 160 may detect the user's behavior when acceleration indicating the magnitude of the user's head movement detected by an acceleration sensor (not shown) is equal to or greater than a predetermined threshold, for example, 0.2 G, and determine that the user is behaving unnaturally. The behavior detection unit 160 may also detect the user's vocalization volume detected by a microphone (not shown) is equal to or greater than a predetermined threshold, for example, 60 dB, and determine that the user is behaving unnaturally. The behavior detection unit 160 may determine that the user is behaving unnaturally when the acceleration sensor or the voice volume is at or above a predetermined threshold for a predetermined period of time, such as one second or more. The behavior detection unit 160 may detect the user's behavior using an acceleration sensor (not shown) attached to the user's arm or leg.

[0021] The attention level determination unit 170 determines the level of attention the user is paying to their surroundings. Here, the user's level of attention refers to the frequency with which the user performs an action of paying attention to their surroundings. Examples of actions of paying attention to their surroundings include the user removing the head-mounted display 10 and looking around, removing earphones, and turning down the volume of the earphones to listen to surrounding sounds. When the head-mounted display 10 is a see-through head-mounted display, an example of an action of paying attention to their surroundings may be the user moving their head left and right while wearing the head-mounted display to look around. For example, when an acceleration sensor built into the head-mounted display 10 detects that the head-mounted display 10 moves upward and then downward, the attention level determination unit 170 determines that the user has removed the head-mounted display 10 and is performing an action of paying attention to their surroundings. When the movement of the head-mounted display 10 indicates a reciprocating movement left and right, the attention level determination unit 170 may determine that the user is looking around and is performing an action of paying attention to their surroundings. Furthermore, when the information on the output volume of the information processing device 100 indicates that the volume has decreased, the attention level determination unit 170 determines that the user is paying attention to their surroundings by listening closely to surrounding sounds. The attention level determination unit 170 may determine that the user is paying attention to their surroundings when the user's behavior of paying attention to their surroundings is performed at a frequency equal to or greater than a predetermined threshold, for example, once every 20 seconds.

[0022] The level of attention is determined in multiple levels, such as 3 or 5. The level of attention is, for example, Level 1, which is the lowest level, when the subject does not take any actions such as removing the head-mounted display 10 and looking around, removing the earphones, or turning down the volume of the earphones to listen to surrounding sounds; Level 2, when the subject takes these actions but the frequency is less than a predetermined threshold, for example, once every 20 seconds; and Level 3, which is the highest level, when the subject takes these actions at a frequency equal to or greater than the predetermined threshold.

[0023] Next, an example of the flow of the notification method according to the present disclosure will be described with reference to Fig. 2. In the example shown in Fig. 2, the information processing device 100 notifies the user when people around the user are gazing at the user. In this case, the information processing device 100 includes at least a notification unit 110, an image acquisition unit 120, and an attention degree determination unit 130.

[0024] The image acquisition unit 120 acquires images of people around the user by capturing images of the user's surroundings (step S101). The attention degree determination unit 130 performs image recognition on the image acquired in step S101 and determines the attention degree of the people included in the image who are gazing at the user (step S102). If the attention degree is equal to or higher than a predetermined level (Yes in step S103), the notification unit 110 notifies the user of information including information on the attention degree (step S104). The predetermined level is, for example, level 2 when the attention degree is determined by dividing it into three levels. It is preferable that the setting of the predetermined level be changeable by the user. The predetermined level may be adjusted according to the user's current location information acquired by the current location acquisition unit 140, the type of the user's current location determined by the location type determination unit 150, the time period, etc.

[0025] Here, the notification including information regarding the degree of gaze refers to a notification including a message such as "There is someone looking at you" that notifies the user that people around the user are gazing at the user. The message included in the notification is notified to the user as, for example, text information or audio information. If the degree of gaze is below a predetermined level (No in step S103), the notification unit 110 does not issue a notification.

[0026] 3 shows another example of a notification method according to the present disclosure. In the example shown in FIG. 3, the information processing device 100 notifies the user when people around the user are gazing at the user and the user is in a public place. In this case, the information processing device 100 includes at least a notification unit 110, an image acquisition unit 120, a gaze degree determination unit 130, a current position acquisition unit 140, and a location type determination unit 150.

[0027] The image acquisition unit 120 acquires images of people around the user by capturing images of the user's surroundings (step S201). The attention degree determination unit 130 performs image recognition on the image acquired in step S201 and determines the attention degree of people included in the image who are gazing at the user (step S202). If the attention degree is equal to or greater than a predetermined level (step S203: Yes), the current position acquisition unit 140 acquires current position information of the user (step S204). The place type determination unit 150 determines whether the user's current position is a public place based on the current position information acquired in step S204 (step S205). If the user's current position is a public place (step S206: Yes), the notification unit 110 notifies the user including information about the attention degree (step S207).

[0028] The notification performed in step S207 may include information about the current location, or may include information about the gaze degree and information about the current location. Here, a notification including information about the current location is a notification including a statement that notifies the user that the user is in a public place, such as "This is a public place." If the gaze degree is below a predetermined level (No in step S203) or if the user's current location is not a public place (No in step S206), the notification unit 110 does not perform the notification.

[0029] 4 shows another example of a notification method according to the present disclosure. In the example shown in FIG. 4, the information processing device 100 notifies the user when people around the user are gazing at the user and the user is behaving unnaturally. In this case, the information processing device 100 includes at least a notification unit 110, an image acquisition unit 120, a gaze degree determination unit 130, and a behavior detection unit 160.

[0030] The image acquisition unit 120 acquires images of people around the user by capturing images of the user's surroundings (step S301). The attention degree determination unit 130 performs image recognition on the image acquired in step S301 and determines the attention degree of the people included in the image who are gazing at the user (step S302). If the attention degree is equal to or greater than a predetermined level (step S303: Yes), the behavior detection unit 160 detects the user's behavior (step S304). If the magnitude of the detected user's behavior is equal to or greater than a predetermined threshold (step S305: Yes), the notification unit 110 notifies the user with information related to the attention degree (step S306). If the attention degree is less than the predetermined level (step S303: No) or if the magnitude of the user's behavior is less than the predetermined threshold (step S305: No), the notification unit 110 does not notify.

[0031] 5 shows another example of a notification method according to the present disclosure. In the example shown in FIG. 5, the information processing device 100 notifies the user when the user is in a public place and exhibits unnatural behavior. In this case, the information processing device 100 includes at least a notification unit 110, a current position acquisition unit 140, a location type determination unit 150, and a behavior detection unit 160.

[0032] The current location acquisition unit 140 acquires current location information of the user (step S401). The place type determination unit 150 determines whether the user's current location is a public place based on the current location information acquired in step S401 (step S402). If the user's current location is a public place (step S403: Yes), the behavior detection unit 160 detects the user's behavior (step S404). If the magnitude of the detected user's behavior is equal to or greater than a predetermined threshold (step S405: Yes), the notification unit 110 notifies the user including information about the degree of attention (step S406). If the user's current location is not a public place (step S403: No) and the magnitude of the user's behavior is less than the predetermined threshold (step S405: No), the notification unit 110 does not notify.

[0033] Fig. 6 shows another example of a notification method according to the present disclosure. In the example shown in Fig. 6, the information processing device 100 notifies the user when the user is not paying attention to the surroundings and is in a public place. In this case, the information processing device 100 includes at least a notification unit 110, a current position acquisition unit 140, a place type determination unit 150, and an attention level determination unit 170.

[0034] The attention level determination unit 170 determines the level of attention the user is paying to their surroundings (step S501). If the level of attention is below a predetermined level (step S502: Yes), the current location acquisition unit 140 acquires the user's current location information (step S503). The place type determination unit 150 determines whether the user's current location is a public place based on the current location information acquired in step S503 (step S504). If the user's current location is a public place (step S505: Yes), the notification unit 110 notifies the user including information about the level of attention (step S506). Note that the predetermined level is, for example, level 2 when the level of attention is classified into three levels. It is preferable that the setting of the predetermined level be changeable by the user. The predetermined level may be adjusted according to the user's current location information acquired by the current location acquisition unit 140, the type of the user's current location determined by the place type determination unit 150, the time period, etc.

[0035] Here, the notification including information regarding the degree of caution is a notification including a message urging the user to pay attention to their surroundings, such as "Pay attention to your surroundings." If the degree of caution is equal to or higher than a predetermined level (No in step S502) or if the user's current location is not in a public place (No in step S505), the notification unit 110 does not issue a notification.

[0036] FIG. 7 illustrates another example of a notification method according to the present disclosure. In the example illustrated in FIG. 7, the information processing device 100 notifies the user when the user is not paying attention to the surroundings and people around the user are gazing at the user. In this case, the information processing device 100 includes at least a notification unit 110, an image acquisition unit 120, an attention level determination unit 130, and an attention level determination unit 170. The attention level determination unit 170 determines the level of attention the user is paying to the surroundings (step S601). If the level of attention is below a predetermined level (Yes in step S602), the image acquisition unit 120 acquires images of people around the user (step S603). The attention level determination unit 130 determines the level of attention the people included in the image acquired in step S603 are gazing at the user (step S604). If the degree of attention is equal to or greater than a predetermined level (Yes in step S605), the notification unit 110 notifies the user of the attention including information about the attention level (step S606). If the degree of attention is equal to or greater than a predetermined level (No in step S602) or if the degree of attention is less than a predetermined level (No in step S605), the notification unit 110 does not notify the user.

[0037] 8 shows another example of a notification method according to the present disclosure. In the example shown in FIG. 8, the information processing device 100 notifies the user when the user is not paying attention to the surroundings and exhibiting unnatural behavior. In this case, the information processing device 100 includes at least a notification unit 110, a behavior detection unit 160, and an attention level determination unit 170.

[0038] The attention level determination unit 170 determines the level of attention the user is paying to the surroundings (step S701). If the level of attention is below a predetermined level (step S702: Yes), the behavior detection unit 160 detects the user's behavior (step S703). If the magnitude of the detected user's behavior is equal to or greater than a predetermined threshold (step S704: Yes), the notification unit 110 notifies the user with information related to the level of attention (step S705). If the level of attention is equal to or greater than a predetermined level (step S702: No) and if the magnitude of the user's behavior is less than the predetermined threshold (step S704: No), the notification unit 110 does not notify.

[0039] In this way, the information processing device 100 can detect situations in which the user may feel embarrassed and notify the user.

[0040] The information processing device 100 includes a processor, a memory, and a storage device (not shown). The storage device stores a computer program that implements the processing of the notification method according to the present disclosure. The processor then loads the computer program from the storage device into the memory and executes the computer program. This allows the processor to realize the functions of each component included in the information processing device 100.

[0041] Alternatively, each component of the information processing device 100 may be realized by dedicated hardware. Furthermore, some or all of the components of each device may be realized by general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and programs. Furthermore, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), quantum processor (quantum computer control chip), etc., may be used as the processor.

[0042] Furthermore, when some or all of the components of the information processing device 100 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or distributed. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, or the like, in a form in which each is connected via a communication network. Furthermore, the functions of the information processing device 100 may be provided in a SaaS (Software as a Service) format.

[0043] <Embodiment 2> In the first embodiment, the case where the information processing device 100 is mounted on the head-mounted display 400 has been described, but the information processing device according to the present disclosure may be a device independent of the head-mounted display. In the second embodiment, a case where the information processing device 300 receives surrounding images, current location information, user behavior, etc. from the head-mounted display 400 and determines whether or not an alert is required will be described. FIG. 9 shows a configuration example of an alert system 200 according to the present disclosure. The alert system 200 includes an information processing device 300 and a head-mounted display 400. The information processing device 300 is a computer such as a server, a personal computer, a tablet terminal, or a smartphone. The information processing device 300 may be a dedicated device equipped with hardware. The information processing device 300 and the head-mounted display 400 are communicably connected via a network 500. The network 500 is a wired or wireless communication line or communication network, such as a LAN (Local Area Network), the Internet, or a wireless communication network.

[0044] The head mounted display 400 is worn on the user's head to provide the user with video and audio. As shown in FIG. 9 , the head mounted display 400 includes a camera 410, a microphone 420, an acceleration sensor 430, a current position detection unit 440, and a communication unit 450. The camera 410 is a camera that can capture images of the surroundings of the head mounted display 400. The microphone 420 is a microphone that picks up the voice of the user wearing the head mounted display 400. The acceleration sensor 430 is a sensor that detects the tilt of the head mounted display 400. The current position detection unit 440 detects information about the user's current position. The communication unit 450 is a communication means for communicating with the information processing device 300.

[0045] The information processing device 300 includes at least an alarm unit 310, and may also include one or more of an image acquisition unit 320, an attention level determination unit 330, a current position acquisition unit 340, a location type determination unit 350, a behavior detection unit 360, and an attention level determination unit 370.

[0046] When it is determined that the user is in a situation where he or she may feel embarrassed based on various data received from the head mounted display 400, the notification unit 310 transmits a notification instruction to the user to the head mounted display 400. The notification instruction may be an instruction including information such as a message to be notified to the user.

[0047] The image acquisition unit 320 acquires images of people around the user by acquiring video captured by the camera 410. The attention level determination unit 330 determines the level of attention that people around the user are paying to the user based on the images acquired by the image acquisition unit 320. The current location acquisition unit 340 acquires current location information of the user by acquiring current location information detected by the current location detection unit 440. The location type determination unit 350 determines whether the current location information acquired by the current location acquisition unit 340 indicates a public place. The behavior detection unit 360 detects the user's behavior based on information detected by at least one of the microphone 420 and the acceleration sensor 430, and video and audio information provided to the user from the head-mounted display 400. The attention level determination unit 170 determines the level of attention that the user is paying to their surroundings based on information about the user's body movement detected by the acceleration sensor 430 or information about the output volume of the head-mounted display 400.

[0048] The conditions for determining whether the situation is such that the user may feel embarrassed may be the same as the conditions described with reference to Figures 2 to 8. In this way, the notification system 200 can detect a situation in which the user may feel embarrassed and notify the user.

[0049] The present disclosure is not limited to the above-described embodiments and may be modified as appropriate without departing from the spirit and scope of the present disclosure. In the above-described embodiments, the invention according to the present disclosure is described as being applied to a head-mounted display. However, the invention according to the present disclosure can be applied to any situation in which a situation in which a user may feel embarrassed may occur. For example, the invention according to the present disclosure may be applied to a situation in which a user who is engrossed in an information device such as a smartphone or tablet behaves unnaturally and receives strange looks from people around them. Furthermore, the present disclosure may be implemented by appropriately combining the embodiments and examples thereof. [Explanation of symbols]

[0050] 100 Information processing device 110 Information Department 120 Image acquisition unit 130 gaze degree determination unit 140 Current position acquisition unit 150 Location type determination unit 160 Behavior detection unit 170 Attention Level Judgment Unit 200 Notification System 300 Information processing device 310 Information Department 320 Image Acquisition Unit 330 Gaze Degree Judgment Unit 340 Current position acquisition unit 350 Location type determination unit 360 Behavior Detection Unit 370 Attention Level Judgment Unit 10,400 Head-Mounted Display 410 Camera 420 Microphone 430 Accelerometer 440 Current location detection unit 450 Communications Department 500 Network

Claims

1. an attention level determination unit that determines the level of attention that a user is paying to their surroundings; a current location acquisition unit that acquires current location information of the user; a place type determination unit that determines whether the current location is a public place; a notification unit that, when the degree of caution is less than a predetermined level and the current location is in a public place, issues a notification including information regarding the degree of caution to the user; An information processing device comprising:

2. an attention level determination unit that determines the level of attention that a user is paying to their surroundings; an image acquisition unit that acquires images of people present around the user; a gaze degree determination unit that determines a gaze degree of the person gazing at the user; a notification unit that, when the degree of attention is less than a predetermined level and the degree of gaze is equal to or greater than a predetermined level, issues a notification including information regarding the degree of attention to the user; An information processing device comprising:

3. an attention level determination unit that determines the level of attention that a user is paying to their surroundings; a behavior detection unit that detects the user's behavior; a notification unit that, when the degree of caution is below a predetermined level and the magnitude of the behavior is equal to or greater than a predetermined threshold, issues a notification including information regarding the degree of caution to the user; An information processing device comprising:

Citation Information

Patent Citations

  • Processing device

    WO2020230892A1