Interactive display system for dogs, method of operation thereof, and interactive display device for dogs

Abstract

The interactive display system for dogs includes a display unit that displays images, a sensor unit that detects the state of the dog, and a control unit that determines at least one of whether the dog can approach, whether the image of the dog can be viewed, and the emotion of the dog based on the detection data of the sensor unit, and controls the operation of the system.

Description

[Technical field]

[0001] The present invention relates to an interactive display system for dogs, an operating method thereof, and an interactive display device for dogs, and more particularly to an interactive display system for dogs that determines at least one of whether a dog can approach, whether a dog can view an image, the dog's emotions, the dog's voice or movement, and health information, and controls the operation of a display device for dogs, an operating method thereof, and an interactive display device for dogs. [Background technology]

[0002] As the number of people raising companion dogs increases, public interest in companion dogs has increased, and display devices for dogs have been developed. Conventional display devices for dogs require the dog owner to directly select and unilaterally provide an image, which can cause the dog to lose interest in the image.

[0003] In addition, if the dog owner goes out or moves away from the display device while it is on, the video will continue to be played even if the dog does not look at it at all, and even if the dog has negative feelings due to the video, the video will continue to be played. Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present invention is to provide an interactive display system for dogs that determines at least one of whether the dog can approach, whether the dog can view an image, the dog's emotions, the dog's voice and movements, and health information, and controls the operation of a display device for dogs.

[0005] Another object of the present invention is to provide a method of operating said dog interactive display system. Another object of the present invention is to provide an interactive display device for dogs. [Means for solving the problem]

[0006] According to one embodiment of the present invention for achieving the object of the present invention, an interactive display system for dogs includes a display unit for displaying images, a sensor unit for detecting the state of the dog, and a control unit for determining at least one of whether the dog can approach, whether the dog can view an image, and the dog's emotions based on the detection data of the sensor unit, and controlling the operation of the system.

[0007] The control unit includes a dog body identification unit that identifies the dog body based on the sensing data. The sensor unit includes a camera that detects the dog's appearance, and the dog body identification unit identifies the dog's body based on at least one of the dog's color, the shape of the dog's eyes, nose, and mouth, and the position of the dog's eyes, nose, and mouth.

[0008] The control unit changes the content displayed on the display unit using the dog body. The dog body identification unit determines the breed and age of the dog. The control unit changes the content to be displayed on the display unit based on the breed and age of the dog.

[0009] The sensor unit includes a proximity sensor, and the control unit includes an approach possibility determination unit that determines whether or not the dog can approach based on data from the proximity sensor. The approach possibility determination unit determines that the dog has approached when the distance between the dog and the display unit is within a first distance for a first time or more, and determines that the dog has left when the distance between the dog and the display unit is outside a second distance that is greater than the first distance for a second time or more that is greater than the first time.

[0010] The sensor unit includes a camera, and the control unit further includes a viewing possibility determination unit that determines whether the dog is able to view the video based on data from the camera. The viewability determination unit sets a region of interest for the dog's eyes and performs eye tracking based on the region of interest.

[0011] The control unit further includes an emotion recognition unit that determines the emotion of the dog based on the data from the camera. The sensor further includes a microphone, and the emotion recognition unit determines the emotion of the dog based on the data from the camera and the data from the microphone.

[0012] The emotion recognition unit uses the dog's ear movements and facial muscle movements to determine the dog's positive and negative emotions. The emotion recognition unit determines the positive and negative emotions of the dog using the angles of the dog's eyes, nose, and mouth and the shape of the dog's eyes.

[0013] When the approachability determination unit determines that the dog is in a nearby location, the viewingability determination unit determines that the dog is viewing a video, and the emotion recognition unit determines that the dog has a positive emotion, the control unit controls the display unit to continue (automatically) playing a video (optimized to reflect the current real-time state of the dog).

[0014] The dog interactive display system of claim 15, characterized in that when the approachability determination unit determines that the dog is in a nearby location, the viewingability determination unit determines that the dog is watching a video, and the emotion recognition unit determines that the dog has a positive emotion, the control unit sends a notification message to a mobile device of the dog owner to notify the dog that the dog is watching a video with the positive emotion.

[0015] The emotion recognition unit determines the dog's level of fatigue based on the degree to which the dog's eyelids are closed and the degree to which the dog's mouth is open. When the approachability determination unit determines that the dog is in a nearby location, the viewingability determination unit determines that the dog is watching a video, and the emotion recognition unit determines that the dog's fatigue level is equal to or higher than a reference value, the control unit controls the display unit to turn off the power or change the content of the display unit.

[0016] When the approachability determination unit determines that the dog is in a nearby position and the emotion recognition unit determines that the dog has a negative emotion, the control unit displays a photo or video of the dog's owner on the display unit.

[0017] When the approachability determination unit determines that the dog is in a nearby position and the emotion recognition unit determines that the dog has a negative emotion, the control unit controls the display unit to change the content.

[0018] The dog interactive display system of claim 11, characterized in that when the approachability determination unit determines that the dog is in a nearby position and the emotion recognition unit determines that the dog has a negative emotion, the control unit sends a notification message to a mobile device of the dog owner to notify the dog that the dog has the negative emotion.

[0019] The display device further includes a memory for tagging and storing the emotion of the dog toward the content displayed on the display unit. When the approach possibility determination unit determines that the dog is in a nearby position and the viewing possibility determination unit determines that the dog is not viewing the video, the control unit controls the display unit to change the content.

[0020] When the approach possibility determination unit determines that the dog is not in a nearby position and the viewing possibility determination unit determines that the dog is not viewing the video, the control unit controls the power supply to be turned off for the display unit.

[0021] The display device further includes a memory for tagging and storing the dog's viewing / non-viewing of the content displayed on the display unit. When the approach possibility determination unit determines that the dog is in a nearby position while the power supply of the display unit is off, the control unit controls the power supply of the display unit to be turned on.

[0022] The sensor unit includes an impact sensor, and when an impact is detected by the impact sensor, the control unit transmits a notification message to notify the dog owner of the impact detection. The sensor unit includes a microphone, and when the control unit recognizes that a barking sound or a howling sound is repeated multiple times through the microphone, the control unit controls to play a whistle sound or play stabilized content.

[0023] The sensor unit includes a microphone, and when the control unit recognizes that a barking or howling sound has been repeated multiple times through the microphone, it transmits a sound generation notification message to the dog owner's mobile device.

[0024] The display unit and the sensor unit are included in a display device, the sensor unit is a built-in sensor of the display device, and the sensor unit includes a camera, a proximity sensor, and a microphone. The display unit is included in a display device, and the sensor unit is an external sensor disposed outside the display device.

[0025] The external sensor is located within at least one of a laptop, a personal computer, an Internet television, and a closed circuit camera system. In one embodiment of the present invention to achieve another object of the present invention, an operating method of an interactive display system for dogs includes the steps of displaying an image, sensing the state of the dog, and determining at least one of whether the dog can approach, whether the dog can view an image, and the dog's emotions based on the sensing data of the sensor unit, and controlling the operation of the system.

[0026] According to one embodiment of the present invention for achieving another object, an interactive display device for dogs includes a display unit, a sensor unit, and a control unit that determines at least one of whether a dog can approach, whether the dog can watch a video, and the dog's emotions based on sensing data from the sensor unit, and controls the operation of the display unit. Effect of the Invention

[0027] According to such an interactive display system for dogs, its operating method, and interactive display device for dogs, the operation of the display system can be controlled based on whether or not the dog approaches the display unit. Also, the operation of the display system can be controlled based on whether or not the dog can view an image on the display unit. Also, the operation of the display system can be controlled based on the dog's emotional changes in response to the displayed image.

[0028] In addition, the operation of the display system is controlled based on whether the dog is approaching, whether the dog is viewing the video, the dog's emotions, etc., thereby increasing the dog's immersion and reducing the power consumption of the display system. In addition, based on whether the dog can approach, whether the image of the dog can be viewed, the emotion of the dog, the sound of the dog barking, etc., a notification is sent to the mobile device of the dog owner, enabling remote control of the dog owner based on the notification.

[0029] It is also possible to identify the dog's body and provide customized content that matches the dog's body. In addition, the dog's viewing / non-viewing of the content displayed on the display unit and the dog's emotions can be stored in memory and used for content recommendations, etc. [Brief description of the drawings]

[0030] [Figure 1] FIG. 2 is a diagram showing an example in which an interactive display device for dogs according to an embodiment of the present invention is used. [Diagram 2] FIG. 1 is a block diagram illustrating an interactive display system for dogs according to one embodiment of the present invention. [Diagram 3] FIG. 3 is a block diagram showing the dog display device of FIG. 2. [Figure 4] FIG. 3 is a block diagram showing a control device shown in FIG. 2. [Diagram 5] 5 is a conceptual diagram showing the operation of the dog body identifying unit in FIG. 4. [Figure 6] FIG. 3 is a block diagram showing an external sensor of FIG. 2. [Figure 7] 3 is a table showing exemplary operations of the dog interactive display system of FIG. 2. [Figure 8] 3 is a flowchart illustrating an example of an operational sequence of the dog interactive display system of FIG. 2. [Figure 9] 1 is a block diagram illustrating an interactive display device for dogs according to one embodiment of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0031] With respect to the embodiments of the present invention set forth herein, specific structural or functional descriptions are merely exemplary for purposes of describing the embodiments of the present invention, and the example embodiments of the present invention may be embodied in various forms and should not be construed as being limited to the embodiments set forth herein.

[0032] The present invention can be modified in various ways and can have various forms, and specific embodiments are shown by way of example in the drawings and will be described in detail herein, but it is to be understood that this is not intended to limit the invention to the specific disclosed forms, but rather to include all modifications, equivalents, and alternatives falling within the spirit and technical scope of the present invention.

[0033] Terms such as "first" and "second" are used to describe various components, but the components should not be limited by the terms. The terms are used only to distinguish one component from another. For example, a first component can be referred to as a second component, and similarly, a second component can be referred to as a first component, without departing from the scope of the present invention.

[0034] When an element is said to be "coupled" or "connected" to another element, it should be understood that it may be directly coupled or connected to the other element, but there may also be other elements in between. On the other hand, when an element is said to be "directly coupled" or "directly connected" to another element, it should be understood that there are no other elements in between. Other expressions describing the relationship between elements, such as "between" and "immediately between," or "adjacent to" and "directly adjacent to," should be interpreted similarly.

[0035] The terms used in this application are merely used to describe certain embodiments and are not intended to limit the present invention. A singular expression includes a plural expression unless the context clearly indicates otherwise. In this application, the terms "include" or "have" are intended to specify the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, and should be understood not to preclude the presence or additional possibility of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0036] Unless otherwise defined, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which this invention pertains. Terms as defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning they have in the context of the relevant art, and not as being idealized or overly formal, unless expressly defined in this application.

[0037] However, when an embodiment is implemented differently, the functions or acts noted in a particular block may occur out of the order noted in the flowchart. For example, two consecutive blocks may in fact be performed substantially simultaneously, or the blocks may be performed in reverse, depending on the functions or acts involved.

[0038] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The same reference numerals are used to refer to the same components in the drawings, and duplicated explanations will be omitted. FIG. 1 is a diagram showing an example in which an interactive display device 100 for a dog according to an embodiment of the present invention is used.

[0039] As shown in Fig. 1, the interactive display device for dogs 100 is a display device used by dogs and is installed at a position (or height) that is easy for dogs to see. For example, the interactive display device for dogs 100 displays images based on image data that takes into account the visual characteristics of dogs. The interactive display device for dogs 100 displays images based on image data that takes into account the visual characteristics of dogs, thereby improving the dog's concentration on the images.

[0040] For example, the dog interactive display device 100 performs at least one of color correction, contrast correction, gamma correction, edge correction, brightness correction, and driving frequency conversion on the input image data to suit the visual characteristics of a dog.

[0041] For example, the dog interactive display device 100 receives the input image data, performs the color correction, and outputs the output image data. Dogs distinguish colors by a combination of blue and yellow (dogs recognize red and green as yellow), and the closer to ultraviolet light the easier it is to distinguish colors. That is, dogs distinguish colors in the blue series more easily than humans. Therefore, the interactive display device for dogs 100 generates output image data in which the proportion of blue is increased among red, green, and blue compared to the input image data.

[0042] In addition, the interactive display device for dogs 100 performs contrast correction, gamma correction, edge correction, driving frequency conversion, etc. of the input image data (IMG) to match the visual characteristics of dogs, thereby increasing the immersiveness of the dog watching the image.

[0043] FIG. 2 is a block diagram illustrating an interactive display system for dogs according to one embodiment of the present invention. 1 and 2, the dog interactive display system includes the dog interactive display device 100. The dog interactive display system includes the dog display device 100, a control device 200, an external sensor 300, and a memory 400. The dog interactive display system further includes a mobile device 500 carried by the dog owner.

[0044] The control device 200 transmits a notification message to the mobile device 500 of the dog owner, and the dog owner can remotely control the dog interactive display system using the mobile device 500. For example, the mobile device 500 can perform a video call function using the display unit 110.

[0045] In this specification, the terms control device and control unit can be used interchangeably. The term sensor unit in this specification refers to a built-in sensor disposed in the dog display device 100 or an external sensor 300 disposed outside the dog display device 100.

[0046] Fig. 3 is a block diagram showing the dog display device 100 of Fig. 2. Fig. 4 is a block diagram showing the control device 200 of Fig. 2. Fig. 5 is a conceptual diagram showing the operation of the dog body identification unit 210 of Fig. 4. Fig. 6 is a block diagram showing the external sensor 300 of Fig. 2.

[0047] As shown in Figures 1 to 6, the dog interactive display system includes a display unit 110 that displays images, sensor units 120, 130, 140, and 150 that detect the state of the dog, and a control unit 200 that determines at least one of whether the dog can approach, whether the dog can view an image, and the dog's emotions based on the detection data of the sensor units 120, 130, 140, and 150, and controls the operation of the system.

[0048] The sensor unit includes a camera 120, a proximity sensor 130, and a microphone 140. The sensor unit further includes an impact sensor 150. The control unit 200 includes a dog body identification unit 210 for identifying the dog body based on the sensing data.

[0049] The dog body identification unit 210 determines the color of the dog, the shape of the dog's eyes, nose, and mouth, and the position of the dog's eyes, nose, and mouth using the data sensed by the camera 120, and the dog body identification unit 210 can identify the dog body based on at least one of the color of the dog, the shape of the dog's eyes, nose, and mouth, and the position of the dog's eyes, nose, and mouth.

[0050] 4, the dog body identification unit 210 can identify the dog body based on the position and shape of the dog's eyes, nose, and mouth, etc., detected by the camera 120. For example, the dog body identification unit 210 can also identify the dog body based on the dog's nose print detected by the camera 120.

[0051] For example, the dog body identification unit 210 can identify the dog body using artificial intelligence algorithms such as machine learning and deep learning. That is, based on an image of a dog, dog breed information, age information, sex information, etc. are learned, and when a dog is recognized by the camera 120, the dog body identification unit 210 can automatically identify the dog body information of the dog.

[0052] Assuming there are two dogs (dog 1 and dog 2) using the dog interactive display system, the dog body identification unit 210 can determine whether the dog recognized by the camera 120 of the dog display device 100 is dog 1 or dog 2 based on at least one of the dog's color, the shape of the dog's eyes, nose, and mouth, and the position of the dog's eyes, nose, and mouth.

[0053] The control unit 200 can change the content displayed on the display unit 110 according to the dog body. That is, when the dog identified by the dog body identification unit 210 is dog 1, the control unit 200 displays the content that dog 1 likes on the display unit 110. When the dog identified by the dog body identification unit 210 is dog 2, the control unit 200 displays the content that dog 2 likes on the display unit 110.

[0054] The dog body identification unit 210 can also determine the breed and age of the dog. The control unit 200 can change the content displayed on the display unit 110 based on the breed and age of the dog.

[0055] For example, if the dog identified by the dog body identification unit 210 is not a dog stored in the database, the dog body identification unit 210 provides customized content based on the breed and age of the dog.

[0056] The control unit 200 further includes an approach possibility determination unit 220 that determines whether the dog is approachable or not based on data from the proximity sensor 130 . For example, the approach possibility determination unit determines that the dog has approached when the distance between the dog and the display unit is within a first distance for a first time or more, and determines that the dog has left when the distance between the dog and the display unit is outside a second distance that is greater than the first distance for a second time or more that is greater than the first time. Here, for example, the first distance is 50 cm, and the second distance is 1 m. Also, the first time is 5 minutes, and the second time is 20 minutes. That is, the conditions for determining the leaving state can be managed more strictly than the conditions for determining the approaching state. When the dog is determined to be in the leaving state, the power supply of the display unit 110 is turned off, and the power consumption of the dog display device 100 can be reduced.

[0057] The control unit 200 further includes a viewability determining unit 230 for determining whether the dog can view the video based on data from the camera 120 . The viewing possibility determination unit 230 detects the position of the dog's eyes (eye detection), sets a region of interest (ROI) for the dog's eyes, and performs eye tracking based on the ROI. The viewing possibility determination unit 230 determines whether the dog is concentrating on the video by determining the dog's visual attention allocation, gaze position, gaze movement, etc. through the eye tracking technology.

[0058] For example, the viewability determining unit 230 may determine whether the video is viewable by using an artificial intelligence algorithm such as machine learning or deep learning. That is, the viewability determining unit 230 may learn a viewing immersion state based on a still image or a video of a dog, and when a dog is recognized by the camera 120, the viewability determining unit 230 may automatically identify the viewing immersion state information.

[0059] The control unit 200 further includes an emotion recognition unit 240 that determines the emotion of the dog based on the data of the camera 120. Alternatively, the emotion recognition unit 240 may determine the emotion of the dog based on the data of the camera 120 and the data of the microphone 140.

[0060] For example, the emotion recognition unit 240 uses the dog's ear movements and facial muscle movements to determine the dog's positive and negative emotions. For example, the emotion recognition unit 240 may determine the positive or negative emotion of the dog using the angle of the dog's eyes, nose, and mouth and the shape of the dog's eyes.

[0061] The emotion recognition unit 240 judges the dog's fatigue level based on the degree to which the dog's eyelids are closed and the degree to which the dog's mouth is open. The emotion recognition unit 240 judges that the dog's fatigue level is high when the dog's eyelids are closed to a large extent. The emotion recognition unit 240 judges that the dog is yawning when the dog's mouth is opened to a large extent, and judges that the dog's fatigue level is high when the dog yawns frequently.

[0062] For example, the emotion recognition unit 240 can use artificial intelligence algorithms such as machine learning and deep learning to determine the dog's positive emotion, negative emotion, tiredness level, etc. In other words, the emotion recognition unit 240 learns the dog's emotional state based on still images or videos of the dog, and when the dog is recognized by the camera 120, the emotion recognition unit 240 automatically identifies the emotional state information.

[0063] In one embodiment of the present invention, the display unit 110 and the sensor units 120, 130, 140, and 150 are included in a display device. The sensor units 120, 130, 140, and 150 are built-in sensors of the display device 100 for dogs.

[0064] Differently from this, the sensor unit is an external sensor 300 disposed outside the dog display device 100. In Fig. 6, the external sensor 300 is shown to include a photographing device 310 and a recording device 320. The external sensor 300 includes the camera, a proximity sensor, and a microphone. The external sensor 300 is disposed in at least one of a notebook computer, a personal computer, an Internet TV, and a closed circuit camera system.

[0065] The dog interactive display system can operate using internal sensors of the dog display device 100 and external sensors including various electronic devices (such as a notebook computer, a personal computer, an Internet television, a closed circuit camera system, etc.) disposed outside the dog display device 100.

[0066] FIG. 7 is a table showing an example of the operation of the dog interactive display system of FIG. As shown in Figures 1 to 7, for example, when the approachability determination unit 220 determines that the dog is in a nearby position, the viewability determination unit 230 determines that the dog is viewing a video, and the emotion recognition unit 240 determines that the dog has a positive emotion (C1), the control unit 200 can control the display unit 110 to continue playing the video.

[0067] In addition, when the approachability determination unit 220 determines that the dog is in a nearby location, the viewingability determination unit 230 determines that the dog is watching a video, and the emotion recognition unit 240 determines that the dog has a positive emotion (C1), the control unit 200 transmits a notification message to the dog owner's mobile device 500 to notify that the dog is watching a video with the positive emotion.

[0068] For example, when the approachability determination unit 220 determines that the dog is in a nearby location, the viewingability determination unit 230 determines that the dog is watching a video, and the emotion recognition unit 240 determines that the dog's fatigue level is equal to or greater than a reference value (C2), the control unit 200 controls the display unit 110 to power off or change the content of the display unit 110.

[0069] For example, when the approachability determination unit 220 determines that the dog is in a nearby position and the emotion recognition unit 240 determines that the dog is sleeping, the control unit 200 controls the power of the display unit 110 to be turned off.

[0070] For example, when the approachability determination unit 220 determines that the dog is in a nearby position and the emotion recognition unit 240 determines that the dog has a negative emotion (C3), the control unit 200 displays a photo or video of the dog's owner on the display unit 110 to stabilize the emotion of the dog. For example, the photo or video of the dog's owner is stored in the memory 400.

[0071] For example, if the approachability determination unit 220 determines that the dog is in a nearby position and the emotion recognition unit 240 determines that the dog has a negative emotion (C3), the control unit 200 controls the display unit 110 to change the content in order to stabilize the emotion of the dog. In this case, the content can be changed to an image that the dog likes, an image of a treat, or the like. For example, the image that the dog likes is stored in the memory 400.

[0072] Furthermore, when the approach possibility determination unit 220 determines that the dog is in a nearby position and the emotion recognition unit 240 determines that the dog has a negative emotion (C3), the control unit 200 transmits a notification message to the mobile device 500 of the dog owner to notify that the dog has the negative emotion.

[0073] The memory 400 stores the dog's viewing / non-viewing of the content displayed on the display unit 110 by tagging the content. This makes it possible to know the content that the dog was engrossed in viewing, and to infer that the content that the dog was engrossed in viewing is the content that the dog likes.

[0074] The memory 400 tags and stores the dog's emotion for the content displayed on the display unit 110. This makes it possible to know the content for which the dog expressed a positive emotion, and to infer that the content for which the dog expressed a positive emotion is the content that the dog likes.

[0075] The content that is inferred to be a favorite content of dogs is used as recommended content for the corresponding dog or dog breed, or as stabilization content. When the approach possibility determination unit 220 determines that the dog is in a nearby position and the view possibility determination unit 230 determines that the dog is not viewing the video (C4), the control unit 200 controls the content of the display unit 110 to be changed.

[0076] When the approach possibility determination unit 220 determines that the dog is not in the vicinity and the view possibility determination unit 230 determines that the dog is not viewing the video (C5), the control unit 200 controls to turn off the power supply of the display unit 110. Thus, the power consumption of the display device can be reduced.

[0077] When the approach possibility determination unit 220 determines that the dog is in a nearby position (C6) while the power supply of the display unit 110 is off, the control unit 200 can control to turn on the power supply of the display unit 110. When the power supply of the display unit 110 is automatically turned on, the control unit 200 can transfer a notification message to the mobile device 500 of the dog owner to notify that the power supply of the display unit 110 has been automatically turned on.

[0078] Furthermore, when an impact is detected by the impact sensor 150 (C7), the control unit 200 can transmit a notification message to notify the dog owner of the impact detection, thereby inducing an action by the dog owner.

[0079] For example, when the control unit 200 recognizes that a barking sound or a howling sound is repeated multiple times through the microphone 140 (C8), the control unit 200 can control to play a whistle sound or to play stabilized content.

[0080] Here, the stabilization content is healing music. Alternatively, the stabilization content may be a photo or video of the dog's owner. Alternatively, the stabilization content may be content that the dog is engrossed in viewing or content in which the dog expresses positive emotions.

[0081] In addition, when the control unit 200 recognizes that the barking sound or howling sound is repeated multiple times through the microphone 140 (C8), it can also transmit a sound generation notification message to the mobile device 500 of the dog owner.

[0082] FIG. 8 is a flow chart illustrating an example of an operational sequence of the dog interactive display system of FIG. As shown in Figures 1 to 8, the data processing flow of the dog interactive display system includes a step of identifying a dog's body based on basic data (dog body identification unit 210), a step of determining whether the dog can watch a video using eye detection and eye tracking technology (viewing ability determination unit 230), and a step of recognizing emotions by analyzing the facial expressions and behaviors of the dog watching the video (emotion recognition unit 240). Here, the basic data includes a profile image for each dog's body, reference data for the emotional state for each dog's body, etc. The basic data is used in the dog body identification step, viewing ability determination step, emotion recognition step, etc.

[0083] The data processing flow of the dog interactive display system performs a preference analysis on the dog's body based on the video viewing ability and the emotion recognition.

[0084] The control unit 200 receives content from a content platform provided by a content production company, and performs a content recommendation operation corresponding to the preference analysis result. The control unit 200 also updates the basic data based on the preference analysis result.

[0085] In addition, the control unit 200 can transmit the preference analysis result to the content platform to provide customization information for the content to be received thereafter.

[0086] The content platform can continuously recommend and provide content appropriate for each dog's body type (by breed and age) using the results of the dog body preference analysis. In the operation flow of the dog interactive display system, the dog approach information and voice information are collected through the proximity sensor 130 and the microphone 140.

[0087] When it is determined that the dog is close to the display unit 110 through the approach information and the voice information, the display unit 110 and the camera 120 of the dog display device 100 can be automatically turned on. In this case, the proximity sensor 130 and the microphone 140 are turned on in advance, but the present invention is not limited thereto, and the approach information and the voice information can also be determined through the external sensor 300.

[0088] When the camera 120 of the dog display device 100 is turned on, operations such as dog body identification, gaze detection, eye tracking, and emotion recognition are performed. Contents corresponding to the results of the dog body preference analysis are played by the dog display device 100 (Contents Streaming). As shown in FIG. 7, the contents include contents that attract the dog's interest, dog owner photos, dog owner videos, contents for stabilizing the dog, training whistle sounds, healing music, etc. The contents do not have to be videos specially prepared for dogs, but may be general TV videos or YouTube videos.

[0089] In the device operation flow of the dog interactive display system, the control unit 200 transmits various notification messages notifying the dog's condition to the dog owner's mobile device 500 as shown in Fig. 7. The dog owner can control the operation of the device for the corresponding situation through the mobile device 500.

[0090] In addition, the control unit 200 can transmit an analysis report on the displayed content and the dog's behavior, state, emotions, etc., to the mobile device 500 of the dog owner. According to this embodiment, the operation of the display system is controlled depending on whether or not the dog approaches the display unit 110. Also, the operation of the display system is controlled depending on whether or not the dog can view an image on the display unit 110. Also, the operation of the display system can be controlled depending on the emotional change of the dog in response to the displayed image.

[0091] In addition, the operation of the display system is controlled based on whether the dog is approaching, whether the dog is viewing the video, the dog's emotions, etc., thereby increasing the dog's immersion and reducing the power consumption of the display system. In addition, based on whether the dog can approach, whether the dog's video can be viewed, the dog's emotions, the sound of the dog's barking, etc., a notification is sent to the dog owner's mobile device 500, enabling the dog owner to remotely control the dog based on the notification.

[0092] It is also possible to identify the dog's body and provide customized content that matches the dog's body. In addition, the dog's viewing / non-viewing of the content displayed on the display unit 110 and the dog's feelings can be stored in a memory and used for content recommendations, etc.

[0093] FIG. 9 is a block diagram illustrating an interactive display device 100A for dogs according to one embodiment of the present invention. In this embodiment, the display unit 110, the sensor units 120, 130, 140, 150, the control unit 160, and the memory 170 are disposed within the dog display device 100A.

[0094] As shown in FIG. 9, the dog interactive display device 100A includes a display unit 110, sensor units 120, 130, 140, and 150, a control unit 160, and a memory 170.

[0095] The control unit 160 can determine at least one of whether a dog is approaching, whether a video of the dog is viewable, and the emotion of the dog based on the sensing data of the sensor units 120, 130, 140, and 150, and control the operation of the display unit 110.

[0096] 9 is substantially the same as the operation of the control device 200 in FIG. 2, and the operation of the memory 170 in FIG. 9 is similar to the operation of the memory 400 in FIG. [Industrial Applicability]

[0097] The present invention is applicable to a display device for dogs and electronic devices including the same. For example, the present invention is applicable to TVs, digital TVs, 3DTVs, monitors, mobile phones, smartphones, tablet computers, VR devices, PCs, home electronic devices, notebook computers, PDAs, PMPs, digital cameras, music players, portable game consoles, navigation systems, sensors, and wearable sensor lights.

[0098] Although the present invention has been described with reference to the embodiments, those skilled in the art will understand that various modifications and variations can be made to the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. [Explanation of symbols]

[0099] 100, 100A: Dog display device 110:Display section 120: Camera 130: Proximity sensor 140: Microphone 150: Impact sensor 160: Control unit 170:Memory 200: Control device 210: Dog body identification department 220: Accessibility judgment unit 230: Viewing availability determination unit 240: Emotion recognition section 300: External sensor 310: Imaging equipment 320: Recording device 400:Memory 500: Mobile devices

Claims

1. A display unit for displaying an image; A sensor unit that detects the state of the dog; and a control unit that determines at least one of whether the dog can approach, whether the dog can watch a video, and the dog's emotions based on the sensing data of the sensor unit, and controls the operation of the system.

2. The interactive display system for dogs according to claim 1 , wherein the control unit includes a dog body identification unit that identifies the dog body based on the sensing data.

3. The sensor unit includes a camera that detects the appearance of the dog, The dog interactive display system of claim 2, characterized in that the dog body identification unit identifies the dog body based on at least one of the color of the dog, the shape of the dog's eyes, nose, and mouth, and the position of the dog's eyes, nose, and mouth.

4. 4. The dog interactive display system according to claim 3, wherein the control unit changes the content displayed on the display unit according to the dog body.

5. 4. The dog interactive display system according to claim 3, wherein the dog body identification unit determines the breed and age of the dog.

6. 6. The dog interactive display system according to claim 5, wherein the control unit changes the content displayed on the display unit based on the breed and age of the dog.

7. the sensor unit includes a proximity sensor, 2. The dog interactive display system according to claim 1, wherein the control unit includes an approach possibility determination unit that determines whether the dog can approach based on data from the proximity sensor.

8. The dog interactive display system of claim 7, characterized in that the approach possibility determination unit determines that the dog has approached when the distance between the dog and the display unit is within a first distance for a first time or more, and determines that the dog has left when the distance between the dog and the display unit is outside a second distance that is greater than the first distance for a second time or more that is greater than the first time.

9. The sensor unit includes a camera.

8. The dog interactive display system according to claim 7, wherein the control unit further includes a viewing possibility determination unit that determines whether the dog can view the video based on the data from the camera.

10. The interactive display system for dogs according to claim 9 , wherein the viewability determining unit sets an area of ​​interest for the dog's eyes and performs eye tracking based on the area of ​​interest.

11. The dog interactive display system according to claim 9 , wherein the control unit further comprises an emotion recognition unit that determines the emotion of the dog based on the data from the camera.

12. The sensor further includes a microphone; The dog interactive display system according to claim 11, wherein the emotion recognition unit determines the emotion of the dog based on the data from the camera and the data from the microphone.

13. The dog interactive display system according to claim 11, wherein the emotion recognition unit determines the positive and negative emotions of the dog using ear movements and facial muscle movements of the dog.

14. The interactive display system for dogs according to claim 11, wherein the emotion recognition unit determines the positive and negative emotions of the dog using the angles of the dog's eyes, nose, and mouth and the shape of the dog's eyes.

15. The dog interactive display system of claim 11, characterized in that when the approachability determination unit determines that the dog is in a nearby position, the viewingability determination unit determines that the dog is viewing a video, and the emotion recognition unit determines that the dog has a positive emotion, the control unit controls the display unit to continue playing the video.

16. The dog interactive display system of claim 15, characterized in that when the approachability determination unit determines that the dog is in a nearby location, the viewingability determination unit determines that the dog is watching a video, and the emotion recognition unit determines that the dog has a positive emotion, the control unit sends a notification message to the dog owner's mobile device to notify the dog that the dog is watching the video with the positive emotion.

17. 12. The dog interactive display system according to claim 11, wherein the emotion recognition unit determines the degree of fatigue of the dog based on the degree to which the dog's eyelids are closed and the degree to which the dog's mouth is open.

18. The interactive display system for dogs as described in claim 11, characterized in that when the approachability determination unit determines that the dog is in a nearby position, the viewingability determination unit determines that the dog is watching a video, and the emotion recognition unit determines that the dog's fatigue level is above a reference value, the control unit controls the display unit to turn off the power or change the content of the display unit.

19. The dog interactive display system of claim 11, characterized in that when the approachability determination unit determines that the dog is in a nearby position and the emotion recognition unit determines that the dog has a negative emotion, the control unit displays a photo or video of the dog's owner on the display unit.

20. The dog interactive display system of claim 11, wherein when the approachability determination unit determines that the dog is in a nearby position and the emotion recognition unit determines that the dog has a negative emotion, the control unit controls the content of the display unit to be changed.

21. The dog interactive display system of claim 11, characterized in that when the approachability determination unit determines that the dog is in a nearby position and the emotion recognition unit determines that the dog has a negative emotion, the control unit sends a notification message to a mobile device of the dog owner to notify the dog owner that the dog has the negative emotion.

22. The dog interactive display system according to claim 11, further comprising a memory for tagging and storing the dog's emotion with respect to the content displayed on the display unit.

23. The dog interactive display system of claim 9, characterized in that when the approachability determination unit determines that the dog is in a nearby position and the viewingability determination unit determines that the dog is not viewing the video, the control unit controls the content of the display unit to be changed.

24. The dog interactive display system of claim 9, characterized in that when the approachability determination unit determines that the dog is not in a close vicinity and the viewingability determination unit determines that the dog is not viewing the video, the control unit controls the power to the display unit to be turned off.

25. The dog interactive display system according to claim 9, further comprising a memory for tagging and storing the dog's viewing / non-viewing of the content displayed on the display unit.

26. The dog interactive display system of claim 5, characterized in that when the display unit is powered off and the approachability determination unit determines that the dog is in a nearby position, the control unit controls the power of the display unit to be turned on.

27. The sensor unit includes an impact sensor, 2. The dog interactive display system according to claim 1, wherein the control unit transmits a notification message to notify the dog owner of the impact detection when the impact is detected by the impact detection sensor.

28. The sensor unit includes a microphone. The interactive display system for dogs according to claim 1, wherein the control unit controls the playback of a whistle sound or stabilized content when the control unit recognizes that a barking sound or a howling sound is repeated multiple times through the microphone.

29. The sensor unit includes a microphone. The interactive display system for dogs according to claim 1, characterized in that when the control unit recognizes that a barking or howling sound is repeated multiple times by the microphone, it sends a sound generation notification message to the dog owner's mobile device.

30. the display unit and the sensor unit are included in a display device, the sensor unit is a built-in sensor of the display device, 2. The dog interactive display system according to claim 1, wherein the sensor unit includes a camera, a proximity sensor, and a microphone.

31. The display unit is included in a display device, 2. The dog interactive display system according to claim 1, wherein the sensor unit is an external sensor disposed outside the display device.

32. 32. The dog interactive display system of claim 31, wherein the external sensor is located within at least one of a laptop, a personal computer, an Internet television, and a closed circuit camera system.

33. displaying the video; Sensing the state of the dog; and determining at least one of whether the dog can approach, whether the dog can view an image, and the dog's emotions based on the sensing data from the sensor unit, and controlling the operation of the system.

34. A display unit; A sensor unit; and a control unit that determines at least one of whether a dog can approach, whether the dog can watch a video, and the dog's emotions based on the sensing data of the sensor unit, and controls the operation of the display unit.

Images