Smart TV supporting emergency rescue and operation method thereof

Abstract

A smart TV according to an embodiment comprises: a display; an input interface for receiving, from a remote controller, a button input designated for a rescue request; a camera and a microphone for acquiring an image and voice of a user; a communication unit for communicating with the outside through a network; and a processor connected to the display, the input interface, the camera, the microphone, and the communication unit. The processor may: acquire situational information about a user by controlling the camera and the microphone when a designated button input is received from the remote controller; determine whether there is an emergency situation on the basis of the situational information; automatically connect to a rescue organization when it is determined that there is an emergency situation; send a video call to a registered external electronic device; and transmit a help request message to the registered external electronic device when it is determined that the situation is normal.

Description

Smart TV supporting emergency rescue and its operation method

[0001] This specification relates to a smart TV that supports emergency rescue and a method of operation thereof. More specifically, this specification relates to a smart TV that recognizes whether an emergency situation exists through the input of a specific button on a remote control and, when an emergency situation is determined, automatically connects to a rescue organization and a registered account, and a method of operation thereof.

[0002]

[0003] Emergency situations, such as sudden falls or difficulty breathing, can occur in the elderly or infirm. Existing emergency rescue systems have often relied on wearable devices, fall detection sensors, and CCTV-based surveillance devices; however, there was a problem in that they could not detect emergencies in spaces where the user was not wearing the device or where sensors were not installed. Voice-calling-based systems had limitations in that rescue requests could not be smoothly executed in the presence of ambient noise or when the user was unable to speak.

[0004]

[0005] Technology is required that allows users to easily make rescue requests without wearing separate equipment or complex operations, more accurately determine whether a situation is an emergency, and immediately connect with rescue agencies and guardians.

[0006] To this end, a smart TV supporting emergency rescue and a method of operation thereof, according to one embodiment, aim to provide a technology that allows a user to input a rescue request with simple operation via a remote control, recognizes whether an emergency situation exists through a camera and microphone, and performs automatic reporting to a rescue agency and a guardian account and video call in the event of an emergency.

[0007] A smart TV that supports emergency rescue and a method of operation thereof, according to one embodiment, transmit a request for help based on the user's condition even when there is no emergency situation, and enable a guardian to provide help remotely.

[0008] The technical problems to be solved in this specification are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below.

[0009]

[0010] According to one embodiment of the present specification, a smart TV comprises a display, an input interface for receiving a button input designated for a rescue request from a remote control, a camera and a microphone for acquiring video and voice of a user, a communication unit for communicating with the outside through a network, and a processor connected to the display, the input interface, the camera, the microphone, and the communication unit.

[0011] When the processor receives a designated button input from the remote control, it controls the camera and the microphone to obtain user situation information, determines whether there is an emergency situation based on the situation information, and if it is determined to be an emergency situation, automatically connects to a rescue agency and sends a video call to a registered external electronic device, and if it is determined to be a normal situation, it can send a help request message to the registered external electronic device.

[0012] According to one embodiment, the processor identifies whether a signal is input through the button for a specified amount of time or longer, or whether a signal is input continuously for a specified number of times or longer, and can recognize that the button input is received by means of the identification.

[0013] According to one embodiment, the processor can determine whether there is an emergency situation by analyzing image information including a user's facial expression, posture, and whether movement has stopped, obtained through the camera, and voice information including voice tone and voice frequency, obtained through the microphone.

[0014] According to one embodiment, the processor can transmit a photo or video captured by the camera to the registered external electronic device when it is determined to be an emergency situation.

[0015] According to one embodiment, the processor can analyze the situation based on a photo or video captured by the camera when it is determined to be an emergency situation, and transmit the result of the situation analysis along with the photo or video to the registered external electronic device.

[0016] According to one embodiment, if the registered external electronic device does not exist, the processor can transmit the photo or video and the situation analysis result to a rescue agency as the recipient and send the video call to the rescue agency.

[0017] According to one embodiment, the processor may conduct a video call with the first registered external electronic device that receives the call when an emergency occurs, and at the end of the video call, summarize the call content and transmit it to another registered external electronic device that did not receive the call.

[0018] According to one embodiment, the processor may conduct a multi-party video call when a plurality of registered external electronic devices sequentially receive a video call, and may summarize the content of the video call prior to the subsequent registered external electronic device participating in the video call and provide it to the subsequent registered external electronic device.

[0019] According to one embodiment, if the processor receives a request for on-site verification from the registered external electronic device when there is prior consent from the user, it can transmit the image captured by the camera to the registered external electronic device in real time.

[0020] According to one embodiment, when the processor determines that the situation is normal, it can check the usage history of the smart TV and the status of currently running applications to estimate the user's situation and transmit a help request message including the estimated result.

[0021] According to one embodiment, the processor may provide assistance to a user in response to a request for at least one function among video call connection, remote control, and screen sharing of a registered external electronic device that has received the assistance request message.

[0022] According to one embodiment, if an external electronic device is not registered, the processor can check the current situation and propose a solution to the problem using generative artificial intelligence.

[0023] According to another embodiment of the present specification, an emergency rescue support system may include the smart TV and a server connected to the smart TV via a network, and when the smart TV receives a designated button input from the remote control, it controls the camera and the microphone to obtain situational information of the user, determines whether there is an emergency situation based on the situational information, and if it is determined to be an emergency situation, it automatically connects to a rescue agency through the server and sends a video call to a registered external electronic device, and if it is determined to be a normal situation, it can send a help request message to the registered external electronic device through the server.

[0024] According to one embodiment, the server can determine whether there is an emergency situation by analyzing video information including the user's facial expression, posture, and whether movement has stopped, and voice information including voice tone and voice frequency, received from the smart TV.

[0025] According to one embodiment, if the server determines that an emergency situation has occurred, it may analyze the situation based on photos or videos received from the smart TV and transmit the results of the situation analysis along with the photos or videos to the registered external electronic device.

[0026] According to one embodiment, if there is no registered external electronic device, the server may initiate a video call to a rescue organization as the recipient and transmit the situation analysis result and the photo or video.

[0027] According to another embodiment of the present specification, an emergency rescue support method for a smart TV may include: receiving a button input designated for a rescue request from a remote control; controlling a camera and a microphone in response to the button input to obtain situational information of the user; determining whether an emergency situation exists based on the situational information; automatically connecting to a rescue agency and sending a video call to a registered external electronic device when an emergency situation is determined; and sending a help request message to the registered external electronic device when a normal situation is determined.

[0028] According to one embodiment, the operation to determine whether an emergency situation exists may include an operation to determine whether an emergency situation exists by analyzing image information including a user's facial expression, posture, and whether movement has stopped, obtained through the camera, and voice information including voice tone and voice frequency, obtained through the microphone.

[0029] According to one embodiment, the method may further include, when an emergency situation is determined, an operation of analyzing the situation based on a photo or video acquired through the camera and an operation of transmitting the result of the situation analysis along with the photo or video to the registered external electronic device.

[0030] According to one embodiment, the method may include the operation of initiating a video call to a rescue organization as the recipient and transmitting the situation analysis result and the photo or video when there is no registered external electronic device.

[0031]

[0032] According to one embodiment, a smart TV that supports emergency rescue and a method of operation thereof improve accessibility by allowing a user to simply make a rescue request through a familiar TV remote control.

[0033] According to one embodiment, a smart TV supporting emergency rescue and a method of operation thereof can more accurately determine whether an emergency situation exists by utilizing a camera, a microphone, and artificial intelligence analysis.

[0034] According to one embodiment, a smart TV supporting emergency rescue and a method of operation thereof can increase the speed and reliability of response by connecting a real-time video call with a guardian account and simultaneously automatically reporting to a rescue agency when an emergency occurs.

[0035] According to one embodiment, a smart TV supporting emergency rescue and a method of operation thereof provide situation estimation information along with a help request message even in non-emergency situations, thereby enabling various remote support.

[0036] According to one embodiment, a smart TV that supports emergency rescue and a method of operation thereof can propose a solution to a problem even when there is no registered external electronic device (199) by utilizing the TV self-diagnosis function and generative artificial intelligence.

[0037] According to one embodiment, a smart TV that supports emergency rescue and a method of operation thereof can implement an emergency rescue system by utilizing a TV in the home without a separate wearable device or additional installation equipment, thus offering high cost efficiency and practical usability.

[0038] The effects obtainable in this specification are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which this specification belongs from the description below.

[0039]

[0040] FIG. 1 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present invention.

[0041] Figure 2 is a flowchart illustrating the flow of the remote control input and emergency situation determination process.

[0042] Figure 3 is a flowchart illustrating the procedure for video calls and reporting to rescue agencies in the event of an emergency.

[0043] Figure 4 is a diagram illustrating a video call summary and a multi-party call sharing procedure.

[0044] Figure 5 is a diagram illustrating a general help request and remote support scenario.

[0045] Figure 6 is a flowchart illustrating the alternative action procedure.

[0046] FIG. 7 is a drawing illustrating a smart TV screen indicating that a request for rescue or help is in progress according to one embodiment.

[0047] FIG. 8 is a diagram illustrating an alarm message received by an external electronic device according to one embodiment.

[0048] FIG. 9 is a drawing illustrating the screen of an external electronic device during a video call according to one embodiment.

[0049]

[0050] The advantages and features of this specification and the methods for achieving them will become clear by referring to the embodiments described below in detail together with the accompanying drawings. However, this specification is not limited to the embodiments disclosed below but may be implemented in various different forms; these embodiments are provided merely to ensure that the disclosure of this specification is complete and to fully inform those skilled in the art of the scope of the disclosure, and this specification is defined only by the scope of the claims. Throughout the specification, the same reference numerals refer to the same components.

[0051] When one component is referred to as being "connected to" or "coupled to" another component, it includes cases where it is directly connected or coupled to the other component, or cases where another component is interposed. Conversely, when one component is referred to as being "directly connected to" or "directly coupled to" another component, it indicates that no other component is interposed. "And / or" includes each of the mentioned items and all combinations of one or more of them.

[0052] The terms used herein are for describing the embodiments and are not intended to be limiting. In this specification, the singular form includes the plural form unless specifically stated otherwise in the text. As used herein, "comprises" and / or "comprising" do not exclude the presence or addition of one or more other components, steps, actions, and / or elements to the mentioned components, steps, actions, and / or elements.

[0053] Although terms such as "first," "second," etc., are used to describe various components, it goes without saying that these components are not limited by these terms. These terms are used merely to distinguish one component from another.

[0054] Therefore, it is obvious that the first component mentioned below may be the second component within the technical scope of this specification. Unless otherwise defined, all terms used in this specification (including technical and scientific terms) may be used in a meaning that is commonly understood by those skilled in the art to which this specification belongs. Furthermore, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless explicitly and specifically defined otherwise.

[0055] The terms 'part' or 'module' used in this embodiment refer to software or hardware components such as FPGAs or ASICs, and the 'part' or 'module' performs certain roles. However, the meaning of 'part' or 'module' is not limited to software or hardware. The 'part' or 'module' may be configured to reside in an addressable storage medium or configured to run one or more processors. Thus, as an example, the 'part' or 'module' may include components such as software components, object-oriented software components, class components, and task components, as well as processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The components and functions provided within the 'part' or 'module' may be combined into a smaller number of components and 'part' or 'module', or further separated into additional components and 'part' or 'module'.

[0056] Steps of a method or algorithm described in connection with some embodiments of this specification may be directly implemented in hardware, software modules, or a combination of both, executed by a processor. Software modules may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disks, removable disks, CD-ROMs, or any other form of recording medium known in the art. An exemplary recording medium is coupled to a processor, and the processor can read information from the recording medium and write information to the storage medium. Alternatively, the recording medium may be integral with the processor. The processor and the recording medium may reside within an Application-Specific Integrated Circuit (ASIC). The ASIC may reside within a user terminal.

[0057] Hereinafter, embodiments of this specification are described in detail with reference to the attached drawings so that those skilled in the art can easily implement them. However, this specification may be implemented in various different forms and is not limited to the embodiments described herein.

[0058] Although this specification has been described with reference to the embodiments illustrated in the drawings, this is merely illustrative, and those skilled in the art will understand that various modifications and equivalent alternative embodiments are possible therefrom. Accordingly, the true technical scope of protection of this specification should be determined by the technical spirit of the appended claims.

[0059] FIG. 1 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present invention.

[0060] Referring to FIG. 1, the system (10) may include a smart TV (100), a server (190), and at least one external electronic device (199).

[0061] According to one embodiment, a smart TV (100) may include a processor (110), a display (111), an input interface (116), an input unit (120), a communication unit (130), a camera (121), and a microphone (126).

[0062] A smart TV (100) is a device that can be connected to a network and provide various services and functions, and can interact with a user by including a display, an input unit, a camera, a microphone, a communication unit, and a processor.

[0063] The smart TV (100) is a platform capable of running an operating system (OS) and applications, and can perform multimedia processing, network communication, and user interface provision functions. The smart TV (100) can be connected to an external server and a user terminal to perform data transmission and reception, remote control, video calls, message transmission, etc.

[0064] According to one embodiment, the smart TV (100) can receive input. For example, the smart TV (100) can receive specific button input from a remote control through an input interface (116). Input can also be received from buttons, touch panels, etc., on the main body of the device through an input unit (120). The smart TV (100) can collect video and audio from a user through a camera (131) and a microphone (136).

[0065] According to one embodiment, the smart TV (100) can acquire situational information. The situational information may be status information of the smart TV (100) user. The processor (110) controls the camera (131) and microphone (136) in response to the user's input and can acquire situational information such as the user's facial expression, posture, whether movement has stopped, voice tone, and frequency.

[0066] According to one embodiment, the smart TV (100) can determine whether there is an emergency situation. For example, the smart TV (100) or the processor (110) can determine whether there is an emergency situation by analyzing acquired video and audio information. The smart TV (100) or the processor (110) can determine whether there is an emergency situation by performing artificial intelligence analysis based on a photo taken by the camera (121).

[0067] According to one embodiment, the smart TV (100) can perform operations in an emergency situation. For example, if the smart TV (100) or the processor (110) determines that an emergency situation has occurred, it can transmit photos and analysis results to a registered external electronic device (199) via the communication unit (130) and simultaneously initiate a video call. If there is no registered external electronic device (199), the smart TV (100) or the processor (110) can automatically report to a rescue agency via the server (190) and transmit the captured video and analysis results along with location information. After connecting with the first responder, the smart TV (100) or the processor (110) can generate a summary at the end of the call and transmit it to another device, and in the case of a multi-party call, provide the previous conversation content to a subsequent device.

[0068] According to one embodiment, the smart TV (100) can perform operations in normal situations, not in emergency situations. When it is determined that it is a normal situation, the smart TV (100) or the processor (110) can send a 'request for help' message to a guardian account. The smart TV (100) or the processor (110) can check the usage history of the smart TV (100) and the status of currently running applications to estimate the function that the user is having difficulty with and include the details in the message. After receiving the request for help message, the guardian device (e.g., a portable terminal) can provide help by selecting one of video calls, remote control, or screen sharing. If there is no registered external electronic device (199), the smart TV (100) or the processor (110) can independently check the situation and suggest a solution to the problem through generative artificial intelligence.

[0069] According to one embodiment, the smart TV (100) can provide output and feedback to the user. For example, the smart TV (100) or the processor (110) can visually provide the user with the progress of a rescue request, a video call screen, notification messages, etc., through a display (111). The smart TV (100) or the processor (110) can provide clear feedback to the user by combining large icons, a simplified UI, and voice guidance to enhance accessibility.

[0070] According to one embodiment, the processor (110) may be implemented as a control unit that controls the overall operation of the smart TV (100). The processor (110) may be electrically connected to a display (111), an input interface (116), an input unit (120), a communication unit (130), a camera (121), and a microphone (126). The processor (110) may be implemented as a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), a neural network processing unit (NPU), or a combination thereof. The processor (110) may perform application operations by executing program code stored in memory. The processor (110) may be composed of one or more chipsets, circuits, firmware modules, or microcontrollers. The processor (110) may perform data processing and instruction execution by cooperatively utilizing non-volatile memory and volatile memory.

[0071] According to one embodiment, when the processor (110) receives a specific button input from the remote control, it can control the camera (121) and microphone (126) to obtain user situation information (e.g., video and audio). The processor (110) can determine whether there is an emergency situation by analyzing the obtained video and audio data. If the processor (110) determines that there is an emergency situation, it can control the transmission of photos, the provision of situation analysis results, and the initiation of a video call by connecting to a rescue agency and a registered account. If the processor (110) determines that there is a normal situation, it can send a help request message and estimate the user's needs based on the user's situation by analyzing the usage history of the smart TV (100) and the status of running applications. The processor (110) can control the generation of a summary upon the end of the video call with the first responding device and transmit it to another device, or, if there is no registered external electronic device (199), it can independently suggest a solution to the problem.

[0072] According to one embodiment, the display (111) may be included in a smart TV (100) to provide visual information such as images, text, and icons to the user. The display (111) may utilize various display device technologies such as LCD (Liquid Crystal Display), OLED (Organic Light Emitting Diode), QLED (Quantum Light Emitting Diode), and Micro LED. It may be in the form of a flat display, a curved display, or a transparent display. In one embodiment, the display (111) may include a touch input function and operate as a user input device.

[0073] According to one embodiment, the display (111) can display the status of a rescue request, a video call screen, a warning message, etc., when an emergency occurs. In normal situations, the display (111) can display a help request message, estimated need for help, and remote support options (video call, remote control, screen sharing, etc.) that the guardian device can select. For accessibility, the display (111) can provide large icons, high-contrast colors, and a simple UI so that the elderly can easily recognize them. When an emergency occurs, the display (111) can display a notification on the screen, such as “A rescue request has been received,” in conjunction with voice guidance.

[0074] According to one embodiment, the input interface (116) can receive a signal from an external device and transmit it to the smart TV (100). For example, the input interface (116) can receive an external input, including a remote control signal, and transmit it to the processor (110). The external device may be a remote control, keyboard, mouse, and voice recognition device that provides input to the smart TV (100). The input interface (116) can receive signals using various wireless communication methods such as infrared (IR), Bluetooth, radio frequency (RF), and Wi-Fi. It performs the role of converting user input into a signal and transmitting it to the processor.

[0075] According to one embodiment, the input interface (116) can be programmed to receive a specific button input from a remote control and to recognize it as a rescue request if the button is input for a certain period of time or is input continuously for a predetermined number of times or more. The user can make a rescue request with only a simple button input without any separate complex operations.

[0076] According to one embodiment, the input unit (120) includes a physical or virtual input device provided in the smart TV (100) itself. The input unit (120) may include a button, a touch panel, a voice command input unit, a gesture sensor, etc. The input unit (120) detects direct operation by a user and provides it to the processor (110), and the processor (110) can control the functions of the smart TV (100) corresponding to the user's operation.

[0077] According to one embodiment, the input unit (120) allows the user to input a rescue request directly from the smart TV main body in addition to the remote control. For example, an emergency call button, a voice command recognition microphone, a touch input panel, etc., provided on the smart TV main body can operate as the input unit. This enables the user to input a rescue request even when the remote control is out of reach.

[0078] According to one embodiment, the input unit may further include a camera (121) and a microphone (126). The camera (121) is a component for acquiring image information and may include an image sensor such as a CCD or CMOS sensor, and may capture an image of a user and the surrounding environment and provide it to the processor (110).

[0079] According to one embodiment, the camera (121) can be used to determine whether there is an emergency situation by capturing the user's facial expression, posture, and whether movement has stopped. When an emergency situation is determined, the processor (110) can transmit the photo or video captured by the camera (121) to the guardian's device and server. Additionally, the processor (110) can use artificial intelligence to analyze the photo or video captured by the camera (121) and use this to determine the emergency situation. The camera (121) may also operate in real-time CCTV mode and transmit the captured video at the request of the guardian.

[0080] According to one embodiment, the microphone (126) is a component for acquiring voice information and, together with an analog-to-digital conversion circuit, can convert the user's voice into an electronic signal and provide it to the processor (110). The microphone (126) can be implemented in the form of a unidirectional, unidirectional microphone or an array microphone.

[0081] According to one embodiment, the processor (110) can analyze the user's voice tone, voice frequency, expression of pain, etc. obtained through the microphone (126) and use this to determine whether an emergency situation exists. When an emergency situation occurs, the voice collected by the microphone (126) can be transmitted along with video to a guardian account or a rescue agency. The microphone (126) can be used as a means for inputting user request messages in normal situations, or can operate as a voice channel during a video call with a guardian.

[0082] According to one embodiment, the communication unit (130) is a component responsible for transmitting and receiving data between the smart TV (100) and an external device or server (190). It can operate via a wired (Ethernet) or wireless (Wi-Fi, LTE, 5G, etc.) network. It can transmit and receive various forms of data, such as voice, video, control signals, and text messages. It can also be connected to a cloud server, an external terminal, and other IoT devices.

[0083] According to one embodiment, the communication unit (130) can transmit and receive data regarding whether an emergency situation is occurring, photos, video, and voice data between the smart TV (100) and the server. If an emergency situation is determined, the communication unit (130) can transmit a message to the server (190) requesting automatic reporting to a rescue agency based on the control of the processor (110). The communication unit (130) can be connected to a plurality of external electronic devices (guardian terminals) to transmit video calls, messages requesting help, analysis results, etc. Even if the video call is disconnected during an emergency, an emergency notification can be transmitted through other channels (SMS, KakaoTalk, voice call, etc.). The communication unit (130) can transmit emergency situation logs and video data to the server (190) for storage, and can also transmit them to a medical institution if necessary.

[0084] Although this specification describes implementation in a smart TV, the functions proposed in this specification can be implemented in various types of electronic devices, such as set-top boxes, smart speakers, mobile terminals (smartphones / tablets), and IoT hubs, in addition to smart TVs, and such modified embodiments are also included in the technical scope of this specification.

[0085] According to another embodiment, the technology proposed in this specification may be implemented in a set-top box connected to a TV. The set-top box receives remote control input and may acquire video and audio of a user by having a camera (131) and a microphone (136) built-in or connected to an external device. The processor (110) determines whether there is an emergency situation and may transmit data to a guardian account or a rescue organization through the network module of the set-top box.

[0086] According to another embodiment, the technology proposed in this specification can be implemented in a smart speaker composed of a microphone (136) and a speaker. When a user inputs an emergency command, such as “help me,” by voice, the processor (110) can recognize this and perform an emergency rescue request. The accuracy of determining the emergency situation can be improved by linking with an internal camera (131) or an external camera. Feedback on the progress of the rescue request can be provided via voice guidance instead of a display.

[0087] According to another embodiment, the technology proposed in this specification may be implemented in a portable terminal such as a smartphone or tablet. When a user presses an emergency call button or inputs a voice command on a device they are carrying, the situation is recognized through a built-in camera and microphone, and a notification can be sent to a guardian account and a rescue agency.

[0088] According to another embodiment, the technology proposed in this specification can be implemented in a hub device that interacts with IoT devices within a home. The IoT hub is connected to a TV, smart lighting, and sensor devices, and can control the devices within the home or synchronize and provide emergency alerts when a rescue request occurs. For example, in the event of an emergency, the IoT hub can turn lights on or off or trigger an alarm to attract the attention of people nearby.

[0089] The server (190) can receive information regarding emergency situations, photos, videos, and audio transmitted from the smart TV (100) and transmit it to a registered external electronic device (199) or rescue organization. The server (190) can be connected to the smart TV (100) and the external electronic device (199) via a network to transmit and receive data. The server (190) can be implemented in various forms, such as a cloud server, a web server, or an application server. The server (190) can perform data storage, analysis, relay, and distribution functions, and can communicate with multiple client devices via a wired or wireless network.

[0090] The server (190) can receive information regarding whether an emergency situation has occurred, video and audio data, captured photos, and analysis results transmitted from the smart TV (100). Based on the received information, it can re-evaluate or correct whether an emergency situation has occurred, and if it is confirmed to be an emergency, it can automatically report to a rescue agency and provide location information. The server (190) can transmit emergency alerts, photos, and analysis results to a guardian account and relay a video call between the initial responder and the smart TV (100). After the video call ends, the server (190) can summarize the conversation content and provide it to another guardian account. It can store data and logs collected during the emergency situation and provide them to a medical institution if necessary.

[0091] The external electronic device (199) is a guardian terminal or other registered external electronic device (199) that is connected to the smart TV (100) via the server (190) and can receive help request messages, video calls, analysis results, etc.

[0092] An external electronic device (199) refers to a user terminal that is connected to a smart TV (100) or server (190) via a network to receive or transmit data. It can be various devices such as a smartphone, tablet, laptop, smart watch, or smart speaker. It can transmit and receive messages, voice, video, notifications, etc., via the network.

[0093] The external electronic device (199) can receive photos, analysis results, and emergency alert messages transmitted from the smart TV (100) or server (190). The external electronic device (199) can receive a video call in the event of an emergency and be connected as the first responder. After the video call ends, the external electronic device (199) can receive a summarized conversation or participate in a multi-party call. In normal situations, the external electronic device (199) can receive a request for help message and provide assistance to the user by selecting at least one of remote control, screen sharing, or video calling. The external electronic device (199) can be utilized as a guardian or acquaintance terminal to participate in the process of ensuring the user's safety and solving problems.

[0094] Figure 2 is a flowchart illustrating the flow of the remote control input and emergency situation determination process.

[0095] The procedure of Figure 2 shows user input, acquisition of situation information, determination of emergency status, and actions according to emergency and general situations.

[0096] In operation S210, the smart TV (100) or processor (110) may receive a designated button input from the remote control and, in response, obtain situational information of the user. Although described as a designated button input from the remote control, the input may be made in various ways, such as a remote control, a button on the main body of the device, a touch panel, or a voice command. The various input methods described here may be pre-configured as means for the user to execute a distress signal. The input signal may be transmitted to the processor (110) through the input interface (116) and / or input unit (120).

[0097] When a specific button input of the remote control is received, the processor (110) may recognize it as a distress request signal. The specific button may be set to a combination of the "HELP" key, a designated function key, or an existing button. According to one embodiment, if the button input is sustained for a certain period of time or is entered continuously for a certain number of times or more, it may be identified as a distress request. When the processor (110) receives a distress request input signal, it may perform a subsequent procedure to determine an emergency situation. For example, when the processor (110) identifies a distress request input signal, it may activate the camera (131) and microphone (136) to switch to a ready state for acquiring the user's video and voice. The distress request input signal may be linked with the server (190) to be stored as a log or recorded for subsequent analysis.

[0098] In operation S220, the smart TV (100) or processor (110) can determine whether there is an emergency situation by analyzing acquired situational information. The subjects of analysis may be diverse, such as video information, voice information, environmental information, and biosignals. For example, the user's facial expression, body posture, and whether movement has stopped can be analyzed from the video acquired through the camera (131). The voice tone, frequency, and whether pain is expressed can be analyzed from the voice acquired through the microphone (136). In some embodiments, heart rate and breathing patterns acquired through external biosensors (heart rate sensor, respiration sensor, wearable device) can be used for additional analysis. In other embodiments, TV usage history or application execution status can be considered together to correct the reliability of the determination of whether it is a simple request or an actual emergency situation.

[0099] The determination of whether an emergency situation exists can be performed by rule-based analysis, pattern recognition, and / or an artificial intelligence (AI) model. For example, an AI model can analyze a captured photo to detect that the user is in pain or has lost consciousness. The AI ​​model can learn subtle changes in the user's facial expressions, voice, and movements to detect signs of an emergency that are difficult to identify with conventional sensors. The results of the situation analysis are stored in the form of logs on a server (190) and can be used as reference material for subsequent medical response.

[0100] The smart TV (100) or processor (110) synthesizes multiple analysis results to finally determine whether there is an emergency situation. The result of the determination can determine the processing branch in operation S230.

[0101] In operation S230, the smart TV (100) or processor (110) can perform a branch operation based on the result determined in operation S220.

[0102] According to one embodiment, if an emergency situation is determined, the smart TV (100) or processor (110) may request assistance from a rescue agency and send a video call to a designated account. The processor (110) may connect with a server (190) or a rescue agency via a communication unit (130) and transmit photos taken by a camera (131) and situation analysis results generated by the processor (110) to the server (190) or the rescue agency. Additionally, the smart TV (100) or processor (110) may automatically send a video call request to a registered external electronic device (199) and immediately connect with the terminal that responds first. After the call ends, the smart TV (100) or processor (110) may generate a summary and transmit it to other registered external electronic devices (199). If there is no registered external electronic device (199), the smart TV (100) or processor (110) may designate a rescue agency (e.g., 119) as the recipient to transmit photos, analysis results, video calls, and provide location information. According to one embodiment, an operation in an emergency situation may be performed by a server (190) at the request of the smart TV (100) or processor (110).

[0103] In cases where it is determined to be a normal situation, the smart TV (100) or processor (110) may send a help request message to a designated account (e.g., guardian account) among the registered external electronic devices (199). The message may include estimated help needs based on TV usage history, the status of currently running applications, etc. The external electronic device (199) that receives the message may assist the user by selecting at least one function among video call connection, remote control, and screen sharing. If no registered external electronic device (199) exists, the smart TV (100) may suggest a solution to the problem on its own.

[0104] According to one embodiment, if a video call connection fails during emergency processing, a text-based message, such as a message or SNS, may be transmitted via the server (190). Data (photos, videos, audio, logs) during an emergency may be automatically saved to the server and provided to a medical institution. The help request message may be provided in various forms, such as an icon-based UI, voice notifications, in addition to text. If multiple external electronic devices (199) are registered, they may be configured to connect first to the account with the highest priority. If a guardian who receives a general situation message selects remote control, they can check the user's distress situation in real time through TV screen sharing.

[0105] FIG. 3 is a flowchart illustrating the procedure for video calls and reporting to rescue agencies in the event of an emergency. The operations in FIG. 3 illustrate detailed operations after the case in FIG. 2 is determined to be an emergency, including photo transmission, generation of analysis results, processing based on whether the device is registered, and automatic reporting to rescue agencies.

[0106] In operation S310, the smart TV (100) or processor (110) can receive input from a remote control. If the input is a normal control input, the smart TV (100) or processor (110) can control the smart TV (100) in accordance with the control. If the input is a distress request input, it can perform subsequent operations.

[0107] In operation S320, the smart TV (100) or processor (110) can control the camera (131) and microphone (136) in response to a distress request input to acquire the user's video and voice. Additionally, the smart TV (100) can indicate on the display (111) that a distress request or a request for help is in progress (see FIG. 7).

[0108] In operation S330, the smart TV (100) or the processor (110) analyzes the acquired video and audio information to determine whether there is an emergency situation. According to one embodiment, if the processor (110) receives a release input within a predetermined time after receiving a rescue request input from the remote control, it may determine that the user's rescue request input has been released by the user and not perform any additional operations. Here, the release input may be touching the rescue request release button displayed on the smart TV (100) display as shown in FIG. 7 or pressing a specific button on the remote control.

[0109] In operation S340, if an emergency situation is determined, the smart TV (100) or processor (110) can transmit a photo taken by the camera (131) to a registered external electronic device (199) and simultaneously make a video call. The smart TV (100) or processor (110) can control the camera (131) to capture the user's current situation and transmit the photo to the registered external electronic device (199). The smart TV (100) or processor (110) can transmit a notification message, such as "An emergency situation has been detected," to the registered external electronic device (199). Then, the external electronic device (199) can display the notification message (see FIG. 8). The message transmitted by the processor (110) may include time information and location information (GPS or network-based location) as metadata. At the same time, the processor (110) can make a video call to the account of the registered external electronic device (199) so that a guardian can check the user's status in real time. If priority is assigned to the registered external electronic device (199), a video call may be attempted first with the account having the highest priority. If multiple external electronic devices (199) are registered, the smart TV (100) or processor (110) may sequentially send video calls by selecting an account according to priority or at random, and may connect with the external electronic device (199) that responds first. The video call (see FIG. 9) can be linked with the display (111) and microphone (136) to provide real-time two-way communication.

[0110] In operation S350, the smart TV (100) or processor (110) can generate a situation analysis result based on a photo taken by the camera (131) and transmit the result to a registered external electronic device (199). According to one embodiment, the smart TV (100) or processor (110) can input a photo acquired by the camera (131) into an artificial intelligence module to analyze the user's posture, facial expression, surrounding environment conditions, etc. Additionally, the smart TV (100) or processor (110) can perform analysis using a generative artificial intelligence model and automatically generate a summary phrase or a situation description phrase as output. For example, the generative artificial intelligence model of the smart TV (100) or processor (110) can analyze whether the user has fallen to the floor, whether their face is distorted due to pain, or whether there has been no movement for a long time. The generative artificial intelligence model of the smart TV (100) or processor (110) can generate phrases such as "suspected fall," "suspected unconscious state," or "complaining of pain" based on the analyzed results. The processor (110) can transmit these analysis results along with photos to an external electronic device (199) or server (190) registered with the data, so that a guardian or rescue agency can understand the situation more quickly than simply checking the video.

[0111] The server (190) can further correct the analysis results or store them as logs for use when transmitting them to a subsequent rescue agency. The guardian can take immediate action based on the analysis results received via an external electronic device (199).

[0112] In operation S360, if no registered external electronic device (199) exists, the smart TV (100) or processor (110) may transmit a captured photo, situation analysis results, and video call to a rescue agency designated as the recipient. The smart TV (100) may directly transmit a photo captured by the camera (131) and a situation analysis result generated in operation S350 to the rescue agency.

[0113] In operation S370, the smart TV (100) or processor (110) can request rescue by transmitting location information to a rescue agency. The location information can be obtained based on GPS, Wi-Fi AP, and mobile communication base station information. Based on the location information, the rescue agency can reduce the response time and quickly identify the situation of the incident along with log data.

[0114] FIG. 4 is a diagram illustrating a video call summary and a multi-party call sharing procedure according to various embodiments of the present specification.

[0115] In operation S410, the smart TV (100) or the processor (110) can make a video call to a plurality of registered external electronic devices (199) when an emergency occurs. The processor (110) can make video calls sequentially or send connection requests to a plurality of external electronic devices (199) simultaneously.

[0116] In operation S420, the smart TV (100) or processor (110) can conduct a video call with the first responding external electronic device (199). The smart TV (100) can output the video call screen through the display (111) and provide two-way communication through the microphone (136) and camera (131).

[0117] In operation S430, when a video call ends, the smart TV (100) or processor (110) can summarize the content of the call. The summary can be generated through a speech recognition and text conversion process, and key conversation content can be extracted. If generative artificial intelligence is applied, the summary can be automatically generated as a sentence in natural language form.

[0118] In operation S440, the smart TV (100) or processor (110) can transmit the summarized call content to another registered external electronic device (199) that did not receive the video call.

[0119] In operation S450, when multiple external electronic devices (199) receive video calls sequentially, the smart TV (100) or the processor (110) can conduct a multi-party video call. The processor (110) can attempt to establish a connection to add a new external electronic device (199) while maintaining an existing connection.

[0120] In operation S460, the smart TV (100) or processor (110) may summarize the conversation content of the second external electronic device (199) up to the point of video call connection with the first external electronic device (199) and provide it to the second external electronic device (199).

[0121] According to one embodiment, if there is prior consent from the user, when a request for on-site verification is received from an external electronic device (199), the processor (110) can control the camera (131) to transmit real-time video footage to the external electronic device (199). The transmitted video footage may be provided separately from video calls in emergency situations, and the guardian can directly check the user's condition through it. Therefore, even in the absence of an actual emergency rescue request, the guardian can request on-site verification if necessary to quickly identify and respond to the user's situation.

[0122] FIG. 5 is a diagram illustrating a general help request and remote support scenario according to various embodiments of the present specification.

[0123] In operation S510, the smart TV (100) or the processor (110) obtains situation information in response to a distress request input, and based on the analysis of the situation information, may determine that it is not an emergency situation. According to one embodiment, the smart TV (100) or the processor (110) may perform operations S310 to S330 to perform operation S510. And based on the judgment of operation S330, it may determine that it is not an emergency situation.

[0124] In operation S520, the smart TV (100) or processor (110) can check the TV's usage history and the status of currently running applications to estimate the difficulties the user is experiencing. The estimated result may be in the form of a short sentence, for example, "There has been no TV usage for about 12 hours," or "Guardian confirmation is required."

[0125] In operation S530, the smart TV (100) or processor (110) may send a help request message to a registered external electronic device (199). The message may be provided in various forms, such as simple text, icons, or voice notifications. According to one embodiment, the smart TV (100) or processor (110) includes the estimation result from operation S520 in the help request message and sends it. According to one embodiment, the help request message may include specific guidance phrases based on the user's behavioral pattern, such as "It seems you are having trouble playing videos" or "It seems you are having trouble using the settings menu."

[0126] In operation S540, a registered external electronic device (199) that receives a help request message from the smart TV (100) or processor (110) may select at least one of video call connection, remote control, or screen sharing to support the user. The guardian may intervene immediately from a remote location, and the user checks the feedback through the display (111).

[0127] In operation S550, if there is no registered external electronic device (199), the smart TV (100) or processor (110) can independently check the current situation and suggest a solution to the problem using generative artificial intelligence.

[0128] According to one embodiment, the user may designate a temporary contact regardless of the registration of the external electronic device (199), and the smart TV (100) may recognize this as an alternative account and send a help request message to the temporary contact when it is not connected to the registered external electronic device (199).

[0129] Figure 6 is a flowchart illustrating an alternative action procedure in the case where there is only one account of a registered external electronic device but there is no response from that account.

[0130] In operation S610, the smart TV (100) or processor (110) can send a help request message or video call to an account of a registered external electronic device (199).

[0131] In operation S620, the smart TV (100) or processor (110) can check whether there is a response from a registered external electronic device (199).

[0132] In operation S630, the smart TV (100) or processor (110) can proceed with normal procedures, such as connecting a video call or checking a message, if there is a response.

[0133] In operation S640, the smart TV (100) or processor (110) may display a message on the display (111) guiding the user to take alternative actions (e.g., "No response from registered account. Would you like to specify another contact?") if there is no response.

[0134] In operation S650, the user can enter a temporary contact, messenger account and / or email address through the input unit (120) or remote control.

[0135] In operation S660, the smart TV (100) or processor (110) may recognize a designated temporary contact as an alternate account and send a help request message. The message may include information about the user's current situation, a default notification phrase, and recent usage history.

[0136] As described above, the smart TV supporting emergency rescue and the method of operation thereof according to the present specification can provide the following effects.

[0137] According to one embodiment, a smart TV may include a display, an input interface that receives a specific button input for a rescue request from a remote control, a camera and a microphone that acquire video and audio of a user, a communication unit that communicates with an external server and accounts of a plurality of external electronic devices via a network, and a processor connected thereto. The processor may be configured to control the camera and microphone to acquire situational information when a designated rescue request button input is received from the remote control, determine whether it is an emergency situation based on this information, connect to a rescue agency and send a video call to a designated account if it is determined to be an emergency situation, and send a help request message to a designated account if it is determined to be a normal situation. The smart TV proposed in this specification according to one embodiment may be provided so that a user can perform a rescue request with only simple remote control operation and automatically take appropriate measures depending on whether the situation is emergency or normal.

[0138] According to one embodiment, a smart TV or a processor of a smart TV may be configured to identify whether a signal is input for a specified amount of time or more, or input continuously for a specified number of times or more, through a specific button for a distress request, and to acquire situation information accordingly. Accordingly, the smart TV according to one embodiment can be provided to reliably process distress requests based on the actual user's intent, distinguishing them from simple malfunctions or accidental inputs.

[0139] According to one embodiment, a smart TV or a processor of a smart TV may be configured to determine whether an emergency situation exists by analyzing video information including a user's facial expression, posture, and whether movement has stopped, and voice information including voice tone and voice frequency. According to one embodiment, a smart TV or a processor of a smart TV may analyze various biological and behavioral signals through a camera and a microphone to provide for more accurate determination of whether an emergency situation exists.

[0140] According to one embodiment, a smart TV or a processor of a smart TV may be configured to transmit a photo or video captured by a camera to a registered external electronic device (199) and simultaneously initiate a video call when an emergency situation is determined. A smart TV or a processor of a smart TV according to one embodiment may provide a method to enable a guardian to check the user's situation in real time and respond immediately.

[0141] According to one embodiment, a smart TV or a processor of a smart TV may be configured to analyze the situation based on a captured photo when an emergency situation is determined, and to transmit the analysis result to a registered external electronic device (199). According to one embodiment, the smart TV or a processor of a smart TV may provide not only simple video transmission but also artificial intelligence analysis results, thereby enabling a guardian or rescue agency to understand the situation quickly and accurately.

[0142] According to one embodiment, a smart TV or a processor of a smart TV may be configured to transmit a captured photo, situation analysis results, and a video call to a rescue agency as the recipient when no registered external electronic device (199) exists. An electronic device and system according to one embodiment may be provided to ensure the safety of the user by connecting directly to a rescue agency even when there is no guardian account or no response.

[0143] According to one embodiment, a smart TV or a processor of a smart TV may connect with the external electronic device that first received the video call in the event of an emergency, and upon termination of the call, summarize the content and transmit it to external electronic devices that did not receive the call. Additionally, if multiple external electronic devices receive video calls sequentially, a multi-party video call may be initiated, and the content of the call with the previous external electronic device before the subsequent external electronic device joins the multi-party video call may be summarized and provided to the subsequent external electronic device. A smart TV or a processor of a smart TV according to one embodiment may enable the minimization of omissions in situation transmission during an emergency through seamless information sharing with multiple guardian accounts.

[0144] According to one embodiment, a smart TV or a processor of a smart TV may be configured to transmit video captured by a camera to the device in real time upon receiving a request for on-site verification from a registered external electronic device, provided that there is prior consent from the user. The smart TV or a processor of a smart TV according to one embodiment may provide the aforementioned function to enable the user to directly verify the scene during normal times or in emergencies and quickly determine whether to respond.

[0145] According to one embodiment, a smart TV or a processor of a smart TV may transmit a help request message to a registered external electronic device (199) when it is not an emergency. Additionally, the smart TV or a processor of a smart TV may be configured to check the usage history of the smart TV and the status of currently running applications to estimate the user's needs and transmit a help request message including the results. Upon receiving the help request message, the external electronic device may support the user by selecting at least one function among video calling, remote control, and screen sharing. If no external electronic device (199) is registered, the smart TV or a processor of a smart TV may display a message guiding the user to an alternative contact method. The smart TV or a processor of a smart TV according to one embodiment may provide for remotely resolving inconveniences experienced by the user in general situations, going beyond simple emergency response.

[0146] According to one embodiment, the emergency rescue support system may include a smart TV and a server. The server is connected to the smart TV via a network and may be configured to receive information regarding whether an emergency situation exists, video information, and voice information transmitted from the smart TV, and to automatically report to a rescue agency if an emergency situation is determined. The emergency rescue support system according to one embodiment may provide a network-based rescue system that automatically links with a rescue agency through the server without relying on the smart TV.

[0147] According to one embodiment, the server may be configured to analyze the situation based on photos received from the smart TV and transmit the analysis results to a guardian account and a rescue agency. An emergency rescue support system according to one embodiment may enable the server to perform additional artificial intelligence analysis and situation correction roles, thereby allowing the guardian and the rescue agency to receive more accurate information. The emergency rescue support system may receive some of the various functions that the smart TV previously performed alone and perform them more accurately.

[0148] According to one embodiment, the server may be configured to relay a video call between the first responder among the guardian accounts and the smart TV, and to summarize the call content and transmit it to another account upon the termination of the video call. The emergency rescue support system according to one embodiment enables stable relaying of video calls and centralized management of call summaries through the server, thereby allowing situation sharing for multiple accounts to be performed more reliably.

[0149] According to one embodiment, the emergency rescue support method may include the steps of receiving a specific button input set for a rescue request from a remote control, acquiring situational information via a camera and microphone in response thereto, determining whether an emergency situation exists based on the acquired information, automatically connecting to a rescue agency and sending a video call to a designated account if an emergency situation exists, and sending a help request message to a designated account if a normal situation exists. The emergency rescue support method according to one embodiment may provide a universal rescue request process that allows the same procedure to be applied to various hardware platforms without being limited to electronic devices.

[0150] According to one embodiment, the operation for determining whether an emergency situation exists may include an operation for analyzing the user's facial expression, posture, whether movement has stopped, and voice frequency. The emergency rescue support method according to one embodiment specifies a multi-faceted analysis procedure using video and audio data as a methodological step, thereby ensuring the accuracy of emergency situation determination regardless of device or server implementation.

[0151] According to one embodiment, the operation to determine whether an emergency situation exists may include the step of analyzing the situation based on a captured photograph and transmitting the analysis result to a registered external electronic device (199) or rescue agency. The emergency rescue support method according to one embodiment can be executed in the same way in a server or cloud environment by clearly including a post-processing analysis procedure based on captured data.

[0152] According to one embodiment, the emergency rescue support method may include the operation of transmitting video calls and situation information to a rescue agency as the recipient when there is no registered external electronic device (199). The emergency rescue support method according to one embodiment may ensure a procedure for direct connection with a rescue agency as a methodological step even in the absence of a guardian account.

[0153] The above method is implemented as a program executable on a processor and stored on a non-transient storage medium, and can be executed on various smart TVs and set-top boxes, smart speakers, mobile terminals (smartphones / tablets), and IoT hubs capable of performing functions similar to smart TVs.

[0154] Although this specification has been described with reference to the embodiments illustrated in the drawings, this is merely illustrative, and those skilled in the art will understand that various modifications and equivalent alternative embodiments are possible therefrom. Accordingly, the true technical scope of protection of this specification should be determined by the technical spirit of the appended claims.

Claims

1. Regarding Smart TVs, display; Input interface for receiving a designated button input for a rescue request from a remote control; A camera and microphone for acquiring the user's video and audio; A communication unit that communicates with the outside world through a network; and It includes the display, the input interface, the camera, the microphone, and a processor connected to the communication unit; The above processor is, When a designated button input is received from the remote control, the camera and microphone are controlled to obtain user situation information, and Based on the above situation information, determine whether it is an emergency situation, and If determined to be an emergency, it automatically connects to rescue agencies and initiates a video call to a registered external electronic device, and Sending a help request message to the above-registered external electronic device when determined to be a normal situation, Smart TV.

2. In Paragraph 1, The above processor is, Identifying whether a signal is input for more than a specified time or a signal is input continuously for more than a specified number of times through the above button, and Recognizing that the button input is received by the above identification, Smart TV.

3. In Paragraph 1, The above processor is, Determining whether an emergency situation exists by analyzing video information including the user's facial expression, posture, and whether movement has stopped, acquired through the camera, and voice information including voice tone and voice frequency, acquired through the microphone. Smart TV.

4. In Paragraph 3, The above processor is, Transmitting a photo or video captured by the camera to the registered external electronic device in the event that it is determined to be an emergency situation Smart TV.

5. In Paragraph 4, The above processor is, When an emergency situation is determined, the situation is analyzed based on photos or videos captured by the camera, and the results of the situation analysis are transmitted to the registered external electronic device along with the photos or videos. Smart TV.

6. In Paragraph 5, The above processor is, If the above-mentioned registered external electronic device does not exist, transmitting the above-mentioned photo or video and the above-mentioned situation analysis results to a rescue agency as the recipient, and sending the above-mentioned video call to the said rescue agency. Smart TV.

7. In Paragraph 1, The above processor is, In the event of an emergency, conduct a video call with the first registered external electronic device that receives the call, and Summarizing the call content upon termination of a video call and transmitting it to other registered external electronic devices that did not receive it, Smart TV.

8. In Paragraph 7, The above processor is, When multiple registered external electronic devices receive a video call sequentially, a multi-party video call is conducted, and Summarizing the video call content prior to the subsequent registered external electronic device participating in the video call and providing it to the said subsequent registered external electronic device, Smart TV.

9. In Paragraph 1, The above processor is, If there is prior consent from the user, when a request for on-site verification is received from the registered external electronic device, the video captured by the camera is transmitted to the registered external electronic device in real time. Smart TV.

10. In Paragraph 1, The above processor is, When determined based on the above general situation, the usage history of the smart TV and the status of currently running applications are checked to estimate the user's situation, and a help request message including the estimated result is transmitted. Smart TV.

11. In Paragraph 1, The above processor is, Providing assistance to a user in response to a request for at least one of the functions of video call connection, remote control, and screen sharing of a registered external electronic device that has received the above assistance request message, Smart TV.

12. In Paragraph 1, The above processor is, If an external electronic device is not registered, checking the current situation and proposing a solution using generative artificial intelligence, Smart TV.

13. In the emergency rescue support system, A smart TV comprising a display, an input interface for receiving a button input designated for a rescue request from a remote control, a camera and a microphone for acquiring video and audio of a user, a communication unit for communicating with the outside via a network, and a processor connected to the display, the input interface, the camera, the microphone, and the communication unit; and It includes a server connected to the above-mentioned smart TV via a network, and The above smart TV is, When a designated button input is received from the remote control, the camera and microphone are controlled to obtain user situation information, and Based on the above situation information, determine whether it is an emergency situation, and In the event that an emergency is determined, it automatically connects with a rescue agency via the above server and initiates a video call to a registered external electronic device, and In the case where it is determined to be a normal situation, sending a help request message to the registered external electronic device through the server, Emergency rescue support system.

14. In Paragraph 13, The above server is, Determining whether an emergency situation exists by analyzing video information including the user's facial expression, posture, and whether movement has stopped, and voice information including voice tone and voice frequency, received from the smart TV. Emergency rescue support system.

15. In Paragraph 14, The above server is, In the event that an emergency situation is determined, the situation is analyzed based on photos or videos received from the smart TV, and the result of the situation analysis is transmitted to the registered external electronic device along with the photos or videos. Emergency rescue support system.

16. In Paragraph 15, The above server is, In the case where there is no registered external electronic device, initiating a video call to a rescue agency as the recipient and transmitting the above situation analysis results and the above photos or videos, Emergency rescue support system.

17. Regarding the emergency rescue support method of a smart TV, The action of receiving a designated button input from a remote control for a rescue request; An operation to control the camera and microphone in response to the above button input to acquire the user's situation information; An action to determine whether there is an emergency situation based on the above situation information; Operation of automatically connecting to a rescue agency and sending a video call to a registered external electronic device when an emergency situation is determined; and Includes the operation of sending a help request message to the above-registered external electronic device when it is determined to be a normal situation, Emergency rescue support methods.

18. In Paragraph 17, The above emergency situation determination operation is, A method comprising analyzing image information including a user's facial expression, posture, and whether movement has stopped, acquired through the camera, and voice information including voice tone and voice frequency, acquired through the microphone, to determine whether an emergency situation exists. Emergency rescue support methods.

19. In Paragraph 17, The above method is, When an emergency situation is determined, an operation to analyze the situation based on photos or videos acquired through the camera; and Further including the operation of transmitting the situation analysis result together with the photo or video to the registered external electronic device, Emergency rescue support methods.

20. In Paragraph 19, The above method is, In the case where there is no registered external electronic device, the operation includes initiating a video call to a rescue agency as the recipient and transmitting the situation analysis result and the photo or video. Emergency rescue support methods.

Images