Data processing method and related device

Abstract

The embodiment of the invention discloses a data processing method and a related device, which can analyze the influence degree of displaying a to-be-analyzed video to a target object on the emotion of the target object based on physiological feature data corresponding to the target object in a display period of displaying the to-be-analyzed video to the target object. The emotion value information corresponding to the to-be-analyzed video can be accurately determined, the emotion influence degree of the to-be-displayed object by displaying the to-be-analyzed video to the to-be-displayed object can be accurately predicted through the emotion value information, and then video processing can be carried out based on the emotion value information. And the video can better meet the emotion demand of the watched object.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a data processing method and related devices. Background Art

[0002] As the economy continues to develop and income levels continue to rise, people have higher requirements for consumer goods. A consumer product usually provides three types of value to users: functional value, emotional value, and asset value. Among them, the value of information consumer goods is mainly reflected in emotional value. For example, watching videos can bring certain emotional values ​​to users, making them feel happy, scared, moved, etc.

[0003] In the related art, in order to provide users with more satisfying videos to watch, video recommendations are made based on multi-dimensional information such as video playback volume, number of video likes, user portraits, etc.

[0004] However, there is no method in the related technology for analyzing the emotional value that a video can bring, which results in the related technology being unable to recommend videos to users based on the emotional value that the video can bring, and further results in the videos recommended to users being difficult to provide users with more emotional value, and thus difficult to provide users with a good video viewing experience. Summary of the invention

[0005] In order to solve the above technical problems, the present application provides a data processing method that can accurately analyze the emotional value information corresponding to the video in combination with physiological characteristics.

[0006] The embodiments of the present application disclose the following technical solutions:

[0007] In a first aspect, an embodiment of the present application discloses a data processing method, the method comprising:

[0008] Determine a video to be analyzed, where the video to be analyzed is used to be displayed to a target object, where the target object is any object capable of viewing a video;

[0009] Acquire first physiological characteristic data corresponding to the target object in a display period of the video to be analyzed, where the first physiological characteristic data is used to characterize the physiological characteristics corresponding to the target object in the display period;

[0010] Based on the first physiological characteristic data, the emotional value information corresponding to the video to be analyzed is determined, and the emotional value information is used to characterize the degree of emotional impact on the object to be displayed when the video to be analyzed is displayed to the object to be displayed. The object to be displayed is any object with the ability to watch videos.

[0011] In a second aspect, an embodiment of the present application discloses a data processing device, the device comprising a first determining unit, a first acquiring unit, and a second determining unit:

[0012] The first determination unit is used to determine a video to be analyzed, and the video to be analyzed is used to display it to a target object, and the target object is any object that has the ability to watch videos;

[0013] The first acquisition unit is used to acquire first physiological characteristic data corresponding to the target object during a display period of the video to be analyzed, wherein the first physiological characteristic data is used to characterize the physiological characteristics corresponding to the target object during the display period;

[0014] The second determination unit is used to determine the emotional value information corresponding to the video to be analyzed based on the first physiological characteristic data, and the emotional value information is used to characterize the degree of emotional impact on the object to be displayed when the video to be analyzed is displayed to the object to be displayed. The object to be displayed is any object with the ability to watch videos.

[0015] In a third aspect, an embodiment of the present application discloses a computer device, wherein the computer device includes a processor and a memory:

[0016] The memory is used to store a computer program and transmit the computer program to the processor;

[0017] The processor is used to execute the data processing method according to any one of the instructions in the computer program;

[0018] In a fourth aspect, an embodiment of the present application discloses a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program, and the computer program is used to execute the data processing method described in any one of the first aspects;

[0019] In a fifth aspect, an embodiment of the present application discloses a computer program product including a computer program, which, when executed on a computer device, enables the computer device to execute the data processing method described in any one of the first aspects.

[0020] It can be seen from the above technical solution that the present application can first determine the video to be analyzed, and the video to be analyzed is used to display to the target object, and the target object can be any object with video viewing ability. During the period when the target object watches the video to be analyzed, the first physiological characteristic data corresponding to the target object in the display period of the video to be analyzed can be obtained, and the first physiological characteristic data can be used to characterize the physiological characteristics corresponding to the target object in the display period. Since the change of physiological characteristics can reflect the change of emotions to a certain extent, the emotional value information corresponding to the video to be analyzed can be determined according to the first physiological characteristic data. The emotional value information is used to characterize the emotional impact of the object to be displayed when the video to be analyzed is displayed to the object to be displayed. The object to be displayed can be any object with video viewing ability. In this way, the emotional changes that the video to be analyzed can cause to the viewing object can be accurately analyzed, and then the emotional value of the video to be analyzed can be analyzed. Based on the emotional value information, the video to be analyzed can be recommended, video edited, etc. in the subsequent process, so that the video recommended to the viewing object can be more in line with the emotional needs of the viewing object, and bring the viewing object a better video viewing experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0022] Figure 1 A schematic diagram of a data processing method in an actual application scenario provided by an embodiment of the present application;

[0023] Figure 2 A flowchart of a data processing method provided in an embodiment of the present application;

[0024] Figure 3 A schematic diagram of a data processing method provided in an embodiment of the present application;

[0025] Figure 4 A schematic diagram of a data processing method provided in an embodiment of the present application;

[0026] Figure 5 A schematic diagram of a data processing method provided in an embodiment of the present application;

[0027] Figure 6 A schematic diagram of a data processing method provided in an embodiment of the present application;

[0028] Figure 7A structural block diagram of a data processing device provided in an embodiment of the present application;

[0029] Figure 8 A structural diagram of a terminal provided in an embodiment of the present application;

[0030] Fig. 9 A structural diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0031] The embodiments of the present application are described below in conjunction with the accompanying drawings.

[0032] In order to provide viewers with a better viewing experience, relevant personnel have studied a variety of video analysis algorithms to obtain data for predicting the viewers' preference for videos. In related technologies, relevant personnel can measure the probability of a video being liked by viewers based on objective factors such as video playback volume and video like rate, thereby completing video recommendations.

[0033] However, at a time when the emotional value brought by information browsing is increasingly valued, related technologies lack a technology that can accurately analyze the emotional value corresponding to a video, making it difficult to recommend videos based on the emotional value that the video can bring, and further making it difficult for the videos displayed to the viewers to meet the viewers' emotional needs.

[0034] In order to solve the above technical problems, the present application provides a data processing method, which can analyze the degree of influence of showing the video to be analyzed to the target object on the target object's emotions based on the physiological characteristic data corresponding to the target object during the display period of the video to be analyzed to the target object, and then can more accurately determine the emotional value information corresponding to the video to be analyzed. The emotional value information can accurately predict the degree of influence on the emotions of the object to be displayed by showing the video to be analyzed to the object to be displayed, and then can perform video processing based on the emotional value information, so that the video can better meet the emotional needs of the viewing object.

[0035] It is understandable that the method can be applied to a computer device, which is a computer device capable of performing video emotion value analysis, such as a terminal device or a server. The method can be executed independently by a terminal device or a server, or can be applied to a network scenario in which a terminal device and a server communicate, and is executed in cooperation with a terminal device and a server. Among them, the terminal device can be a mobile phone, a tablet computer, a laptop computer, a desktop computer and other devices. The terminal device can also include a variety of virtual reality devices, such as augmented reality (AR) devices, such as AR glasses, AR screens and other devices, and virtual reality (VR) technology (VR) devices, such as head-mounted VR glasses and other devices. The server can be understood as an application server or a Web server. In actual deployment, the server can be an independent server, a cluster server, or a cloud server.

[0036] In order to facilitate understanding of the technical solution provided by this application, the data processing method provided by this application will be introduced below in combination with an actual application scenario.

[0037] See also Figure 1 , Figure 1 A schematic diagram of a data processing method in an actual application scenario provided in an embodiment of the present application. In this actual application scenario, the computer device may be a server 101 having a video emotion value analysis capability.

[0038] The server 101 can display the video to be analyzed to the target object, and obtain the first physiological characteristic data corresponding to the target object during the display period of the video to be analyzed to the target object through a variety of physiological characteristic data acquisition devices. The first physiological characteristic data is used to characterize the physiological characteristics corresponding to the target object during the display period, such as skin conductance level, heart rate, body temperature and other characteristics. Since the change of physiological characteristics usually corresponds to the change of the object's emotions, the server 101 can analyze the change of the physiological characteristics of the target object during the display period according to the first physiological characteristic data, and then analyze the emotional value information corresponding to the video to be analyzed. The emotional value information is used to characterize the degree of emotional impact on any object with video viewing ability, such as the degree of emotional impact on the object to be displayed when the object to be displayed displays the video to be analyzed. Therefore, the emotional value of the video to be analyzed can be analyzed in this way, and then the video can be recommended to other objects based on the emotional value information. For example, when the degree of emotional impact represented by the emotional value information is high, the video to be analyzed can be displayed to the viewing object with higher emotional value requirements to meet the emotional value requirements of the viewing object as much as possible.

[0039] Next, the technical solution provided by this application will be introduced in detail in conjunction with the accompanying drawings.

[0040] See also Figure 2 , Figure 2 A flowchart of a data processing method provided in an embodiment of the present application, the method comprising:

[0041] S201: Determine the video to be analyzed.

[0042] Among them, the video to be analyzed can be any video, such as a movie, animation, documentary, etc. The video to be analyzed is used to show the target object, and the target object is any object with video viewing ability, such as a user of a video platform, etc., which is not limited here.

[0043] S202: Obtain first physiological characteristic data corresponding to the target object during the display period of the video to be analyzed.

[0044] Changes in physiological characteristics are closely related to changes in emotions. For example:

[0045] 1. The relationship between heart rate and brain activity. Changes in heart rate reflect changes in cognitive and emotional values.

[0046] Cardiac activity is not only related to human movement, but also strongly correlated with brain activity. Since the activities of the brain and heart cannot be controlled autonomously, these synchronization phenomena will appear spontaneously. These activities also show complex and regular characteristics in time series because they can be considered as a self-organizing system with nonlinear interactions between its components on multiple time scales.

[0047] An article in Nature, "Engagement in video and audio narratives: contrasting self-report and physiological measures," points out that in a study of audio stories, narratives reproduced in listeners similar brain activity patterns as those produced by storytellers. Using functional magnetic resonance imaging (FMRI) to scan the storytelling brain and the storylistening brain, it was found that there was extensive coupling between the speaker's brain and the listener's brain activity. In other words, the act of listening to a story reproduces the same basic pattern of brain activity as storytelling. This may mean that the listener has the same mental representation as the speaker, but at least it shows that listening to a story produces similar neural processing. By reasoning that the same brain activity has the same magnetic resonance imaging (FMRI), emotional value can also be detected by changes in magnetic resonance imaging.

[0048] The article "Engagement in video and audio narratives: contrasting self-report and physiological measures" also reveals the relationship between heart activity and the brain. Heart activity can be measured by changes in heart rate. The article points out that changes in heart rate are related to increased information processing needs or greater mental work; heart rate has a close and complex relationship with specific cognitive states; an increase in heart rate is an indicator of increased human effort and an indirect measure of cognitive and emotional engagement. When people pay more attention to internal information rather than the external environment, their heart rate increases; at the same time, an increase in heart rate indicates cognitive refinement, that is, the amplification of basic information processing activities, such as logical reasoning, concentration, and emotional processing through discussion, cognition, or imagination. Although the article compares that the narrative provided in the form of audiobooks requires more positive psychological feedback than watching videos, the conclusion is that the heart rate of audio relative to video stories will increase, and it can also be deduced that the heart rate of different videos with high emotional value will be higher.

[0049] 2. Relationship between galvanic skin response (GSR) and emotional changes

[0050] Galvanic skin response (GSR) is another physiological indicator of engagement, which is often understood as an index of emotional arousal. The amygdala is one of the key emotional centers in the brain. It stimulates the adrenal medulla, releases adrenaline hormones and strengthens the autonomic nervous system. One of the results is that the sweat glands in the dermis contract, thereby increasing skin conductance. That is, when the body is stimulated by sensory stimulation or changes in emotions, the blood vessels in the skin will contract and dilate due to the individual's emotional stimulation. At the same time, the body's sweat gland secretion will also change, which will cause changes in skin resistance and form a galvanic skin response. When the sweat glands are stimulated and become more active, they secrete sweat to the surface of the skin through the pores. When the balance of positive and negative ions in the secretion is broken, the current is easier to flow, resulting in changes in skin conductance, and the changes can be measured. Changes in skin conductance are called galvanic skin response. Therefore, galvanic skin response (GSR) provides an indirect method to measure emotional arousal and can be used to assess whether the human body has differential emotional responses to external affairs.

[0051] Skin resistance is a physical quantity that describes the conductivity of human skin. The smaller the skin resistance, the stronger the conductivity, and the greater the current that can pass under the same voltage. Skin resistance has a large range of numerical changes, and its value is affected by many factors, such as the thickness of the skin's stratum corneum, the secretion of sweat, and the blood circulation in the body. Skin resistance is an external manifestation of psychological phenomena. Emotional fluctuations will affect skin resistance. When the human body is nervous and sweating, the body's conductivity will increase and the skin resistance value will decrease; on the contrary, when the human body tends to be calm and the skin is drier, the skin resistance value will increase accordingly. Therefore, skin resistance can also measure changes in human emotions.

[0052] An article from the University of Alabama, "Electrodermal Responses: What Happens in the Brain", reveals the relationship between electrodermal activity (EDA) and the brain. The article explains how EDA is a sensitive physiological and psychological indicator of autonomic nervous system activity, combined with emotional and cognitive states. EDA reflects the activity of the sympathetic nervous system and is closely related to emotions, attention, and cognitive processes. The figure above shows the galvanic skin response of the human body during cognitive effort. The galvanic skin response of the subjects at rest varies greatly from the galvanic skin activity during cognitive stress tests. Conclusion: EDA is a sensitive, convenient and effective measurement method for changes in emotions, cognition, and attention.

[0053] 3. Relationship between changes in skin temperature and emotional changes

[0054] Body temperature regulation is a higher-level regulatory function acquired by animals in the long process of evolution. Many social animals have evolved to share body warmth with each other by directing blood to the skin and then huddling together or making skin contact. It can be summarized that changes in body surface temperature are related to emotions and social activities. The article "Engagement in video and audio narratives: contrasting self-report and physiological measures" points out that when participants watch movie clips that produce positive and happy emotions or have positive social interactions, the skin temperature on their hands will rise a small amount; the study also found that the temperature of the fingers will decrease in response to fear-inducing stimuli. Conclusion: By measuring the changes in the user's body temperature, we can detect the physiological changes that video content brings to the audience.

[0055] 4. Compare the physiological changes when watching video and audio. The high emotional value comes from outside the picture.

[0056] According to the Nature article "Engagement in video and audio narratives: contrasting self-report and physiological measures", the study found that participants felt more focused and engaged when watching videos, but their physiological responses showed more cognitive and emotional engagement when listening to audio narratives. Oral narratives require participants to be actively engaged listeners, while videos provide rich stimulation for more passive viewers. The images in the listener's mind may not be as vivid and detailed as those on the screen, so auditory narratives are explicitly rated as less attractive; however, the imaginative generation of these images requires more cognitive and emotional processing, so they are more physiologically attractive. Similarly, the emotional value of the film content is more reflected in emotional engagement rather than passive visual stimulation. Therefore, films with high emotional value can lead to higher physiological responses. Furthermore, the emotional value of the film content can be judged by the fluctuations in physiological responses.

[0057] It can be seen that changes in physiological characteristics such as skin conductance level, body temperature, heart rate, etc. are closely related to changes in emotions. Therefore, in order to analyze the emotional impact of watching the video to be analyzed on the target object, the computer device can first obtain the first physiological characteristic data corresponding to the target object in the display period of the video to be analyzed. The display period is the period when the video to be analyzed is displayed to the target object. The first physiological characteristic data is used to characterize the physiological characteristics corresponding to the target object in the display period. The physiological characteristic data may include multiple data, which will be introduced in detail below.

[0058] S203: Determine the emotion value information corresponding to the video to be analyzed according to the first physiological characteristic data.

[0059] The computer device can analyze the changes in the physiological characteristics of the target object during the display period through the first physiological characteristic data, thereby analyzing the changes in the emotions of the target object during the display period, and further analyzing the impact of watching the video to be analyzed on the emotions of the target object. Based on this, the computer device can determine the emotional value information corresponding to the video to be analyzed, and the emotional value information is used to characterize the degree of emotional impact of the video to be analyzed on the viewing object. For example, it can be used to characterize the degree of emotional impact on the object to be displayed when the video to be analyzed is displayed to the object to be displayed. The object to be displayed can be any object with video viewing ability.

[0060] The emotional value information may include multiple types of information, such as numerical information, such as Arabic numerals, etc., which characterize the degree of emotional impact of the video to be analyzed on the viewing object through the size of the numerical value; or text information, which describes the degree of emotional impact through text, which is not limited here. In addition, based on different physiological characteristic data, the processing device may also determine the emotional value information in different ways, which will be described in detail below.

[0061] It can be seen from the above technical solution that the present application can first determine the video to be analyzed, and the video to be analyzed is used to display to the target object, and the target object can be any object with video viewing ability. During the period when the target object watches the video to be analyzed, the first physiological characteristic data corresponding to the target object in the display period of the video to be analyzed can be obtained, and the first physiological characteristic data can be used to characterize the physiological characteristics corresponding to the target object in the display period. Since the change of physiological characteristics can reflect the change of emotions to a certain extent, the emotional value information corresponding to the video to be analyzed can be determined according to the first physiological characteristic data. The emotional value information is used to characterize the emotional impact of the object to be displayed when the video to be analyzed is displayed to the object to be displayed. The object to be displayed can be any object with video viewing ability. In this way, the emotional changes that the video to be analyzed can cause to the viewing object can be accurately analyzed, and then the emotional value of the video to be analyzed can be analyzed. Based on the emotional value information, the video to be analyzed can be recommended, video edited, etc. in the subsequent process, so that the video recommended to the viewing object can be more in line with the emotional needs of the viewing object, and bring the viewing object a better video viewing experience.

[0062] Next, various physiological characteristics that may be involved in this application will be introduced in detail.

[0063] In the present application, physiological characteristics may include multiple types, such as skin conductance level, heart rate and body temperature, etc. These three physiological characteristics will be introduced below.

[0064] The first one: skin conductance level

[0065] Skin Conductance Level (SCL) is the baseline of skin conductance without any environmental stimulation, which changes slowly and slightly within tens of seconds to minutes. The rise and fall of SCL varies with individual reactions, skin dryness or self-regulation ability. The rise and fall of SCL depends on the hydration of the subject. The hydration of the skin refers to the ability of keratin or its degradation products in the outermost layer of the skin, the stratum corneum, to bind water.

[0066] In a possible implementation, the first physiological characteristic data is skin conductance data, which can be collected by Figure 3 This is accomplished by installing acquisition devices at various locations on the object as shown. Figure 3 The serial number in is used to identify each point on the object where data can be collected. The collection device can collect skin conductance data corresponding to each part by current detection and other methods, and then transmit the data to the computer device for analysis of emotional value information by Bluetooth, wired transmission, wireless network transmission and other methods. Alternatively, the computer device can also be the collection device itself, and after collecting the skin conductance data, the emotional value can be directly analyzed based on the skin computer data, which is not limited here.

[0067] The skin conductance data is used to characterize the skin conductance level of the target object in the display period. When executing step S203, the computer device may execute steps S2031-S2032 (not shown in the figure). Steps S2031-S2032 are a possible implementation of step S203, including:

[0068] S2031: Determine the number of times the target object has a skin conductance response during the display period and the amplitude of each skin conductance response based on the skin conductance data.

[0069] Skin Conductance Response (SCR), the phase response is above the basal level, with a higher amplitude and faster speed, and is displayed in the form of "GSR burst" or "GSR peak". SCR is sensitive to specific emotional stimulation events. Event-related skin conductance response (ER-SCRs) will burst between 1 and 5 seconds after the emotional stimulation occurs; non-specific skin conductance response (NS-SCRs) occurs spontaneously in the human body at a rate of 1 to 3 minutes, regardless of any stimulation. SCR has more significant changes than SCL, so this physiological indicator is the key to distinguishing emotional changes.

[0070] Among them, a skin conductance response (SCR) is composed of the skin conductance level rising process and the skin conductance level falling process, such as Figure 4As shown. The skin conductance level will rise due to the sudden change of the target object's emotions, and then fall due to the calming of emotions. Therefore, a skin conductance response can indicate that the target object's emotions have changed. Among them, the number of times the target object has a skin conductance response during the display period can represent the number of times the target object has emotional changes during the display period, and the amplitude of each skin conductance response can represent the amplitude of the target object's emotional changes. Therefore, these two data can represent the degree of influence of the display of the video to be analyzed on the target object's emotions.

[0071] S2032: Determine the emotion value information corresponding to the video to be analyzed according to the number of skin conductance responses and the amplitude of each skin conductance response.

[0072] Among them, the degree of emotional impact represented by the emotional value information is positively correlated with the number of skin conductance responses, that is, the more times the skin conductance response appears in the display period, the more frequent the emotional changes of the target object when watching the video to be analyzed, so it can be determined that the video to be analyzed can affect the target object's emotions to a greater extent; the degree of emotional impact represented by the emotional value information is positively correlated with the amplitude of each skin conductance response, that is, the greater the amplitude of each conductance level fluctuation, the greater the degree of emotional change of the target object, so it can be determined that the video to be analyzed can affect the target object's emotions to a greater extent. As mentioned above, emotional value information can include multiple types of information. Taking numerical type emotional value information as an example, the processing device can generate corresponding emotional value information through a preset conversion function based on the parameters of the two dimensions of the number of skin conductance responses and the amplitude of skin conductance responses. The numerical value of the emotional value information can be positively correlated with the degree of emotional impact represented. At this time, the number of skin conductance responses is positively correlated with the numerical value of the emotional value information, and the amplitude of the skin conductance response is positively correlated with the numerical value of the emotional value information. The conversion function may be any function as long as it can satisfy the above-mentioned correlation relationship between the information, and is not limited here.

[0073] Among them, the fluctuation range can be reflected by the following data:

[0074] (1) Average SCR peak amplitude: The amplitude difference between the starting point and the peak value, SCR amplitude. SCR is a response caused by stimulation, and its amplitude can be used as an indicator of the intensity of internal and external stimulation. The greater the intensity, the greater the amplitude and the stronger the response.

[0075] (2) SCR peak amplitude standard deviation: The standard deviation of multiple SCR amplitude data, which measures the fluctuation of the peak amplitude.

[0076] (3) Average SCR rise time: the duration from the onset of stimulation to the peak.

[0077] (4) Average SCR half-decay period: The time from the highest point of SCR to the time it recovers to half of its level. The shorter the time, the stronger its stress recovery ability, and the longer the time, the stronger the stimulation.

[0078] (5) Average SCR recovery time: duration from peak to baseline recovery

[0079] Among them, the skin conductance response is sensitive to specific emotional stimulation events. Event-related skin conductance responses (ER-SCRs) will burst out between 1 and 5 seconds after the emotional stimulation occurs; non-specific skin conductance responses (NS-SCRs) occur spontaneously in the human body at a rate of 1 to 3 minutes, regardless of any stimulation. SCR has more significant changes than SCL, so not every change in skin conductance level is due to emotional changes, but may also be a natural change.

[0080] Based on this, in a possible implementation, the computer device can set a preset skin conductance level threshold and a preset duration. The above-mentioned skin conductance response is sequentially composed of a skin conductance level rising process with a peak value exceeding the preset skin conductance level threshold and a skin conductance level falling process, and the duration of a skin conductance response does not exceed the preset duration, so that a skin conductance response that can reflect the emotional changes of the target object can be statistically calculated.

[0081] In addition, when analyzing skin conductance levels, such as Figure 5 As shown, the computer equipment can also combine the following data for analysis:

[0082] (1) Peak amplitude: The amplitude difference between the starting point and the peak value.

[0083] (2) Rise time: the duration from the beginning to the peak. The longer the duration, the greater the impact.

[0084] (3) Half-decay period: The duration from peak to half of the peak. The longer the time, the greater the impact.

[0085] (4) Recovery time (i.e., the time it takes for skin conductance levels to drop): the duration of recovery from the peak to the baseline. Similarly, the longer the time, the greater the degree of impact.

[0086] Second: Heart rate

[0087] Heart rate (English: Heart rate) refers to the frequency (beats) of heart contractions (contractions) and the number of beats per minute (bpm). A normal person's heart rate is 60 to 100 beats per minute (60-100 bpm (times / minute)) when calm. The heartbeat will accelerate during exercise. Athletes with better cardiopulmonary function will have a slower heartbeat than normal people.

[0088] Heart Rate Variability (HRV) refers to the variation of heart rate at different points in time. Usually, we think of heart rate as a fixed value, but in fact the heart beats are not completely uniform, and it will have slight changes in time. HRV is measured by analyzing the time intervals between heart beats. Under normal circumstances, the heart beat intervals will have a certain variation and show different patterns under different physiological and psychological states. This variation can be determined by measuring and analyzing the electrocardiogram (ECG) or pulse waveform. HRV is widely considered to be an indicator of the level of activity of the autonomic nervous system, especially sensitive to the activity of the sympathetic and parasympathetic nerves. The sympathetic nervous system is responsible for stress response and coping with tense activities, while the parasympathetic nervous system promotes relaxation and recovery. A higher HRV is generally considered to be an indicator of good psychological and physical health. It is related to factors such as the flexibility of heart function, the balance of the autonomic nervous system, and the regulation of stress response. Generally speaking, people with higher heart rate variability are more adaptable and resilient, and have a stronger ability to cope with stress and stress.

[0089] From the above, it can be seen that changes in heart rate are related to increased information processing needs or greater mental work; an increase in heart rate is an indicator of increased effort and an indirect measure of cognitive and emotional engagement. When people pay more attention to internal information rather than the external environment, their heart rate increases; at the same time, an increase in heart rate indicates cognitive refinement, that is, the amplification of basic information processing activities. That is, when heart rate changes, there is a high probability that emotional changes have occurred.

[0090] Based on this, in a possible implementation, the first physiological characteristic data may be heart rate data, and the heart rate data is used to characterize the heart rate of the target object in the display period. When executing step S203, the computer device may execute steps S2033-S2034 (not shown in the figure), and steps S2033-S2034 are a possible implementation of step S203, including:

[0091] S2033: Determine the overall heart rate information and heart rate change information corresponding to the target object according to the heart rate data.

[0092] The overall heart rate information is used to characterize the overall heart rate level of the target object in the display period, and the heart rate change information is used to characterize the way in which the heart rate of the target object changes in the display period.

[0093] S2034: Determine the emotion value information corresponding to the video to be analyzed based on the overall heart rate information and the heart rate change information.

[0094] Among them, the degree of emotional impact represented by the emotional value information is positively correlated with the overall heart rate level, and is positively correlated with the number of changes and / or the amplitude of changes represented by the heart rate change information. That is, the higher the overall heart rate level of the target object determined by the computer device through the overall heart rate information during the display period, the more intense the emotions of the target object when watching the video to be analyzed, and thus it can be explained that the video to be analyzed has a greater emotional impact on the target object. At the same time, the heart rate change information can characterize the change mode of the target object's heart rate from the two dimensions of the number of changes and / or the amplitude of changes. The more the number of changes, or the larger the amplitude of changes, it can be explained that the target object's heart rate changes more drastically during the display period, thereby indicating that the video to be analyzed has a greater emotional impact on the target object.

[0095] Among them, the computer device can preset a heart rate data statistical cycle and count the heart rate data based on the cycle. For example, the heart rate data statistical cycle can be 1 minute, that is, the heart rate data includes the heart rate of the target object per minute in the display period, so that the overall heart rate level can be obtained by analyzing the average heart rate in the display period, and the heart rate change information can be obtained by analyzing the changes in heart rate data of adjacent periods (such as the heart rate change amplitude, heart rate difference, etc.). If the heart rate difference between adjacent periods is higher, it means that the heart rate change amplitude is larger, and the degree of influence represented by the determined emotional value information is greater.

[0096] When the emotional value information is of numerical type, the processing device can also determine the emotional value information based on the overall heart rate information and the heart rate change information based on the conversion function. When the numerical value of the emotional value information is positively correlated with the degree of emotional impact represented, the conversion function satisfies that the overall heart rate level represented by the overall heart rate information is positively correlated with the numerical value of the emotional value information, and satisfies that the number of changes and / or the magnitude of changes represented by the heart rate change information are positively correlated with the numerical value of the emotional value information. The conversion function only needs to satisfy the above-mentioned association relationship, and is not limited here.

[0097] The third type: body temperature

[0098] From the above analysis, it can be seen that if the target object has emotional changes, it is likely to cause body temperature fluctuations. Therefore, in a possible implementation, the computer device can obtain the target object's body temperature data during the display period to analyze the degree of emotional change of the target object.

[0099] In this implementation, the first physiological characteristic data may be body temperature data, and the body temperature data is used to characterize the body temperature of the target object in the display period. When executing step S203, the computer device may execute steps S2035-S2036 (not shown in the figure), and steps S2035-S2036 are a possible implementation of step S203, including:

[0100] S2035: Determine the overall body temperature information and body temperature change information corresponding to the target object based on the body temperature data.

[0101] The overall body temperature information is used to characterize the overall body temperature level of the target object in the display period, and the body temperature change information is used to characterize the change mode of the body temperature of the target object in the display period. For example, the computer device can set a statistical cycle, count the average body temperature of the target object in each cycle, and then calculate the average body temperature of the target object in the display period as the overall body temperature information; and can determine the average body temperature difference between adjacent statistical cycles as the body temperature change information.

[0102] S2036: Determine the emotion value information corresponding to the video to be analyzed based on the overall body temperature information and the body temperature change information.

[0103] Similar to the heart rate information, the degree of emotional impact represented by the emotional value information is positively correlated with the overall body temperature level, and is positively correlated with the number of changes and / or the magnitude of changes represented by the body temperature change information. That is, when the emotional value information is numerical information, the processing device can calculate the emotional value information according to the overall body temperature information and the body temperature change information through a conversion function. When the numerical value corresponding to the emotional value information is positively correlated with the degree of emotional impact represented, the conversion function satisfies that the body temperature level represented by the overall body temperature information is positively correlated with the numerical value of the emotional value information, and the number of changes and / or the magnitude of changes represented by the body temperature change information are positively correlated. Here, the conversion function only needs to satisfy the above-mentioned information generation function, and is not limited here.

[0104] In addition to analyzing emotional changes based on the target object's physiological characteristics during the display period, the computer device can also obtain the target object's physiological characteristic data when not watching the video to compare and analyze whether there are major physiological characteristic changes when watching the video, that is, whether there are major emotional fluctuations.

[0105] The computer device may obtain the second physiological characteristic data corresponding to the target object in the non-display period, and the second physiological characteristic data is used to characterize the physiological characteristics corresponding to the target object in the non-display period, and the non-display period is a period when the video is not displayed to the target object. It can be understood that the greater the difference between the physiological characteristics corresponding to the target object in the display period and the non-display period, the greater the difference between the emotional state of the target object when watching the video and the emotional state when not watching the video, which can indicate that watching the video to be analyzed can cause a significant change in the target object's emotions, and the emotional value information can be determined based on the difference.

[0106] When executing step S2037, the computer device may execute step S2037 (not shown in the figure), which is a possible implementation of step S203, including:

[0107] S2037: Determine the emotion value information corresponding to the video to be analyzed based on the data difference between the first physiological characteristic data and the second physiological characteristic data.

[0108] Among them, the degree of emotional impact represented by the emotional value information is positively correlated with the data difference.

[0109] In a possible implementation, in order to further improve the accuracy of the emotion value information analysis, the computer device may determine the emotion value corresponding to the video to be analyzed by combining the correlation between the changes in physiological characteristics of the target object in multiple dimensions.

[0110] In this implementation, the first physiological characteristic data includes physiological characteristic data corresponding to multiple physiological characteristic dimensions, and the physiological characteristic data corresponding to the target physiological characteristic dimension is used to characterize the physiological characteristics of the target object corresponding to the target physiological characteristic dimension during the display period. It can be understood that since the physiological characteristics of multiple dimensions will be affected by the emotions of the target object, if the physiological characteristics of multiple dimensions change synchronously, it can further indicate that the emotions of the target object have changed. Based on this, when executing step S203, the computer device can execute steps S2038-S2039 (not shown in the figure), and steps S2038-S2039 are a possible implementation of step S203, including:

[0111] S2038: Determine, based on the first physiological characteristic data, the amplitude of changes in the physiological characteristic data of the target object corresponding to the multiple physiological characteristic dimensions, and the data correlation of the physiological characteristic data corresponding to the multiple physiological characteristic dimensions.

[0112] Among them, data correlation is used to characterize the correlation between physiological characteristic data corresponding to multiple physiological characteristic dimensions, that is, whether the physiological characteristic data of one dimension changes, the physiological characteristic data of another dimension also changes. If the physiological characteristic data corresponding to multiple dimensions change in a similar way, the stronger the correlation, the greater the impact of the video to be analyzed on the target object's emotions.

[0113] S2039: Determine the emotional value information corresponding to the video to be analyzed based on the change amplitude of the physiological characteristic data and the correlation of the data change.

[0114] Among them, the degree of emotional impact represented by the emotional value information is positively correlated with the amplitude of change of the physiological characteristic data, and is positively correlated with the correlation of the data change. That is, on the one hand, the greater the amplitude of change of the physiological characteristic data of each physiological characteristic dimension, the greater the emotional impact of the video to be analyzed on the target object; on the other hand, the stronger the data correlation of the physiological characteristic data of each physiological characteristic dimension, the more significant the change of the physiological characteristics of the target object caused by watching the video to be analyzed, which can also be explained as a greater degree of impact. In this way, the errors caused by analyzing data based on a single physiological characteristic data dimension can be avoided, and the accuracy of the emotional value information analysis can be improved.

[0115] For example, the computer device can select three biometric dimensions of skin conductance level, heart rate, and body temperature for analysis.

[0116] Computer equipment can use the Pearson correlation coefficient to measure data correlation, also known as the linear correlation coefficient. Covariance COV (X, Y) represents the numerical characteristics of the relationship between two variables X and Y. The calculation formula is:

[0117]

[0118] The calculation formula of Pearson correlation coefficient COR(X,Y) between two variables X and Y is:

[0119]

[0120] Among them, n is the number of values ​​of the two variables, X i Indicates the value of variable X, Y i represents the value of variable Y, represents the average value of variable X among n values, It represents the average value of variable Y among n values.

[0121] The Pearson correlation coefficient is the covariance divided by the standard deviation of the two variables. Although the covariance can reflect the degree of correlation between two random variables (when the covariance is greater than 0, it means the two are positively correlated, and when it is less than 0, it means the two are negatively correlated), its value is greatly affected by the dimension, and the degree of correlation of the variables cannot be simply judged from the numerical value of the covariance. In order to eliminate the influence of this dimension, the concept of correlation coefficient was created.

[0122] The value range of the Pearson correlation coefficient is [-1,1]. The closer its absolute value is to 1, the stronger the correlation is. The closer its absolute value is to 0, the weaker the correlation is. When the correlation coefficient is less than 0, it means that the two variables are negatively correlated. When it is greater than 0, it means that there is a positive correlation. For the strength of the correlation, please refer to Figure 6 shown.

[0123] The computer device can calculate the Pearson correlation coefficient between the skin conductance level data, the heart rate data and the body temperature data. If it is greater than 0.8, it is determined that there is a high data correlation, so that it can be determined that the degree of emotional change caused by watching the video to be analyzed is large. The higher the correlation coefficient, the greater the degree of influence represented by the emotional value information. Here, based on the different requirements for the analysis accuracy of the emotional value information, different correlation coefficient analysis methods can be selected. For example, when the analysis accuracy of the emotional value information is low, as long as there is a high correlation coefficient between two data, it can be determined that the emotional impact represented by the emotional value information is large; when the analysis accuracy of the emotional value information is high, the correlation coefficient between any two data must be high to determine that the emotional impact represented by the emotional perpetrator information is large. When the emotional value information is a numerical type of information, and the numerical value of the emotional value information is positively correlated with the degree of emotional impact represented, the processing device can generate emotional value information according to the correlation coefficient and the amplitude of change of the physiological characteristic data through a conversion function. The conversion function satisfies that the emotional value information is positively correlated with the correlation coefficient and is positively correlated with the amplitude of change of the physiological characteristic data.

[0124] Next, various scenarios to which this application is applicable will be introduced.

[0125] First, in a possible implementation, when executing step S201, the computer device may execute steps S2011-S2012 (not shown in the figure), and steps S2011-S2012 are a possible implementation of step S201, including:

[0126] S2011: Acquire the initial video.

[0127] The video content of the initial video corresponds to multiple video scenes, for example, it can be a video such as a documentary or a movie with scene switching.

[0128] S2012: Segment the initial video at a time point when a video scene corresponding to the video content of the initial video switches to obtain a plurality of videos.

[0129] Generally speaking, when an object watches a video of the same scene, the way its emotions change is relatively uniform. Therefore, a computer device can perform video segmentation based on the video scene and obtain multiple videos for analysis to accurately measure the target object's emotional changes. The video to be analyzed is any one of the multiple videos.

[0130] Among them, the detection of scene switching can be achieved by manually extracting features, such as calculating the color histogram similarity of adjacent frames, or directly calculating the frame difference, or using the change degree feature VH (viewport Height) of the high-frequency sub-band coefficients of each frame in the video scene to detect scene switching, wherein the calculation of the high-frequency sub-band coefficients requires the use of algorithms such as three-dimensional wavelet transform. These technologies will calculate a feature value and then compare it with the threshold. If it is greater than the threshold or less than the threshold, it is determined to be a switching frame. There are also some adaptive threshold algorithms based on the above technology, such as a video scene change detection method based on an adaptive threshold, in which the sliding window size and the preset threshold need to be set manually.

[0131] The scene switching detection technology may also adopt a detection algorithm based on the pixel domain or a detection algorithm based on the compression domain. Setting corresponding scene switching thresholds according to different scenes may improve the speed and accuracy of scene switching detection, which is not limited here.

[0132] In one possible implementation, if the degree of emotional impact represented by the emotional value information is greater than a preset degree threshold, it means that the video to be analyzed is a video clip in the initial video that can more significantly cause emotional changes in the viewing object. Therefore, the computer device can generate a recommended video corresponding to the initial video based on the video to be analyzed. The recommended video is used to recommend the initial video, so that the viewing object can have more significant emotional changes when watching the recommended video, thereby increasing the viewing object's interest in watching the initial video, and effectively realizing the recommendation of the initial video.

[0133] In addition, in a possible implementation, in order to recommend a video that is more in line with the emotional needs of an object, a computer device can obtain the required emotional value information corresponding to the object to be displayed. The required emotional value information is used to characterize the degree of emotional impact required by the object to be displayed when watching the video, and can characterize the emotional needs of the object to be displayed for the recommended video.

[0134] The computer device can determine whether the degree of emotional impact represented by the emotional value information corresponding to the video to be analyzed is greater than the required emotional impact degree. Based on the fact that the degree of emotional impact represented by the emotional value information is greater than the degree of emotional impact represented by the required emotional value information, it means that the emotional value requirements of the object to be displayed can be met by displaying the video to be analyzed to the object to be displayed, and thus the video to be analyzed can be determined as a video for display to the object to be displayed.

[0135] Based on the data processing method provided in the above embodiment, the present application provides a data processing device, see Figure 7 , Figure 7 This is a structural block diagram of a data processing device provided in an embodiment of the present application. The device 700 includes a first determining unit 701, a first acquiring unit 702, and a second determining unit 703:

[0136] The first determination unit 701 is used to determine a video to be analyzed, and the video to be analyzed is used to display it to a target object, and the target object is any object that has the ability to watch videos;

[0137] The first acquisition unit 702 is used to acquire first physiological characteristic data corresponding to the target object during the display period of the video to be analyzed, where the first physiological characteristic data is used to characterize the physiological characteristics corresponding to the target object during the display period;

[0138] The second determination unit 703 is used to determine the emotional value information corresponding to the video to be analyzed based on the first physiological characteristic data, and the emotional value information is used to characterize the degree of emotional impact on the object to be displayed when the video to be analyzed is displayed to the object to be displayed. The object to be displayed is any object with the ability to watch videos.

[0139] In a possible implementation, the first physiological characteristic data is skin conductance data, and the skin conductance data is used to characterize the skin conductance level of the target object in the display period, and the second determining unit 703 is specifically used to:

[0140] Determine, according to the skin conductance data, the number of times the target object has a skin conductance response during the display period, and the amplitude of each skin conductance response, wherein one skin conductance response is sequentially composed of a skin conductance level rising process and a skin conductance level falling process;

[0141] According to the number of skin conductance responses and the amplitude of each skin conductance response, the emotional value information corresponding to the video to be analyzed is determined, and the degree of emotional impact represented by the emotional value information is positively correlated with the number of skin conductance responses and the amplitude of each skin conductance response.

[0142] In a possible implementation, a skin conductance response is sequentially composed of a skin conductance level rising process whose peak value exceeds a preset skin conductance level threshold and a skin conductance level falling process, and the duration of a skin conductance response does not exceed the preset duration.

[0143] In a possible implementation, the first physiological characteristic data is heart rate data, and the heart rate data is used to characterize the heart rate of the target object in the display period. The second determining unit 703 is specifically configured to:

[0144] Determine the overall heart rate information and heart rate change information corresponding to the target object according to the heart rate data, wherein the overall heart rate information is used to characterize the overall heart rate level of the target object in the display period, and the heart rate change information is used to characterize the change mode of the heart rate of the target object in the display period;

[0145] Based on the overall heart rate information and the heart rate change information, the emotional value information corresponding to the video to be analyzed is determined, and the degree of emotional impact represented by the emotional value information is positively correlated with the overall heart rate level, and is positively correlated with the number of changes and / or the magnitude of changes represented by the heart rate change information.

[0146] In a possible implementation, the first physiological characteristic data is body temperature data, and the body temperature data is used to characterize the body temperature of the target object in the display period. The second determining unit 703 is specifically configured to:

[0147] Determine, according to the body temperature data, the overall body temperature information and the body temperature change information corresponding to the target object, wherein the overall body temperature information is used to characterize the overall body temperature level of the target object in the display period, and the body temperature change information is used to characterize the change mode of the body temperature of the target object in the display period;

[0148] Based on the overall body temperature information and the body temperature change information, the emotional value information corresponding to the video to be analyzed is determined, and the degree of emotional impact represented by the emotional value information is positively correlated with the overall body temperature level, and is positively correlated with the number of changes and / or the magnitude of changes represented by the body temperature change information.

[0149] In a possible implementation manner, the device further includes a second acquiring unit:

[0150] The second acquisition unit is used to acquire second physiological characteristic data corresponding to the target object in a non-display period, where the second physiological characteristic data is used to characterize the physiological characteristics corresponding to the target object in the non-display period, and the non-display period is a period when the video is not displayed to the target object;

[0151] The second determining unit 703 is specifically configured to:

[0152] According to the data difference between the first physiological characteristic data and the second physiological characteristic data, the emotional value information corresponding to the video to be analyzed is determined, and the degree of emotional impact represented by the emotional value information is positively correlated with the data difference.

[0153] In a possible implementation, the first physiological characteristic data includes physiological characteristic data corresponding to a plurality of physiological characteristic dimensions, and the physiological characteristic data corresponding to the target physiological characteristic dimension is used to characterize the physiological characteristics of the target object corresponding to the target physiological characteristic dimension during the display period;

[0154] The second determining unit 703 is specifically configured to:

[0155] Determine, based on the first physiological characteristic data, the magnitude of changes in the physiological characteristic data of the target object corresponding to the multiple physiological characteristic dimensions, and the data change correlation of the physiological characteristic data corresponding to the multiple physiological characteristic dimensions;

[0156] Based on the change amplitude of the physiological characteristic data and the data change correlation, the emotional value information corresponding to the video to be analyzed is determined, and the degree of emotional impact represented by the emotional value information is positively correlated with the change amplitude of the physiological characteristic data and positively correlated with the data change correlation.

[0157] In a possible implementation manner, the first determining unit 701 is specifically configured to:

[0158] Acquire an initial video, wherein video content of the initial video corresponds to multiple video scenes;

[0159] The initial video is segmented at a time point when a video scene corresponding to the video content of the initial video switches to obtain a plurality of videos, and the video to be analyzed is any one of the plurality of videos.

[0160] In a possible implementation manner, the device further includes a generating unit:

[0161] The generating unit is used to generate a recommended video corresponding to the initial video according to the video to be analyzed if the degree of emotional impact represented by the emotional value information is greater than a preset degree threshold, and the recommended video is used to recommend the initial video.

[0162] In a possible implementation manner, the apparatus further includes a third acquiring unit and a third determining unit:

[0163] The third acquisition unit is used to acquire the required emotional value information corresponding to the object to be displayed, and the required emotional value information is used to represent the degree of emotional impact required by the object to be displayed when watching a video;

[0164] The third determination unit is used to determine the video to be analyzed as a video to be displayed to the object to be displayed based on the fact that the degree of emotional impact represented by the emotional value information is greater than the degree of emotional impact represented by the required emotional value information.

[0165] The present application also provides a computer device, see Figure 8 As shown, the computer device may be a terminal device, and a mobile phone is taken as an example:

[0166] Figure 8 FIG. 1 is a block diagram showing a partial structure of a mobile phone related to a terminal device provided in an embodiment of the present application. Figure 8 The mobile phone includes: a radio frequency (RF) circuit 710, a memory 720, an input unit 730, a display unit 740, a sensor 750, an audio circuit 760, a wireless fidelity (WiFi) module 770, a processor 780, and a power supply 790. Those skilled in the art will understand that Figure 8 The mobile phone structure shown in the figure does not constitute a limitation on the mobile phone, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0167] Combine the following Figure 8 A detailed introduction to the various components of the mobile phone:

[0168] The RF circuit 710 can be used for receiving and sending signals during the process of sending and receiving information or making calls. In particular, after receiving the downlink information of the base station, it is sent to the processor 780 for processing; in addition, the designed uplink data is sent to the base station. Usually, the RF circuit 710 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (Low Noise Amplifier, referred to as LNA), a duplexer, etc. In addition, the RF circuit 710 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to the Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), etc.

[0169] The memory 720 can be used to store software programs and modules. The processor 780 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 720. The memory 720 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 720 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0170] The input unit 730 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the mobile phone. Specifically, the input unit 730 may include a touch panel 731 and other input devices 732. The touch panel 731, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 731 or near the touch panel 731 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. Optionally, the touch panel 731 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the processor 780, and can receive and execute commands sent by the processor 780. In addition, the touch panel 731 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 731, the input unit 730 may further include other input devices 732. Specifically, the other input devices 732 may include but are not limited to one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

[0171] The display unit 740 can be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 740 may include a display panel 741. Optionally, the display panel 741 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), etc. Further, the touch panel 731 may cover the display panel 741. When the touch panel 731 detects a touch operation on or near it, it is transmitted to the processor 780 to determine the type of touch event. Subsequently, the processor 780 provides a corresponding visual output on the display panel 741 according to the type of touch event. Although in Figure 8 In the embodiment, the touch panel 731 and the display panel 741 are used as two independent components to realize the input and output functions of the mobile phone, but in some embodiments, the touch panel 731 and the display panel 741 can be integrated to realize the input and output functions of the mobile phone.

[0172] The mobile phone may also include at least one sensor 750, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 741 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 741 and / or the backlight when the mobile phone is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured in the mobile phone, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0173] The audio circuit 760, the speaker 761, and the microphone 762 can provide an audio interface between the user and the mobile phone. The audio circuit 760 can transmit the received audio data to the speaker 761 after converting the received audio data into an electrical signal, which is converted into a sound signal for output; on the other hand, the microphone 762 converts the collected sound signal into an electrical signal, which is received by the audio circuit 760 and converted into audio data, and then the audio data is output to the processor 780 for processing, and then sent to another mobile phone through the RF circuit 710, or the audio data is output to the memory 720 for further processing.

[0174] WiFi is a short-range wireless transmission technology. The mobile phone can help users send and receive emails, browse web pages and access streaming media through the WiFi module 770. It provides users with wireless broadband Internet access. Figure 8 A WiFi module 770 is shown, but it is understandable that it is not an essential component of the mobile phone and can be omitted as needed without changing the essence of the invention.

[0175] The processor 780 is the control center of the mobile phone. It uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing software programs and / or modules stored in the memory 720, and calling data stored in the memory 720, it executes various functions of the mobile phone and processes data, thereby performing overall detection of the mobile phone. Optionally, the processor 780 may include one or more processing units; preferably, the processor 780 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 780.

[0176] The mobile phone also includes a power supply 790 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 780 through a power management system, so that the power management system can manage charging, discharging, power consumption and other functions.

[0177] Although not shown, the mobile phone may also include a camera, a Bluetooth module, etc., which will not be described in detail here.

[0178] In this embodiment, the processor 780 included in the terminal device also has the following functions:

[0179] Determine a video to be analyzed, where the video to be analyzed is used to be displayed to a target object, where the target object is any object capable of viewing a video;

[0180] Acquire first physiological characteristic data corresponding to the target object in a display period of the video to be analyzed, where the first physiological characteristic data is used to characterize the physiological characteristics corresponding to the target object in the display period;

[0181] Based on the first physiological characteristic data, the emotional value information corresponding to the video to be analyzed is determined, and the emotional value information is used to characterize the degree of emotional impact on the object to be displayed when the video to be analyzed is displayed to the object to be displayed. The object to be displayed is any object with the ability to watch videos.

[0182] The present application also provides a server. Fig. 9 As shown, Fig. 9 The structural diagram of the server 800 provided in the embodiment of the present application, the server 800 may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPU) 822 (for example, one or more processors) and a memory 832, and one or more storage media 830 (for example, one or more mass storage devices) storing application programs 842 or data 844. Among them, the memory 832 and the storage medium 830 can be temporary storage or permanent storage. The program stored in the storage medium 830 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the server. Furthermore, the central processing unit 822 can be configured to communicate with the storage medium 830 and execute a series of instruction operations in the storage medium 830 on the server 800.

[0183] The server 800 may also include one or more power supplies 826, one or more wired or wireless network interfaces 850, one or more input and output interfaces 858, and / or one or more operating systems 841, such as Windows Server 2000.TM , Mac OS X TM , Unix TM ,Linux TM , FreeBSD TM etc.

[0184] The steps performed by the server in the above embodiment can be based on Fig. 9 The server structure shown.

[0185] The embodiment of the present application further provides a computer-readable storage medium for storing a computer program, wherein the computer program is used to execute any one of the object information display methods described in the aforementioned embodiments.

[0186] An embodiment of the present application further provides a computer program product including a computer program, which, when executed on a computer device, enables the computer device to execute the object information display method described in any one of the above embodiments.

[0187] It is understandable that in the specific implementation of the present application, related data such as user information (such as physiological characteristic data) is involved. When the above embodiments of the present application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0188] A person of ordinary skill in the art can understand that all or part of the steps of implementing the above-mentioned method embodiment can be completed by hardware related to program instructions, and the above-mentioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above-mentioned method embodiment; and the above-mentioned storage medium can be at least one of the following media: read-only memory (English: read-only memory, abbreviated: ROM), RAM, magnetic disk or optical disk, etc. Various media that can store program codes.

[0189] It should be noted that each embodiment in this specification is described in a progressive manner, and the same and similar parts between the embodiments can refer to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device and system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can refer to the partial description of the method embodiments. The device and system embodiments described above are merely schematic, in which the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative work.

[0190] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A data processing method, characterized in that: The method comprises: Determine a video to be analyzed, where the video to be analyzed is used to be displayed to a target object, where the target object is any object capable of viewing a video; Acquire first physiological characteristic data corresponding to the target object in a display period of the video to be analyzed, where the first physiological characteristic data is used to characterize the physiological characteristics corresponding to the target object in the display period; Based on the first physiological characteristic data, the emotional value information corresponding to the video to be analyzed is determined, and the emotional value information is used to characterize the degree of emotional impact on the object to be displayed when the video to be analyzed is displayed to the object to be displayed. The object to be displayed is any object with the ability to watch videos.

2. The method according to claim 1, characterized in that The first physiological characteristic data is skin conductance data, and the skin conductance data is used to characterize the skin conductance level of the target object in the display period. Determining the emotional value information corresponding to the video to be analyzed based on the first physiological characteristic data includes: Determine, according to the skin conductance data, the number of times the target object has a skin conductance response during the display period, and the amplitude of each skin conductance response, wherein one skin conductance response is sequentially composed of a skin conductance level rising process and a skin conductance level falling process; According to the number of skin conductance responses and the amplitude of each skin conductance response, the emotional value information corresponding to the video to be analyzed is determined, and the degree of emotional impact represented by the emotional value information is positively correlated with the number of skin conductance responses and the amplitude of each skin conductance response.

3. The method according to claim 2, characterized in that A skin conductance response is composed of a skin conductance level rising process in which the peak value exceeds a preset skin conductance level threshold and a skin conductance level falling process, and the duration of a skin conductance response does not exceed the preset duration.

4. The method according to claim 1, characterized in that: The first physiological characteristic data is heart rate data, and the heart rate data is used to characterize the heart rate of the target object in the display period. The determining, based on the first physiological characteristic data, the emotional value information corresponding to the video to be analyzed includes: Determine the overall heart rate information and heart rate change information corresponding to the target object according to the heart rate data, wherein the overall heart rate information is used to characterize the overall heart rate level of the target object in the display period, and the heart rate change information is used to characterize the change mode of the heart rate of the target object in the display period; Based on the overall heart rate information and the heart rate change information, the emotional value information corresponding to the video to be analyzed is determined, and the degree of emotional impact represented by the emotional value information is positively correlated with the overall heart rate level, and is positively correlated with the number of changes and / or the magnitude of changes represented by the heart rate change information.

5. The method according to claim 1, characterized in that The first physiological characteristic data is body temperature data, and the body temperature data is used to characterize the body temperature of the target object in the display period. The determining, based on the first physiological characteristic data, the emotional value information corresponding to the video to be analyzed includes: Determine, according to the body temperature data, the overall body temperature information and the body temperature change information corresponding to the target object, wherein the overall body temperature information is used to characterize the overall body temperature level of the target object in the display period, and the body temperature change information is used to characterize the change mode of the body temperature of the target object in the display period; Based on the overall body temperature information and the body temperature change information, the emotional value information corresponding to the video to be analyzed is determined, and the degree of emotional impact represented by the emotional value information is positively correlated with the overall body temperature level, and is positively correlated with the number of changes and / or the magnitude of changes represented by the body temperature change information.

6. The method according to claim 1, characterized in that The method further comprises: Acquire second physiological characteristic data corresponding to the target object in a non-display period, where the second physiological characteristic data is used to characterize the physiological characteristics corresponding to the target object in the non-display period, where the non-display period is a period during which no video is displayed to the target object; Determining the emotion value information corresponding to the video to be analyzed based on the first physiological characteristic data: According to the data difference between the first physiological characteristic data and the second physiological characteristic data, the emotion value information corresponding to the video to be analyzed is determined, and the degree of emotion impact represented by the emotion value information is positively correlated with the data difference.

7. The method according to claim 1, characterized in that The first physiological characteristic data includes physiological characteristic data corresponding to a plurality of physiological characteristic dimensions respectively, and the physiological characteristic data corresponding to the target physiological characteristic dimension is used to characterize the physiological characteristics of the target object corresponding to the target physiological characteristic dimension during the display period; Determining the emotion value information corresponding to the video to be analyzed according to the first physiological characteristic data includes: Determine, based on the first physiological characteristic data, the magnitude of changes in the physiological characteristic data of the target object corresponding to the multiple physiological characteristic dimensions, and the data change correlation of the physiological characteristic data corresponding to the multiple physiological characteristic dimensions; Based on the change amplitude of the physiological characteristic data and the data change correlation, the emotional value information corresponding to the video to be analyzed is determined, and the degree of emotional impact represented by the emotional value information is positively correlated with the change amplitude of the physiological characteristic data and positively correlated with the data change correlation.

8. The method according to claim 1, characterized in that The step of determining the video to be analyzed includes: Acquire an initial video, wherein video content of the initial video corresponds to multiple video scenes; The initial video is segmented at a time point when a video scene corresponding to the video content of the initial video switches to obtain a plurality of videos, and the video to be analyzed is any one of the plurality of videos.

9. The method according to claim 8, characterized in that The method further comprises: If the degree of emotional impact represented by the emotional value information is greater than a preset degree threshold, a recommended video corresponding to the initial video is generated based on the video to be analyzed, and the recommended video is used to recommend the initial video.

10. The method according to claim 8, characterized in that The method further comprises: Acquire the required emotional value information corresponding to the object to be displayed, wherein the required emotional value information is used to represent the degree of emotional impact required by the object to be displayed when watching a video; Based on the fact that the degree of emotional impact represented by the emotional value information is greater than the degree of emotional impact represented by the required emotional value information, the video to be analyzed is determined as a video to be displayed to the object to be displayed.

11. A data processing device, characterized in that: The device comprises a first determining unit, a first acquiring unit and a second determining unit: The first determination unit is used to determine a video to be analyzed, and the video to be analyzed is used to display it to a target object, and the target object is any object that has the ability to watch videos; The first acquisition unit is used to acquire first physiological characteristic data corresponding to the target object during a display period of the video to be analyzed, wherein the first physiological characteristic data is used to characterize the physiological characteristics corresponding to the target object during the display period; The second determination unit is used to determine the emotional value information corresponding to the video to be analyzed based on the first physiological characteristic data, and the emotional value information is used to characterize the degree of emotional impact on the object to be displayed when the video to be analyzed is displayed to the object to be displayed. The object to be displayed is any object with the ability to watch videos.

12. A computer device, characterized in that: The computer device comprises a processor and a memory: The memory is used to store a computer program and transmit the computer program to the processor; The processor is used to execute the data processing method according to any one of claims 1 to 10 according to the instructions in the computer program.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store a computer program, and the computer program is used to execute the data processing method according to any one of claims 1 to 10.

14. A computer program product comprising a computer program, which, when executed on a computer device, enables the computer device to execute the data processing method according to any one of claims 1 to 10.

Images