electronic devices

Abstract

An embodiment of the present invention provides an electronic device. The electronic device includes: a speaker; at least one proximity sensor, configured to: sense the state of a target object and generate state information of the target object accordingly; a controller, connected to the at least one proximity sensor and the speaker, and configured to: receive the state information sent by the at least one proximity sensor; and control the speaker based on the state information. In the solution of the embodiment of the present invention, since at least one proximity sensor is used to sense the state of the target object, and the controller can control the speaker based on the state information of the target object, sound interference caused by voice interaction is avoided, thereby improving the user experience.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of computer technology, and in particular to an electronic device. Background Art

[0002] Smart devices are usually controlled by mobile phones or other control terminals or voice recognition. For example, voice interaction is used to control the power on and off of smart devices, control audio and video, etc.

[0003] In voice control of smart speakers, voice commands for volume adjustment are often sent when the speaker volume is high. However, the voice commands interfere with the playback of the speaker itself, resulting in a poor user experience. Summary of the Invention

[0004] In view of this, an embodiment of the present invention provides an electronic device to solve or alleviate the above problems.

[0005] According to a first aspect of an embodiment of the present invention, an electronic device is provided, comprising: a speaker; at least one proximity sensor, configured to: sense the state of a target object and generate state information of the target object accordingly; a controller, connected to the at least one proximity sensor and the speaker, wherein the controller is configured to: receive the state information sent by the at least one proximity sensor; and control the speaker according to the state information.

[0006] According to a second aspect of an embodiment of the present invention, there is provided an electronic device, comprising: a speaker; a biometric feature acquisition component configured to sense biometric features of a target object and generate status information of the target object accordingly; and a controller connected to the biometric feature acquisition component and the speaker, wherein the controller is configured to receive the status information sent by the biometric feature acquisition component; and control the speaker according to the status information.

[0007] According to a third aspect of an embodiment of the present invention, an electronic device is provided, comprising: a human-computer interaction component, arranged with at least one proximity sensor, a display, and a component controller configured to control the at least one proximity sensor and the display, wherein the at least one proximity sensor is configured to: sense a target spatial gesture and generate the spatial gesture information accordingly, and the component controller is connected to the at least one proximity sensor and the display, wherein the component controller is configured to: perform display control on the display according to the spatial gesture information received and sent by the at least one proximity sensor.

[0008] In the solution of the embodiment of the present invention, since at least one proximity sensor is used to sense the state of the target object, and the controller can control the speaker based on the state information of the target object, sound interference caused by voice interaction is avoided and the user experience is improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present invention. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0010] Figure 1 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

[0011] Figure 2 A schematic flowchart of an example control method of an electronic device according to another embodiment of the present invention;

[0012] Figure 3 is a schematic flowchart of another exemplary control method of an electronic device according to another embodiment of the present invention;

[0013] Figure 4 is a schematic diagram of an electronic device interaction method according to another embodiment of the present invention;

[0014] Figures 5A-5D is a schematic diagram of an arrangement of proximity sensors of an electronic device according to another embodiment of the present invention;

[0015] Figure 5E is a schematic structural diagram of an electronic device according to another embodiment of the present invention;

[0016] Figure 6 is a schematic structural diagram of an electronic device according to another embodiment of the present invention;

[0017] Figure 7 FIG. 4 is a schematic diagram of a control method of an electronic device according to another embodiment of the present invention. DETAILED DESCRIPTION

[0018] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by those skilled in the art based on the embodiments in the embodiments of the present invention should fall within the scope of protection of the embodiments of the present invention.

[0019] The specific implementation of the embodiment of the present invention is further described below with reference to the accompanying drawings of the embodiment of the present invention.

[0020] Figure 1 A schematic block diagram of an electronic device according to an embodiment of the present invention is shown. Figure 1 Electronic equipment includes:

[0021] speaker 11; at least one proximity sensor 12, configured to: sense the state of the target object, and accordingly generate state information of the target object; a controller 13, connected to at least one proximity sensor 12 and the speaker 11,

[0022] The controller 13 is configured to: receive status information sent by at least one proximity sensor 12; and control the speaker 11 according to the status information.

[0023] It should be understood that the proximity sensor herein includes but is not limited to a capacitive proximity sensor, an inductive proximity sensor, and a photoelectric proximity sensor. For example, the proximity sensor is connected to the controller via an external bus, that is, via an off-chip bus. The external bus includes but is not limited to an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, an AGP (Accelerated Graphics Port) bus, a PCI-Express high-speed bus, and the like. For example, the controller is connected to a functional amplifier of a speaker. Figure 1 In the embodiment, the proximity sensors are arranged at the four corners, but it should be understood that this is only exemplary. The number and position of the proximity sensors can be arbitrary.

[0024] It should also be understood that the aforementioned electronic devices include any device equipped with a speaker. This includes, but is not limited to, IoT devices, embedded devices, smart devices, servers, mobile terminals (such as mobile phones and PADs), and personal computers. These smart devices include, but are not limited to, smart transportation equipment, smart home devices, and public safety equipment. These smart home devices include, but are not limited to, smart air conditioners, smart light bulbs, smart tables and chairs, smart TVs, smart speakers, smart instruments, smart cameras, smart window sensors, smart doorbells, smart detectors, and other smart security devices. This is not a limitation in the present embodiment.

[0025] In the solution of the embodiment of the present invention, since at least one proximity sensor is used to sense the state of the target object, and the controller can control the speaker based on the state information of the target object, sound interference caused by voice interaction is avoided and the user experience is improved.

[0026] The controller can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present invention. The general-purpose processor can be a microprocessor or any conventional processor.

[0027] The electronic device may further include a storage medium. For example, the storage medium may be, but is not limited to, a random access memory (RAM), a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), etc.

[0028] In another implementation of the present invention, the controller is specifically configured to: receive current status information sent by at least one proximity sensor; perform current volume control on the speaker based on the current status information to adjust the volume of the speaker to the current value; receive next status information sent by at least one proximity sensor in response to the current volume control; and perform next volume control on the speaker based on the current value based on the next status information.

[0029] In another implementation of the present invention, as an example, the controller is specifically configured to: receive current status information sent by at least one proximity sensor within a preset current sensing time period; perform current volume control on the speaker based on the current status information to adjust the volume of the speaker to the current value; in response to the current volume control, receive next status information sent by at least one proximity sensor within a preset next sensing time period; and perform next volume control on the speaker based on the current value based on the next status information.

[0030] For example, if the volume of the speaker is lowered below a mute volume threshold, the speaker is controlled to enter mute mode. For example, the electronic device may further include a touch control module configured to, when the speaker enters mute mode, respond to a touch operation and control the speaker to wake up. Furthermore, the current sensing time period and the next sensing time period may be the same value, allowing for a concise and efficient algorithm. Furthermore, the current sensing time period and the next sensing time period may be different values. For example, the current sensing time period may be determined based on the current volume. For example, the current volume is positively correlated with the current sensing time period. For example, the higher the volume, the longer the sensing time period; the lower the volume, the shorter the sensing time period. This improves the recognition accuracy of target objects (e.g., user gestures) at low volume levels. For example, when the volume reaches a mute trigger range, the controller directly controls the speaker to enter mute mode. Furthermore, when the volume reaches a wake-up trigger range, the controller directly controls the speaker to enter wake-up mode (or standby mode). It should be understood that the mute trigger range and the wake-up trigger range described above may be the same control threshold range or different control threshold ranges. The control threshold ranges may be time ranges and / or distance ranges. It should also be understood that mute triggering and wake-up triggering can also be triggered by non-spatial gestures (postures). For example, voice triggering, touch triggering, etc. can be used. For touch triggering, the control mode indicated by the touch operation can be identified, and the vibration frequency or intensity can also be identified based on the sensor set in the electronic device to perform the above-mentioned mute triggering or wake-up triggering.

[0031] Figure 2 This is a schematic flow chart of a control method for an example of an electronic device according to another embodiment of the present invention. For example, in this example, the sensing distance can be the distance of a gesture. As shown in the figure, in step 201, the electronic device uses the volume set by the above-mentioned volume control and proceeds to step 202. In step 202, it is determined whether the current sensing distance meets the distance threshold within the current time period threshold (for example, whether the current gesture distance meets the distance threshold). If so, the process proceeds to step 203 (if it is an approaching gesture, the volume is lowered; if it is a moving gesture, the volume is raised). If not, the process returns to step 201. In step 203, the current volume control is performed, the next sensing is started, and the process proceeds to step 204. In step 204, it is determined whether the next sensing distance meets the distance threshold within the next time period threshold. If so, the process proceeds to step 205; if not, the process returns to step 203. In step 205, the next volume measurement is performed. It should be understood that the current time period threshold and the next time period threshold can be the same or different.

[0032] Figure 3 FIG. 1 is a schematic flow chart of another example of a control method for an electronic device according to another embodiment of the present invention. Figure 2 As an example, the example combination of Figure 2 and Figure 3 An example of a program with two flowcharts. It can also be used as an example alone. As shown in the figure, in step 301, the electronic device adopts the volume of the last volume control and proceeds to step 302. In step 302, it is determined whether the current volume meets the silent threshold. If yes, it proceeds to step 303; if not, it proceeds to step 304. In step 304, the current volume control is performed and the process proceeds to step 305. In step 305, it is determined whether the next volume meets the silent threshold. If yes, it proceeds to step 306; if not, it proceeds to step 307. In step 307, the next volume control is performed. It should be understood that the electronic device can be awakened from silent mode by the above-mentioned touch method. Gesture operation can also be used. If it is an approaching gesture, the volume is turned down; if it is a moving away gesture, the volume is turned up. The above-mentioned Figure 2 and Figure 3 In any of the examples, gesture recognition can be performed. For example, it should be understood that in the above-mentioned determination process, the gesture can be in a static state, a moving state, or a state alternating between static and moving. For example, the above-mentioned time threshold can be set to within 10 seconds to simplify the calculation and standby power consumption. For example, it can also be set to within 1 second to achieve more precise control.

[0033] In another implementation of the present invention, the controller may function as a timer. Alternatively, the electronic device may further include a timer. The controller or timer may monitor the sensing time. The distance to the target object may be detected based on the sensing time. The distance may be an obstruction distance or a sensing distance, such as the sensing distance of a capacitive sensor or an inductive sensor. The controller may store a mapping between sensing time and sensing distance. Furthermore, the at least one proximity sensor may include a first proximity sensor and a second proximity sensor, with the first proximity sensor being configured to monitor the time period or time window, or the start and end time points, of the target object within a distance range. The monitoring process may be real-time, periodic, or aperiodic. Furthermore, for the controller, if the sensing distance of the target object (e.g., the obstruction distance) falls within the distance range within the monitoring time window, it may be considered that the controller is triggered, i.e., an obstruction event occurs. Alternatively, if the sensing distance of the target object falls within the distance range during a portion of the monitoring time window, it may be considered that an obstruction event occurs. Furthermore, the second proximity sensor may be configured to monitor the distance to the target object. Thus, different proximity sensors are configured to implement different functions, thereby simplifying the algorithm. In addition, the controller may calculate the sensing distance based on the time window to determine the trigger event. The controller may also calculate the sensing time period based on the distance range to determine the trigger event.

[0034] As an example, at least one proximity sensor is specifically configured to: sense the occlusion distance of the target object within a preset sensing time period, wherein the status information includes occlusion distance information and occlusion time information, and the controller is specifically configured to: control the volume of the speaker according to the occlusion distance information and occlusion time information.

[0035] In another implementation of the present invention, the occlusion distance information includes a first occlusion distance value and a second occlusion distance value, and the occlusion time information includes a first time value corresponding to sensing the first occlusion distance value and a second time value corresponding to sensing the second occlusion distance value. The controller is specifically configured to control the volume of the speaker based on the size relationship between the first occlusion distance value and the second occlusion distance value, and the size relationship between the first time value and the second time value.

[0036] In another implementation of the present invention, the controller is specifically configured to: if the first blocking distance value is greater than the second blocking distance value, and the first time value is less than the second time value, control the volume of the speaker to be turned down.

[0037] In another implementation of the present invention, the controller is specifically configured to: for the current sensing of the state of the target object, if the current first occlusion distance value is greater than the current second occlusion distance value, and the current first time value is less than the current second time value, lower the current volume of the speaker and start the next sensing of the target object.

[0038] In another implementation of the present invention, if the turned-down volume of the speaker is lower than a mute volume threshold, the speaker is controlled to enter a mute mode.

[0039] In another implementation of the present invention, the controller is specifically configured to: if the first shielding distance value is greater than the second shielding distance value, and the first time value is greater than the second time value, control the volume of the speaker to be turned up.

[0040] In another implementation of the present invention, the controller is specifically configured to: for the current sensing of the state of the target object, if the current first occlusion distance value is greater than the current second occlusion distance value, and the current first time value is greater than the current second time value, then increase the current volume of the speaker and start the next sensing of the target object.

[0041] In another implementation of the present invention, if the turned-up volume of the speaker is higher than the mute volume threshold, the speaker is controlled to exit the mute mode.

[0042] In another implementation of the present invention, there is a distance difference between the first occlusion distance value and the second occlusion distance value, and there is a time difference between the first time value and the second time value. The controller is specifically configured to: control the volume adjustment amplitude of the speaker based on the ratio relationship between the distance difference and the time difference.

[0043] In another implementation of the present invention, the at least one proximity sensor includes a first proximity sensor and a second proximity sensor, the first proximity sensor senses distance information, and the second proximity sensor senses time information.

[0044] In another implementation of the present invention, the electronic device also includes: a transceiver connected to the controller, the transceiver is configured to: obtain status information from the controller; send a status identification request including status information to the server, so as to receive a status identification result returned by the server in response to the status identification request, wherein the controller is specifically configured to: control the speaker based on the status identification result returned by the transceiver.

[0045] Figure 4 This is a schematic diagram of an interaction method for an electronic device according to another embodiment of the present invention. As shown, the proximity sensor is connected to a controller, which is connected to a power amplifier. The proximity sensor can also be connected to a transceiver via the controller. In this example, the status information is gesture information. Alternatively, the proximity sensor can be connected to both the controller and the transceiver. For example, the controller can transmit gesture information sensed by the proximity sensor to a gesture recognition server via the transceiver. The transceiver can also communicate with the gesture recognition server, sending gesture recognition requests to the server and receiving gesture recognition results from the server. The transceiver can transmit the gesture recognition results to the controller, which controls the power amplifier of the speaker via the controller. It should be understood that the recognition algorithm in the gesture recognition server can vary for different electronic devices. For example, the electronic device can be equipped with a client for updating the gesture recognition algorithm model in the server or selecting a target gesture recognition algorithm from multiple gesture recognition algorithm models.

[0046] In another implementation of the present invention, at least one proximity sensor is arranged along the circumference of the speaker.

[0047] Figures 5A-5D FIG. 1 is a schematic diagram of an arrangement of proximity sensors of an electronic device according to another embodiment of the present invention. Figure 5A In, with Figure 1 Unlike the example of , the proximity sensors in this example are arranged at the center of each side of the matrix. It should be understood that the number and arrangement of all proximity sensors in this article are exemplary, and similar arrangements or various combinations thereof are within the scope of protection of the embodiments of the present invention. Figure 5BAs shown, a separate proximity sensor is arranged at the center of the speaker. For example, the proximity sensor can be arranged corresponding to the speaker. Figure 5C As shown, multiple speakers are arranged corresponding to multiple proximity sensors. Each proximity sensor is arranged at the center of each speaker. Figure 5D As shown, multiple proximity sensors are arranged around the speaker, thereby improving the recognition accuracy of the proximity sensors.

[0048] For example, the proximity sensors may be arranged symmetrically. For example, the proximity sensors may be arranged centrally symmetrically. For example, the proximity sensors may be arranged axially symmetrically.

[0049] In another implementation of the present invention, the multiple directions indicated by the multiple sensing surfaces respectively corresponding to the at least one proximity sensor converge in a direction away from the speaker. Figure 5D The plurality of proximity sensors shown may each have a plurality of sensor surfaces, wherein a vertical axis of each sensor surface is formed through a center point of the plurality of sensor surfaces. For example, the plurality of vertical axes may converge in a direction away from the speaker.

[0050] In another implementation of the present invention, the at least one proximity sensor is at least one infrared proximity sensor.

[0051] In another implementation of the present invention, the controller is specifically configured to: send a status identification request including status information to the server, so as to receive a status identification result returned by the server in response to the status identification request, wherein the controller is specifically configured to: control the speaker based on the status identification result.

[0052] In another implementation of the present invention, at least one sensor may include one proximity sensor or multiple proximity sensors. In one example, multiple proximity sensors may be independently controlled by their respective sensor controllers. Each sensor controller may be controlled by the controller of the above-mentioned device. In another example, multiple proximity sensors may be divided into several groups, each group may be controlled by a sensor controller. In another example, multiple proximity sensors may be controlled by separate sensor controllers. For example, a deep learning online model (interacting with the server) or an offline model may be used to identify the state of the target object based on the sensing signals of each of the multiple proximity sensors. For example, the above-mentioned deep learning model can be trained using supervised learning. In addition, a multi-threshold setting method can also be used to determine the state of the target object based on the sensing signals of each of the multiple proximity sensors.

[0053] As an example, the controller is specifically configured to: receive time information and / or speed information of the target object sent by multiple proximity sensors; and control the speaker according to the time information and / or speed information.

[0054] For example, multiple proximity sensors can be tested to obtain a mapping relationship or mapping table between time information and / or speed information and speaker volume. That is, the mapping table can be a relationship between time information and speaker volume, a relationship between speed information and speaker volume, or a relationship between time information, speed information, and speaker volume. The mapping relationship between time information and / or speed information and speaker volume can be a positive correlation (e.g., directly proportional), a negative correlation (e.g., inversely proportional), an association based on a predetermined distribution, or an association based on a distribution obtained through experience or testing.

[0055] For example, the mapping table can be pre-installed in the storage space of the electronic device (e.g., a secondary storage medium). The device controller can access the storage space to query the mapping table. In addition, the mapping table can also be imported through other external devices or downloaded locally from the server after the electronic device leaves the factory. In addition, the mapping table can also be updated to add new functions or to correct or adjust the mapping relationship.

[0056] In another implementation of the present invention, the controller is specifically configured to: if the target object is a target subject type, then according to the status information, control the volume of the speaker to be turned down; if the target object is a non-target subject type, then according to the status information, control the volume of the speaker to be turned up. For example, the controller is specifically configured to determine whether the target object is a target subject type. The target subject type can be determined based on subject type features. Subject type features may include biometric features such as voiceprint features, facial features, fingerprint features, body temperature, etc. For example, when the target subject type indicates a gesture, then according to the status information, control the volume of the speaker to be turned down. When the target object is not a gesture, then according to the status information, control the volume of the speaker to be turned up. Thus, if the target subject type indicates a gesture, it means that the user is trying to manipulate the electronic device. If the target subject type does not indicate a gesture, it means that the electronic device is blocked, thereby achieving smooth interactive control using a simple configuration.

[0057] Figure 5E 21. An electronic device comprising:

[0058] Speaker 51; biometric acquisition component 52, configured to: sense the biometric characteristics of the target object, and accordingly generate state information of the target object; a controller 53, connected to the biometric acquisition component 52 and the speaker 51,

[0059] The controller 53 is configured to: receive status information sent by the biometric feature collection component 52; and control the speaker 11 according to the status information.

[0060] In the solution of the embodiment of the present invention, since a biometric feature collection component is used to sense the state of the target object, and the controller can control the speaker based on the state information of the target object, erroneous operations caused by non-biometric target objects are avoided and the accuracy of the control operation is improved.

[0061] In another implementation of the present invention, the biometric feature collection component is a camera, an image sensor, etc. The biometric feature may include posture features, facial features, distance features, speed features, or gesture features, etc.

[0062] In one example, the biometric feature acquisition component is configured to sense the biometric features of a target object and generate target object status information accordingly. For example, the biometric feature acquisition component is configured with a deep learning offline model, which, through the operation of an inference engine, implements the recognition logic of the deep learning offline model to generate target object status information. For example, the camera is configured with a facial recognition offline model, which, through the operation of a recognition inference engine, implements the recognition logic of the facial recognition offline model to generate target object status information. For example, when the gesture feature indicates an approaching operation of the target object, the volume of the speaker is controlled to decrease; when the gesture feature indicates a moving away operation of the target object, the volume of the speaker is controlled to increase, and vice versa.

[0063] In another example, an image sensor can sense the clarity of a target object's biometric features and generate target object status information accordingly. Biometric features can include posture features, distance features, speed features, or gesture features. For example, when the distance feature indicates an approaching operation of the target object, the volume of the speaker is controlled to decrease; when the distance feature indicates a moving away operation of the target object, the volume of the speaker is controlled to increase, and vice versa.

[0064] Figure 6 FIG. 4 is a schematic structural diagram of an electronic device according to another embodiment of the present invention. Figure 6 electronic equipment, including:

[0065] The human-computer interaction component 61 is provided with at least one proximity sensor 62, a display 63, and a component controller 64 configured to control the at least one proximity sensor 62 and the display 63. The at least one proximity sensor 62 is configured to sense a target spatial gesture and generate spatial gesture information accordingly. The component controller 64 is connected to the at least one proximity sensor 62 and the display 63.

[0066] The component controller 64 is configured to perform display control on the display 63 according to the received spatial gesture information sent by the at least one proximity sensor 62 .

[0067] In the solution of the embodiment of the present invention, since at least one proximity sensor is used for gesture recognition and display control is performed on the display based on spatial gesture information, more convenient gesture operation is achieved.

[0068] It should be understood that the aforementioned electronic devices include any device equipped with human-computer interaction components. These include, but are not limited to, Internet of Things devices, embedded devices, smart devices, servers, mobile terminals (such as mobile phones and PADs), and personal computers. These smart devices include, but are not limited to, smart transportation equipment, smart home devices, and public safety equipment. These smart home devices include, but are not limited to, smart air conditioners, smart light bulbs, smart tables and chairs, smart TVs, smart speakers, smart instruments, smart cameras, smart window sensors, smart doorbells, smart detectors, and other smart security devices. This is not limited in the present embodiment.

[0069] The electronic device may further include a storage medium. For example, the storage medium may be, but is not limited to, a random access memory (RAM), a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), etc.

[0070] In another implementation of the present invention, the processor 65 of the electronic device is connected to the component controller 64 and is configured to: control the human-computer interaction component 61 via the component controller 64,

[0071] The component controller 64 is specifically configured to: send an input instruction to the processor 65 according to the spatial gesture information received from the at least one proximity sensor 62;

[0072] The receiving processor 65 displays the output instruction sent according to the input instruction on the display 63.

[0073] In another implementation of the present invention, at least one proximity sensor is arranged as a proximity sensor array, the proximity sensor array is arranged in a circumference of the display, and the proximity sensor array has a mapping relationship with the pixel array of the display.

[0074] In another implementation of the present invention, the spatial gesture information is approach gesture information or distance gesture information, and the component controller is specifically configured to: send an input instruction to the processor based on the approach gesture information or distance gesture information received from at least one proximity sensor, and the processor is configured to: respond to the input instruction and generate a corresponding zoom-in instruction or zoom-in instruction for the display object, and the component controller is further configured to: receive the zoom-in instruction or zoom-in instruction and zoom out or zoom in the display object on the display. For example, the electronic device can be configured with a rendering module, and the rendering module controls the component controller through the processor to render based on the input instruction, and send the rendering result to the display for display. It should be understood that the rendering process can be hardware rendering, software rendering, rendering engine rendering, etc.

[0075] Figure 7 Schematic diagram of a control method for an electronic device according to another embodiment of the present invention. As shown in the figure, in this example, the display object is the "apple" shown in the accompanying figure. When the gesture information indicates a distance gesture, the display object in the display is magnified. For example, the proximity sensor monitors the user's gesture information in real time. Preferably, the multiple proximity sensors are presented as multiple groups of proximity sensors, and each group of sensors can be presented as a sensor array to improve the accuracy of gesture recognition. In addition, as shown in the figure, when the gesture information indicates a distance gesture, the display (for example, controlled by a rendering module) reduces the display object. It should be understood that the scheme of the embodiment of the present invention also includes a combination of the schemes of the above-mentioned examples. For example, in Figure 6 In the example of , the recognition request of the gesture recognition can also be sent to the server via the controller, and the recognition result can be received from the server. In addition, the controller can send the service result to the rendering module for rendering, so as to perform zoomed display and / or zoomed display.

[0076] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code configured to execute the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part, and / or installed from a removable medium. When the computer program is executed by a central processing unit (CPU), the above-mentioned functions defined in the method of the present invention are executed. It should be noted that the computer-readable medium described in the present invention can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage medium, a magnetic storage medium, or any suitable combination thereof. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present invention, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transfer a program configured for use by or in conjunction with an instruction execution system, apparatus, or device. Program code embodied on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0077] Computer program code configured to perform the operations of the present invention may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0078] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of the systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or portion of code, which contains one or more executable instructions configured to implement the specified logical function. The above-mentioned specific embodiments have specific sequential relationships, but these sequential relationships are merely exemplary. During the specific implementation, these steps may be fewer, more, or the execution order may be adjusted. In other words, in some alternative implementations, the functions marked in the boxes may also occur in an order different from that marked in the accompanying drawings. For example, two boxes shown in succession can actually be executed substantially in parallel, or they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, as well as combinations of boxes in the block diagram and / or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or can be implemented using a combination of dedicated hardware and computer instructions.

[0079] The modules involved in the embodiments of the present invention may be implemented in software or hardware, and the names of these modules do not necessarily limit the modules themselves.

[0080] As another aspect, the present invention further provides a computer-readable medium having a computer program stored thereon, which implements the method described in the above embodiment when the program is executed by a processor.

[0081] The terms "first," "second," "the first," or "the second" used in various embodiments of the present disclosure may modify various components regardless of order and / or importance, but these terms do not limit the corresponding components. The above terms are configured solely for the purpose of distinguishing an element from other elements. For example, a first user device and a second user device represent different user devices, even though both are user devices. For example, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element without departing from the scope of the present disclosure.

[0082] When one element (for example, a first element) is referred to as being “(operably or communicably) coupled” or “(operably or communicably) coupled to” or “connected to” another element (for example, a second element), it should be understood that the one element is directly connected to the other element or that the one element is indirectly connected to the other element via yet another element (for example, a third element). Conversely, it should be understood that when an element (for example, a first element) is referred to as being “directly connected” or “directly coupled” to another element (the second element), there is no element (for example, a third element) interposed therebetween.

[0083] The above description is merely an illustration of the preferred embodiments of the present invention and the technical principles employed. Those skilled in the art should understand that the scope of the invention is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also encompasses other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned inventive concept. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in the present invention.

Claims

1. An electronic device comprising: speaker; at least one proximity sensor configured to: sense a state of a target object and generate state information of the target object accordingly; a controller connected to the at least one proximity sensor and the speaker, Wherein, the controller is configured to: receive the status information sent by the at least one proximity sensor; controlling the speaker according to the status information; The controller is specifically configured as follows: If the target object is a target subject type indicating a biometric feature, controlling to lower the volume of the speaker according to the status information; If the target object is a non-target subject type indicating a non-biological feature, controlling to increase the volume of the speaker according to the status information; wherein the at least one proximity sensor is arranged along the circumference of the speaker; The at least one proximity sensor includes multiple proximity sensors, and the multiple directions indicated by the multiple sensing surfaces corresponding to the multiple proximity sensors converge in the direction away from the speaker. The multiple proximity sensors respectively have multiple sensor surfaces, and the directions indicated by the sensing surfaces are directions of the vertical axes of the sensor surfaces formed by the center points of the proximity sensor surfaces.

2. The electronic device according to claim 1, wherein The controller is specifically configured to: receiving current state information sent by the at least one proximity sensor; performing current volume control on the speaker according to the current state information to adjust the volume of the speaker to a current value; In response to the current volume control, receiving next state information sent by the at least one proximity sensor; According to the next state information, the next volume control of the speaker is performed based on the current value.

3. The electronic device according to claim 1, wherein The controller is specifically configured to: receiving current state information sent by the at least one proximity sensor within a preset current sensing time period; performing current volume control on the speaker according to the current state information to adjust the volume of the speaker to a current value; In response to the current volume control, receiving next state information sent by the at least one proximity sensor within a preset next sensing time period; According to the next state information, the next volume control of the speaker is performed based on the current value.

4. The electronic device according to claim 1, wherein The at least one proximity sensor is specifically configured to: sense the occlusion distance of the target object within a preset sensing time period, wherein the state information includes occlusion distance information and occlusion time information, The controller is specifically configured to control the volume of the speaker according to the blocking distance information and the blocking time information.

5. The electronic device according to claim 4, wherein The occlusion distance information includes a first occlusion distance value and a second occlusion distance value, and the occlusion time information includes a first time value corresponding to sensing the first occlusion distance value and a second time value corresponding to sensing the second occlusion distance value. The controller is specifically configured to control the volume of the speaker based on a magnitude relationship between the first shielding distance value and the second shielding distance value, and a magnitude relationship between the first time value and the second time value. The electronic device according to claim 5 , wherein: If the turned-down volume of the speaker is lower than a mute volume threshold, the speaker is controlled to enter a mute mode.

7. The electronic device according to claim 5, wherein: If the turned-up volume of the speaker is higher than the mute volume threshold, the speaker is controlled to exit the mute mode.

8. The electronic device according to claim 5, wherein There is a distance difference between the first occlusion distance value and the second occlusion distance value, and there is a time difference between the first time value and the second time value. The controller is specifically configured to: control the volume adjustment amplitude of the speaker based on the ratio relationship between the distance difference and the time difference.

9. The electronic device according to claim 4, wherein The at least one proximity sensor includes a first proximity sensor and a second proximity sensor, the first proximity sensor sensing the distance information and the second proximity sensor sensing time information.

10. The electronic device according to claim 1, further comprising: a transceiver connected to the controller, wherein the transceiver is configured to: obtain the status information from the controller; A status identification request including the status information is sent to the server so as to receive a status identification result returned by the server in response to the status identification request, wherein the controller is specifically configured to control the speaker based on the status identification result returned by the transceiver.

11. The electronic device according to claim 1, wherein The at least one proximity sensor is at least one infrared proximity sensor.

12. The electronic device according to claim 1, wherein The controller is specifically configured to: Sending a status identification request including the status information to the server, so as to receive a status identification result returned by the server in response to the status identification request, wherein: The controller is specifically configured to control the speaker based on the state recognition result.

13. The electronic device according to claim 1, wherein The at least one sensor includes a plurality of proximity sensors, wherein The controller is specifically configured to: receiving time information and / or speed information of the target object sent by the plurality of proximity sensors; The speaker is controlled according to the time information and / or the speed information.

Images