[go: up one dir, main page]

CN109167877B - Terminal screen control method and device, terminal equipment and storage medium - Google Patents

Terminal screen control method and device, terminal equipment and storage medium Download PDF

Info

Publication number
CN109167877B
CN109167877B CN201810862616.8A CN201810862616A CN109167877B CN 109167877 B CN109167877 B CN 109167877B CN 201810862616 A CN201810862616 A CN 201810862616A CN 109167877 B CN109167877 B CN 109167877B
Authority
CN
China
Prior art keywords
terminal
screen
angle range
viewing angle
human eye
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201810862616.8A
Other languages
Chinese (zh)
Other versions
CN109167877A (en
Inventor
雷辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oppo Chongqing Intelligent Technology Co Ltd
Original Assignee
Oppo Chongqing Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo Chongqing Intelligent Technology Co Ltd filed Critical Oppo Chongqing Intelligent Technology Co Ltd
Priority to CN201810862616.8A priority Critical patent/CN109167877B/en
Publication of CN109167877A publication Critical patent/CN109167877A/en
Application granted granted Critical
Publication of CN109167877B publication Critical patent/CN109167877B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W52/00—Power management, e.g. Transmission Power Control [TPC] or power classes
    • H04W52/02—Power saving arrangements
    • H04W52/0209—Power saving arrangements in terminal devices
    • H04W52/0261—Power saving arrangements in terminal devices managing power supply demand, e.g. depending on battery level
    • H04W52/0267—Power saving arrangements in terminal devices managing power supply demand, e.g. depending on battery level by controlling user interface components
    • H04W52/027—Power saving arrangements in terminal devices managing power supply demand, e.g. depending on battery level by controlling user interface components by controlling a display operation or backlight unit
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/52—Details of telephonic subscriber devices including functional features of a camera
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Ophthalmology & Optometry (AREA)
  • Evolutionary Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Multimedia (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Environmental & Geological Engineering (AREA)
  • Telephone Function (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请实施例公开了一种终端屏幕控制方法、装置、终端设备和存储介质。其中方法包括：在终端屏幕处于亮屏状态时，触发稳定性检测组件检测终端是否处于稳定状态；在检测到终端处于稳定状态时，调用终端的前置摄像头，并通过前置摄像头对当前场景进行拍摄；对拍摄到的图像进行人脸识别以识别出图像中人眼的视角范围；以及根据图像中人眼的视角范围，控制终端屏幕灭屏或保持亮屏。该方法可以智能控制终端屏幕的亮灭，在满足对终端屏幕亮灭智能化的需求的同时，也达到了节省终端电量的目的，提升了用户的使用体验。

Figure 201810862616

The embodiments of the present application disclose a terminal screen control method, apparatus, terminal device and storage medium. The method includes: when the screen of the terminal is in a bright screen state, triggering a stability detection component to detect whether the terminal is in a stable state; when it is detected that the terminal is in a stable state, calling the front camera of the terminal, and through the front camera, the current scene is performed. Shooting; performing face recognition on the captured image to identify the viewing angle range of the human eye in the image; and controlling the terminal screen to turn off the screen or keep the screen bright according to the viewing angle range of the human eye in the image. The method can intelligently control the on-off of the terminal screen, while meeting the demand for intelligent on-off of the terminal screen, it also achieves the purpose of saving the power of the terminal and improves the user experience.

Figure 201810862616

Description

Terminal screen control method and device, terminal equipment and storage medium
Technical Field
The present application relates to the field of terminal device control, and in particular, to a terminal screen control method and apparatus, a terminal device, and a computer-readable storage medium.
Background
With the development of mobile terminal technology, the operation of the existing mobile terminal through the touch screen is more and more popular, and for convenience of operation, the existing mobile terminal is also developing towards the trend of large screen, however, the direct disadvantage brought by the large screen is the increase of the power consumption of the mobile terminal, and people pay more and more attention to the power saving technology.
In fact, there are many optimization links to save power in the process of using a large-screen mobile terminal device, and taking a mobile phone as an example, the mobile phone will automatically turn off the screen after a user does not operate the screen for a period of time, so as to achieve the purpose of saving power. However, in some scenarios, for example, when a user browses web page content, there is no need to touch the screen, but the mobile phone needs to turn on the screen to continuously view the content of the mobile phone, so that the existing scheme for turning off the screen at regular time cannot meet the requirement for intelligentizing turning on and off the screen of the mobile phone. Therefore, how to intelligently control the on and off of the screen of the mobile terminal becomes a problem to be solved urgently.
Disclosure of Invention
The embodiment of the application provides a terminal screen control method and device, terminal equipment and a storage medium, and can solve the technical problem that the existing scheme for regularly turning off the screen cannot meet the intelligent on-off requirement of a mobile phone screen.
In a first aspect, an embodiment of the present application provides a terminal screen control method, including:
when a screen of the terminal is in a bright screen state, triggering a stability detection component to detect whether the terminal is in a stable state;
when the terminal is detected to be in a stable state, calling a front-facing camera of the terminal to shoot a current scene;
identifying a viewing angle range of human eyes in the captured image;
and controlling the screen to be turned off or kept on according to the visual angle range.
In a second aspect, an embodiment of the present application provides a terminal screen control device, including:
the detection triggering module is used for triggering the stability detection component to detect whether the terminal is in a stable state or not when the screen of the terminal is in a bright screen state;
the image shooting module is used for calling a front camera of the terminal to shoot a current scene when the terminal is detected to be in a stable state;
the image identification module is used for identifying the visual angle range of human eyes in the shot image;
and the screen control module is used for controlling the screen to be turned off or kept on according to the visual angle range.
In a third aspect, an embodiment of the present application provides a terminal device, including a memory, a processor, and a computer program that is stored in the memory and is executable on the processor, where when the processor executes the program, the terminal screen control method described in the first aspect of the present application is implemented.
In a fourth aspect, an embodiment of the present application provides a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the terminal screen control method according to the first aspect of the present application.
According to the terminal screen control method and device, the terminal device and the computer readable storage medium, when the terminal screen is in the bright screen state, the stability detection assembly is triggered to detect whether the terminal is in the stable state or not, when the terminal is detected to be in the stable state, the front camera of the terminal is called to shoot a current scene, then face recognition is carried out on the shot image to recognize the visual angle range of human eyes in the image, and the terminal screen is controlled to be turned off or kept bright according to the visual angle range of the human eyes in the image. When monitoring that the terminal is in a stable state, utilize face identification correlation technique, discern the visual angle range of user's eyes promptly to whether the user is using the terminal according to the visual angle range intelligent detection who discerns the eyes, and according to the bright going out of testing result intelligent control terminal screen, when satisfying the demand intelligent to terminal screen bright going out, also reached the purpose of saving the terminal electric quantity, promoted user's use and experienced.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is an exemplary diagram of an application scenario of a terminal screen control method according to an embodiment of the present application;
FIG. 2 is a flow chart of a terminal screen control method according to one embodiment of the present application;
FIG. 3 is a flow chart of generating the sample data according to an embodiment of the present application;
FIG. 4 is a flow chart of a terminal screen control method according to an embodiment of the present application;
FIG. 5 is a flow chart of a terminal screen control method according to another embodiment of the present application;
FIG. 6 is a schematic structural diagram of a terminal screen control device according to an embodiment of the present application;
FIG. 7 is a schematic diagram of a terminal screen control device according to an embodiment of the present application;
FIG. 8 is a schematic diagram of a terminal screen control device according to another embodiment of the present application;
FIG. 9 is a schematic diagram of a terminal screen control device according to another embodiment of the present application;
FIG. 10 is a schematic diagram of a terminal screen control device according to yet another embodiment of the present application;
FIG. 11 is a schematic diagram of a terminal screen control device according to yet another embodiment of the present application;
fig. 12 is a schematic structural diagram of a terminal device according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application.
A terminal screen control method, apparatus, terminal device, and computer-readable storage medium according to embodiments of the present application are described below with reference to the accompanying drawings.
It should be noted that the terminal screen control method in the embodiment of the present application can be applied to the terminal screen control device in the embodiment of the present application. The terminal screen control device can be configured on the terminal equipment. The terminal device may be a mobile terminal, such as a mobile phone, a tablet computer, a personal digital assistant, and other hardware devices with various operating systems.
As shown in fig. 1, the terminal screen control method according to the embodiment of the present application may be used to determine whether a user is reading the terminal device a by detecting a visual angle range of eyes of the user when the user uses the terminal device a, and control the screen of the terminal to be turned off or kept on according to a detection result.
In order to realize the intelligent control of the on-off of the terminal screen and achieve the purpose of saving the electric quantity of the terminal while meeting the intelligent requirement of the on-off of the terminal screen, the embodiment of the application provides a terminal screen control method. As shown in fig. 2, the terminal screen control method may include:
s210, when the screen of the terminal is in a bright screen state, triggering the stability detection component to detect whether the terminal is in a stable state.
Optionally, when it is monitored that the screen of the terminal device is in a bright screen state, a stability detection component in the terminal device may be triggered to detect whether the terminal device is in a stable state. The terminal is in a stable state, which means that the terminal is in a stable state and does not greatly shake. It can be understood that when the user uses the terminal, the screen of the terminal can be lightened so as to be used by the user, in the screen lightening process, the user may not use the terminal any more or leave the position of the terminal, and when the screen of the terminal is in the lightening state, the stability detection component can be triggered to detect whether the terminal is in the stable state or not. In the embodiment of the present application, the stability detecting component may be a sensor capable of detecting a displacement state, such as a gyroscope or a vibration sensor. Two examples of different implementations will be given below:
as one example, the stability detection component includes a gyroscope. In this example, a specific implementation process of the trigger stability detection component detecting whether the terminal is in a stable state may be as follows: recording component values of an X axis, a Y axis and a Z axis of the gyroscope, judging whether the jitter amplitude of the gyroscope is stable according to the component values of the X axis, the Y axis and the Z axis, returning to execute the step of recording the component values of the X axis, the Y axis and the Z axis of the gyroscope in a preset time period when judging that the jitter amplitude of the gyroscope is not stable, and determining that the terminal is in a stable state when judging that the jitter amplitude of the gyroscope is stable.
Optionally, when the screen of the terminal is in a bright screen state, component values of an X axis, a Y axis, and a Z axis of the gyroscope in a preset time period may be recorded, and whether a change in an angular velocity measured by the gyroscope in the preset time period is smaller than a certain threshold value is determined according to the component values of the X axis, the Y axis, and the Z axis, if so, the jitter amplitude of the gyroscope is determined to be stable, at this time, the terminal may be determined to be in a stable state, otherwise, the jitter amplitude of the gyroscope is determined to be not stable, and at this time, the step of recording component values of the X axis, the Y axis, and the Z axis of the gyroscope in the preset time period may be performed.
That is to say, it may be detected whether the axis component values of the gyroscope recorded within the preset time period change, and when it is detected that the axis component values of the gyroscope recorded within the preset time period change greatly, it may be considered that the jitter amplitude of the gyroscope is not stable, for example, when a user is at an adjustment terminal, the gyroscope may be continuously triggered to record the axis component values of the gyroscope at this time; when detecting that the component values of each axis of the gyroscope recorded in the preset time period are not changed, the jitter amplitude of the gyroscope can be judged to be stable, and at the moment, the terminal can be considered to be in a stable state.
As another example, the stability detection component includes a vibration sensor. In this example, a specific implementation process of the trigger stability detection component detecting whether the terminal is in a stable state may be as follows: and receiving an output signal of a vibration sensor, and judging whether the terminal is in a stable state or not according to the output signal of the vibration sensor. Alternatively, the current movement displacement of the terminal may be detected by an output signal of the vibration sensor, and it is determined whether the terminal is in a stable state according to the movement displacement. For example, if the movement displacement detected by the vibration sensor is within a certain range, the terminal may be considered to be in a stable state.
Optionally, in an embodiment of the present application, when detecting that the terminal is not in a stable state, the stability detection component may be continuously triggered to detect whether the terminal is in the stable state.
And S220, when the terminal is detected to be in a stable state, calling a front camera of the terminal to shoot the current scene.
Optionally, when it is detected that the terminal is in a stable state, it may be considered that the terminal is not moved or shaken by the user, and at this time, a front camera of the terminal device may be called, and shooting is performed by using the front camera.
And S230, identifying the visual angle range of human eyes in the shot image.
Optionally, the face recognition technology is used for carrying out face recognition on the shot image to obtain a face region, the eye region is extracted from the face region based on the eye positioning algorithm, and iris sight analysis is carried out on the eye region to determine the visual angle range of the eyes in the image.
And S240, controlling the screen to be turned off or kept on according to the visual angle range of human eyes in the image.
Optionally, whether the user is currently using the terminal may be determined according to the visual angle range of the human eyes in the image, and if it is determined that the user is currently using the terminal, the terminal screen may be controlled to remain bright; if the terminal is judged not to be used by the user currently, for example, the terminal is horizontally placed on a desk, the terminal is in a stable state at the moment, but the terminal is not used by the user currently, and the screen of the terminal can be controlled to be turned off at the moment so as to achieve the purpose of saving the electric quantity of the terminal.
It can be understood that the visual angle range of the human eyes in the obtained image can be compared with the sample, and whether the screen of the terminal is controlled to be turned off or the screen of the terminal is controlled to be kept on according to the comparison result. As a possible implementation manner, acquiring a visual angle range of a sample human eye, wherein the visual angle range of the sample human eye is used for indicating a reference visual angle range of an eye when a user uses the terminal, performing similarity matching between the visual angle range of the human eye in the image and the visual angle range of the sample human eye, and controlling the terminal screen to keep bright when the similarity between the visual angle range of the human eye in the image and the visual angle range of the sample human eye is greater than or equal to a preset threshold value; and when the similarity between the visual angle range of the human eyes in the image and the visual angle range of the human eyes of the sample is smaller than the preset threshold value, controlling the screen to be turned off.
That is to say, similarity calculation can be performed on the visual angle range of human eyes in the obtained image and the visual angle range of human eyes of the sample, if the similarity between the visual angle range and the visual angle range of human eyes is greater than or equal to a preset threshold value, it can be considered that the current user is using the terminal device, and at the moment, the terminal screen can be controlled to keep bright; if the similarity is smaller than the preset threshold, the user can be considered not to use the terminal equipment currently, and the screen of the terminal screen can be controlled to be turned off at the moment.
It should be noted that, in the embodiment of the present application, the range of the viewing angle of the human eye may be generated in advance. As an example, as shown in fig. 3, the viewing angle range of the sample human eye may be generated in advance by:
s310, when the screen of the terminal is in a bright screen state and the terminal is in a stable state, calling a front camera of the terminal to shoot for multiple times;
s320, identifying the visual angle range of human eyes in the shot multiple sample images, and determining the visual angle range of the eyes of the user when the user uses the terminal from the visual angle range of the human eyes in the multiple sample images;
optionally, face recognition is performed on the plurality of shot images based on a face recognition technology to obtain a face region in each image, a human eye region is extracted from the face region based on a human eye positioning algorithm, and iris sight analysis is performed on the human eye region to determine the visual angle range of human eyes in each sample image. Then, the visual angle range of the eyes of the user when using the terminal can be determined from the visual angle range of the eyes in a plurality of sample images. For example, the visual angle ranges of human eyes in the multiple sample images can be used as the visual angle ranges of the sample human eyes, so that whether the current user uses the terminal device can be judged by judging whether the visual angle range of the human eyes in the currently acquired image is matched with one visual angle range in the visual angle ranges of the sample human eyes.
For another example, a viewing angle range with a high proportion of the viewing angle range of the human eye in the plurality of sample images may be selected as the viewing angle range of the human eye when the user uses the terminal (i.e., the viewing angle range of the human eye of the sample). For example, if there are 5 sample images, and the viewing angle ranges of human eyes in the 5 sample images are "30 degrees", "50 degrees" and "40 degrees", respectively, in this case, the viewing angle range corresponding to "30 degrees" with a high duty ratio can be taken as the viewing angle range of the eyes of the user when using the terminal from the viewing angle ranges of human eyes in the 5 sample images.
S330, taking the determined visual angle range of the eyes of the user when the user uses the terminal as the visual angle range of the sample human eyes.
That is to say, when the user uses the mobile phone, the bright screen is triggered, when the stability detection component detects that the terminal is in a stable state, the terminal holding posture is fixed well, at the moment, the visual angle range of human eyes is identified through multiple snapshot by the front camera, the playing habit of the user is determined, and one or more preset samples are selected as a reference standard, so that whether the user is using the terminal currently or not is judged according to the samples later.
According to the terminal screen control method, when the terminal screen is in the bright screen state, the stability detection assembly is triggered to detect whether the terminal is in the stable state or not, when the terminal is detected to be in the stable state, the front-facing camera of the terminal is called to shoot a current scene, then face recognition is carried out on the shot image to recognize the visual angle range of human eyes in the image, and the terminal screen is controlled to be turned off or kept bright according to the visual angle range of the human eyes in the image. When monitoring that the terminal is in a stable state, utilize face identification correlation technique, discern the visual angle range of user's eyes promptly to whether the user is using the terminal according to the visual angle range intelligent detection who discerns the eyes, and according to the bright going out of testing result intelligent control terminal screen, when satisfying the demand intelligent to terminal screen bright going out, also reached the purpose of saving the terminal electric quantity, promoted user's use and experienced.
In order to make the automatic screen-off of the terminal equipment more intelligent, the screen-off can be adjusted according to different application programs. Optionally, in an embodiment of the present application, when a similarity between a visual angle range of human eyes in the image and a visual angle range of human eyes in the sample is smaller than the preset threshold, determining an application program type to which an application interface currently being displayed on the terminal screen belongs, and when the application program type is a viewing class, controlling the terminal screen to be turned off; and when the type of the application program is an audio and video type, controlling the terminal screen to keep bright.
Optionally, when the similarity between the visual angle range of the human eyes in the image and the visual angle range of the human eyes in the sample is smaller than the preset threshold, it may be determined that the face of the user does not face the terminal screen, for example, the user is far away from the location of the terminal, it may be determined which application program in the terminal is running at the front end, and the type of the application program is determined, if the type of the application program is a browsing type, such as a book application program, a news application program, and the like, it may be determined that the user is away from the terminal and temporarily does not need to browse the APP, and at this time, the terminal screen may be controlled to be turned. If the application program type is an audio-video type, such as a video application program, an audio application program and the like, the user can be considered to leave the terminal and also want to continue listening to songs or listening to video sounds by using the application program, and at the moment, the screen of the terminal can be controlled to keep bright.
Fig. 4 is a flowchart of a terminal screen control method according to an embodiment of the present application.
In order to improve the security of the terminal device and ensure the security of the user privacy information in the terminal device, in the embodiment of the application, the feature information of human eyes in the image can be extracted, whether the terminal is being used by a target user (such as a user) is judged according to the feature information, and the screen of the terminal is controlled to be turned off or kept on according to the judgment result. Specifically, as shown in fig. 4, the terminal screen control method may include:
s410, when the screen of the terminal is in a bright screen state, the stability detection component is triggered to detect whether the terminal is in a stable state.
In the embodiment of the present application, the stability detecting component may be a sensor capable of detecting a displacement state, such as a gyroscope or a vibration sensor. Two examples of different implementations will be given below:
as one example, the stability detection component includes a gyroscope. In this example, a specific implementation process of the trigger stability detection component detecting whether the terminal is in a stable state may be as follows: recording component values of an X axis, a Y axis and a Z axis of the gyroscope, judging whether the jitter amplitude of the gyroscope is stable according to the component values of the X axis, the Y axis and the Z axis, returning to execute the step of recording the component values of the X axis, the Y axis and the Z axis of the gyroscope in a preset time period when judging that the jitter amplitude of the gyroscope is not stable, and determining that the terminal is in a stable state when judging that the jitter amplitude of the gyroscope is stable.
As another example, the stability detection component includes a vibration sensor. In this example, a specific implementation process of the trigger stability detection component detecting whether the terminal is in a stable state may be as follows: and receiving an output signal of a vibration sensor, and judging whether the terminal is in a stable state or not according to the output signal of the vibration sensor.
And S420, when the terminal is detected to be in a stable state, calling a front camera of the terminal to shoot the current scene.
And S430, identifying the visual angle range of human eyes in the shot image.
It should be noted that, in the embodiment of the present application, the descriptions of the implementation manners of steps S410 to S430 may refer to the descriptions of the implementation manners of steps S210 to S230, and are not described herein again.
S440, extracting characteristic information of human eyes in the image.
Optionally, feature information of the human eye is extracted from a human eye region in the image based on an extraction technique of iris feature points.
S450, judging whether the terminal is used by the target user or not according to the characteristic information.
Alternatively, the extracted feature information is matched with sample information indicating feature information of human eyes of the user himself, and it is determined whether the terminal is being used by the user himself or herself according to a matching result, for example, if the extracted feature information does not match with the sample information, it may be determined that a user currently using the terminal is not the user himself or herself, and if the extracted feature information matches with the sample information, it may be determined that the terminal is being used by the user himself or herself.
And S460, when the terminal is judged to be used by the target user according to the characteristic information, controlling the screen of the terminal to be turned off or kept on according to the visual angle range of human eyes in the image.
Optionally, when it is determined that the terminal is being used by the user himself or herself according to the feature information, pre-generated sample data may be acquired, where the sample data includes a visual angle range of a sample human eye, the visual angle range of the sample human eye is used to indicate a reference visual angle range of an eye when the user uses the terminal, and the visual angle range of the human eye in the image is subjected to similarity matching with the visual angle range of the sample human eye, and when the similarity between the visual angle range of the human eye in the image and the visual angle range of the sample human eye is greater than or equal to a preset threshold, the terminal screen is controlled to remain bright; and when the similarity between the visual angle range of the human eyes in the image and the visual angle range of the human eyes of the sample is smaller than the preset threshold value, controlling the screen of the terminal to be turned off.
Optionally, in an embodiment of the application, when it is determined that the user currently using the terminal is not the user owner according to the feature information, the screen of the terminal is controlled to be turned off.
According to the terminal screen control method, the characteristic information of human eyes in the image can be extracted, whether the terminal is used by a target user or not is judged according to the characteristic information, the screen of the terminal is controlled to be turned off or kept on according to the judgment result, the safety of the terminal equipment can be improved, and the safety of user privacy information in the terminal equipment is guaranteed.
Fig. 5 is a flowchart of a terminal screen control method according to another embodiment of the present application.
In order to improve the usability and feasibility of the application and prevent the terminal from being in a bright screen state without displacement change for a long time and the user does not use the terminal, in the embodiment of the application, a longest detection period can be defined, and even if the terminal equipment does not have displacement change in the period of time, the front camera is triggered to perform framing comparison to determine whether the user is currently using the terminal. Specifically, as shown in fig. 5, the terminal screen control method may include:
s510, after the screen of the terminal is determined to be in the bright screen state, determining the current bright screen time of the screen.
Optionally, after determining that the terminal screen is in a bright screen state, counting the time from the current screen start to the current screen bright of the terminal screen.
S520, judging whether the current screen lightening time is longer than a preset time length, if so, executing a step S540, otherwise, executing a step S530.
The preset duration may be a preset longest detection period, and if the current screen-on time is longer than the longest detection period, the front-facing camera is triggered to view and compare to determine whether the user is currently using the terminal even if the terminal device does not have displacement change within the time period.
And S530, triggering the stability detection component to detect whether the terminal is in a stable state, if so, executing the step S540, otherwise, returning to execute the step of determining the current screen-on time of the terminal screen.
And S540, calling a front camera of the terminal to shoot the current scene.
And S550, identifying the visual angle range of human eyes in the shot image.
And S560, extracting the characteristic information of human eyes in the image.
S570, determining whether the terminal is being used by the target user according to the feature information, if so, performing step S580, otherwise, performing step S590.
And S580, controlling the screen of the terminal to be turned off or kept on according to the visual angle range of human eyes in the image.
And S590, controlling the screen of the terminal to be turned off.
According to the terminal screen control method, after the terminal screen is determined to be in the bright screen state, before the stability detection component is triggered to detect whether the terminal is in the stable state, the current bright screen time of the terminal screen is determined, whether the current bright screen time is longer than the preset time length is judged, and whether the front camera is directly called for framing comparison is determined according to the judgment result so as to determine whether a user is using the terminal currently or whether the stability detection component is triggered to detect whether the terminal is in the stable state. If the current screen-on time is longer than the longest detection period, the front camera is triggered to view and compare even if the terminal equipment does not have displacement change in the time period so as to determine whether the user is currently using the terminal, so that the situation that the terminal is still in a screen-on state without displacement change for a long time and the user does not use the terminal is prevented, and the usability and the feasibility of the application are improved.
Corresponding to the terminal screen control methods provided in the foregoing several embodiments, an embodiment of the present application further provides a terminal screen control device, and since the terminal screen control device provided in the embodiment of the present application corresponds to the terminal screen control methods provided in the foregoing several embodiments, the embodiments of the terminal screen control method described above are also applicable to the terminal screen control device provided in this embodiment, and will not be described in detail in this embodiment. Fig. 6 is a schematic structural diagram of a terminal screen control device according to an embodiment of the present application. As shown in fig. 6, the terminal screen control apparatus 600 may include: a detection trigger module 610, an image capture module 620, an image recognition module 630, and a screen control module 640.
Specifically, the detection triggering module 610 is configured to trigger the stability detection component to detect whether the terminal is in a stable state when the screen of the terminal is in a bright screen state. In the embodiment of the present application, the stability detecting component may be a sensor capable of detecting a displacement state, such as a gyroscope or a vibration sensor. Two examples of different implementations will be given below:
as one example, the stability detection component includes a gyroscope. In this example, the detection triggering module 610 is specifically configured to: recording component values of an X axis, a Y axis and a Z axis of the gyroscope in a preset time period; judging whether the jitter amplitude of the gyroscope is stable or not according to the component values of the X axis, the Y axis and the Z axis; when the jitter amplitude of the gyroscope is judged to be unstable, returning to the step of recording component values of an X axis, a Y axis and a Z axis of the gyroscope in a preset time period; and when the shaking amplitude of the gyroscope is judged to be stable, determining that the terminal is in a stable state.
As another example, the stability detection component includes a vibration sensor. In this example, the detection triggering module 610 is specifically configured to: receiving an output signal of a vibration sensor; and judging whether the terminal is in a stable state or not according to the output signal of the vibration sensor.
The image capturing module 620 is configured to call a front-facing camera of the terminal to capture a current scene when detecting that the terminal is in a stable state.
The image recognition module 630 is used for recognizing the range of the angle of view of the human eye in the captured image.
The screen control module 640 is configured to control the terminal screen to turn off or keep on according to the visual angle range of the human eyes in the image. As an example, as shown in fig. 7, the screen control module 640 may include: a sample acquiring unit 641, a matching unit 642 and a control unit 643. The sample acquiring unit 641 is configured to acquire a visual angle range of a sample human eye, where the visual angle range of the sample human eye is used to indicate a reference visual angle range of an eye when a user uses the terminal; the matching unit 642 is configured to perform similarity matching on the visual angle range of the human eyes in the image and the visual angle range of the sample human eyes; the control unit 643 is configured to control the terminal screen to keep on screen when a similarity between a visual angle range of human eyes in the image and a visual angle range of the sample human eyes is greater than or equal to a preset threshold, and control the terminal screen to turn off screen when the similarity between the visual angle range of human eyes in the image and the visual angle range of the sample human eyes is less than the preset threshold.
It should be noted that, in the embodiment of the present application, the sample data may be generated in advance. As an example, as shown in fig. 8, the terminal screen control apparatus 600 may further include: a sample establishing module 650 for generating the view angle range of the sample human eye in advance. In this example, the sample creating module 650 is specifically configured to: when the terminal screen is in a bright screen state and the terminal is in a stable state, calling a front-facing camera of the terminal to shoot for multiple times; identifying visual angle ranges of human eyes in the shot multiple sample images, and determining the visual angle ranges of the human eyes of the user when the user uses the terminal from the visual angle ranges of the human eyes in the multiple sample images; and taking the determined visual angle range of the eyes of the user when the user uses the terminal as the visual angle range of the sample human eyes.
According to the terminal screen control device, when the terminal screen is in the bright screen state, the stability detection assembly is triggered to detect whether the terminal is in the stable state or not, when the terminal is detected to be in the stable state, the front camera of the terminal is called, the current scene is shot through the front camera, then face recognition is conducted on the shot image to recognize the visual angle range of human eyes in the image, and the terminal screen is controlled to be turned off or kept bright according to the visual angle range of the human eyes in the image. When monitoring that the terminal is in a stable state, utilize face identification correlation technique, discern the visual angle range of user's eyes promptly to whether the user is using the terminal according to the visual angle range intelligent detection who discerns the eyes, and according to the bright going out of testing result intelligent control terminal screen, when satisfying the demand intelligent to terminal screen bright going out, also reached the purpose of saving the terminal electric quantity, promoted user's use and experienced.
In order to improve the security of the terminal device and ensure the security of the user privacy information in the terminal device, optionally, in an embodiment of the present application, as shown in fig. 9, the terminal screen control apparatus 600 may further include: an extraction module 660 and a first judgment module 670. The extraction module 660 is configured to extract feature information of human eyes in the image. The first determining module 670 is configured to determine whether the terminal is being used by a target user according to the feature information. In an embodiment of the present application, the screen control module 640 is further configured to control the screen of the terminal to be turned off or kept on according to the visual angle range of human eyes in the image when it is determined that the terminal is being used by the target user according to the feature information. In an embodiment of the application, the screen control module 640 is further configured to control the screen of the terminal to be turned off when it is determined that the user currently using the terminal is not the user.
In order to make the automatic screen-off of the terminal equipment more intelligent, the screen-off can be adjusted according to different application programs. Optionally, in an embodiment of the present application, as shown in fig. 10, the terminal screen control device 600 may further include: the type determining module 680 is configured to determine the type of the application program to which the application interface currently being displayed on the terminal screen belongs when the similarity between the visual angle range of the human eye in the image and the visual angle range of the human eye of the sample is smaller than the preset threshold. In the embodiment of the present application, the screen control module 640 is further configured to control the terminal screen to be turned off when the application program type is a viewing type, and control the terminal screen to be kept on when the application program type is an audio/video type.
In order to improve the usability and feasibility of the present application and prevent the terminal from being in a bright screen state without displacement change for a long time, and the user does not use the terminal, optionally, in an embodiment of the present application, as shown in fig. 11, the terminal screen control device 600 may further include: a bright screen time determination module 690 and a second decision module 6100. The screen-lighting time determination module 690 is configured to determine a current screen-lighting time of the terminal screen after determining that the terminal screen is in a screen-lighting state and before triggering the stability detection component to detect whether the terminal is in a stable state. The second determining module 6100 is configured to determine whether the current screen-on time is greater than a preset time. In an embodiment of the present application, the image capturing module 620 is further configured to call a front camera of the terminal when the current screen-on time is longer than a preset time, and capture a current scene through the front camera; the detection triggering module 610 is further configured to trigger the stability detection component to detect whether the terminal is in a stable state when the current screen-on time is less than or equal to a preset time.
In order to implement the above embodiment, the present application further provides a terminal device.
Fig. 12 is a schematic structural diagram of a terminal device according to an embodiment of the present application. As shown in fig. 12, the terminal apparatus 1200 may include: the memory 1210, the processor 1220 and the computer program 1230 stored in the memory 1210 and running on the processor 1220, when the processor 1220 executes the program 1230, the terminal screen control method according to any of the above embodiments of the present application is realized.
In order to implement the above embodiments, the present application also proposes a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the terminal screen control method according to any of the above embodiments of the present application.
In the description of the present application, it is to be understood that, furthermore, the terms "first", "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Claims (18)

1.一种终端屏幕控制方法，其特征在于，包括：1. a terminal screen control method, is characterized in that, comprises: 在终端的屏幕处于亮屏状态时，确定所述屏幕的当前亮屏时间，When the screen of the terminal is in the bright screen state, determine the current screen bright time of the screen, 判断所述当前亮屏时间是否大于预设时长，当所述当前亮屏时间不大于预设时长时，触发稳定性检测组件检测所述终端是否处于稳定状态；Determine whether the current screen-on time is greater than a preset duration, and when the current screen-on time is not greater than the preset duration, trigger a stability detection component to detect whether the terminal is in a stable state; 在检测到所述终端处于稳定状态时，调用所述终端的前置摄像头对当前场景进行拍摄；When detecting that the terminal is in a stable state, call the front camera of the terminal to shoot the current scene; 识别所拍摄的图像中人眼的视角范围；Identify the viewing angle range of the human eye in the captured image; 获取样本人眼的视角范围，所述样本人眼的视角范围用于指示用户使用所述终端时眼睛的参考视角范围；acquiring a viewing angle range of a sample human eye, where the viewing angle range of the sample human eye is used to indicate a reference viewing angle range of the user's eyes when using the terminal; 将所述图像中人眼的视角范围与所述样本人眼的视角范围进行相似度匹配；performing similarity matching between the viewing angle range of the human eye in the image and the viewing angle range of the sample human eye; 在所述图像中人眼的视角范围与所述样本人眼的视角范围之间的相似度小于预设阈值时，确定所述屏幕当前正在显示的应用界面所属的应用程序类型；When the similarity between the viewing angle range of the human eye in the image and the viewing angle range of the sample human eye is less than a preset threshold, determining the application type to which the application interface currently being displayed on the screen belongs; 当所述应用程序类型为阅览类时，控制所述屏幕灭屏；When the application type is a reading class, controlling the screen to turn off the screen; 当所述应用程序类型为音视频类时，控制所述屏幕保持亮屏。When the application type is audio and video, control the screen to keep the screen on. 2.如权利要求1所述的终端屏幕控制方法，其特征在于，所述稳定性检测组件包括陀螺仪；所述触发稳定性检测组件检测所述终端是否处于稳定状态，包括：2. The terminal screen control method according to claim 1, wherein the stability detection component comprises a gyroscope; the triggering stability detection component detects whether the terminal is in a stable state, comprising: 记录所述陀螺仪在预设时间段内的X轴、Y轴和Z轴的分量值；record the component values of the X-axis, Y-axis and Z-axis of the gyroscope within a preset time period; 根据所述X轴、Y轴和Z轴的分量值，判断所述陀螺仪的抖动幅度是否平稳；According to the component values of the X-axis, the Y-axis and the Z-axis, determine whether the shaking amplitude of the gyroscope is stable; 在判定所述陀螺仪的抖动幅度未平稳时，返回执行所述记录所述陀螺仪在预设时间段内的X轴、Y轴和Z轴的分量值的步骤；在判定所述陀螺仪的抖动幅度平稳时，确定所述终端处于稳定状态。When it is determined that the shaking amplitude of the gyroscope is not stable, return to the step of recording the component values of the X-axis, Y-axis and Z-axis of the gyroscope within a preset time period; When the jitter amplitude is stable, it is determined that the terminal is in a stable state. 3.如权利要求1所述的终端屏幕控制方法，其特征在于，所述稳定性检测组件包括振动传感器；所述触发稳定性检测组件检测所述终端是否处于稳定状态，包括：3. The terminal screen control method according to claim 1, wherein the stability detection component comprises a vibration sensor; the trigger stability detection component detects whether the terminal is in a stable state, comprising: 接收所述振动传感器的输出信号；receiving the output signal of the vibration sensor; 根据所述振动传感器的输出信号判断所述终端是否处于稳定状态。Determine whether the terminal is in a stable state according to the output signal of the vibration sensor. 4.如权利要求1所述的终端屏幕控制方法，其特征在于，在所述将所述图像中人眼的视角范围与所述样本人眼的视角范围进行相似度匹配之后，所述方法还包括：4. The terminal screen control method according to claim 1, wherein after the similarity matching is performed between the viewing angle range of the human eye in the image and the viewing angle range of the sample human eye, the method further comprises: include: 当所述图像中人眼的视角范围与所述样本人眼的视角范围之间的相似度大于或等于预设阈值时，控制所述屏幕保持亮屏；When the similarity between the viewing angle range of the human eye in the image and the viewing angle range of the sample human eye is greater than or equal to a preset threshold, controlling the screen to keep the screen bright; 当所述图像中人眼的视角范围与所述样本人眼的视角范围之间的相似度小于所述预设阈值时，控制所述屏幕灭屏。When the similarity between the viewing angle range of the human eye in the image and the viewing angle range of the sample human eye is less than the preset threshold, the screen is controlled to be off. 5.如权利要求4所述的终端屏幕控制方法，其特征在于，通过以下步骤预先生成所述样本人眼的视角范围：5. The terminal screen control method according to claim 4, wherein the viewing angle range of the sample human eye is pre-generated by the following steps: 在所述终端的屏幕处于亮屏状态，且所述终端处于稳定状态时，调用所述终端的前置摄像头进行多次拍摄；When the screen of the terminal is in a bright screen state and the terminal is in a stable state, call the front camera of the terminal to shoot multiple times; 识别所拍摄的多张样本图像中人眼的视角范围，并从所述多张样本图像中人眼的视角范围中确定出所述用户在使用所述终端时眼睛的视角范围；Identifying the viewing angle range of the human eye in the multiple sample images captured, and determining the viewing angle range of the user's eyes when using the terminal from the viewing angle range of the human eye in the multiple sample images; 将确定的所述用户在使用所述终端时眼睛的视角范围作为所述样本人眼的视角范围。The determined viewing angle range of the user's eyes when using the terminal is used as the viewing angle range of the sample human eye. 6.如权利要求1所述的终端屏幕控制方法，其特征在于，在所述获取样本人眼的视角范围之前，所述方法还包括：6 . The terminal screen control method according to claim 1 , wherein before acquiring the viewing angle range of a sample human eye, the method further comprises: 6 . 提取所述图像中人眼的特征信息；extracting feature information of the human eye in the image; 根据所述特征信息判断所述终端是否正在被目标用户使用；Determine whether the terminal is being used by the target user according to the feature information; 在根据所述特征信息判断所述终端正在被目标用户使用时，执行所述获取样本人眼的视角范围的步骤。When it is determined according to the characteristic information that the terminal is being used by the target user, the step of acquiring the viewing angle range of the sample human eye is performed. 7.如权利要求6所述的终端屏幕控制方法，其特征在于，所述方法还包括：7. The terminal screen control method according to claim 6, wherein the method further comprises: 在根据所述特征信息判断当前正在使用所述终端的使用者为非所述用户本人时，控制所述屏幕灭屏。When it is determined according to the feature information that the user currently using the terminal is not the user himself, the screen is controlled to be off. 8.如权利要求1至7中任一项所述的终端屏幕控制方法，其特征在于，在所述判断所述当前亮屏时间是否大于预设时长之后，所述方法还包括：8. The terminal screen control method according to any one of claims 1 to 7, wherein after judging whether the current screen-on time is greater than a preset time period, the method further comprises: 在所述当前亮屏时间大于预设时长时，则执行所述调用所述终端的前置摄像头对当前场景进行拍摄的步骤。When the current screen-on time is greater than the preset time period, the step of invoking the front camera of the terminal to shoot the current scene is performed. 9.一种终端屏幕控制装置，其特征在于，包括：9. A terminal screen control device, comprising: 检测触发模块，用于在终端的屏幕处于亮屏状态时，触发稳定性检测组件检测所述终端是否处于稳定状态；a detection trigger module, configured to trigger the stability detection component to detect whether the terminal is in a stable state when the screen of the terminal is in a bright screen state; 图像拍摄模块，用于在检测到所述终端处于稳定状态时，调用所述终端的前置摄像头对当前场景进行拍摄；an image capturing module, configured to call the front camera of the terminal to capture the current scene when it is detected that the terminal is in a stable state; 图像识别模块，用于识别所拍摄的图像中人眼的视角范围；The image recognition module is used to recognize the viewing angle range of the human eye in the captured image; 屏幕控制模块，用于根据所述视角范围，控制所述屏幕灭屏或保持亮屏；a screen control module, configured to control the screen to turn off or keep the screen on according to the viewing angle range; 所述装置还包括：The device also includes: 亮屏时间确定模块，用于在确定所终端的屏幕处于亮屏状态之后，在触发稳定性检测组件检测所述终端是否处于稳定状态之前，确定所述屏幕的当前亮屏时间；a screen-on time determination module, configured to determine the current screen-on time of the screen after determining that the screen of the terminal is in the screen-on state and before triggering the stability detection component to detect whether the terminal is in a stable state; 第二判断模块，用于判断所述当前亮屏时间是否大于预设时长；a second judging module, configured to judge whether the current screen-on time is greater than a preset time length; 所述检测触发模块还用于：在所述当前亮屏时间小于或等于预设时长时，触发稳定性检测组件检测所述终端是否处于稳定状态；The detection triggering module is further configured to: when the current screen-on time is less than or equal to a preset duration, trigger the stability detection component to detect whether the terminal is in a stable state; 屏幕控制模块，包括：Screen control module, including: 样本获取单元，用于获取样本人眼的视角范围，所述样本人眼的视角范围用于指示用户使用所述终端时眼睛的参考视角范围；a sample obtaining unit, configured to obtain a viewing angle range of a sample human eye, where the viewing angle range of the sample human eye is used to indicate a reference viewing angle range of the user's eyes when using the terminal; 匹配单元，用于将所述图像中人眼的视角范围与所述样本人眼的视角范围进行相似度匹配；a matching unit, configured to perform similarity matching between the viewing angle range of the human eye in the image and the viewing angle range of the sample human eye; 所述装置还包括类型确定模块，用于在所述图像中人眼的视角范围与所述样本人眼的视角范围之间的相似度小于预设阈值时，确定所述屏幕当前正在显示的应用界面所属的应用程序类型；The device further includes a type determination module for determining the application currently being displayed on the screen when the similarity between the viewing angle range of the human eye in the image and the viewing angle range of the sample human eye is less than a preset threshold The type of application to which the interface belongs; 其中，所述屏幕控制模块还用于在所述应用程序类型为阅览类时，控制所述屏幕灭屏，并在所述应用程序类型为音视频类时，控制所述屏幕保持亮屏。Wherein, the screen control module is further configured to control the screen to turn off the screen when the application type is viewing type, and control the screen to keep the screen on when the application type is audio-video type. 10.如权利要求9所述的终端屏幕控制装置，其特征在于，所述稳定性检测组件包括陀螺仪；所述检测触发模块具体用于：10. The terminal screen control device according to claim 9, wherein the stability detection component comprises a gyroscope; and the detection trigger module is specifically used for: 记录所述陀螺仪在预设时间段内的X轴、Y轴和Z轴的分量值；Record the component values of the X-axis, Y-axis and Z-axis of the gyroscope within a preset time period; 根据所述X轴、Y轴和Z轴的分量值，判断所述陀螺仪的抖动幅度是否平稳；According to the component values of the X-axis, the Y-axis and the Z-axis, determine whether the shaking amplitude of the gyroscope is stable; 在判定所述陀螺仪的抖动幅度未平稳时，返回执行所述记录所述陀螺仪在预设时间段内的X轴、Y轴和Z轴的分量值的步骤；When it is determined that the jitter amplitude of the gyroscope is not stable, return to the step of recording the component values of the X-axis, Y-axis and Z-axis of the gyroscope within a preset time period; 在判定所述陀螺仪的抖动幅度平稳时，确定所述终端处于稳定状态。When it is determined that the shaking amplitude of the gyroscope is stable, it is determined that the terminal is in a stable state. 11.如权利要求9所述的终端屏幕控制装置，其特征在于，所述稳定性检测组件包括振动传感器；所述检测触发模块具体用于：11. The terminal screen control device according to claim 9, wherein the stability detection component comprises a vibration sensor; the detection trigger module is specifically used for: 接收所述振动传感器的输出信号；receiving the output signal of the vibration sensor; 根据所述振动传感器的输出信号判断所述终端是否处于稳定状态。Determine whether the terminal is in a stable state according to the output signal of the vibration sensor. 12.如权利要求9所述的终端屏幕控制装置，其特征在于，所述屏幕控制模块还包括：12. The terminal screen control device according to claim 9, wherein the screen control module further comprises: 控制单元，用于在所述图像中人眼的视角范围与所述样本人眼的视角范围之间的相似度大于或等于预设阈值时，控制所述屏幕保持亮屏，并在所述图像中人眼的视角范围与所述样本人眼的视角范围之间的相似度小于所述预设阈值时，控制所述屏幕灭屏。The control unit is configured to control the screen to keep a bright screen when the similarity between the viewing angle range of the human eye in the image and the viewing angle range of the sample human eye is greater than or equal to a preset threshold, and the image When the similarity between the viewing angle range of the middle human eye and the viewing angle range of the sample human eye is less than the preset threshold, the screen is controlled to be off. 13.如权利要求12所述的终端屏幕控制装置，其特征在于，还包括：13. The terminal screen control device according to claim 12, further comprising: 样本建立模块，用于预先生成所述样本人眼的视角范围；a sample establishment module, configured to pre-generate the viewing angle range of the sample human eye; 其中，所述样本建立模块具体用于：Wherein, the sample establishment module is specifically used for: 在所述终端的屏幕处于亮屏状态，且所述终端处于稳定状态时，调用所述终端的前置摄像头进行多次拍摄；When the screen of the terminal is in a bright screen state and the terminal is in a stable state, call the front camera of the terminal to shoot multiple times; 识别所拍摄的多张样本图像中人眼的视角范围，并从所述多张样本图像中人眼的视角范围中确定出所述用户在使用所述终端时眼睛的视角范围；Identifying the viewing angle range of the human eye in the multiple sample images captured, and determining the viewing angle range of the user's eyes when using the terminal from the viewing angle range of the human eye in the multiple sample images; 将确定的所述用户在使用所述终端时眼睛的视角范围作为所述样本人眼的视角范围。The determined viewing angle range of the user's eyes when using the terminal is used as the viewing angle range of the sample human eye. 14.如权利要求9所述的终端屏幕控制装置，其特征在于，还包括：14. The terminal screen control device according to claim 9, further comprising: 提取模块，用于提取所述图像中人眼的特征信息；an extraction module for extracting the feature information of the human eye in the image; 第一判断模块，用于根据所述特征信息判断所述终端是否正在被目标用户使用；a first judging module, configured to judge whether the terminal is being used by a target user according to the characteristic information; 其中，所述屏幕控制模块，还用于在根据所述特征信息判断所述终端正在被目标用户使用时，根据所述视角范围，控制所述屏幕灭屏或保持亮屏。Wherein, the screen control module is further configured to control the screen to turn off the screen or keep the screen on according to the viewing angle range when it is determined according to the feature information that the terminal is being used by the target user. 15.如权利要求14所述的终端屏幕控制装置，其特征在于，所述屏幕控制模块还用于在根据所述特征信息判断当前正在使用所述终端的使用者为非所述用户本人时，控制所述屏幕灭屏。15 . The terminal screen control device according to claim 14 , wherein the screen control module is further configured to: when it is determined according to the characteristic information that the user currently using the terminal is not the user himself, the terminal screen control device according to claim 14 . Controls the screen to go off. 16.如权利要求9至15中任一项所述的终端屏幕控制装置，其特征在于，还包括：16. The terminal screen control device according to any one of claims 9 to 15, further comprising: 所述图像拍摄模块还用于：在所述当前亮屏时间大于预设时长时，调用所述终端的前置摄像头对当前场景进行拍摄。The image capturing module is further configured to: when the current screen-on time is greater than a preset duration, call the front camera of the terminal to capture the current scene. 17.一种用于控制屏幕的终端设备，包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，其特征在于，所述处理器执行所述程序时，实现如权利要求1至8中任一项所述的终端屏幕控制方法。17. A terminal device for controlling a screen, comprising a memory, a processor and a computer program stored in the memory and running on the processor, wherein when the processor executes the program, The terminal screen control method described in any one of requirements 1 to 8. 18.一种非临时性计算机可读存储介质，其上存储有计算机程序，其特征在于，所述程序被处理器执行时实现如权利要求1至8中任一项所述的终端屏幕控制方法。18. A non-transitory computer-readable storage medium on which a computer program is stored, characterized in that, when the program is executed by a processor, the terminal screen control method according to any one of claims 1 to 8 is implemented .
CN201810862616.8A 2018-08-01 2018-08-01 Terminal screen control method and device, terminal equipment and storage medium Expired - Fee Related CN109167877B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810862616.8A CN109167877B (en) 2018-08-01 2018-08-01 Terminal screen control method and device, terminal equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810862616.8A CN109167877B (en) 2018-08-01 2018-08-01 Terminal screen control method and device, terminal equipment and storage medium

Publications (2)

Publication Number Publication Date
CN109167877A CN109167877A (en) 2019-01-08
CN109167877B true CN109167877B (en) 2021-05-18

Family

ID=64898469

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810862616.8A Expired - Fee Related CN109167877B (en) 2018-08-01 2018-08-01 Terminal screen control method and device, terminal equipment and storage medium

Country Status (1)

Country Link
CN (1) CN109167877B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110534073A (en) * 2019-07-30 2019-12-03 华为技术有限公司 Method and device for adjusting screen brightness
CN110597426A (en) * 2019-08-30 2019-12-20 捷开通讯(深圳)有限公司 Bright screen processing method and device, storage medium and terminal
CN110647233A (en) * 2019-09-27 2020-01-03 三星电子（中国）研发中心 Screen power consumption control method and system of terminal
CN112363611B (en) * 2020-11-27 2023-11-10 Oppo（重庆）智能科技有限公司 Power consumption adjustment method and device, electronic equipment and readable storage medium
CN112631432A (en) * 2021-01-05 2021-04-09 Oppo广东移动通信有限公司 Screen control method, wearable device and storage medium
CN113628579A (en) * 2021-08-09 2021-11-09 深圳市优聚显示技术有限公司 LED energy-saving display method, LED display screen system and LCD display equipment
CN115731590A (en) * 2021-08-30 2023-03-03 中兴通讯股份有限公司 Control method, device, equipment and storage medium
CN113903317B (en) * 2021-10-19 2023-06-27 Oppo广东移动通信有限公司 Screen brightness adjusting method and device of electronic equipment and electronic equipment
CN114629992A (en) * 2022-03-17 2022-06-14 Oppo广东移动通信有限公司 Equipment prompting method and device, electronic equipment and computer readable storage medium
CN118092828A (en) * 2022-11-25 2024-05-28 北京罗克维尔斯科技有限公司 Information display method, device, equipment, storage medium and vehicle

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106095281A (en) * 2016-08-24 2016-11-09 北京小米移动软件有限公司 Screen control method, device and electronic equipment
CN106303055A (en) * 2016-08-23 2017-01-04 努比亚技术有限公司 Bright screen controls device, mobile terminal and method

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005236597A (en) * 2004-02-19 2005-09-02 Oki Electric Ind Co Ltd Portable terminal equipment having power-saving function
US9798371B2 (en) * 2013-06-05 2017-10-24 Samsung Electronics Co., Ltd Electronic device and content display method thereof
US20150061988A1 (en) * 2013-09-05 2015-03-05 Texas Instruments Incorporated Adaptive Power Savings on a Device Display
CN104656899A (en) * 2015-02-12 2015-05-27 深圳市金立通信设备有限公司 Terminal operation and control method
CN106020510B (en) * 2016-05-17 2019-05-03 Oppo广东移动通信有限公司 Terminal control method and device
CN106843454A (en) * 2017-02-28 2017-06-13 宇龙计算机通信科技(深圳)有限公司 Display control method and display device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106303055A (en) * 2016-08-23 2017-01-04 努比亚技术有限公司 Bright screen controls device, mobile terminal and method
CN106095281A (en) * 2016-08-24 2016-11-09 北京小米移动软件有限公司 Screen control method, device and electronic equipment

Also Published As

Publication number Publication date
CN109167877A (en) 2019-01-08

Similar Documents

Publication Publication Date Title
CN109167877B (en) Terminal screen control method and device, terminal equipment and storage medium
KR101444103B1 (en) Media signal generating method and apparatus using state information
CN101388965B (en) Data processing device and data processing method
JP6360619B2 (en) REPRODUCTION CONTROL METHOD, REPRODUCTION CONTROL DEVICE, COMPUTER PROGRAM, AND COMPUTER-READABLE STORAGE MEDIUM
US20110280551A1 (en) Unintended Video Recording Detection in a Video Recording Device
US20160180882A1 (en) Editing apparatus and editing method
CN107566643B (en) Information processing method, information processing apparatus, storage medium, and electronic device
WO2016200741A1 (en) Method and apparatus for finding and using video portions that are relevant to adjacent still images
JP2017514427A (en) REPRODUCTION CONTROL METHOD, REPRODUCTION CONTROL DEVICE, AND ELECTRONIC DEVICE
CN109359458A (en) Application unlocking method, device and computer-readable storage medium
CN110177258A (en) Image processing method, image processing apparatus, server, and storage medium
CN105069426A (en) Method and device for judging similar pictures
CN111818263A (en) Processing method, device, mobile terminal and storage medium for shooting parameters
CN107360366B (en) Photographing method, device, storage medium and electronic device
CN109766473B (en) Information interaction method, device, electronic device and storage medium
CN109981988B (en) Video generation method and device and mobile terminal
CN104536675B (en) A kind of screening-mode processing method and terminal
CN106060383B (en) An image acquisition method and system
CN105956169B (en) Picture processing method and system and voice playing method and system
CN107872620A (en) Video recording method and device
JP2009194900A (en) Imaging apparatus and control method thereof
CN105744165A (en) Photographing method and device, and terminal
CN105872424A (en) Video recording method of mobile terminal and the mobile terminal
KR20160016746A (en) Determining start and end points of a video clip based on a single click
CN118244877A (en) Page screenshot method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20210518