WO2024234800A9 - Image recommendation method and related apparatus - Google Patents
Image recommendation method and related apparatus Download PDFInfo
- Publication number
- WO2024234800A9 WO2024234800A9 PCT/CN2024/081113 CN2024081113W WO2024234800A9 WO 2024234800 A9 WO2024234800 A9 WO 2024234800A9 CN 2024081113 W CN2024081113 W CN 2024081113W WO 2024234800 A9 WO2024234800 A9 WO 2024234800A9
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- score
- corrected
- rule
- accordance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/53—Querying
- G06F16/535—Filtering based on additional data, e.g. user or group profiles
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/54—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
Definitions
- the present application relates to the field of terminals and image analysis, and in particular to image recommendation methods and related devices.
- Smart devices such as mobile phones are equipped with camera functions, and users can use the camera function to take the images they want, such as photos, dynamic photos, videos, etc. After users take a large number of photos and videos, it is difficult to accurately find the photos or videos they want. Therefore, some smart devices provide solutions for recommending images, which can recommend some images for users to view, which can save users time and is convenient and fast. In order to improve user experience, how smart devices recommend images is the direction of current and future research.
- the present application provides an image recommendation method and related devices, which can recommend images to users.
- an image recommendation method is provided, which is applied to an electronic device.
- the method may include: displaying a preview interface, wherein the preview interface displays a preview image frame reported by a camera of the electronic device; detecting a user operation for shooting an image, saving a first image, wherein the first image includes one or more preview image frames displayed on the preview interface; determining the theme, score, and repeatability of the first image, wherein the score of the first image is obtained according to any one or more of the image quality, composition, facial beauty, and character action of the first image, and the repeatability indicates whether the first image is repeated with a historically shot image; determining a recommended image from a plurality of first images according to their respective scores, themes, and repeatability; and displaying indication information of the recommended image.
- the electronic device can recommend images to the user based on the subject, score, and repetitiveness of each image among multiple captured images.
- the method may further include: during display of the preview interface, determining a score of each preview image frame displayed on the preview interface, wherein the score of the preview image frame is obtained according to any one or more of image quality, composition, facial beauty, and character action of the preview image frame. Determining the score of the first image specifically includes: determining the score of the first image according to the scores of one or more preview image frames contained in the first image.
- the score of the preview image frame is determined in real time when the image is previewed, which can save the execution time of the subsequent determination of the first image score and reduce the time cost.
- the storage capacity of the preview stream is small, this also facilitates the convenience of the calculation and analysis process.
- the score of each preview image frame displayed on the preview interface can be determined in the following manner: a first score is determined according to the image quality of the jth preview image frame, the jth preview image frame being any preview image frame displayed on the preview interface; whether the jth preview image frame contains a subject is determined, and if so, a second score of the jth preview image frame is determined according to the composition; if not, the second score, the third score, and the fourth score of the jth preview image frame are all set to 0; when the jth preview image frame contains a subject, a third score of the jth preview image frame is determined according to the subject category of the jth preview image frame; when the subject contained in the jth preview image frame is a person, a fourth score of the jth preview image frame is determined according to the action of the person; a weighted average score of the first score, the second score, the third score, and the fourth score is
- the score of each preview image frame can reflect the image quality, composition, facial beauty and character action of the preview image frame, so that the score of the final first image can also reflect the above factors.
- the first score, the second score, the third score, and the fourth score are all within a first score interval, wherein the first score interval depends on a preset scoring system, such as a ten-point system, a hundred-point system, and the like.
- the electronic device may determine the first score according to the clarity and/or symmetry of the jth preview image frame; the higher the clarity and/or symmetry, the higher the first score.
- the electronic device may determine the third score of the j-th preview image frame according to the following method:
- the third score is set to a high score, where the high score includes a score whose difference from the full score is less than a preset value, and the full score is the highest score in the scoring range of the third score;
- the third score is determined based on any one or more of whether the jth preview image frame contains a face, whether the eyes of the contained face are open or closed, the expression of the face, the posture of the face, the area of the face in the jth preview image frame, the size of the area, the size of the proportion, and the number of faces.
- the electronic device may determine the third score by the following formula:
- Nface is the number of faces contained in the j-th preview image frame
- s e,i is the eye-opening and eye-closing score of the i-th face.
- s e,i is set to the first value.
- s e,i is set to the second value. The first value is higher than the second value.
- s m,i is the smile score of the i-th face.
- s m,i is set to the third value.
- s m,i is set to the fourth value.
- the third value is higher than the fourth value.
- s d,i is the posture score of the i-th face.
- s d,i is set to the fifth value.
- s d,i is set to the sixth value. The fifth value is higher than the sixth value.
- s b is the face size influence coefficient of the i-th face.
- s b is set to the seventh value.
- s b is set to the eighth value. The seventh value is greater than the eighth value.
- s N is the face ratio coefficient of the i-th face. The larger the area ratio of the i-th face, the larger s N is.
- sc is the composition beauty coefficient.
- sc is set to the ninth value.
- sc is set to the tenth value.
- the ninth value is higher than the tenth value.
- the first area includes the central area of the j-th preview image frame.
- s p is the non-face penalty threshold.
- s p is 0.
- s p is set to the preset non-face penalty threshold.
- the first value, the third value, and the fifth value are all high scores; the second value, the fourth value, and the sixth value are all low scores; among them, the high score includes the score whose difference with the full score is less than the preset value, the low score includes the score whose difference with the full score is greater than the preset value, and the full score is the highest score in the scoring range of the third score.
- the electronic device may determine the fourth score of the jth preview image frame in the following manner: determine whether the character in the jth preview image frame includes a preset wonderful action; if so, the fourth score is equal to the product of the confidence level output by the action evaluation output algorithm and the high score; if not, the fourth score is set to a low score; wherein the high score includes a score whose difference from the full score is less than a preset value, the low score includes a score whose difference from the full score is greater than a preset value, and the full score is the highest score in the scoring range of the fourth score.
- the score of the first image is determined based on the scores of preview image frames contained in the first image, specifically including: determining the score of the first image based on the first preview image frame, the first preview image frame including preview image frames among all preview image frames of the first image except transition frames, the transition frames including preview image frames whose information amount and image quality do not meet the first threshold.
- the score of the first image can more objectively reflect the quality of the first image.
- the electronic device may determine the score of the first image based on the first preview image frame in the following manner: determine the wonderful frame with the highest score in the first preview image frame; determine the weighted average score of the wonderful frame, a first preset number of preview image frames before the wonderful frame in the first preview image frame, and a second preset number of preview image frames after the wonderful frame in the first preview image frame; and determine the weighted average score as the score of the first image.
- the first preset number and the second preset number may be the same or different.
- the electronic device may determine the repeatability of the first image based on any one or more of the scores of the first image and the historically captured images, including whether the person is moving, the subject, and the similarity.
- the first image is determined to be repeated; if the first image and all of the historically captured images are not repeated, the first image is determined to be non-repeated.
- the score of the first image is lower than the score of the second image, and one of the first image and the second image is a motion frame, and the other is not a motion frame;
- the score of the first image is lower than the score of the second image, and both the first image and the second image are motion frames, and the motion time is greater than a preset minimum time interval;
- the score of the first image is lower than the score of the second image, and both the first image and the second image are non-motion frames, and the subjects are the same, and the similarity between the first image and the second image is lower than a second threshold.
- the subject of the first image includes any one of the following: children, animals, buildings, plants, and landscapes; and the subject of the first image is determined according to the content of the first image.
- the electronic device can determine the recommended image from the multiple first images in the following manner: divide the multiple first images into multiple theme groups according to their respective themes; sort the first images in each theme group according to the scores and repetitiveness, with the higher scores being arranged first, and non-repetitive images being arranged first compared to repetitive images; and filter the first images from each theme group according to the order of arrangement to form the recommended image. In this way, high-quality images with different themes, wonderful content, and non-repetitive images can be recommended to users.
- the number of recommended images selected by the electronic device from each theme group may be the same or different.
- the method may further include: displaying a notification message, the notification message being used to prompt a user to view the recommended image; and detecting a user operation acting on the notification message.
- the notification message is displayed at any of the following time points: a preset fixed time; after a third preset number of images are taken; after entering the first location and taking multiple images at the first location, and after leaving the first location.
- the manner of displaying the indication information of the recommended image may include the following two methods:
- the method may further include: detecting a user operation for generating a video; and generating a video according to the recommended image. This can facilitate the user to generate a video with one click, meeting the user's need to make a video.
- the electronic device may generate a video according to the recommended image in the following manner: matching an audio and video template according to the recommended image; and generating a video according to the recommended image and the matched audio and video template.
- the method may further include: detecting a user operation for sharing the video; sharing the video to a first application in the electronic device, or sharing the video to a first device different from the electronic device. This makes it easy for users to quickly and conveniently share videos made using the recommended image to some applications or devices, meeting the user's need to share videos.
- the type of any first image is any of the following: a static photo containing one image frame; a dynamic photo containing multiple image frames; a video containing multiple image frames. That is, the image recommendation method provided by the present application can recommend different types of images to the user.
- saving the first image specifically includes: storing the moment, before and after the moment when the user operation for taking the image is detected, the preview image frame displayed on the preview interface, and the sound detected by the electronic device as a dynamic photo.
- the historical captured images specifically include any one of the following: all images taken by the electronic device before the first image; images taken after the camera was last started; images taken on the same day; images within a fourth preset number taken most recently; images taken at the first location after entering the first location.
- the multiple first images specifically include any one of the following: all images taken by the electronic device; images taken during the period from the last time the camera was started to the last time the camera was turned off; images taken on the same day; the fifth preset number of images taken most recently; images taken at the first location during the period from entering the second location to leaving the second location.
- an electronic device comprising: a memory and one or more processors; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute a method executed by the electronic device in the first aspect or any one of the embodiments of the first aspect.
- an embodiment of the present application provides a computer-readable storage medium, comprising instructions, which, when executed on an electronic device, causes the electronic device to execute a method executed by the electronic device in the first aspect or any one of the embodiments of the first aspect.
- an embodiment of the present application provides a computer program product.
- the computer program product When the computer program product is run on a computer, it enables the computer to execute the method executed by the electronic device in the first aspect or any one of the embodiments of the first aspect.
- an embodiment of the present application provides a chip system, which includes at least one processor for implementing a method executed by an electronic device in the first aspect or any one of the embodiments of the first aspect.
- the image recommendation method provided in the present application is implemented to provide an intelligent image recommendation solution, which can recommend images to users based on the theme, score and repeatability of each image to meet the actual needs of users.
- 2A-2P are user interfaces for recommending images, generating videos, and sharing videos provided in an embodiment of the present application;
- FIG3A is a flow chart of an image recommendation method provided in an embodiment of the present application.
- FIG3B is a flow chart of another image recommendation method provided in an embodiment of the present application.
- FIG4 is a flowchart of scoring a preview image of a current frame provided by an embodiment of the present application.
- FIG5 is a mapping relationship curve between the face size influence coefficient s b and the face size provided by an embodiment of the present application;
- FIG6 is a flow chart of determining the repeatability of two images provided by an embodiment of the present application.
- FIG7 is a hardware structure block diagram of an electronic device provided in an embodiment of the present application.
- FIG8 is a software architecture of an electronic device provided in an embodiment of the present application.
- first and second are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features.
- a feature defined as “first” or “second” may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality” means two or more.
- GUI graphical user interface
- the image recommendation method is applied to an electronic device, and the electronic device is an intelligent terminal device, which can be of various types, and the embodiments of the present application do not limit its specific type.
- the electronic device can be a mobile phone, and can also include a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, a smart screen, a wearable device, an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a car machine, a smart headset, a game console, and can also be an Internet of Things (IOT) device or a smart home device such as a smart TV, etc.
- the electronic device can also include a laptop computer with a touch-sensitive surface or a touch panel, a desktop computer with a touch-sensitive surface or a touch panel, and other non-portable terminal devices, etc.
- the electronic device can score multiple images separately and determine whether each image is similar.
- the score of an image measures the quality of the image and the degree of excitement of the content, and the similarity indicates whether an image is similar to other images.
- the electronic device can recommend high-quality, exciting, and dissimilar (i.e., different content) images to the user based on the scores and similarities of each image, so that the user can pay attention to these recommended images.
- the scoring strategy and the similarity measurement method please refer to the method implementation example below, which will not be repeated here.
- the electronic device may further process the recommended images. For example, the electronic device may generate a video using the recommended images to meet the user's need to produce high-quality videos with exciting content and non-repetitive content. The function of generating a video using the recommended images may be called "one-click video" or other names. For another example, the electronic device may also share the generated video to a social platform or contact to meet the user's need to share the video.
- the image recommendation method provided in this application can be a function provided by the system's gallery application, or a function provided by other third-party applications, which is not limited here.
- System applications refer to applications provided by the manufacturer of the electronic device, and third-party applications are applications not provided by the device manufacturer.
- the gallery is an image management APP on electronic devices such as smartphones and tablets, which can also be called “album” and "photo”, etc.
- This application does not limit the name of the application.
- the gallery can support users to perform various operations on images stored on electronic devices, such as browsing, editing, deleting, selecting, etc. That is, the object managed by the "gallery" is the image. In other cases, the gallery can also support users to perform the above-mentioned operations on images stored on cloud servers.
- the gallery APP in the following embodiments of the present application also provides an image recommendation function.
- Live photo include the moment of shooting and the picture content and sound of a period of time before and after the moment. That is, it contains multiple frames (such as 90 frames) of pictures and corresponding sounds, which can be played like short videos.
- the number of frames before and after the moment of shooting included in a live photo can be the same or different.
- Live photos can also be called animated pictures, live photos, etc.
- Still photos include one frame of picture, which can be the picture content recorded at the time of shooting, or a frame of picture fused together from several frames before and after the shooting. Still photos only include the picture but not the sound. Both still photos and dynamic photos can be collectively referred to as photos.
- Video can include images and sounds recorded continuously over a period of time. Usually, the duration of a video is longer than that of a dynamic photo.
- the electronic device can display a thumbnail of the image, and the original image can be stored locally on the electronic device or in the cloud.
- the thumbnail of a dynamic photo can be a frame captured at the time of taking the photo.
- the image displayed in the electronic device may be captured by the electronic device using a camera, obtained from other applications or downloaded from the Internet, or shared by other electronic devices, without limitation here.
- 1A-1C are user interfaces for an electronic device to take dynamic photos.
- FIG. 1A exemplarily shows an exemplary user interface 11 on an electronic device 100 for displaying installed applications.
- the user interface 11 displays: a status bar, a page indicator, a tray with common application icons, other application icons, etc. Without limitation, the user interface 11 may also include a navigation bar, a sidebar, etc.
- the user interface 11 shown in FIG1A may be referred to as a home screen.
- the application icons in the user interface 11 may include, for example, a camera icon 111, a gallery icon 112, and icons of some other applications.
- the camera is an APP on an electronic device that is used to call a camera to take images. This embodiment does not limit the name of the application.
- the camera APP may be a system application provided by the electronic device or a third-party application.
- the electronic device may receive a user operation (such as a click operation or a touch operation) on a camera icon 111, and then respond to the operation by starting a camera application and displaying a user interface 12 as shown in FIG1B .
- the user interface 12 in FIG1B is a preview interface provided by the camera application.
- the user interface 12 may include a mode bar 121 , a photo control 122 , a preview window 123 , a review control 124 , and a quick function area 125 . Among them:
- the mode bar 121 may include multiple camera mode options, such as “night scene”, “portrait”, “photo”, “video recording”, etc. Different camera modes can provide users with different camera services. Users can choose any of the multiple camera modes to take pictures according to different needs. For example, “photo” can be the default camera mode, which is used to take pictures. "Video recording” is used to record videos. The "night scene” mode is suitable for photo scenes with dim light, such as at night. The "portrait” mode is suitable for photo scenes where the subject of the photo is a person.
- the electronic device can detect the user operation of switching modes, such as swiping left/right in the mode bar 121, and change the currently used camera mode according to the operation.
- the electronic device can switch to the "portrait” mode.
- the electronic device first uses the "photo” mode.
- the photo control 122 is used to trigger photo taking.
- the electronic device can detect whether there is a user operation on the photo control 122, such as a click operation. When the user operation on the photo control 122 is detected, the electronic device can generate a photo taking instruction. The electronic device can obtain the image reported by the corresponding camera according to the photo taking instruction, and then save it as a static photo or a dynamic photo.
- the preview window 123 can be used to display the image captured by the camera of the electronic device in real time.
- the electronic device can process the image reported by the camera to improve the display effect of the image.
- the electronic device can blur the background in the image reported by the camera to highlight the portrait.
- the preview window 123 can display the image processed by the image processing algorithm corresponding to the different shooting modes in real time, so that the user can perceive the shooting effect corresponding to the different shooting modes in real time.
- the image in the preview window 123 can also be called a preview image.
- the review control 124 can be used to display thumbnails of recently taken photos or videos. When a user operation acting on the review control 124 is detected, the electronic device can also display an image corresponding to the thumbnail.
- the quick function area 125 may include a high-dynamic range (HDR) function option, a dynamic photo function option 125A, an AI function option, a flash function option, a color mode function option, a setting function option, etc.
- the HDR function option can be used to trigger the electronic device to use the HDR algorithm to fuse the image when it is turned on.
- the AI function option can be used to trigger the electronic device to identify the photo scene in the preview screen when it is turned on, and the current AI function option is in the off state.
- the flash control can be used to trigger the electronic device to turn on or off the flash.
- the color mode function option can be used to trigger the electronic device to use a color filter to process the image captured by the camera.
- the setting function option can be used to set the photo parameters of the electronic device (for example, image size, image storage format, etc.).
- the dynamic photo function option 125A can be used to turn on or off the dynamic photo shooting mode.
- the display state of the dynamic photo function option 125A in FIG. 1B indicates that the dynamic photo shooting mode has been turned on.
- the electronic device After turning on the dynamic photo shooting mode, the electronic device can detect user operations (such as click operations, touch operations, etc.) acting on the photo control 122, and then respond to the user operation to save the preview image at the photo moment and a period of time before and after the photo moment and the collected sound as a dynamic photo.
- user operations such as click operations, touch operations, etc.
- FIG. 2A is a user interface 21 provided by a gallery for displaying a plurality of images taken by a user.
- the user interface 21 displays thumbnails of multiple dynamic photos taken by the user, including thumbnails 211A to 211P.
- a dynamic photo indicator is displayed in the lower left corner of each thumbnail, indicating that the image corresponding to the thumbnail is a dynamic photo.
- FIG2A may be the user interface displayed after the electronic device detects a user operation on the icon 112 of the gallery in FIG1A .
- 2B-2L are user interfaces for recommending images from a gallery and generating videos.
- the user interface 22 shown in FIG2B is provided by a drop-down notification bar of an electronic device.
- the notification bar is a system application that provides notification messages in an electronic device.
- the user interface 22 displays a notification message 221 provided by the notification bar, and the specific content of the notification message 221 comes from the gallery.
- the notification message 221 includes: an icon 221A of the gallery, the name 221B of the gallery, the generation time 221C of the notification message, and the notification content 221D.
- the notification content 221D can prompt the user that the electronic device recommends images, and the user can use these images to generate videos.
- the notification content 221D can, for example, be "One-click blockbuster recommendation" or "Recommend you to create a wonderful short story about nature with one click.”
- the user interface 23 displays: a return key 231, a title bar 232, thumbnails of multiple images taken by the electronic device over a period of time such as thumbnails 211A to thumbnail 211P, an edit bar 233, a clear control 234, and a control 235 for generating a video.
- the return key 231 is used to monitor user operations. After the electronic device detects the user operation acting on the return key 231, it can respond to the user operation and display the homepage provided by the gallery for displaying images, or it can also return to the desktop.
- the title bar 232 is used to indicate which images are displayed in the current user interface 23. For example, "all photos" in FIG. 2C refers to photos taken by the electronic device within a period of time. There is also a drop-down arrow next to the title bar 232, and the user can click the drop-down arrow to select the image type and image range (including time range) that he wants to view from the drop-down options in the electronic device.
- the images corresponding to thumbnails 211A to 211P are multiple images taken by the electronic device within a period of time.
- the period of time can be defined in many ways. For example, these images may include images taken from the last time the electronic device started the camera to the time the camera was turned off, or may include images taken by the electronic device on the same day, or may include a preset number of images taken recently by the electronic device, or may be images taken from the time the electronic device entered a certain place/area to the time it left the place/area, and so on.
- a zoom icon may be displayed in the upper left corner of each thumbnail. The user may click on the zoom icon, and the electronic device may then display the original image of the corresponding thumbnail in full screen, making it easier for the user to view.
- each thumbnail may also display an image category logo.
- the images corresponding to the thumbnails in FIG. 2C are all dynamic photos, so a dynamic photo logo is displayed in the lower left corner. If the image is a video, a video logo may be displayed in the lower left corner; if the image is a static photo, no logo may be displayed in the lower left corner.
- a selection mark box may also be displayed in the lower right corner of each thumbnail.
- the selection mark boxes of some of the multiple thumbnails are empty, indicating that the corresponding thumbnails are not selected; the background of the selection mark boxes of some thumbnails (such as thumbnail 211D, thumbnail 211E, thumbnail 211G, thumbnail 211J, thumbnail 211K, and thumbnail 211M) is filled, indicating that the corresponding thumbnail is selected by the electronic device.
- the selection mark box of the selected thumbnail is also marked with a number, and the numbers correspond to the order in which the images are selected from small to large.
- thumbnail 211M thumbnail 211K
- thumbnail 211J thumbnail 211G
- thumbnail 211E thumbnail 211D
- the original image corresponding to the selected thumbnail is the image recommended by the electronic device to the user.
- recommendation strategies please refer to the introduction of the method embodiment below.
- the electronic device can detect the user operation acting on the blank selection mark box and mark the corresponding thumbnail as being selected.
- thumbnails selected by the electronic device are displayed in the edit bar 233.
- the electronic device can detect the left/right swipe operation on the edit bar 233, and in response to the operation, switch to display other thumbnails selected by the electronic device.
- the lower left corner of each thumbnail in the edit bar 233 can also display an image category logo.
- the edit bar 233 can be used to edit the thumbnails selected by the electronic device, and the editing operation includes, for example, deletion, order adjustment, etc.
- a delete control is displayed in the upper right corner of each thumbnail in the edit bar 233, and the electronic device can detect the user operation on the delete control of the thumbnail, and then respond to the user operation, mark the corresponding thumbnail as unselected, and remove it from the edit bar 233.
- the electronic device can also detect the user operation of long pressing the thumbnail in the edit bar 233 and then dragging it to other positions in the edit bar 233, and then respond to the user operation to adjust the order in which the corresponding thumbnails are selected, such as advancing or placing them in the back.
- the clear control 234 can be used to monitor user operations. After the electronic device detects the user operation acting on the clear control 234, it can respond to the user operation and mark all previously selected thumbnails as unselected, thereby achieving the purpose of clearing the selection.
- the number of thumbnails currently selected by the electronic device may be displayed on the control 235 , and the number may change as the user adds or deletes selected thumbnails.
- the control 235 may be used to monitor user operations. After the electronic device detects the user operation acting on the control 235, it may respond to the user operation and synthesize the original image corresponding to the selected thumbnail into a video.
- the electronic device may also display the user interface 24 shown in FIG2D after detecting the user operation acting on the control 235.
- the user interface 24 is used to obtain authorization for the relevant permissions required for the "one-click to create a picture" function.
- the user interface 24 displays: prompt information 241 , prompt information 242 , cancel control 243 , and agree control 244 .
- Prompt information 241 is used to prompt the user of the service or application that will be launched after turning on "One-click Video", that is, the service or application that supports the implementation of "One-click Video".
- the "Editing" service mentioned in Figure 2D provides functions such as video capture, adjustment, and trimming.
- the "Trimming” service can also be called other names, which are not limited here.
- the "Trimming” service can be a system service or a third-party service.
- the prompt information 242 is used to prompt the user to start the "Clip" service.
- FIG. 2D shows that the "Clip" service needs to obtain network permissions.
- the prompt information 242 can also provide some controls for the user to click to view more detailed instructions.
- the cancel control 243 is used to monitor user operations. After the electronic device detects the user operation acting on the cancel control 243, it can respond to the user operation and return to display the user interface 23 shown in Figure 2C.
- the consent control 244 is used to monitor user operations. After the electronic device detects the user operation acting on the consent control 244, it can respond to the user operation. The electronic device can obtain the user authorization to use the "Clip” service, and thus can use the "Clip” service via the network.
- the user interface 25 displays prompt information for prompting the user to grant the "Clip" service access to music and audio in the electronic device, as well as a prohibition authorization control and an always allow control. After the electronic device detects that the always allow control is activated, the music and audio access rights can be permanently granted to the "Clip" service.
- the electronic device After the electronic device detects that the always-allow control in FIG. 2F is acted upon, the electronic device may start synthesizing the video.
- the original image (also referred to as material) corresponding to the thumbnail selected by the electronic device is analyzed, for example, various information thereof is obtained, such as size, quantity, theme, etc.
- the electronic device may display the user interface 27 shown in FIG. 2G .
- the user interface 27 displays: prompt information 271, which is used to prompt the user that the electronic device is analyzing the material; a progress bar and progress value 272, which are used to prompt the user of the progress of the analysis; and a stop control 273, which is used to interrupt the analysis operation and the subsequent operation of generating a video.
- the video template is matched to the selected original image.
- the electronic device can display the user interface 28 shown in FIG2H.
- the user interface 28 displays: prompt information 281, which is used to prompt the user that the electronic device is matching the material; a progress bar and progress value 282, which are used to prompt the user of the matching progress; and a stop control 283, which is used to interrupt the matching operation and the subsequent operation of generating a video.
- the video generation starts.
- the electronic device can display the user interface 29 shown in FIG. 2I .
- the user interface 29 displays: a return key 291 , a share key 292 , a prompt message 293 , a play/pause control 294 , a video progress bar 295 , and a menu bar 296 at the bottom.
- the return key 291 may be used to return to the user interface 23 shown in FIG. 2C .
- the share button 292 can be used to share the finished video to other applications or contacts.
- the prompt information 293 is used to prompt the user that a video is currently being generated. After the electronic device has finished making the video, the video can be automatically played in the area 297 where the prompt information 293 is located.
- the video progress bar 295 is used to indicate the playing progress and the total length of the video. Before the video is made, the playing progress and the total length of the video can both be 0.
- the menu bar 296 includes a plurality of controls, such as:
- Template control 296A which the user can click to view more video templates and select an appropriate template to synthesize the previously selected original image
- the export control 296C is used to export the generated video, that is, store it as a video file; before the video is generated, the export control 296C may be in a non-clickable state;
- Editing control 296E is used to edit the generated video, such as cropping, adding filters, etc.
- FIG. 2J exemplarily shows a frame of user interface 30 displayed when an electronic device automatically plays a video after the video is produced.
- FIG2K exemplarily shows a user interface 31 displayed during the process of exporting a video by an electronic device.
- the user interface 31 displays: a prompt message 311 for prompting the user that the electronic device is exporting a video; a progress bar and a progress value 312 for prompting the user of the progress of exporting the video; and a stop control 313 for interrupting the operation of exporting the video.
- the electronic device may display the user interface 32 shown in FIG. 2L.
- the user interface 32 displays a prompt message 321, which is used to prompt the user to which album in the gallery the generated video has been saved, and that the video has been saved to the template draft of the "Clip" service. That is, after the electronic device exports the video, in addition to storing it in the album storage path under the gallery, it can also store it in the storage path of the template draft under the "Clip" service.
- the prompt information 321 may disappear automatically after being displayed for a period of time, or may disappear in response to a user operation (eg, the user clicks on the “Got it” operation in FIG. 2L ), after which the electronic device may continue to display a user interface similar to FIG. 2J .
- the electronic device After storing the video, the electronic device can view and share the video in the corresponding album of the gallery.
- Figures 2M-2P are the user interfaces for viewing and sharing videos in the gallery.
- Fig. 2M shows a user interface 33 of a gallery displaying an album in an electronic device.
- the album here refers to the presentation of image classification results in the gallery.
- the user interface 33 displays a thumbnail 331 of the "Video" album and the number of videos contained in the album.
- the electronic device After the electronic device detects a user operation on a thumbnail of the "Video” album, it can display a user interface 34 shown in FIG2N, which is used to display thumbnails of each video contained in the "Video” album and the video duration. As shown in FIG2N, the user interface 34 displays thumbnails 341 of videos previously generated by the electronic device and the corresponding duration.
- the electronic device can detect the user operation on the thumbnail 341 of the video generated by the electronic device in FIG. 2N , and then display the user interface 35 shown in FIG. 2O , and play the video in the video play area 351 of the user interface 35.
- the user interface 25 also displays various operation controls for the video, such as a progress bar, a share control 352, a favorite control 353, an edit control 354, a delete control 355, and the like.
- the electronic device can detect a user operation on the sharing control 352, and then display the user interface 36 shown in FIG2P in response to the user operation.
- the user interface 36 displays any one or more of the following: one or more application options, one or more contact options, one or more device options, etc.
- an application option corresponds to an application, and is used to share the video to the application
- the contact option corresponds to a contact of the electronic device, and is used to share the video to the contact's device
- the device option corresponds to a nearby device discovered by the electronic device, and is used to share the video to the nearby device.
- FIG. 3A exemplarily shows a process of an image recommendation method provided by the present application. The method is executed by an electronic device.
- the method may include the following steps:
- an electronic device captures a plurality of images.
- the images captured by the electronic device may be static photos, dynamic photos or videos, and there is no limitation here.
- the electronic device determines the subject, score, and repeatability of each captured image.
- the score of each image can be obtained by the electronic device according to any one or more of the image quality, composition, facial beauty, and task action of the image. Repeatability refers to whether an image is repeated in the historical images taken before the image. Theme refers to the scene reflected by the image.
- S103 The electronic device determines a recommended image from the plurality of images according to the scores, themes and repetitiveness of the plurality of images respectively.
- the electronic device displays indication information of the recommended image.
- FIG. 3B exemplarily shows another process of the image recommendation method provided by the present application. The method is executed by an electronic device.
- the method may include the following steps:
- the electronic device can run system applications or third-party applications to start the camera to capture images, receive the preview stream reported by the camera, and display the preview image in the preview interface displayed on the display screen based on the preview stream.
- the camera started by the electronic device can be any camera, depending on user needs.
- the electronic device After the electronic device starts the camera, it can continuously receive the preview stream reported by the camera, so the preview image displayed by the electronic device will also include continuous multiple frames (ie, multiple preview image frames).
- the electronic device may run a camera application and display a preview image frame in the preview window 123 of FIG1B.
- the user interface 12 shown in FIG1B may be referred to as a preview interface.
- the current preview frame image refers to a preview image frame currently displayed on the display screen.
- the current preview frame image may also be referred to as a preview image frame.
- the electronic device can analyze the current preview frame image from the preview stream.
- Image quality includes image clarity and/or symmetry. The higher the clarity and/or the better the symmetry, the higher the image quality and the higher the image score. Symmetry refers to the degree of symmetry of the image content (such as the left-right symmetry of a building), which can be reflected by a score of [0, full score].
- Each frame of an image includes a subject, and the subject of the image refers to an object of a category such as a person or an animal that occupies a relatively large proportion in the picture.
- a frame of an image may include one or more subjects.
- An electronic device may use a subject detection algorithm to detect and identify the subject category in an image, and the subject detection algorithm may be a convolutional neural network (CNN).
- CNN convolutional neural network
- the image may be scored based on the aesthetics of the face of the person or animal in the image.
- the image can be scored according to the excitement of the person's movements. If the person has a moving movement and the movement is a preset exciting movement, the image can be considered exciting.
- the preset exciting movement movements may include, for example, jumping, running, raising hands, raising legs, etc.
- Composition refers to the arrangement, planning, and position of objects in an image. The more coordinated and complete the arrangement and position of objects, the more beautiful the composition will be, and the higher the image score will be.
- the weight of each factor on the final score can be the same or different.
- the weight of each factor on the final score can be preset according to actual needs and is not specifically limited here.
- score is the score of the preview image of the current frame
- score1 is the score in the dimension of image quality
- score2 is the score in the dimension of composition
- score3 is the score in the dimension of facial beauty
- score4 is the score in the dimension of character action.
- score1, score2, score3, and score4 can also be called the first score, the second score, the third score, and the fourth score, respectively.
- the scoring system of each dimension is consistent.
- the scoring system can be any scoring system, such as a percentage system, a ten-point system, etc.
- the score interval of the scoring system such as [0, 10] of a ten-point system and [0, 100] of a percent system, can be called a first score interval.
- the highest score in the first score interval such as 10 points of a ten-point system and 100 points of a percent system, can be called a full score.
- a high score includes a score whose difference from the full score is less than a preset value, such as 9-10 points on a 10-point scale, such as 90-100 points on a 100-point scale, etc.;
- a low score includes a score whose difference from the full score is greater than a preset value, such as 0-2 points on a 10-point scale, such as 0-20 points on a 100-point scale, etc.
- a1, a2, a3, and a4 are the weights of image quality, composition, facial beauty, and character action on the final score.
- the sum of a1, a2, a3, and a4 is 1.
- FIG4 exemplarily shows a process of an electronic device scoring a preview image of a current frame.
- the process includes the following steps:
- Step 1 Set the initial score1, score2, score3, and score4 to 0.
- Step 2 Calculate the image quality score score1 of the current frame preview image.
- score1 can be calculated based on an image quality assessment (IQA) algorithm.
- IQA image quality assessment
- Step 3 determine whether the current frame preview image contains a subject, if not, go directly to step 9; if contained, go to step 4.
- Step 4 Calculate the composition score score2 of the current frame preview image.
- score2 can be calculated based on a composition scoring algorithm.
- the composition scoring algorithm can be used to score images with a subject, and to evaluate whether the composition of the subject in the overall picture is beautiful.
- the composition scoring algorithm can be a calculation method based on human skeleton nodes.
- Step 5 determine the category of the image subject, if it is an animal, go to step 6; if it is a person, go to step 7.
- Step 6 if an animal's face is detected, the facial beauty score score3 is set to a high score, which can be preset, for example, a full score (such as 100 points on a 100-point scale) or a value close to the full score (such as 90-100 points on a 100-point scale).
- a full score such as 100 points on a 100-point scale
- a value close to the full score such as 90-100 points on a 100-point scale
- a high score can be set as a score whose difference from the full score is less than a preset value.
- Step 7 calculate the facial beauty score score3 of the character.
- score3 can be calculated based on the expression of the person in the image, the posture of the face, the proportion of the face in the image, the number of faces, etc.
- the expression of the person may include whether the person has open eyes or a smile, etc., and the facial posture includes whether the person is facing the camera.
- score3 may be calculated based on Formula 2:
- score3 is the total score of facial beauty
- N face is the number of faces
- s e,i is the score of eye opening and closing of the ith face
- s m,i is the score of smile of the ith face
- s d,i is the score of posture correctness of the ith face
- s b is the influence coefficient of face size
- s N is the coefficient of face proportion when there are multiple faces
- s c is the composition beauty coefficient
- s p is the penalty threshold for no face.
- the face size influence coefficient s b , the face ratio coefficient s N when there are multiple faces, the composition beauty coefficient sc , and the face-free penalty threshold s p are all in the interval [0, 1].
- Eyes open and closed score s e,i If the character's eyes are open and the expression is considered beautiful, the first value is assigned; if the character's eyes are closed and the expression is considered ugly, the second value is assigned, and the first value is higher than the second value.
- the first value can be a high score, and the second value can be a low score.
- Smile score s m,i A smiling face is considered beautiful and is assigned the third value; a non-expression face is considered unsightly and is assigned the fourth value.
- the third value is higher than the fourth value.
- the third value can be a high score, and the fourth value can be a low score.
- Correct posture score sd,i When the face faces the camera, the posture is correct and the fifth value is assigned; when the face faces the camera with the head up or down, the posture of the face in the picture is not correct and the sixth value is assigned.
- the fifth value is higher than the sixth value.
- the fifth value can be a high score and the sixth value can be a low score.
- Face size influence coefficient sb When the face area of appropriate size (such as the face area within the first range) is assigned the seventh value, when the area is too large (such as the face area outside the first range), the face is incomplete and is considered unsightly; when the area is too small, the person is not the subject (maybe a passerby), it is background interference and is considered unsightly; when it is unsightly, the face size influence coefficient sb is assigned the eighth value, and the seventh value is higher than the eighth value.
- the seventh value can be a higher value within the value range, and the eighth value can be a lower value within the value atmosphere.
- the face size influence coefficient s b can be obtained by querying the three Gaussian curves shown in FIG5 . Specifically, it is calculated based on the part above the intersection of the three Gaussian curves. It represents the square root of the ratio of the face frame area to the image area, and the vertical axis represents the face size influence coefficient s b .
- the three curves from left to right represent the mapping relationship between the face size at far, medium, and close distances and the face size influence coefficient s b . In this way, the subjective evaluation of faces at different distances can be integrated to limit the scores of faces that are too large or too small.
- the three Gaussian curves shown in FIG5, which represent the mapping relationship between the face size at far, medium and near distances and the face size influence coefficient s b, are preset.
- the parameter ⁇ represents the mean
- sig represents the inverse of the standard deviation
- the three lines indicate that there is an optimal composition coefficient for the subject at near, medium and far distances.
- the peak of the curve represents the best position. The position above the intersection can ensure that the coefficient value within a reasonable distance maintains a high score.
- w refers to the face frame width
- h refers to the face frame height
- W refers to the image width
- H refers to the image height.
- the face frame refers to a frame obtained by framing the face position with a rectangle or square when the electronic device analyzes the preview image of the current frame.
- each face ratio coefficient s N According to the area of each face from large to small, it is considered that the influence of each face on the overall picture decreases in turn.
- the face ratio coefficient s N of multiple faces is a preset weight, and the sum is 1. That is, several face ratio coefficients s N that decrease in turn are preset, and then correspond to each face according to the area size of each face in the image.
- Composition beauty coefficient The main character requires that the face is within a certain range (such as the first area) in the center of the picture; when the face is at the edge, it is considered not to be the main character, and the face is incomplete and the composition is considered unsightly, so the face will be multiplied by the penalty coefficient k to reduce the score of the face.
- the penalty coefficient k is a preset value.
- the ninth value is higher than the tenth value. The ninth value can be a higher value within the value range, and the tenth value can be a lower value within the value atmosphere.
- Penalty threshold s p when no face is detected When a human body is detected but no face is detected, it may be that the face is not in the picture or the person is facing away, which is considered unsightly and the score of the facial beauty of the corresponding face is reduced by score3.
- step 6 and step 7 may be combined to calculate a comprehensive facial beauty score score3 using weights.
- step 7 [Corrected 13.12.2024 in accordance with Rule 26] After step 7, you can go to step 8.
- Step 8 calculate the character action score score4.
- score4 is set to a low score (eg, 0).
- the confidence output by the action evaluation algorithm can be multiplied by a high score (e.g., full score) to obtain a value, which can be set as the value of score4.
- the action evaluation algorithm is an algorithm that evaluates the action of the person in the image and the probability of the action, which can be a CNN algorithm.
- the confidence is the probability that the action of the person in the image output by the action evaluation algorithm is a certain action.
- the value of score4 is in the range of [0, full score].
- Step 9 Calculate the score of the preview image of the current frame based on Formula 1.
- the current frame preview image is scored based on the method shown in FIG4 , and the score of the current frame preview image can reflect the quality of the image, the beauty of the face in the image, the excitement of the character's movements, the composition, etc.
- the electronic device may further analyze whether the current frame preview image is a transition frame.
- the preview stream reported by the camera of the electronic device is a transition frame, and the imaging information amount of the transition frame is low and the image quality is poor, that is, the image frame whose information amount and image quality do not reach the first threshold.
- the electronic device may use a transition detection algorithm to identify the transition frame.
- the electronic device may also analyze the subject of the current frame preview image.
- the subject refers to the scene contained in the image, for example, it may include children, animals, buildings, plants, landscapes, etc.
- the subject may be obtained based on the content analysis of the image.
- the electronic device may use a perception engine to score the current frame preview image, and analyze whether it is a transition frame and its theme, etc.
- the perception engine may be equipped with the above-mentioned various algorithms to calculate the required results.
- S303 perform image encoding on the current frame preview image and save the label of the current frame preview image.
- Image coding also known as image compression, refers to the technology of representing an image or the information contained in the image with fewer bits under the condition of meeting certain quality requirements (such as signal-to-noise ratio requirements). This can save storage space of electronic devices.
- the electronic device may encode the tag of the current frame preview image separately into the audio stream of the current frame preview image, and may store it separately from the picture data.
- the electronic device may only save a preset number of compressed images and labels of preview images, and compressed images and labels of preview images with earlier generation times exceeding the preset number may be discarded. This does not affect the subsequent implementation of the present solution and can also save storage space of the electronic device.
- S304 Detect a user operation for capturing an image, and save a corresponding image in response to the user operation.
- a photo operation is input.
- the electronic device stores the preview stream as a dynamic photo.
- the photo operation may be in various forms, such as a touch operation on the display screen, a voice command, a specific expression, etc.
- the photo operation may be a user operation on the photo control 122 when the dynamic photo function of the electronic device is started.
- the image saved by the electronic device may include one or more preview image frames displayed on the preview interface.
- the image capturing operation in S304 may also be performed multiple times, so that the electronic device can save multiple images according to the needs of the user.
- the multiple images saved by the electronic device may include one or more types, such as dynamic photos, static photos and videos.
- the user interface 21 displays thumbnails of multiple dynamic photos taken by the electronic device, including thumbnails 211A to 211P.
- the electronic device can save images sent by other applications other than the camera, or download images from the network, or receive images shared by other electronic devices, and perform subsequent steps based on these images.
- the image saved by the electronic device may be referred to as a first image.
- the score of the saved image is measured by one or more frames contained in it. The higher the score of the one or more frames contained in it is, the higher the score of the saved image is.
- an exemplary scoring method traverse the image queue in the dynamic photo and find all the frames it contains; optionally, remove the transition frames to obtain the remaining frame sequence FrameSeq [frameStart, ..., frameEnd]. This step can ensure the validity of the final score; then find the frame with the highest score from FrameSeq and record it as the wonderful frame WonderfulFrame, and look for K frames before and after the wonderful frame. If there are less than K frames, fill them with a score of 0; set the weight of the wonderful frame to 1, and the weights of the K frames before and after are reduced by 0.1. Calculate the weighted average score weightAvgScore of the 2K+1 frame scores as the scoring result of the dynamic photo. Remove the transition frames to obtain the image frames contained in the remaining frame sequence FrameSeq, which can also be called the first preview image frame.
- the number of historical images may be one or more.
- the definition of historical images may include any of the following:
- FIG6 exemplarily shows a process of making a repeatability judgment on two dynamic images.
- the process may include the following steps:
- Step 1 Set the initial similarity score similarScore to 0.
- Step 2 determine whether a.imageScore is greater than b.imageScore, if so, go to step 3; if not, go to step 4.
- a represents the image currently saved by the electronic device
- b represents an image in the historical images
- a.imageScore is the score of the image saved by the electronic device
- b.imageScore is the score of an image in the historical images.
- Step 3 set similarScore to 0.
- image a with a higher score can be marked as a non-repeated frame, so that image a with a higher score is more likely to be recommended later, so that the recommendation result is of high quality.
- Step 4 determine whether one of image a and image b is a motion frame and the other is not a motion frame. If so, go to step 5; if not, go to step 6.
- Whether an image is a motion frame may be determined based on a motion evaluation algorithm.
- Step 5 set similarScore to 0.
- Step 6 determine whether both image a and image b are motion frames, if so, go to step 7; if not, go to step 10.
- Step 7 Is the time interval between the motion frames in image a and image b less than the minimum interval intervalMin? If yes, go to step 8; if no, go to step 9.
- the minimum interval intervalMin can be preset as needed.
- Step 8 set similarScore to 1.
- Step 9 set similarScore to 0.
- Step 10 determine whether the subjects in image a and image b are the same, if so, go to step 11; if not, go to step 12.
- Step 11 set similarScore to 1.
- Step 12 using any one of the mean hash algorithm, Euclidean distance algorithm, cosine distance algorithm, Hamming distance algorithm, etc. to calculate the similarity between image a and image b, and set similarScore to the calculated value.
- Step 13 determine whether similarScore is greater than a similarity threshold threshold, if so, go to step 14; if not, go to step 15.
- the similarity threshold threshold can be preset as needed.
- Step 14 determining to save the image as a duplicate image.
- Step 15 determining that the saved image is a non-duplicate image.
- S305 can also be executed multiple times to calculate the scores of the multiple stored images respectively.
- the electronic device may encode the tag for saving the image separately into the audio stream of the image, and may store it separately from the picture data.
- the electronic device may generate and display a notification message, which may be used to prompt that an image can be recommended at present, or may prompt that a video can be created at present.
- the notification message may be sent by the gallery application to the notification application, and finally displayed by the notification application.
- the user operation for obtaining the recommended image may include a user operation acting on the notification message (such as a click operation, a touch operation, etc.).
- the notification message 221 in the user interface 22 is a possible implementation form.
- the electronic device can also display the notification message at the top of the display screen after generating it, and if there is no user interaction with it, it can automatically disappear after staying for a period of time.
- the generation and display time of the notification message may include any of the following:
- a “one-click recommendation” control may be displayed in the user interface of an application that provides an image recommendation function (such as a gallery application or other application), and the user can input a user operation on the “one-click recommendation” control to trigger subsequent steps.
- the user operation acting on the “one-click recommendation” control detected by the electronic device is the user operation for obtaining a recommended image.
- the embodiments of the present application do not limit the user interface in which the “one-click recommendation” control is provided and the form of the “one-click recommendation” control.
- the name of the “one-click recommendation” control is only an example, and its function has been clearly explained. The control may also be called by other names.
- the multiple images here can include any of the following:
- the electronic device may extract the labels of the respective images from the memory.
- thumbnails 211A to 211P are images captured from the last time the electronic device started up the camera to the last time the camera was turned off, the electronic device can extract tags of the original images corresponding to these thumbnails.
- the multiple images include original images corresponding to thumbnails 211A to 211P, the multiple images may be divided into the following groups:
- Character group thumbnail 211G, thumbnail 211H, thumbnail 211I, thumbnail 211K, thumbnail 211M, and corresponding original images.
- Dog group thumbnail 211C, thumbnail 211D, and corresponding original images.
- non-repeated images are arranged first and repeated images are arranged last; then, the non-repeated images are sorted from high to low according to the scores, and the repeated images are also sorted from high to low according to the scores.
- the electronic device may select the top K images from different theme groups to form a recommendation sequence. This can ensure the diversity and high quality of the recommended images.
- K can be preset, and its specific value is not limited here.
- the electronic device may also select different numbers of top ranked images from different theme groups to form a recommendation sequence. For example, the electronic device may select a certain proportion of the actual number of images in each theme group to form a recommendation sequence.
- the electronic device may also select images from only part of the subject group to form a recommendation sequence.
- the electronic device may select images from a preset subject group.
- the electronic device After the electronic device obtains multiple recommended images, it can also sort the multiple recommended images.
- This application does not limit the sorting method. For example, it can be sorted from high to low according to the score, sorted according to a certain theme order, sorted according to the order of storage time, etc.
- the indication information of the recommended image may include a thumbnail, or may include a name, a selected selection mark box, or other indication information, which is not limited here.
- the electronic device may launch an application that provides an image recommendation function, and then display indication information of the recommended image in a user interface provided by the application.
- the electronic device may display thumbnails of the multiple images traversed in S307 in the user interface 23 of the gallery application, and mark the images recommended by the electronic device by selecting a selection mark box, and also add numbers in the corresponding selection mark boxes to indicate the ranking of the corresponding images in the recommended images.
- S312 adjust the recommended image according to the user operation.
- the adjustment for the recommended images may include: adjusting the order of the multiple recommended images, adding recommended images, deleting recommended images, etc.
- the user operation for generating the video may be implemented in various forms, such as user operation on the display screen, voice commands, gestures, expressions, etc., which are not limited here.
- S313 may also be an optional step, and the electronic device does not need to receive the user operation, and can directly generate a video using the recommended image after determining the recommended image.
- the electronic device may first ask the user to obtain the relevant permission to use the "one-click video" function.
- An exemplary user interface for obtaining authorization from the user can refer to the user interface shown in Figures 2D-2F, which will not be repeated here.
- the process of generating a video based on the recommended image may include the following steps:
- the material i.e., the recommended images
- the material is analyzed, for example, its size, quantity, duration, theme, and other information.
- Audio and video templates can be divided into video templates and audio templates, or they can be combined into one template.
- the video template may include transition effects, filters, image cropping methods, visualization elements (such as stickers), etc.
- the audio template includes audio.
- the audio and video template can be stored in the electronic device, or it can be obtained by the electronic device from the cloud server through the network. In some embodiments, after matching the audio and video template, the user can also adjust it to the form they want according to actual needs.
- the electronic device starts to generate a video based on the matched audio and video template and the recommended material.
- the order in which the images appear in the generated video can be consistent with the order in which the images appear in the recommended image determined by the electronic device. If the recommended image includes a dynamic photo, the dynamic photo included in the video can be presented in full length, and the same applies to the video. In other embodiments, the user can select the audio and video template by himself.
- the electronic device can output some prompt information to remind the user of the steps currently being performed. Examples of these prompt information can refer to the relevant descriptions of Figures 2G-2I.
- the electronic device after the electronic device generates a video, it can also automatically play the video so that the user can view the video effect.
- the user interface 30 shows an effect of automatically playing the video after the video is generated.
- the electronic device can also play the video after receiving the user's operation to trigger the video to play.
- the electronic device can automatically save the video after generating it.
- the electronic device may also save the video in response to a received user operation after generating the video.
- the user operation may be a user operation acting on the export control 296C in the user interface 30 shown in FIG. 2J .
- the electronic device can save the video to a storage path under an application that provides image recommendation functions (such as a gallery), and can also store it to a storage path under a "clipping" service, or store it to both paths at the same time, without limitation here.
- S316 Detect a user operation for sharing a video, and share the video to a corresponding object.
- the electronic device After the electronic device saves the generated video, it can display the video in a user interface based on its storage path for the user to view.
- 2M-2O exemplarily illustrate a way for the electronic device to display the video.
- the video can be shared to the corresponding object.
- the user operation for sharing the video can be implemented in various forms, which are not limited here, for example, it can include the user operation acting on the sharing control 352 in Figure 2O.
- the sharing object can be the contact's device, the application in the electronic device (such as a social platform, memo, notes, etc.), the discovered nearby device, the device where the contact in the application is located, etc.
- the application to which the electronic device shares the video can be called the first application, and the device to which the video is shared can be called the first device.
- the electronic device may also first display various objects, then select one or more of the objects, and then find the generated video from the gallery or other applications and share it with the one or more objects.
- the image recommendation method shown in FIG. 3B can recommend high-quality, exciting, and non-similar (i.e., different content) images to users, so that users can pay attention to these recommended images.
- the electronic device can also generate videos using the recommended images to meet the user's needs for making high-quality, exciting, and non-repetitive videos.
- the electronic device can also share the generated videos to social platforms or contacts to meet the user's needs for sharing videos.
- the duplicate image can be deleted using the judgment result.
- the deletion can be directly performed by the electronic device, or the electronic device can show the image recommended for deletion to the user and the user can decide whether to delete the duplicate image.
- the electronic device may also recommend images with the same theme to the user so that the user can view more images with the same theme.
- FIG. 7 shows a schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application.
- the electronic device 100 is used to execute the image recommendation method provided in the above method embodiment.
- the electronic device 100 may include a processor 101, a memory 102, a wireless communication module 103, a mobile communication module 104, an antenna 103A, an antenna 104A, a power switch 105, a sensor module 106, a focus motor 107, a camera 108, a display screen 109, etc.
- the sensor module 106 may include a gyroscope sensor 106A, an acceleration sensor 106B, an ambient light sensor 106C, an image sensor 106D, a distance sensor 106E, etc.
- the wireless communication module 103 may include a WLAN communication module, a Bluetooth communication module, etc. The above multiple parts can transmit data through a bus.
- the processor 101 may include one or more processing units, for example, the processor 101 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and/or a neural-network processing unit (NPU), etc.
- AP application processor
- GPU graphics processor
- ISP image signal processor
- DSP digital signal processor
- NPU neural-network processing unit
- Different processing units may be independent devices or integrated into one or more processors.
- the memory 102 may be used to store computer executable program codes, which may include instructions.
- the processor 101 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the memory 102 .
- the wireless communication function of the electronic device 100 can be implemented through the antenna 103A, the antenna 104A, the mobile communication module 104, the wireless communication module 103, the modem processor and the baseband processor.
- Antenna 103A and antenna 104A can be used to transmit and receive electromagnetic wave signals.
- Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas.
- the mobile communication module 104 can provide solutions for wireless communications including 2G/3G/4G/5G, etc., applied to the electronic device 100.
- the mobile communication module 104 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc.
- the mobile communication module 104 can receive electromagnetic waves through the antenna 104A, and filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.
- the mobile communication module 104 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 104A.
- a modem processor may include a modulator and a demodulator.
- the wireless communication module 103 can provide wireless communication solutions including wireless local area networks (WLAN), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100.
- the wireless communication module 160 can be one or more devices integrating at least one communication processing module.
- the wireless communication module 103 receives electromagnetic waves via the antenna 103A, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 101.
- the wireless communication module 103 can also receive the signal to be sent from the processor 101, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 103A.
- the electronic device 100 can realize the shooting function through the ISP, the camera 108, the video codec, the GPU, the display screen 109 and the application processor.
- the ISP is used to process the data fed back by the camera 108. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye.
- the ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera 108.
- the camera 108 can be used to capture still photos or dynamic photos or videos.
- the object generates an optical image through the lens and projects it onto the image sensor.
- the image sensor can convert the optical signal into an electrical signal, and then transmit the electrical signal to the ISP to convert it into a digital image signal.
- the ISP can output the digital image signal to the DSP for processing.
- the DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format.
- the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
- the video codec is used to compress or decompress digital images.
- the electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can open or save pictures or videos in multiple coding formats.
- the electronic device 100 can realize the display function through a GPU, a display screen 109, and an application processor.
- the GPU is a microprocessor for image processing, which connects the display screen 109 and the application processor.
- the GPU is used to perform mathematical and geometric calculations for graphics rendering.
- the processor 101 may include one or more GPUs, which execute program instructions to generate or change display information.
- the display screen 109 is used to display images, videos, etc.
- the display screen 109 includes a display panel.
- the electronic device 100 may include 1 or N display screens 109, where N is a positive integer greater than 1.
- the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100.
- the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently.
- the components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
- the camera 108 can be used to capture images.
- the AP or GPU in the processor 101 can be used to analyze the current frame preview image to obtain the label of the preview image, analyze the image saved by the user to obtain the label of the image, and determine the recommended image from multiple images.
- the AP or GPU in the processor 101 can also be used to generate a video based on the recommended image.
- the memory 102 may be used to store preview images and labels of the preview images, images saved as specified by the user and labels of the images, and videos generated based on recommended images.
- the display screen 109 may be used to display various types of information for the user, such as the user interface mentioned in the above embodiment.
- Information input devices such as the display screen 109, the camera 108, and the microphone may also be used to receive user operations, and the electronic device may respond to these user operations and execute corresponding functions.
- the wireless communication module 103 may be used to share the video generated by the electronic device based on the recommended image to other devices.
- the software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture.
- the present application embodiment takes a mobile operating system with a layered architecture as an example to exemplify the software structure of the electronic device 100.
- FIG. 8 is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.
- the layered architecture divides the software into several layers, each with clear roles and division of labor.
- the layers communicate with each other through software interfaces.
- the mobile operating system is divided into four layers, from top to bottom: application layer, application framework layer/core service layer, system library and runtime, and kernel layer.
- the application layer can include a series of application packages.
- the application package may include applications such as camera, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.
- the application layer may also include the application for providing image recommendation function mentioned in the above embodiment, such as gallery or other third-party applications.
- the application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer.
- API application programming interface
- the application framework layer includes some predefined functions.
- the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.
- a window manager is used to manage window programs.
- the view system includes visual controls, such as controls for displaying text, controls for displaying images, etc.
- the phone manager is used to provide the communication function of the electronic device.
- the resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
- the notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages and disappear automatically after a short stay without user interaction.
- Runtime can refer to all code libraries, frameworks, etc. required for the program to run.
- the system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
- functional modules such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
- the surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
- the media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc.
- the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
- the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
- a 2D graphics engine is a drawing engine for 2D drawings.
- the kernel layer is the layer between hardware and software.
- the kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
- each step in the above method embodiment can be completed by an integrated logic circuit of hardware in a processor or by instructions in the form of software.
- the method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.
- the present application also provides an electronic device, which may include: a memory and a processor.
- the memory may be used to store a computer program; the processor may be used to call the computer program in the memory so that the electronic device executes the method executed by the electronic device side in any of the above embodiments.
- the present application also provides an electronic device, which may include: a memory and a processor.
- the memory may be used to store a computer program; the processor may be used to call the computer program in the memory so that the electronic device executes the method executed by the electronic device side in any of the above embodiments.
- the present application also provides a chip system, which includes at least one processor for implementing the functions involved in the electronic device side in any of the above embodiments.
- the chip system also includes a memory, which is used to store program instructions and data, and the memory is located inside or outside the processor.
- the chip system may be composed of the chip, or may include the chip and other discrete devices.
- the processor in the chip system may be one or more.
- the processor may be implemented by hardware or by software.
- the processor may be a logic circuit, an integrated circuit, etc.
- the processor may be a general-purpose processor implemented by reading software code stored in a memory.
- the memory in the chip system may also be one or more.
- the memory may be integrated with the processor or may be separately arranged with the processor, which is not limited in the embodiments of the present application.
- the memory may be a non-transient processor, such as a read-only memory ROM, which may be integrated with the processor on the same chip or may be arranged on different chips respectively.
- the embodiments of the present application do not specifically limit the type of memory and the arrangement of the memory and the processor.
- the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.
- FPGA field programmable gate array
- ASIC application specific integrated circuit
- SoC system on chip
- CPU central processor unit
- NP network processor
- DSP digital signal processor
- MCU microcontroller unit
- PLD programmable logic device
- the present application also provides a computer program product, which includes: a computer program (also referred to as code, or instruction), which, when executed, enables a computer to execute the method executed by the electronic device side in any of the above embodiments.
- a computer program also referred to as code, or instruction
- the present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program (also referred to as code or instruction).
- a computer program also referred to as code or instruction.
- the computer program executes the method executed by the electronic device side in any of the above embodiments.
- the computer program product includes one or more computer instructions.
- the computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device.
- the computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium.
- the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode.
- the computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated.
- the available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.
- the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media.
- the programs can include the processes of the above-mentioned method embodiments.
- the aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Library & Information Science (AREA)
- Studio Devices (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
[根据细则26改正 13.12.2024]
本申请要求于2023年05月17日提交中国专利局、申请号为202310558291.5、申请名称为“图像推荐方法、相关装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。[Corrected 13.12.2024 in accordance with Rule 26]
This application claims the priority of the Chinese patent application filed with the China Patent Office on May 17, 2023, with application number 202310558291.5 and application name “Image Recommendation Method and Related Device”, the entire contents of which are incorporated by reference in this application.
[根据细则26改正 13.12.2024]
本申请涉及终端领域以及图像分析领域,尤其涉及图像推荐方法、相关装置。[Corrected 13.12.2024 in accordance with Rule 26]
The present application relates to the field of terminals and image analysis, and in particular to image recommendation methods and related devices.
[根据细则26改正 13.12.2024]
智能设备如手机上搭载了拍照功能,用户可使用拍照功能拍摄想要的图像,如照片、动态照片、视频等。用户拍摄了大量照片、视频后,很难从中精准地找到自己想要的照片或视频。因而,一些智能设备提供推荐图像的方案,可以为用户推荐一些图像以供用户查看,这样可以节约用户时间,方便快捷。为提升用户体验,智能设备如何推荐图像,是当前及未来研究的方向。[Corrected 13.12.2024 in accordance with Rule 26]
Smart devices such as mobile phones are equipped with camera functions, and users can use the camera function to take the images they want, such as photos, dynamic photos, videos, etc. After users take a large number of photos and videos, it is difficult to accurately find the photos or videos they want. Therefore, some smart devices provide solutions for recommending images, which can recommend some images for users to view, which can save users time and is convenient and fast. In order to improve user experience, how smart devices recommend images is the direction of current and future research.
[根据细则26改正 13.12.2024]
本申请提供了图像推荐方法、相关装置,可以为用户推荐图像。[Corrected 13.12.2024 in accordance with Rule 26]
The present application provides an image recommendation method and related devices, which can recommend images to users.
[根据细则26改正 13.12.2024]
第一方面,提供一种图像推荐方法,应用于电子设备。该方法可包括:显示预览界面,预览界面显示有电子设备的摄像头上报的预览图像帧;检测到用于拍摄图像的用户操作,保存第一图像,第一图像包括预览界面显示的一个或多个预览图像帧;确定第一图像的主题、分数、重复性,第一图像的分数根据第一图像的图像质量、构图、脸部美观度、人物动作中的任一个或多个得到,重复性指示第一图像和历史拍摄图像是否重复;根据多个第一图像各自的分数、主题和重复性,从多个第一图像中确定出推荐图像;显示推荐图像的指示信息。[Corrected 13.12.2024 in accordance with Rule 26]
In a first aspect, an image recommendation method is provided, which is applied to an electronic device. The method may include: displaying a preview interface, wherein the preview interface displays a preview image frame reported by a camera of the electronic device; detecting a user operation for shooting an image, saving a first image, wherein the first image includes one or more preview image frames displayed on the preview interface; determining the theme, score, and repeatability of the first image, wherein the score of the first image is obtained according to any one or more of the image quality, composition, facial beauty, and character action of the first image, and the repeatability indicates whether the first image is repeated with a historically shot image; determining a recommended image from a plurality of first images according to their respective scores, themes, and repeatability; and displaying indication information of the recommended image.
[根据细则26改正 13.12.2024]
实施第一方面的方法,电子设备可以在拍摄的多个图像中,根据各个图像的主题、分数以及重复性来为用户推荐图像。[Corrected 13.12.2024 in accordance with Rule 26]
By implementing the method of the first aspect, the electronic device can recommend images to the user based on the subject, score, and repetitiveness of each image among multiple captured images.
[根据细则26改正 13.12.2024]
结合第一方面,在一些实施方式中,该方法还可包括:在显示预览界面过程中,确定预览界面显示的每一个预览图像帧的分数,其中,预览图像帧的分数根据预览图像帧的图像质量、构图、脸部美观度、人物动作中的任一个或多个得到。确定第一图像的分数,具体包括:根据第一图像包含的一个或多个预览图像帧的分数,确定第一图像的分数。[Corrected 13.12.2024 in accordance with Rule 26]
In combination with the first aspect, in some embodiments, the method may further include: during display of the preview interface, determining a score of each preview image frame displayed on the preview interface, wherein the score of the preview image frame is obtained according to any one or more of image quality, composition, facial beauty, and character action of the preview image frame. Determining the score of the first image specifically includes: determining the score of the first image according to the scores of one or more preview image frames contained in the first image.
[根据细则26改正 13.12.2024]
基于上一实施方式,在预览图像时即实时确定预览图像帧的分数,可以节约后续确定第一图像分数的执行时间,降低时间成本。并且,由于预览流的存储量较小,这样也便于计算及分析过程的便捷性。[Corrected 13.12.2024 in accordance with Rule 26]
Based on the above implementation, the score of the preview image frame is determined in real time when the image is previewed, which can save the execution time of the subsequent determination of the first image score and reduce the time cost. In addition, since the storage capacity of the preview stream is small, this also facilitates the convenience of the calculation and analysis process.
[根据细则26改正 13.12.2024]
结合上一实施方式,可以通过以下方式来确定预览界面显示的每一个预览图像帧的分数:根据第j预览图像帧的图像质量确定第一分数,第j预览图像帧为预览界面显示的任一个预览图像帧;判断第j预览图像帧是否包含主体,若是,则根据构图确定第j预览图像帧的第二分数;若否,则将第j预览图像帧的第二分数、第三分数、第四分数均置为0;在第j预览图像帧包含主体的情况下,根据第j预览图像帧的主体类别,确定第j预览图像帧的第三分数;在第j预览图像帧包含的主体为人物的情况下,根据人物的动作确定第j预览图像帧的第四分数;计算第一分数、第二分数、第三分数、第四分数的加权平均分;将加权平均分确定为第j预览图像帧的分数。[Corrected 13.12.2024 in accordance with Rule 26]
In combination with the previous embodiment, the score of each preview image frame displayed on the preview interface can be determined in the following manner: a first score is determined according to the image quality of the jth preview image frame, the jth preview image frame being any preview image frame displayed on the preview interface; whether the jth preview image frame contains a subject is determined, and if so, a second score of the jth preview image frame is determined according to the composition; if not, the second score, the third score, and the fourth score of the jth preview image frame are all set to 0; when the jth preview image frame contains a subject, a third score of the jth preview image frame is determined according to the subject category of the jth preview image frame; when the subject contained in the jth preview image frame is a person, a fourth score of the jth preview image frame is determined according to the action of the person; a weighted average score of the first score, the second score, the third score, and the fourth score is calculated; and the weighted average score is determined as the score of the jth preview image frame.
[根据细则26改正 13.12.2024]
这样,每一个预览图像帧的分数都可以反映该预览图像帧的图像质量、构图、脸部美观度和人物动作,使得最终第一图像的分数也能反映上述因子。[Corrected 13.12.2024 in accordance with Rule 26]
In this way, the score of each preview image frame can reflect the image quality, composition, facial beauty and character action of the preview image frame, so that the score of the final first image can also reflect the above factors.
[根据细则26改正 13.12.2024]
可选的,第一分数、第二分数、第三分数、第四分数的打分均在第一分数区间内。其中,第一分数区间取决于预设的打分制度,例如可以为十分制、百分制等。[Corrected 13.12.2024 in accordance with Rule 26]
Optionally, the first score, the second score, the third score, and the fourth score are all within a first score interval, wherein the first score interval depends on a preset scoring system, such as a ten-point system, a hundred-point system, and the like.
[根据细则26改正 13.12.2024]
可选的,电子设备可以根据第j预览图像帧的清晰度和/或对称性,确定第一分数;清晰度和/或对称性越高,第一分数越高。[Corrected 13.12.2024 in accordance with Rule 26]
Optionally, the electronic device may determine the first score according to the clarity and/or symmetry of the jth preview image frame; the higher the clarity and/or symmetry, the higher the first score.
[根据细则26改正 13.12.2024]
可选的,电子设备可以根据以下方式来确定述第j预览图像帧的第三分数:[Corrected 13.12.2024 in accordance with Rule 26]
Optionally, the electronic device may determine the third score of the j-th preview image frame according to the following method:
[根据细则26改正 13.12.2024]
在第j预览图像帧的主体包含动物的情况下,若第j预览图像帧包含动物的脸部,则将第三分数置为高分,高分包括和满分之间的差值小于预设值的分数,满分为第三分数的打分区间中的最高分;[Corrected 13.12.2024 in accordance with Rule 26]
In the case where the subject of the j-th preview image frame includes an animal, if the j-th preview image frame includes the face of the animal, the third score is set to a high score, where the high score includes a score whose difference from the full score is less than a preset value, and the full score is the highest score in the scoring range of the third score;
[根据细则26改正 13.12.2024]
或者,[Corrected 13.12.2024 in accordance with Rule 26]
or,
[根据细则26改正 13.12.2024]
在第j预览图像帧的主体包含人物的情况下,根据第j预览图像帧中是否包含人脸、包含的人脸的睁闭眼情况、人脸的表情、人脸的姿态、人脸在第j预览图像帧中的区域、面积大小、占比大小、人脸数量中的任一个或多个,确定第三分数。[Corrected 13.12.2024 in accordance with Rule 26]
When the subject of the jth preview image frame includes a person, the third score is determined based on any one or more of whether the jth preview image frame contains a face, whether the eyes of the contained face are open or closed, the expression of the face, the posture of the face, the area of the face in the jth preview image frame, the size of the area, the size of the proportion, and the number of faces.
[根据细则26改正 13.12.2024]
相当于,对于动物来说,只要拍摄到脸部,对于用户来说该图像内容就是可接受的,因为可以给予脸部美观度一个高分。而用户对于人脸的美观度有较高的要求,因而可以考虑图像中人物的表情、脸部的姿态、脸部在图像中的占比大小、人脸数量等因素来对包含任务的脸部美观度进行打分。这样的打分方式更加符合用户期待。[Corrected 13.12.2024 in accordance with Rule 26]
For animals, as long as the face is captured, the image content is acceptable to the user, because the facial beauty can be given a high score. However, users have higher requirements for the beauty of human faces, so the facial beauty of the task can be scored by considering factors such as the facial expression, facial posture, the proportion of the face in the image, and the number of faces. This scoring method is more in line with user expectations.
[根据细则26改正 13.12.2024]
可选的,在第j预览图像帧的主体包含人物的情况下,电子设备可以通过以下公式来确定第三分数:
[Corrected 13.12.2024 in accordance with Rule 26]
Optionally, when the subject of the j-th preview image frame includes a person, the electronic device may determine the third score by the following formula:
[根据细则26改正 13.12.2024]
为第三分数;[Corrected 13.12.2024 in accordance with Rule 26]
for the third score;
[根据细则26改正 13.12.2024]
Nface为第j预览图像帧包含的人脸个数;[Corrected 13.12.2024 in accordance with Rule 26]
Nface is the number of faces contained in the j-th preview image frame;
[根据细则26改正 13.12.2024]
se,i为第i张人脸的睁闭眼得分,第i张人脸睁眼时,se,i置为第一值,第i张人脸闭眼时,se,i置为第二值,第一值高于第二值;[Corrected 13.12.2024 in accordance with Rule 26]
s e,i is the eye-opening and eye-closing score of the i-th face. When the i-th face has eyes open, s e,i is set to the first value. When the i-th face has eyes closed, s e,i is set to the second value. The first value is higher than the second value.
[根据细则26改正 13.12.2024]
sm,i为第i张人脸的笑脸得分,第i张人脸微笑时,sm,i置为第三值,第i张人脸未微笑时,sm,i置为第四值,第三值高于第四值;[Corrected 13.12.2024 in accordance with Rule 26]
s m,i is the smile score of the i-th face. When the i-th face is smiling, s m,i is set to the third value. When the i-th face is not smiling, s m,i is set to the fourth value. The third value is higher than the fourth value.
[根据细则26改正 13.12.2024]
sd,i为第i张人脸的姿态得分,第i张人脸面向镜头时,sd,i置为第五值,第i张人脸未面向镜头时,sd,i置为第六值,第五值高于第六值;[Corrected 13.12.2024 in accordance with Rule 26]
s d,i is the posture score of the i-th face. When the i-th face faces the camera, s d,i is set to the fifth value. When the i-th face does not face the camera, s d,i is set to the sixth value. The fifth value is higher than the sixth value.
[根据细则26改正 13.12.2024]
sb为第i张人脸的人脸大小影响系数,第i张人脸的大小在第一范围内时,sb置为第七值,第i张人脸的大小在第一范围外时,sb置为第八值,第七值大于第八值;[Corrected 13.12.2024 in accordance with Rule 26]
s b is the face size influence coefficient of the i-th face. When the size of the i-th face is within the first range, s b is set to the seventh value. When the size of the i-th face is outside the first range, s b is set to the eighth value. The seventh value is greater than the eighth value.
[根据细则26改正 13.12.2024]
sN为第i张人脸的人脸占比系数,第i张人脸的面积占比越大,sN越大;[Corrected 13.12.2024 in accordance with Rule 26]
s N is the face ratio coefficient of the i-th face. The larger the area ratio of the i-th face, the larger s N is.
[根据细则26改正 13.12.2024]
sc为构图美观系数,第i张人脸位于第j预览图像帧的第一区域时,sc置为第九值,第i张人脸位于第j预览图像帧的第一区域外时,sc置为第十值,第九值高于第十值,第一区域包含第j预览图像帧的中心区域;[Corrected 13.12.2024 in accordance with Rule 26]
sc is the composition beauty coefficient. When the i-th face is located in the first area of the j-th preview image frame, sc is set to the ninth value. When the i-th face is located outside the first area of the j-th preview image frame, sc is set to the tenth value. The ninth value is higher than the tenth value. The first area includes the central area of the j-th preview image frame.
[根据细则26改正 13.12.2024]
sp为无人脸惩罚阈值,第j预览图像帧包含人脸时,sp为0,第j预览图像帧不包含人脸时,sp置为预设的无人脸惩罚阈值。[Corrected 13.12.2024 in accordance with Rule 26]
s p is the non-face penalty threshold. When the j-th preview image frame contains a face, s p is 0. When the j-th preview image frame does not contain a face, s p is set to the preset non-face penalty threshold.
[根据细则26改正 13.12.2024]
上述公式提供了一种具体的确定衡量人物脸部美观度的分数的方式。[Corrected 13.12.2024 in accordance with Rule 26]
The above formula provides a specific way to determine a score for measuring the beauty of a person's face.
[根据细则26改正 13.12.2024]
可选的,在上述公式中,第一值、第三值、第五值,均为高分;第二值、第四值、第六值,均为低分;其中,高分包括和满分之间的差值小于预设值的分数,低分包括和满分之间的差值大于预设值的分数,满分为第三分数的打分区间中的最高分。[Corrected 13.12.2024 in accordance with Rule 26]
Optionally, in the above formula, the first value, the third value, and the fifth value are all high scores; the second value, the fourth value, and the sixth value are all low scores; among them, the high score includes the score whose difference with the full score is less than the preset value, the low score includes the score whose difference with the full score is greater than the preset value, and the full score is the highest score in the scoring range of the third score.
[根据细则26改正 13.12.2024]
可选的,在上述公式中,第i张人脸和电子设备之间的距离不同时,相同的第i张人脸的大小对应不同的sb。这样可以综合不同距离来对人脸美观度进行评价,限制过大和过小人脸的得分。[Corrected 13.12.2024 in accordance with Rule 26]
Optionally, in the above formula, when the distance between the i-th face and the electronic device is different, the same i-th face size corresponds to different s b . In this way, the beauty of the face can be evaluated by combining different distances, limiting the scores of faces that are too large or too small.
[根据细则26改正 13.12.2024]
可选的,电子设备可通过以下方式来确定第j预览图像帧的第四分数:判断第j帧预览图像帧中的人物是否包含预设的精彩动作;若是,则第四分数等于动作评价输出算法输出的置信度和高分的乘积;若否,则将第四分数置为低分;其中,高分包括和满分之间的差值小于预设值的分数,低分包括和满分之间的差值大于预设值的分数,满分为第四分数的打分区间中的最高分。[Corrected 13.12.2024 in accordance with Rule 26]
Optionally, the electronic device may determine the fourth score of the jth preview image frame in the following manner: determine whether the character in the jth preview image frame includes a preset wonderful action; if so, the fourth score is equal to the product of the confidence level output by the action evaluation output algorithm and the high score; if not, the fourth score is set to a low score; wherein the high score includes a score whose difference from the full score is less than a preset value, the low score includes a score whose difference from the full score is greater than a preset value, and the full score is the highest score in the scoring range of the fourth score.
[根据细则26改正 13.12.2024]
结合上一实施方式,在一些实施方式中,根据第一图像包含的预览图像帧的分数,确定第一图像的分数,具体包括:根据第一预览图像帧确定第一图像的分数,第一预览图像帧包括第一图像的所有预览图像帧中除转场帧以外的预览图像帧,转场帧包括信息量和图像质量达不到第一阈值的预览图像帧。[Corrected 13.12.2024 in accordance with Rule 26]
In combination with the previous embodiment, in some embodiments, the score of the first image is determined based on the scores of preview image frames contained in the first image, specifically including: determining the score of the first image based on the first preview image frame, the first preview image frame including preview image frames among all preview image frames of the first image except transition frames, the transition frames including preview image frames whose information amount and image quality do not meet the first threshold.
[根据细则26改正 13.12.2024]
通过去除转场帧,可以让第一图像的分数能够更加客观地反映该第一图像的质量。[Corrected 13.12.2024 in accordance with Rule 26]
By removing the transition frame, the score of the first image can more objectively reflect the quality of the first image.
[根据细则26改正 13.12.2024]
结合上一实施方式,电子设备可根据以下方式,根据第一预览图像帧确定第一图像的分数:确定第一预览图像帧中分数最高的精彩帧;确定精彩帧、第一预览图像帧中精彩帧之前的第一预设数量个预览图像帧、第一预览图像帧中精彩帧之后的第二预设数量个预览图像帧的加权平均分;将加权平均分确定为第一图像的分数。[Corrected 13.12.2024 in accordance with Rule 26]
In combination with the previous embodiment, the electronic device may determine the score of the first image based on the first preview image frame in the following manner: determine the wonderful frame with the highest score in the first preview image frame; determine the weighted average score of the wonderful frame, a first preset number of preview image frames before the wonderful frame in the first preview image frame, and a second preset number of preview image frames after the wonderful frame in the first preview image frame; and determine the weighted average score as the score of the first image.
[根据细则26改正 13.12.2024]
可选的,第一预设数量和第二预设数量可以相同,也可以不同。[Corrected 13.12.2024 in accordance with Rule 26]
Optionally, the first preset number and the second preset number may be the same or different.
[根据细则26改正 13.12.2024]
可选的,精彩帧的加权系数=1,精彩帧向前或向后的其他图像帧的甲醛系数依次递减。[Corrected 13.12.2024 in accordance with Rule 26]
Optionally, the weighting coefficient of the wonderful frame=1, and the formaldehyde coefficients of other image frames before or after the wonderful frame decrease in sequence.
[根据细则26改正 13.12.2024]
结合第一方面,在一些实施方式中,电子设备可以根据第一图像和历史拍摄图像的分数、包含人物是否运动、主体、相似度中的任一个或多个,确定第一图像的重复性。[Corrected 13.12.2024 in accordance with Rule 26]
In combination with the first aspect, in some embodiments, the electronic device may determine the repeatability of the first image based on any one or more of the scores of the first image and the historically captured images, including whether the person is moving, the subject, and the similarity.
[根据细则26改正 13.12.2024]
结合第一方面,在一些实施方式中,如果第一图像和历史拍摄图像中任一个图像重复,则确定第一图像是重复的;如果第一图像和历史拍摄图像中全部图像都不重复,则确定第一图像是不重复的。[Corrected 13.12.2024 in accordance with Rule 26]
In combination with the first aspect, in some embodiments, if any one of the first image and the historically captured images is repeated, the first image is determined to be repeated; if the first image and all of the historically captured images are not repeated, the first image is determined to be non-repeated.
[根据细则26改正 13.12.2024]
结合上两个实施方式中任一个,仅在以下任一种情况下,第一图像和历史拍摄图像中的第二图像不重复,第二图像为历史拍摄图像中的任一个图像:[Corrected 13.12.2024 in accordance with Rule 26]
In combination with any one of the above two implementations, only in any one of the following cases, the first image and the second image in the historically shot images are not repeated, and the second image is any one of the historically shot images:
[根据细则26改正 13.12.2024]
第一图像的分数高于第二图像的分数;[Corrected 13.12.2024 in accordance with Rule 26]
The score of the first image is higher than the score of the second image;
[根据细则26改正 13.12.2024]
或者,第一图像的分数低于第二图像的分数,且,第一图像和第二图像中一个为运动帧,另一个不为运动帧;[Corrected 13.12.2024 in accordance with Rule 26]
Alternatively, the score of the first image is lower than the score of the second image, and one of the first image and the second image is a motion frame, and the other is not a motion frame;
[根据细则26改正 13.12.2024]
或者,第一图像的分数低于第二图像的分数,且,第一图像和第二图像均为运动帧,且,运动时间大于预设的最小时间间隔;[Corrected 13.12.2024 in accordance with Rule 26]
Alternatively, the score of the first image is lower than the score of the second image, and both the first image and the second image are motion frames, and the motion time is greater than a preset minimum time interval;
[根据细则26改正 13.12.2024]
或者,第一图像的分数低于第二图像的分数,且,第一图像和第二图像均为非运动帧,且,主体相同,且,第一图像和第二图像的相似度低于第二阈值。[Corrected 13.12.2024 in accordance with Rule 26]
Alternatively, the score of the first image is lower than the score of the second image, and both the first image and the second image are non-motion frames, and the subjects are the same, and the similarity between the first image and the second image is lower than a second threshold.
[根据细则26改正 13.12.2024]
结合第一方面,在一些实施方式中,第一图像的主题包括以下任一个:儿童、动物、建筑、植物、风景;第一图像的主题根据第一图像的内容确定。[Corrected 13.12.2024 in accordance with Rule 26]
In combination with the first aspect, in some implementations, the subject of the first image includes any one of the following: children, animals, buildings, plants, and landscapes; and the subject of the first image is determined according to the content of the first image.
[根据细则26改正 13.12.2024]
结合第一方面,在一些实施方式中,电子设备可以通过以下方式,从多个第一图像中确定出推荐图像:根据多个第一图像各自的主题,将多个第一图像分为多个主题组;针对每一个主题组,按照第一图像的分数和重复性排序,分数越高的排列在前,不重复的相比重复的排列在前;从每一个主题组中根据先后排列顺序筛选第一图像,形成推荐图像。这样可以为用户推荐高质量的、不同主题的、内容精彩的、不重复的图像。[Corrected 13.12.2024 in accordance with Rule 26]
In conjunction with the first aspect, in some embodiments, the electronic device can determine the recommended image from the multiple first images in the following manner: divide the multiple first images into multiple theme groups according to their respective themes; sort the first images in each theme group according to the scores and repetitiveness, with the higher scores being arranged first, and non-repetitive images being arranged first compared to repetitive images; and filter the first images from each theme group according to the order of arrangement to form the recommended image. In this way, high-quality images with different themes, wonderful content, and non-repetitive images can be recommended to users.
[根据细则26改正 13.12.2024]
从每个主题组中均选择一定数量的推荐图像,这样可以保障最终确定的推荐图像的多样性和高质量。[Corrected 13.12.2024 in accordance with Rule 26]
A certain number of recommended images are selected from each theme group, which can ensure the diversity and high quality of the final recommended images.
[根据细则26改正 13.12.2024]
可选的,电子设备从每个主题组中选择的推荐图像的数量可以相同,也可以不同。[Corrected 13.12.2024 in accordance with Rule 26]
Optionally, the number of recommended images selected by the electronic device from each theme group may be the same or different.
[根据细则26改正 13.12.2024]
结合第一方面,在一些实施方式中,根据多个第一图像各自的分数、主题和重复性,从多个第一图像中确定出推荐图像之前,该方法还可包括:显示通知消息,通知消息用于提示用户查看推荐图像;检测到作用于通知消息的用户操作。[Corrected 13.12.2024 in accordance with Rule 26]
In combination with the first aspect, in some embodiments, before determining a recommended image from a plurality of first images based on their respective scores, themes, and repeatability, the method may further include: displaying a notification message, the notification message being used to prompt a user to view the recommended image; and detecting a user operation acting on the notification message.
[根据细则26改正 13.12.2024]
结合上一实施方式,通知消息在以下任意时间点显示:预设的固定时间;在最新拍摄了第三预设数量个图像后;在进入第一地点,并在第一地点拍摄了多个图像,在离开第一地点后。[Corrected 13.12.2024 in accordance with Rule 26]
In combination with the previous implementation, the notification message is displayed at any of the following time points: a preset fixed time; after a third preset number of images are taken; after entering the first location and taking multiple images at the first location, and after leaving the first location.
[根据细则26改正 13.12.2024]
结合第一方面,在一些实施方式中,显示推荐图像的指示信息的方式可包括以下两种:[Corrected 13.12.2024 in accordance with Rule 26]
In conjunction with the first aspect, in some implementations, the manner of displaying the indication information of the recommended image may include the following two methods:
[根据细则26改正 13.12.2024]
1.显示推荐图像的缩略图。[Corrected 13.12.2024 in accordance with Rule 26]
1. Display thumbnails of recommended images.
[根据细则26改正 13.12.2024]
2.显示多个第一图像的指示信息,并且,其中推荐图像的指示信息被选中。[Corrected 13.12.2024 in accordance with Rule 26]
2. Displaying indication information of a plurality of first images, wherein indication information of a recommended image is selected.
[根据细则26改正 13.12.2024]
结合第一方面,在一些实施方式中,显示推荐图像的指示信息之后,该方法还可包括:检测到用于生成视频的用户操作;根据推荐图像生成视频。这样可以便于用于一键生成视频,满足用户制作视频的需求。[Corrected 13.12.2024 in accordance with Rule 26]
In conjunction with the first aspect, in some embodiments, after displaying the indication information of the recommended image, the method may further include: detecting a user operation for generating a video; and generating a video according to the recommended image. This can facilitate the user to generate a video with one click, meeting the user's need to make a video.
[根据细则26改正 13.12.2024]
结合上一实施方式,电子设备可通过以下方式来根据推荐图像生成视频:根据推荐图像匹配音视频模板;根据推荐图像和匹配的音视频模板,生成视频。[Corrected 13.12.2024 in accordance with Rule 26]
In combination with the previous embodiment, the electronic device may generate a video according to the recommended image in the following manner: matching an audio and video template according to the recommended image; and generating a video according to the recommended image and the matched audio and video template.
[根据细则26改正 13.12.2024]
结合上一实施方式,根据推荐图像生成视频之后,该方法还可包括:检测到用于分享视频的用户操作;将视频分享至电子设备中的第一应用,或者,将视频分享至不同于电子设备的第一设备。这样便于用户方便快捷地将利用推荐图像制作的视频分享至一些应用或者设备,满足用户分享视频的需求。[Corrected 13.12.2024 in accordance with Rule 26]
In combination with the previous embodiment, after generating a video according to the recommended image, the method may further include: detecting a user operation for sharing the video; sharing the video to a first application in the electronic device, or sharing the video to a first device different from the electronic device. This makes it easy for users to quickly and conveniently share videos made using the recommended image to some applications or devices, meeting the user's need to share videos.
[根据细则26改正 13.12.2024]
结合第一方面,在一些实施方式中,任意一个第一图像的类型为以下任一种:包含一个图像帧的静态照片;包含多个图像帧的动态照片;包含多个图像帧的视频。即,本申请提供的图像推荐方法可以推荐不同类型的图像给用户。[Corrected 13.12.2024 in accordance with Rule 26]
In conjunction with the first aspect, in some embodiments, the type of any first image is any of the following: a static photo containing one image frame; a dynamic photo containing multiple image frames; a video containing multiple image frames. That is, the image recommendation method provided by the present application can recommend different types of images to the user.
[根据细则26改正 13.12.2024]
结合第一方面,在一些实施方式中,第一图像为动态照片时,保存第一图像具体包括:将检测到用于拍摄图像的用户操作的时刻、时刻之前、时刻之后,预览界面所显示的预览图像帧以及电子设备检测到的声音,存储为动态照片。[Corrected 13.12.2024 in accordance with Rule 26]
In combination with the first aspect, in some embodiments, when the first image is a dynamic photo, saving the first image specifically includes: storing the moment, before and after the moment when the user operation for taking the image is detected, the preview image frame displayed on the preview interface, and the sound detected by the electronic device as a dynamic photo.
[根据细则26改正 13.12.2024]
结合第一方面,在一些实施方式中,历史拍摄图像具体包括以下任意一种:在第一图像之前,电子设备拍摄过的全部图像;最近一次启动相机后所拍摄的图像;当天内拍摄的图像;最近拍摄的第四预设数量之内的图像;在进入第一地点后在第一地点所拍摄的图像。[Corrected 13.12.2024 in accordance with Rule 26]
In combination with the first aspect, in some embodiments, the historical captured images specifically include any one of the following: all images taken by the electronic device before the first image; images taken after the camera was last started; images taken on the same day; images within a fourth preset number taken most recently; images taken at the first location after entering the first location.
[根据细则26改正 13.12.2024]
结合第一方面,在一些实施方式中,多个第一图像,具体包括以下任意一种:电子设备拍摄过的全部图像;最近一次启动相机到关闭相机期间所拍摄的图像;当天内拍摄的图像;最近拍摄的第五预设数量个图像;在进入第二地点到离开第二地点期间,在第一地点所拍摄的图像。[Corrected 13.12.2024 in accordance with Rule 26]
In combination with the first aspect, in some embodiments, the multiple first images specifically include any one of the following: all images taken by the electronic device; images taken during the period from the last time the camera was started to the last time the camera was turned off; images taken on the same day; the fifth preset number of images taken most recently; images taken at the first location during the period from entering the second location to leaving the second location.
[根据细则26改正 13.12.2024]
第二方面,提供一种电子设备,包括:存储器、一个或多个处理器;存储器与一个或多个处理器耦合,存储器用于存储计算机程序代码,计算机程序代码包括计算机指令,一个或多个处理器调用计算机指令以使得电子设备执行如第一方面或第一方面的任意一种实施方式中电子设备所执行的方法。[Corrected 13.12.2024 in accordance with Rule 26]
In a second aspect, an electronic device is provided, comprising: a memory and one or more processors; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute a method executed by the electronic device in the first aspect or any one of the embodiments of the first aspect.
[根据细则26改正 13.12.2024]
第三方面,本申请实施例提供了一种计算机可读存储介质,包括指令,当指令在电子设备上运行时,使得电子设备执行如第一方面或第一方面的任意一种实施方式中电子设备所执行的方法。[Corrected 13.12.2024 in accordance with Rule 26]
In a third aspect, an embodiment of the present application provides a computer-readable storage medium, comprising instructions, which, when executed on an electronic device, causes the electronic device to execute a method executed by the electronic device in the first aspect or any one of the embodiments of the first aspect.
[根据细则26改正 13.12.2024]
第四方面,本申请实施例提供了一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行如第一方面或第一方面的任意一种实施方式中电子设备所执行的方法。[Corrected 13.12.2024 in accordance with Rule 26]
In a fourth aspect, an embodiment of the present application provides a computer program product. When the computer program product is run on a computer, it enables the computer to execute the method executed by the electronic device in the first aspect or any one of the embodiments of the first aspect.
[根据细则26改正 13.12.2024]
第五方面,本申请实施例提供了一种芯片系统,所述芯片系统包括至少一个处理器,用于实现如第一方面或第一方面的任意一种实施方式中电子设备所执行的方法。[Corrected 13.12.2024 in accordance with Rule 26]
In a fifth aspect, an embodiment of the present application provides a chip system, which includes at least one processor for implementing a method executed by an electronic device in the first aspect or any one of the embodiments of the first aspect.
[根据细则26改正 13.12.2024]
实施本申请提供的图像推荐方法,提供一种智能化的图像推荐方案,可以根据各个图像的主题、分数以及重复性来为用户推荐图像,以满足用户的实际需求。[Corrected 13.12.2024 in accordance with Rule 26]
The image recommendation method provided in the present application is implemented to provide an intelligent image recommendation solution, which can recommend images to users based on the theme, score and repeatability of each image to meet the actual needs of users.
[根据细则26改正 13.12.2024]
图1A-图1C为本申请实施例提供的用于拍摄动态照片的用户界面;[Corrected 13.12.2024 in accordance with Rule 26]
1A-1C are user interfaces for taking dynamic photos provided in an embodiment of the present application;
[根据细则26改正 13.12.2024]
图2A-图2P为本申请实施例提供的用于推荐图像、生成视频以及分享视频的用户界面;[Corrected 13.12.2024 in accordance with Rule 26]
2A-2P are user interfaces for recommending images, generating videos, and sharing videos provided in an embodiment of the present application;
[根据细则26改正 13.12.2024]
图3A为本申请实施例提供的一种图像推荐方法的流程图;[Corrected 13.12.2024 in accordance with Rule 26]
FIG3A is a flow chart of an image recommendation method provided in an embodiment of the present application;
[根据细则26改正 13.12.2024]
图3B为本申请实施例提供的另一种图像推荐方法的流程图;[Corrected 13.12.2024 in accordance with Rule 26]
FIG3B is a flow chart of another image recommendation method provided in an embodiment of the present application;
[根据细则26改正 13.12.2024]
图4为本申请实施例提供的对当前帧预览图像打分的流程图;[Corrected 13.12.2024 in accordance with Rule 26]
FIG4 is a flowchart of scoring a preview image of a current frame provided by an embodiment of the present application;
[根据细则26改正 13.12.2024]
图5为本申请实施例提供的人脸大小影响系数sb和人脸大小的映射关系曲线;[Corrected 13.12.2024 in accordance with Rule 26]
FIG5 is a mapping relationship curve between the face size influence coefficient s b and the face size provided by an embodiment of the present application;
[根据细则26改正 13.12.2024]
图6为本申请实施例提供的判断两个图像的重复性的流程图;[Corrected 13.12.2024 in accordance with Rule 26]
FIG6 is a flow chart of determining the repeatability of two images provided by an embodiment of the present application;
[根据细则26改正 13.12.2024]
图7为本申请实施例提供的电子设备的硬件结构框图;[Corrected 13.12.2024 in accordance with Rule 26]
FIG7 is a hardware structure block diagram of an electronic device provided in an embodiment of the present application;
[根据细则26改正 13.12.2024]
图8为本申请实施例提供的电子设备的软件架构。[Corrected 13.12.2024 in accordance with Rule 26]
FIG8 is a software architecture of an electronic device provided in an embodiment of the present application.
[根据细则26改正 13.12.2024]
下面将结合附图对本申请实施例中的技术方案进行清楚、详尽地描述。其中,在本申请实施例的描述中,除非另有说明,“/”表示或的意思,例如,A/B可以表示A或B;文本中的“和/或”仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况,另外,在本申请实施例的描述中,“多个”是指两个或多于两个。[Corrected 13.12.2024 in accordance with Rule 26]
The technical solutions in the embodiments of the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, "/" means or, for example, A/B can mean A or B; "and/or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and/or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[根据细则26改正 13.12.2024]
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为暗示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征,在本申请实施例的描述中,除非另有说明,“多个”的含义是两个或两个以上。[Corrected 13.12.2024 in accordance with Rule 26]
In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.
[根据细则26改正 13.12.2024]
本申请以下实施例中的术语“用户界面(user interface,UI)”,是应用程序或操作系统与用户之间进行交互和信息交换的介质接口,它实现信息的内部形式与用户可以接受形式之间的转换。用户界面是通过java、可扩展标记语言(extensible markup language,XML)等特定计算机语言编写的源代码,界面源代码在电子设备上经过解析,渲染,最终呈现为用户可以识别的内容。用户界面常用的表现形式是图形用户界面(graphic user interface,GUI),是指采用图形方式显示的与计算机操作相关的用户界面。它可以是在电子设备的显示屏中显示的文本、图标、按钮、菜单、选项卡、文本框、对话框、状态栏、导航栏、Widget等可视的界面元素。[Corrected 13.12.2024 in accordance with Rule 26]
The term "user interface (UI)" in the following embodiments of the present application refers to a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device and finally presented as content that the user can recognize. The commonly used form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.
[根据细则26改正 13.12.2024]
本申请提供了图像推荐方法、相关装置。[Corrected 13.12.2024 in accordance with Rule 26]
The present application provides an image recommendation method and related devices.
[根据细则26改正 13.12.2024]
该图像推荐方法应用于电子设备,电子设备为智能终端设备,可以为各种类型,本申请实施例对其具体类型不作限制。例如,该电子设备可以是手机,还可以包括平板电脑、桌面型计算机、膝上型计算机、手持计算机、笔记本电脑、智慧屏、可穿戴式设备、增强现实(augmented reality,AR)设备、虚拟现实(virtual reality,VR)设备、人工智能(artificial intelligence,AI)设备、车机、智能耳机,游戏机,还可以是物联网(internet of things,IOT)设备或智能家居设备如智能电视机等等。不限于此,电子设备还可以包括具有触敏表面或触控面板的膝上型计算机(laptop)、具有触敏表面或触控面板的台式计算机等非便携式终端设备等等。[Corrected 13.12.2024 in accordance with Rule 26]
The image recommendation method is applied to an electronic device, and the electronic device is an intelligent terminal device, which can be of various types, and the embodiments of the present application do not limit its specific type. For example, the electronic device can be a mobile phone, and can also include a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, a smart screen, a wearable device, an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a car machine, a smart headset, a game console, and can also be an Internet of Things (IOT) device or a smart home device such as a smart TV, etc. Not limited to this, the electronic device can also include a laptop computer with a touch-sensitive surface or a touch panel, a desktop computer with a touch-sensitive surface or a touch panel, and other non-portable terminal devices, etc.
[根据细则26改正 13.12.2024]
在该图像推荐方法中,电子设备可以针对多个图像分别打分,以及,判定各个图像之间是否相似。一个图像的分数衡量了该图像的质量以及内容精彩程度,相似度表明一个图像是否和其他图像相似。电子设备可根据各个图像的分数以及相似度,为用户推荐高质量及内容精彩的、不相似(即内容各异)的图像,从而让用户能够关注到这部分推荐的图像。打分策略以及相似性的衡量方式,请参考后文方法实施例的详细介绍,这里暂不赘述。[Corrected 13.12.2024 in accordance with Rule 26]
In the image recommendation method, the electronic device can score multiple images separately and determine whether each image is similar. The score of an image measures the quality of the image and the degree of excitement of the content, and the similarity indicates whether an image is similar to other images. The electronic device can recommend high-quality, exciting, and dissimilar (i.e., different content) images to the user based on the scores and similarities of each image, so that the user can pay attention to these recommended images. For the detailed description of the scoring strategy and the similarity measurement method, please refer to the method implementation example below, which will not be repeated here.
[根据细则26改正 13.12.2024]
在一些实施方式中,电子设备可基于这部分推荐的图像做进一步处理。例如,电子设备可利用其推荐的图像生成视频,满足用户制作高质量且内容精彩且内容不重复的视频的需求。利用推荐图像生成视频的功能可以被称为“一键成片”或其他名字。再例如,电子设备还可将生成的视频分享至社交平台或联系人,满足用户分享视频的需求。[Corrected 13.12.2024 in accordance with Rule 26]
In some embodiments, the electronic device may further process the recommended images. For example, the electronic device may generate a video using the recommended images to meet the user's need to produce high-quality videos with exciting content and non-repetitive content. The function of generating a video using the recommended images may be called "one-click video" or other names. For another example, the electronic device may also share the generated video to a social platform or contact to meet the user's need to share the video.
[根据细则26改正 13.12.2024]
本申请提供的图像推荐方法可以是系统的图库应用提供的功能,也可以是其他的第三方应用提供的功能,这里不做限定。系统应用是指电子设备的制造商所提供的应用,第三方应用是非设备制造商提供的应用。[Corrected 13.12.2024 in accordance with Rule 26]
The image recommendation method provided in this application can be a function provided by the system's gallery application, or a function provided by other third-party applications, which is not limited here. System applications refer to applications provided by the manufacturer of the electronic device, and third-party applications are applications not provided by the device manufacturer.
[根据细则26改正 13.12.2024]
其中,图库是智能手机、平板电脑等电子设备上的一款图像管理的APP,又可以称为“相册”“照片”等,本申请对该应用程序的名称不做限制。图库可以支持用户对存储于电子设备上的图像进行各种操作,例如浏览、编辑、删除、选择等操作。即“图库”管理的对象是图像。在另一些情况下,图库也可以支持用户对存储在云端服务器上的图像进行上述各种操作。本申请以下实施例的图库APP还提供了图像推荐功能。[Corrected 13.12.2024 in accordance with Rule 26]
Among them, the gallery is an image management APP on electronic devices such as smartphones and tablets, which can also be called "album" and "photo", etc. This application does not limit the name of the application. The gallery can support users to perform various operations on images stored on electronic devices, such as browsing, editing, deleting, selecting, etc. That is, the object managed by the "gallery" is the image. In other cases, the gallery can also support users to perform the above-mentioned operations on images stored on cloud servers. The gallery APP in the following embodiments of the present application also provides an image recommendation function.
[根据细则26改正 13.12.2024]
为了行文简便,后续以图库提供本申请的图像推荐方法为例进行说明。[Corrected 13.12.2024 in accordance with Rule 26]
For the sake of simplicity, the image recommendation method of the present application provided by the gallery is used as an example for explanation.
[根据细则26改正 13.12.2024]
本申请所提及的图像,可包括以下几种类别:[Corrected 13.12.2024 in accordance with Rule 26]
The images mentioned in this application may include the following categories:
[根据细则26改正 13.12.2024]
1.动态照片(livephoto)。动态照片包括拍摄时记录的拍照时刻以及该时刻前后一段时间的画面内容和声音,即包含多帧(如90帧)画面以及相应的声音,可以像短视频一样播放。动态照片中包括的拍照时刻之前帧和之后帧的数量可以相同,也可以不同。动态照片也可称为动图、实况照片等。[Corrected 13.12.2024 in accordance with Rule 26]
1. Live photo. Live photos include the moment of shooting and the picture content and sound of a period of time before and after the moment. That is, it contains multiple frames (such as 90 frames) of pictures and corresponding sounds, which can be played like short videos. The number of frames before and after the moment of shooting included in a live photo can be the same or different. Live photos can also be called animated pictures, live photos, etc.
[根据细则26改正 13.12.2024]
2.静态照片。静态照片包括一帧画面,可以是拍摄时记录的拍照时刻的画面内容,也可以是拍照时刻前后的几帧画面融合的一帧画面。静态照片仅包括画面而不包括声音。静态照片和动态照片都可以统称为照片。[Corrected 13.12.2024 in accordance with Rule 26]
2. Still photos. Still photos include one frame of picture, which can be the picture content recorded at the time of shooting, or a frame of picture fused together from several frames before and after the shooting. Still photos only include the picture but not the sound. Both still photos and dynamic photos can be collectively referred to as photos.
[根据细则26改正 13.12.2024]
3.视频。视频可包括在一段时间内连续记录的画面内容和声音。通常视频的时长要长于动态照片的时长。[Corrected 13.12.2024 in accordance with Rule 26]
3. Video. Videos can include images and sounds recorded continuously over a period of time. Usually, the duration of a video is longer than that of a dynamic photo.
[根据细则26改正 13.12.2024]
电子设备可以展示图像的缩略图,该图像的原图可以存储在电子设备本地,也可以存储在云端。动态照片的缩略图可以是拍照时刻获取到的一帧画面。[Corrected 13.12.2024 in accordance with Rule 26]
The electronic device can display a thumbnail of the image, and the original image can be stored locally on the electronic device or in the cloud. The thumbnail of a dynamic photo can be a frame captured at the time of taking the photo.
[根据细则26改正 13.12.2024]
电子设备中展示的图像,可以是电子设备利用摄像头捕捉到的,也可以是从其他应用程序中获取到的或者从网络中下载的,还可以是其他电子设备分享的,这里不做限定。[Corrected 13.12.2024 in accordance with Rule 26]
The image displayed in the electronic device may be captured by the electronic device using a camera, obtained from other applications or downloaded from the Internet, or shared by other electronic devices, without limitation here.
[根据细则26改正 13.12.2024]
在详细介绍本申请提供的图像推荐方法之前,先提供一组电子设备上的UI示例,用于帮助理解该方法。该组UI中以图像类型为动态照片为例来介绍。[Corrected 13.12.2024 in accordance with Rule 26]
Before introducing the image recommendation method provided by the present application in detail, a set of UI examples on electronic devices are provided to help understand the method. The set of UIs is introduced by taking the image type of dynamic photos as an example.
[根据细则26改正 13.12.2024]
图1A-图1C为电子设备拍摄动态照片的用户界面。[Corrected 13.12.2024 in accordance with Rule 26]
1A-1C are user interfaces for an electronic device to take dynamic photos.
[根据细则26改正 13.12.2024]
图1A示例性示出了电子设备100上的用于展示已安装应用程序的示例性用户界面11。[Corrected 13.12.2024 in accordance with Rule 26]
FIG. 1A exemplarily shows an exemplary user interface 11 on an electronic device 100 for displaying installed applications.
[根据细则26改正 13.12.2024]
用户界面11显示有:状态栏、页面指示符、具有常用应用程序图标的托盘、其他应用程序图标等等。不限于此,用户界面11还可能包括导航栏、侧边栏等等。图1A所示的用户界面11可称为主界面(home screen)。[Corrected 13.12.2024 in accordance with Rule 26]
The user interface 11 displays: a status bar, a page indicator, a tray with common application icons, other application icons, etc. Without limitation, the user interface 11 may also include a navigation bar, a sidebar, etc. The user interface 11 shown in FIG1A may be referred to as a home screen.
[根据细则26改正 13.12.2024]
用户界面11中的应用程序图标例如可包括相机的图标111、图库的图标112,以及一些其他应用程序的图标。相机是电子设备上的一款用于调用摄像头来拍摄图像的APP,本实施例对该应用程序的名称不做限制。相机APP可以是电子设备提供的系统应用,也可以是第三方应用。[Corrected 13.12.2024 in accordance with Rule 26]
The application icons in the user interface 11 may include, for example, a camera icon 111, a gallery icon 112, and icons of some other applications. The camera is an APP on an electronic device that is used to call a camera to take images. This embodiment does not limit the name of the application. The camera APP may be a system application provided by the electronic device or a third-party application.
[根据细则26改正 13.12.2024]
如图1A所示,电子设备可接收到作用于相机的图标111的用户操作(如点击操作、触摸操作),然后可响应该操作,启动相机应用,并显示如图1B所示的用户界面12。图1B的用户界面12为相机应用提供的预览界面。[Corrected 13.12.2024 in accordance with Rule 26]
As shown in FIG1A , the electronic device may receive a user operation (such as a click operation or a touch operation) on a camera icon 111, and then respond to the operation by starting a camera application and displaying a user interface 12 as shown in FIG1B . The user interface 12 in FIG1B is a preview interface provided by the camera application.
[根据细则26改正 13.12.2024]
如图1B所示,用户界面12可包括模式栏121、拍照控件122、预览窗123、回看控件124、快捷功能区125。其中:[Corrected 13.12.2024 in accordance with Rule 26]
As shown in FIG. 1B , the user interface 12 may include a mode bar 121 , a photo control 122 , a preview window 123 , a review control 124 , and a quick function area 125 . Among them:
[根据细则26改正 13.12.2024]
模式栏121中可包括有多个拍照模式选项,例如“夜景”、“人像”、“拍照”、“录像”等等。不同的拍照模式可为用户提供不同效果的拍照服务。用户可根据不同的需求选择多个拍照模式中的任一拍照模式进行拍照。例如,“拍照”可以为默认的拍照模式,用于拍照照片。“录像”用于录制视频。“夜景”模式适用于光线较暗的拍照场景,例如夜晚。“人像”模式适用于拍照主体为人物的拍照场景。电子设备可检测到切换模式的用户操作,例如在模式栏121中左滑/右滑,并根据该操作变更当前所使用的拍照模式。例如,当检测到拖拽模式栏121向左滑动(左滑操作)并使得浮标停止在“人像”选项时,电子设备可切换到“人像”模式。默认的,电子设备首先使用“拍照”模式。[Corrected 13.12.2024 in accordance with Rule 26]
The mode bar 121 may include multiple camera mode options, such as "night scene", "portrait", "photo", "video recording", etc. Different camera modes can provide users with different camera services. Users can choose any of the multiple camera modes to take pictures according to different needs. For example, "photo" can be the default camera mode, which is used to take pictures. "Video recording" is used to record videos. The "night scene" mode is suitable for photo scenes with dim light, such as at night. The "portrait" mode is suitable for photo scenes where the subject of the photo is a person. The electronic device can detect the user operation of switching modes, such as swiping left/right in the mode bar 121, and change the currently used camera mode according to the operation. For example, when it is detected that the mode bar 121 is dragged to slide to the left (left slide operation) and the float stops at the "portrait" option, the electronic device can switch to the "portrait" mode. By default, the electronic device first uses the "photo" mode.
[根据细则26改正 13.12.2024]
拍照控件122用于触发拍照。电子设备可检测是否有作用于拍照控件122的用户操作,例如点击操作。当检测到作用于拍照控件122的用户操作后,电子设备可生成拍照指令。电子设备可根据拍照指令获取对应摄像头上报的图像,然后保存为静态照片或动态照片。[Corrected 13.12.2024 in accordance with Rule 26]
The photo control 122 is used to trigger photo taking. The electronic device can detect whether there is a user operation on the photo control 122, such as a click operation. When the user operation on the photo control 122 is detected, the electronic device can generate a photo taking instruction. The electronic device can obtain the image reported by the corresponding camera according to the photo taking instruction, and then save it as a static photo or a dynamic photo.
[根据细则26改正 13.12.2024]
预览窗123可用于实时地显示电子设备的摄像头采集的图像。在不同的拍照模式下,电子设备可对摄像头上报的图像进行处理,提升图像的显示效果。例如,在“人像”模式下,电子设备可对摄像头上报的图像中的背景进行虚化以凸显人像。这里,预览窗123可实时地显示经过不同拍照模式对应的图像处理算法处理后的图像,以使得用户可以实时地感知不同拍照模式对应的拍照效果。预览窗123中的图像也可称为预览图像。[Corrected 13.12.2024 in accordance with Rule 26]
The preview window 123 can be used to display the image captured by the camera of the electronic device in real time. In different shooting modes, the electronic device can process the image reported by the camera to improve the display effect of the image. For example, in the "portrait" mode, the electronic device can blur the background in the image reported by the camera to highlight the portrait. Here, the preview window 123 can display the image processed by the image processing algorithm corresponding to the different shooting modes in real time, so that the user can perceive the shooting effect corresponding to the different shooting modes in real time. The image in the preview window 123 can also be called a preview image.
[根据细则26改正 13.12.2024]
回看控件124可用于显示最近拍摄照片或视频的缩略图。当检测到作用于回看控件124的用户操作后,电子设备也可显示该缩略图对应的图像。[Corrected 13.12.2024 in accordance with Rule 26]
The review control 124 can be used to display thumbnails of recently taken photos or videos. When a user operation acting on the review control 124 is detected, the electronic device can also display an image corresponding to the thumbnail.
[根据细则26改正 13.12.2024]
快捷功能区125可包括高动态范围图像(high-dynamic range,HDR)功能选项、动态照片功能选项125A、AI功能选项、闪光灯功能选项、色彩模式功能选项、设置功能选项等。HDR功能选项可用于在开启时触发电子设备采用HDR算法对图像进行融合处理。AI功能选项可用于在开启时触发电子设备识别预览画面中的拍照场景,当前AI功能选项处于关闭状态。闪光灯控件可用于触发电子设备开启或关闭闪光灯。色彩模式功能选项可用于触发电子设备使用色彩滤镜对摄像头采集到的图像进行处理。该设置功能选项可用于设置电子设备的拍照参数(例如,图像尺寸、图像的存储格式,等等)等。[Corrected 13.12.2024 in accordance with Rule 26]
The quick function area 125 may include a high-dynamic range (HDR) function option, a dynamic photo function option 125A, an AI function option, a flash function option, a color mode function option, a setting function option, etc. The HDR function option can be used to trigger the electronic device to use the HDR algorithm to fuse the image when it is turned on. The AI function option can be used to trigger the electronic device to identify the photo scene in the preview screen when it is turned on, and the current AI function option is in the off state. The flash control can be used to trigger the electronic device to turn on or off the flash. The color mode function option can be used to trigger the electronic device to use a color filter to process the image captured by the camera. The setting function option can be used to set the photo parameters of the electronic device (for example, image size, image storage format, etc.).
[根据细则26改正 13.12.2024]
动态照片功能选项125A可用于开启或关闭动态照片的拍摄模式。图1B中的动态照片功能选项125A的显示状态表明动态照片的拍摄模式已被开启。[Corrected 13.12.2024 in accordance with Rule 26]
The dynamic photo function option 125A can be used to turn on or off the dynamic photo shooting mode. The display state of the dynamic photo function option 125A in FIG. 1B indicates that the dynamic photo shooting mode has been turned on.
[根据细则26改正 13.12.2024]
开启动态照片的拍摄模式后,电子设备可以检测到作用于拍照控件122的用户操作(如点击操作、触摸操作等),然后响应于该用户操作,将拍照时刻以及拍照时刻前后一段时间内的预览图像以及采集到的声音保存为动态照片。[Corrected 13.12.2024 in accordance with Rule 26]
After turning on the dynamic photo shooting mode, the electronic device can detect user operations (such as click operations, touch operations, etc.) acting on the photo control 122, and then respond to the user operation to save the preview image at the photo moment and a period of time before and after the photo moment and the collected sound as a dynamic photo.
[根据细则26改正 13.12.2024]
如图1C所示,拍摄动态照片后,该动态照片的缩略图将显示在回看控件124中。如果用户此时点击回看控件124,则电子设备将启动图库并跳转至显示图库中展示该缩略图对应的动态照片的用户界面。[Corrected 13.12.2024 in accordance with Rule 26]
As shown in FIG1C , after taking a dynamic photo, a thumbnail of the dynamic photo will be displayed in the review control 124. If the user clicks the review control 124 at this time, the electronic device will start the gallery and jump to the user interface that displays the dynamic photo corresponding to the thumbnail in the gallery.
[根据细则26改正 13.12.2024]
按照图1B-图1C相同的操作,用户可以转换电子设备的角度,或者更换切换摄像头等,在取景合适时拍摄更多的动态照片。[Corrected 13.12.2024 in accordance with Rule 26]
According to the same operations as shown in FIG. 1B-FIG 1C , the user can change the angle of the electronic device, or change the camera, etc., to take more dynamic photos when the framing is appropriate.
[根据细则26改正 13.12.2024]
图2A为图库提供的展示用户拍摄的多个图像的用户界面21。[Corrected 13.12.2024 in accordance with Rule 26]
FIG. 2A is a user interface 21 provided by a gallery for displaying a plurality of images taken by a user.
[根据细则26改正 13.12.2024]
如图2A所示,用户界面21中显示有用户拍摄的多张动态照片的缩略图,包括缩略图211A~缩略图211P。每张缩略图的左下角都显示有动态照片的指示符,表明该缩略图对应的图像为动态照片。图2A可以是电子设备检测到作用于图1A中的图库的图标112上的用户操作后,所显示的用户界面。[Corrected 13.12.2024 in accordance with Rule 26]
As shown in FIG2A , the user interface 21 displays thumbnails of multiple dynamic photos taken by the user, including thumbnails 211A to 211P. A dynamic photo indicator is displayed in the lower left corner of each thumbnail, indicating that the image corresponding to the thumbnail is a dynamic photo. FIG2A may be the user interface displayed after the electronic device detects a user operation on the icon 112 of the gallery in FIG1A .
[根据细则26改正 13.12.2024]
图2B-图2L为图库推荐图像及生成视频的用户界面。[Corrected 13.12.2024 in accordance with Rule 26]
2B-2L are user interfaces for recommending images from a gallery and generating videos.
[根据细则26改正 13.12.2024]
图2B示出的用户界面22由电子设备的下拉通知栏提供。通知栏为电子设备中提供通知消息的系统应用。该用户界面22中显示有通知栏提供的通知消息221,通知消息221的具体内容来自图库。通知消息221中包括:图库的图标221A、图库的名称221B、该通知消息的生成时间221C、通知内容221D。通知内容221D可以提示用户电子设备推荐了图像,并且用户可以使用这些图像生成视频。该通知内容221D例如可以是“一键大片推荐”“推荐您一键创作大自然精彩短篇”。[Corrected 13.12.2024 in accordance with Rule 26]
The user interface 22 shown in FIG2B is provided by a drop-down notification bar of an electronic device. The notification bar is a system application that provides notification messages in an electronic device. The user interface 22 displays a notification message 221 provided by the notification bar, and the specific content of the notification message 221 comes from the gallery. The notification message 221 includes: an icon 221A of the gallery, the name 221B of the gallery, the generation time 221C of the notification message, and the notification content 221D. The notification content 221D can prompt the user that the electronic device recommends images, and the user can use these images to generate videos. The notification content 221D can, for example, be "One-click blockbuster recommendation" or "Recommend you to create a wonderful short story about nature with one click."
[根据细则26改正 13.12.2024]
通知消息221的生成时间在后续方法实施例中将展开介绍。[Corrected 13.12.2024 in accordance with Rule 26]
The generation time of the notification message 221 will be described in detail in the subsequent method embodiments.
[根据细则26改正 13.12.2024]
如图2B所示,电子设备检测到作用于通知消息221上的用户操作后,可以跳转至显示图2C所示的图库的用户界面23。[Corrected 13.12.2024 in accordance with Rule 26]
As shown in FIG. 2B , after the electronic device detects a user operation on the notification message 221 , it may jump to the user interface 23 displaying the gallery shown in FIG. 2C .
[根据细则26改正 13.12.2024]
如图2C所示,用户界面23中显示有:返回键231、标题栏232、电子设备在一段时间内拍摄的多个图像的缩略图如缩略图211A~缩略图211P,编辑栏233、清空控件234、用于生成视频的控件235。[Corrected 13.12.2024 in accordance with Rule 26]
As shown in Figure 2C, the user interface 23 displays: a return key 231, a title bar 232, thumbnails of multiple images taken by the electronic device over a period of time such as thumbnails 211A to thumbnail 211P, an edit bar 233, a clear control 234, and a control 235 for generating a video.
[根据细则26改正 13.12.2024]
返回键231用于监听用户操作,电子设备检测到作用于该返回键231的用户操作后,可响应该用户操作,显示图库提供的用于展示图像的主页,或者,也可以回到桌面。[Corrected 13.12.2024 in accordance with Rule 26]
The return key 231 is used to monitor user operations. After the electronic device detects the user operation acting on the return key 231, it can respond to the user operation and display the homepage provided by the gallery for displaying images, or it can also return to the desktop.
[根据细则26改正 13.12.2024]
标题栏232用于提示当前的用户界面23中所展示的图像有哪些。例如图2C中的“所有照片”指的是电子设备在一段时间内拍摄的照片。标题栏232旁边还有下拉箭头,用户可点击该下拉箭头,从电子设备中的下拉选项中选择想要查看的图像类型及图像范围(包括时间范围)等。[Corrected 13.12.2024 in accordance with Rule 26]
The title bar 232 is used to indicate which images are displayed in the current user interface 23. For example, "all photos" in FIG. 2C refers to photos taken by the electronic device within a period of time. There is also a drop-down arrow next to the title bar 232, and the user can click the drop-down arrow to select the image type and image range (including time range) that he wants to view from the drop-down options in the electronic device.
[根据细则26改正 13.12.2024]
缩略图211A~缩略图211P对应的图像是电子设备在一段时间内拍摄的多个图像。该一段时间可以有多种定义。例如这些图像可以包括电子设备最近一次启动相机到关闭相机期间所拍摄的图像,或者可以包括电子设备当天内拍摄的图像,或者可以包括电子设备最近拍摄的预设数量个图像,或者可以是电子设备在进入某个地点/区域到离开该地点/区域期间所拍摄的图像,等等。[Corrected 13.12.2024 in accordance with Rule 26]
The images corresponding to thumbnails 211A to 211P are multiple images taken by the electronic device within a period of time. The period of time can be defined in many ways. For example, these images may include images taken from the last time the electronic device started the camera to the time the camera was turned off, or may include images taken by the electronic device on the same day, or may include a preset number of images taken recently by the electronic device, or may be images taken from the time the electronic device entered a certain place/area to the time it left the place/area, and so on.
[根据细则26改正 13.12.2024]
每个缩略图的左上角可以显示有放大图标,用户可点击该放大图标,电子设备就可以全屏显示对应缩略图的原图,方便用户查看。[Corrected 13.12.2024 in accordance with Rule 26]
A zoom icon may be displayed in the upper left corner of each thumbnail. The user may click on the zoom icon, and the electronic device may then display the original image of the corresponding thumbnail in full screen, making it easier for the user to view.
[根据细则26改正 13.12.2024]
每个缩略图的左下角还可以显示图像类别的标识,例如图2C中的各个缩略图对应的图像均为动态照片,因而左下角显示有动态照片的标识。如果图像为视频,则左下角可以显示视频标识;如果图像为静态照片,则左下角可以不显示标识。[Corrected 13.12.2024 in accordance with Rule 26]
The lower left corner of each thumbnail may also display an image category logo. For example, the images corresponding to the thumbnails in FIG. 2C are all dynamic photos, so a dynamic photo logo is displayed in the lower left corner. If the image is a video, a video logo may be displayed in the lower left corner; if the image is a static photo, no logo may be displayed in the lower left corner.
[根据细则26改正 13.12.2024]
每个缩略图的右下角还可显示选择标记框。如图2C所示,多个缩略图中有部分缩略图的选择标记框为空,表示对应的缩略图未被选中;部分缩略图(如缩略图211D、缩略图211E、缩略图211G、缩略图211J、缩略图211K、缩略图211M)的选择标记框的背景被填充,表示对应的缩略图被电子设备选中。被选中的缩略图的选择标记框中还标记有数字,数字由小到大对应着图像被选中的先后顺序,例如从前往后被选中的顺序为:缩略图211M、缩略图211K、缩略图211J、缩略图211G、缩略图211E、缩略图211D。被选中的缩略图对应的原图像为电子设备为用户推荐的图像,具体的推荐策略可参考后文方法实施例的介绍。[Corrected 13.12.2024 in accordance with Rule 26]
A selection mark box may also be displayed in the lower right corner of each thumbnail. As shown in FIG2C , the selection mark boxes of some of the multiple thumbnails are empty, indicating that the corresponding thumbnails are not selected; the background of the selection mark boxes of some thumbnails (such as thumbnail 211D, thumbnail 211E, thumbnail 211G, thumbnail 211J, thumbnail 211K, and thumbnail 211M) is filled, indicating that the corresponding thumbnail is selected by the electronic device. The selection mark box of the selected thumbnail is also marked with a number, and the numbers correspond to the order in which the images are selected from small to large. For example, the order selected from front to back is: thumbnail 211M, thumbnail 211K, thumbnail 211J, thumbnail 211G, thumbnail 211E, and thumbnail 211D. The original image corresponding to the selected thumbnail is the image recommended by the electronic device to the user. For specific recommendation strategies, please refer to the introduction of the method embodiment below.
[根据细则26改正 13.12.2024]
电子设备可以检测到用于作用于空白的选择标记框上的用户操作,并将对应的缩略图也标记为被选中的状态。[Corrected 13.12.2024 in accordance with Rule 26]
The electronic device can detect the user operation acting on the blank selection mark box and mark the corresponding thumbnail as being selected.
[根据细则26改正 13.12.2024]
编辑栏233中显示有部分被电子设备选中的缩略图。电子设备可检测到作用于编辑栏233中的左滑/右滑操作,并响应该操作切换显示其他被电子设备选中的缩略图。编辑栏233中的各缩略图左下角也可显示有图像类别的标识。[Corrected 13.12.2024 in accordance with Rule 26]
Some of the thumbnails selected by the electronic device are displayed in the edit bar 233. The electronic device can detect the left/right swipe operation on the edit bar 233, and in response to the operation, switch to display other thumbnails selected by the electronic device. The lower left corner of each thumbnail in the edit bar 233 can also display an image category logo.
[根据细则26改正 13.12.2024]
编辑栏233可用于编辑被电子设备选中的缩略图,该编辑操作例如包括删除、调整顺序等等。例如,编辑栏233中每个缩略图的右上角显示有删除控件,电子设备可以检测到作用于缩略图的删除控件上的用户操作,然后响应该用户操作,将对应的缩略图标记为未被选中的状态,并将其从编辑栏233中移除。又例如,电子设备还可以检测到长按编辑栏233中的缩略图然后拖拽移动至编辑栏233中的其他位置处的用户操作,然后响应该用户操作,调整对应的缩略图被选中的先后顺序,例如将其顺序提前或者置后等。[Corrected 13.12.2024 in accordance with Rule 26]
The edit bar 233 can be used to edit the thumbnails selected by the electronic device, and the editing operation includes, for example, deletion, order adjustment, etc. For example, a delete control is displayed in the upper right corner of each thumbnail in the edit bar 233, and the electronic device can detect the user operation on the delete control of the thumbnail, and then respond to the user operation, mark the corresponding thumbnail as unselected, and remove it from the edit bar 233. For another example, the electronic device can also detect the user operation of long pressing the thumbnail in the edit bar 233 and then dragging it to other positions in the edit bar 233, and then respond to the user operation to adjust the order in which the corresponding thumbnails are selected, such as advancing or placing them in the back.
[根据细则26改正 13.12.2024]
清空控件234可用于监听用户操作,电子设备检测到作用于该清空控件234的用户操作后,可响应该用户操作,将之前被选中的缩略图都标记为未被选中的状态,达到清空选择的目的。[Corrected 13.12.2024 in accordance with Rule 26]
The clear control 234 can be used to monitor user operations. After the electronic device detects the user operation acting on the clear control 234, it can respond to the user operation and mark all previously selected thumbnails as unselected, thereby achieving the purpose of clearing the selection.
[根据细则26改正 13.12.2024]
控件235之上可以显示有当前被电子设备选中的缩略图的数量,该数量可随着用户添加或删除被选中缩略图的操作更改。[Corrected 13.12.2024 in accordance with Rule 26]
The number of thumbnails currently selected by the electronic device may be displayed on the control 235 , and the number may change as the user adds or deletes selected thumbnails.
[根据细则26改正 13.12.2024]
控件235可用于监听用户操作,电子设备检测到作用于该控件235的用户操作后,可响应该用户操作,将被选中的缩略图对应的原图像合成为视频。[Corrected 13.12.2024 in accordance with Rule 26]
The control 235 may be used to monitor user operations. After the electronic device detects the user operation acting on the control 235, it may respond to the user operation and synthesize the original image corresponding to the selected thumbnail into a video.
[根据细则26改正 13.12.2024]
如果电子设备是首次启用“一键成片”功能,则电子设备检测到作用于控件235的用户操作后,还可以显示图2D所示的用户界面24。用户界面24用于获取针对“一键成片”功能所需的相关权限的授权。[Corrected 13.12.2024 in accordance with Rule 26]
If the electronic device enables the "one-click to create a picture" function for the first time, the electronic device may also display the user interface 24 shown in FIG2D after detecting the user operation acting on the control 235. The user interface 24 is used to obtain authorization for the relevant permissions required for the "one-click to create a picture" function.
[根据细则26改正 13.12.2024]
如图2D所示,用户界面24中显示有:提示信息241、提示信息242、取消控件243、同意控件244。[Corrected 13.12.2024 in accordance with Rule 26]
As shown in FIG. 2D , the user interface 24 displays: prompt information 241 , prompt information 242 , cancel control 243 , and agree control 244 .
[根据细则26改正 13.12.2024]
提示信息241用于提示用户开启“一键成片”后即将启动的服务或应用,也即用于支持实现“一键成片”的服务或应用。例如图2D中提及的“剪辑”服务,“剪辑”服务提供视频截取、调节、剪裁等功能。“剪裁”服务也可以被称为其他名称,这里不做限定。“剪裁”服务可以是系统服务,也可以是第三方服务。[Corrected 13.12.2024 in accordance with Rule 26]
Prompt information 241 is used to prompt the user of the service or application that will be launched after turning on "One-click Video", that is, the service or application that supports the implementation of "One-click Video". For example, the "Editing" service mentioned in Figure 2D provides functions such as video capture, adjustment, and trimming. The "Trimming" service can also be called other names, which are not limited here. The "Trimming" service can be a system service or a third-party service.
[根据细则26改正 13.12.2024]
提示信息242用于提示用户启动“剪辑”服务所需要获取的用户权限。例如,图2D中表明使用该“剪辑”服务需要获取网络权限。提示信息242中还可以提供一些控件,以供用户点击后查看更加详细的使用说明。[Corrected 13.12.2024 in accordance with Rule 26]
The prompt information 242 is used to prompt the user to start the "Clip" service. For example, FIG. 2D shows that the "Clip" service needs to obtain network permissions. The prompt information 242 can also provide some controls for the user to click to view more detailed instructions.
[根据细则26改正 13.12.2024]
取消控件243用于监听用户操作,电子设备检测到作用于该取消控件243的用户操作后,可响应该用户操作,退回显示图2C所示的用户界面23。[Corrected 13.12.2024 in accordance with Rule 26]
The cancel control 243 is used to monitor user operations. After the electronic device detects the user operation acting on the cancel control 243, it can respond to the user operation and return to display the user interface 23 shown in Figure 2C.
[根据细则26改正 13.12.2024]
同意控件244用于监听用户操作,电子设备检测到作用于该同意控件244的用户操作后,可响应该用户操作,电子设备可获取使用“剪辑”服务的用户授权,因而可以利用网络来使用“剪辑”服务。[Corrected 13.12.2024 in accordance with Rule 26]
The consent control 244 is used to monitor user operations. After the electronic device detects the user operation acting on the consent control 244, it can respond to the user operation. The electronic device can obtain the user authorization to use the "Clip" service, and thus can use the "Clip" service via the network.
[根据细则26改正 13.12.2024]
电子设备检测到作用于同意控件244的用户操作后,可以先后显示图2E所示的用户界面25,图2F所示的用户界面26。[Corrected 13.12.2024 in accordance with Rule 26]
After the electronic device detects the user operation acting on the consent control 244, it can successively display the user interface 25 shown in Figure 2E and the user interface 26 shown in Figure 2F.
[根据细则26改正 13.12.2024]
如图2E所示,用户界面25显示有提示信息,用于提示用户授予“剪辑”服务访问电子设备中音乐和音频的提示信息,以及,禁止授权控件,和,始终允许控件。电子设备检测到作用于始终允许控件之后,可以将音乐及音频的访问权限长久地授予“剪辑”服务。[Corrected 13.12.2024 in accordance with Rule 26]
As shown in Fig. 2E, the user interface 25 displays prompt information for prompting the user to grant the "Clip" service access to music and audio in the electronic device, as well as a prohibition authorization control and an always allow control. After the electronic device detects that the always allow control is activated, the music and audio access rights can be permanently granted to the "Clip" service.
[根据细则26改正 13.12.2024]
电子设备检测到作用于图2E中始终允许控件之后,如图2F所示,用户界面26显示有提示信息,用于提示用户授予“剪辑”服务访问电子设备中照片和视频的提示信息,以及,禁止授权控件,和,始终允许控件。电子设备检测到作用于始终允许控件之后,可以将照片及视频的访问权限长久地授予“剪辑”服务。[Corrected 13.12.2024 in accordance with Rule 26]
After the electronic device detects that the always-allowed control in FIG. 2E is applied, as shown in FIG. 2F , the user interface 26 displays a prompt message for prompting the user to grant the "Clip" service access to photos and videos in the electronic device, as well as a prohibition authorization control and an always-allowed control. After the electronic device detects that the always-allowed control is applied, the access rights to photos and videos can be permanently granted to the "Clip" service.
[根据细则26改正 13.12.2024]
电子设备检测到作用于图2F中始终允许控件之后,电子设备可以开始合成视频。[Corrected 13.12.2024 in accordance with Rule 26]
After the electronic device detects that the always-allow control in FIG. 2F is acted upon, the electronic device may start synthesizing the video.
[根据细则26改正 13.12.2024]
当然,如果电子设备为非首次,如果非首次启用“一键成片”功能,则无需显示图2D-图2F所示的用户界面,在检测到作用于图2C中控件235的用户操作后,如果已经获取用户授权,则可以直接开始合成视频。[Corrected 13.12.2024 in accordance with Rule 26]
Of course, if the electronic device is not being used for the first time and the "one-click film-making" function is not being enabled for the first time, there is no need to display the user interface shown in Figures 2D-2F. After detecting the user operation acting on control 235 in Figure 2C, if the user authorization has been obtained, the video synthesis can be started directly.
[根据细则26改正 13.12.2024]
合成视频的具体过程包括如下:[Corrected 13.12.2024 in accordance with Rule 26]
The specific process of synthesizing video includes the following:
[根据细则26改正 13.12.2024]
首先,分析电子设备选择的缩略图(即编辑栏233包含的缩略图)对应的原图像(也可称为素材),例如获取其各类信息,如大小、数量、主题等。在分析过程中,电子设备可显示图2G所示的用户界面27。用户界面27中显示有:提示信息271,用于提示用户电子设备正在分析素材;进度条及进度数值272,用于提示用户分析的进度;停止控件273,用于中断分析操作以及后续的生成视频的操作。[Corrected 13.12.2024 in accordance with Rule 26]
First, the original image (also referred to as material) corresponding to the thumbnail selected by the electronic device (i.e., the thumbnail included in the edit bar 233) is analyzed, for example, various information thereof is obtained, such as size, quantity, theme, etc. During the analysis process, the electronic device may display the user interface 27 shown in FIG. 2G . The user interface 27 displays: prompt information 271, which is used to prompt the user that the electronic device is analyzing the material; a progress bar and progress value 272, which are used to prompt the user of the progress of the analysis; and a stop control 273, which is used to interrupt the analysis operation and the subsequent operation of generating a video.
[根据细则26改正 13.12.2024]
完成分析后,为选择的原图像匹配视频模板。在匹配过程中,电子设备可显示图2H所示的用户界面28。用户界面28中显示有:提示信息281,用于提示用户电子设备正在匹配素材;进度条及进度数值282,用于提示用户匹配的进度;停止控件283,用于中断匹配操作以及后续的生成视频的操作。[Corrected 13.12.2024 in accordance with Rule 26]
After the analysis is completed, the video template is matched to the selected original image. During the matching process, the electronic device can display the user interface 28 shown in FIG2H. The user interface 28 displays: prompt information 281, which is used to prompt the user that the electronic device is matching the material; a progress bar and progress value 282, which are used to prompt the user of the matching progress; and a stop control 283, which is used to interrupt the matching operation and the subsequent operation of generating a video.
[根据细则26改正 13.12.2024]
分析、匹配的具体过程,可参考后文方法实施例的详细介绍,在此不赘述。[Corrected 13.12.2024 in accordance with Rule 26]
The specific process of analysis and matching can be referred to the detailed description of the method embodiment below, which will not be described here.
[根据细则26改正 13.12.2024]
完成匹配后,开始生成视频。在生成视频过程中,电子设备可显示图2I所示的用户界面29。[Corrected 13.12.2024 in accordance with Rule 26]
After the matching is completed, the video generation starts. During the video generation process, the electronic device can display the user interface 29 shown in FIG. 2I .
[根据细则26改正 13.12.2024]
如图2I所示,用户界面29中显示有:返回键291、分享键292、提示信息293、播放/暂停控件294、视频进度条295,以及底部的菜单栏296。[Corrected 13.12.2024 in accordance with Rule 26]
As shown in FIG. 2I , the user interface 29 displays: a return key 291 , a share key 292 , a prompt message 293 , a play/pause control 294 , a video progress bar 295 , and a menu bar 296 at the bottom.
[根据细则26改正 13.12.2024]
返回键291可用于重新回到图2C所示的用户界面23。[Corrected 13.12.2024 in accordance with Rule 26]
The return key 291 may be used to return to the user interface 23 shown in FIG. 2C .
[根据细则26改正 13.12.2024]
分享键292可用于将制作完成的视频分享至其他应用或联系人。[Corrected 13.12.2024 in accordance with Rule 26]
The share button 292 can be used to share the finished video to other applications or contacts.
[根据细则26改正 13.12.2024]
提示信息293用于提示用户当前正在生成视频中。当电子设备制作完视频后,可以在提示信息293所在的区域297自动播放该视频。[Corrected 13.12.2024 in accordance with Rule 26]
The prompt information 293 is used to prompt the user that a video is currently being generated. After the electronic device has finished making the video, the video can be automatically played in the area 297 where the prompt information 293 is located.
[根据细则26改正 13.12.2024]
视频进度条295用于提示播放进度以及视频的总长度。在还未制作完视频之前,播放进度以及视频总长度均可以为0。[Corrected 13.12.2024 in accordance with Rule 26]
The video progress bar 295 is used to indicate the playing progress and the total length of the video. Before the video is made, the playing progress and the total length of the video can both be 0.
[根据细则26改正 13.12.2024]
菜单栏296中包括多个控件,如:[Corrected 13.12.2024 in accordance with Rule 26]
The menu bar 296 includes a plurality of controls, such as:
[根据细则26改正 13.12.2024]
模板控件296A,用户可点击其以查看更多的视频模板并选择合适的模板来合成之前选择的原图像;[Corrected 13.12.2024 in accordance with Rule 26]
Template control 296A, which the user can click to view more video templates and select an appropriate template to synthesize the previously selected original image;
[根据细则26改正 13.12.2024]
音乐控件296B,用户可点击其以查看可选的音乐并将其合成至视频中;[Corrected 13.12.2024 in accordance with Rule 26]
Music control 296B, which the user can click to view optional music and synthesize it into the video;
[根据细则26改正 13.12.2024]
导出控件296C,用于将生成的视频导出,即存储为视频文件;在生成视频之前,导出控件296C可处于不可点击状态;[Corrected 13.12.2024 in accordance with Rule 26]
The export control 296C is used to export the generated video, that is, store it as a video file; before the video is generated, the export control 296C may be in a non-clickable state;
[根据细则26改正 13.12.2024]
片段控件296D,用户可点击其已查看生成视频中的各个片段;[Corrected 13.12.2024 in accordance with Rule 26]
Segment controls 296D that the user can click to view individual segments in the generated video;
[根据细则26改正 13.12.2024]
编辑控件296E,用于编辑已经生成的视频,如裁剪、添加滤镜等。[Corrected 13.12.2024 in accordance with Rule 26]
Editing control 296E is used to edit the generated video, such as cropping, adding filters, etc.
[根据细则26改正 13.12.2024]
参考图2J,图2J示例性示出了电子设备制作完视频之后,自动播放该视频时显示的一帧用户界面30。[Corrected 13.12.2024 in accordance with Rule 26]
Referring to FIG. 2J , FIG. 2J exemplarily shows a frame of user interface 30 displayed when an electronic device automatically plays a video after the video is produced.
[根据细则26改正 13.12.2024]
如果用户观看区域297中的视频后,决定保存该视频,则可以向用户界面30中的导出控件296C输入用户操作,电子设备可响应该操作,将该视频导出为某一种视频格式并且存储到电子设备的存储区中。[Corrected 13.12.2024 in accordance with Rule 26]
If the user decides to save the video after watching it in area 297, he or she may input a user operation into the export control 296C in the user interface 30, and the electronic device may respond to the operation by exporting the video into a certain video format and storing it in the storage area of the electronic device.
[根据细则26改正 13.12.2024]
图2K示例性示出了电子设备导出视频过程中所显示的用户界面31。如图2K所示,用户界面31中显示有:提示信息311,用于提示用户电子设备正在导出视频;进度条及进度数值312,用于提示用户导出视频的进度;停止控件313,用于中断导出视频的操作。[Corrected 13.12.2024 in accordance with Rule 26]
FIG2K exemplarily shows a user interface 31 displayed during the process of exporting a video by an electronic device. As shown in FIG2K , the user interface 31 displays: a prompt message 311 for prompting the user that the electronic device is exporting a video; a progress bar and a progress value 312 for prompting the user of the progress of exporting the video; and a stop control 313 for interrupting the operation of exporting the video.
[根据细则26改正 13.12.2024]
完成视频导出后,电子设备可以显示图2L所示的用户界面32。用户界面32显示有提示信息321,用于提示用户已将生成的视频保存到图库中的哪一个相册,以及,已将该视频保存到“剪辑”服务的模板草稿中。即,电子设备导出视频后,除了将其存储到图库下的相册存储路径,还可将其存储至“剪辑”服务下的模板草稿的存储路径。[Corrected 13.12.2024 in accordance with Rule 26]
After the video export is completed, the electronic device may display the user interface 32 shown in FIG. 2L. The user interface 32 displays a prompt message 321, which is used to prompt the user to which album in the gallery the generated video has been saved, and that the video has been saved to the template draft of the "Clip" service. That is, after the electronic device exports the video, in addition to storing it in the album storage path under the gallery, it can also store it in the storage path of the template draft under the "Clip" service.
[根据细则26改正 13.12.2024]
提示信息321可以在显示一段时间后自动消失,也可以响应于用户操作(例如用户点击图2L中“知道了”的操作)而消失,之后电子设备可继续显示类似图2J的用户界面。[Corrected 13.12.2024 in accordance with Rule 26]
The prompt information 321 may disappear automatically after being displayed for a period of time, or may disappear in response to a user operation (eg, the user clicks on the “Got it” operation in FIG. 2L ), after which the electronic device may continue to display a user interface similar to FIG. 2J .
[根据细则26改正 13.12.2024]
存储视频之后,电子设备就可以在图库的对应相册中查看并分享该视频。[Corrected 13.12.2024 in accordance with Rule 26]
After storing the video, the electronic device can view and share the video in the corresponding album of the gallery.
[根据细则26改正 13.12.2024]
图2M-图2P为在图库中查看视频及分享视频的用户界面。[Corrected 13.12.2024 in accordance with Rule 26]
Figures 2M-2P are the user interfaces for viewing and sharing videos in the gallery.
[根据细则26改正 13.12.2024]
图2M示出了电子设备中的图库展示相册的用户界面33。这里的相册指图库中对图像分类结果的呈现。如图2M所示,用户界面33中显示有“视频”相册的缩略图331以及该相册中包含的视频数量。[Corrected 13.12.2024 in accordance with Rule 26]
Fig. 2M shows a user interface 33 of a gallery displaying an album in an electronic device. The album here refers to the presentation of image classification results in the gallery. As shown in Fig. 2M, the user interface 33 displays a thumbnail 331 of the "Video" album and the number of videos contained in the album.
[根据细则26改正 13.12.2024]
电子设备检测到作用于“视频”相册的缩略图上的用户操作后,可以显示图2N所示的用户界面34,用户界面34用于展示该“视频”相册包含的各个视频的缩略图以及视频时长。如图2N所示,用户界面34中显示有之前电子设备生成的视频的缩略图341以及对应的时长。[Corrected 13.12.2024 in accordance with Rule 26]
After the electronic device detects a user operation on a thumbnail of the "Video" album, it can display a user interface 34 shown in FIG2N, which is used to display thumbnails of each video contained in the "Video" album and the video duration. As shown in FIG2N, the user interface 34 displays thumbnails 341 of videos previously generated by the electronic device and the corresponding duration.
[根据细则26改正 13.12.2024]
电子设备可以检测到作用于图2N中电子设备生成的视频的缩略图341的用户操作,然后显示图2O所示的用户界面35,并在用户界面35的视频播放区域351中播放该视频。该用户界面25还显示有针对该视频的各类操作控件,如进度条、分享控件352、收藏控件353、编辑控件354、删除控件355等等。[Corrected 13.12.2024 in accordance with Rule 26]
The electronic device can detect the user operation on the thumbnail 341 of the video generated by the electronic device in FIG. 2N , and then display the user interface 35 shown in FIG. 2O , and play the video in the video play area 351 of the user interface 35. The user interface 25 also displays various operation controls for the video, such as a progress bar, a share control 352, a favorite control 353, an edit control 354, a delete control 355, and the like.
[根据细则26改正 13.12.2024]
如图2O所示,电子设备可检测到作用于分享控件352的用户操作,然后响应于该用户操作,显示图2P所示的用户界面36。用户界面36显示有以下任一个或多个:一个或多个应用选项、一个或多个联系人选项、一个或多个设备选项等。其中,一个应用选项对应一个应用,用于将视频分享至该应用;联系人选项对应电子设备的联系人,用于将该视频分享至联系人的设备;设备选项对应于电子设备发现的附近设备,用于将该视频分享至该附近设备。[Corrected 13.12.2024 in accordance with Rule 26]
As shown in FIG2O , the electronic device can detect a user operation on the sharing control 352, and then display the user interface 36 shown in FIG2P in response to the user operation. The user interface 36 displays any one or more of the following: one or more application options, one or more contact options, one or more device options, etc. Among them, an application option corresponds to an application, and is used to share the video to the application; the contact option corresponds to a contact of the electronic device, and is used to share the video to the contact's device; the device option corresponds to a nearby device discovered by the electronic device, and is used to share the video to the nearby device.
[根据细则26改正 13.12.2024]
示例性地,如图2P所示,电子设备检测到作用于应用选项361的用户操作之后,响应该操作,将当前显示的视频分享至该应用选项361对应的应用中。当然,用户也可以根据实际需求将该视频分享至其他应用,或者其他设备,或者,其他联系人。[Corrected 13.12.2024 in accordance with Rule 26]
For example, as shown in FIG2P , after the electronic device detects the user operation on the application option 361, it responds to the operation and shares the currently displayed video to the application corresponding to the application option 361. Of course, the user can also share the video to other applications, other devices, or other contacts according to actual needs.
[根据细则26改正 13.12.2024]
图3A示例性示出了本申请提供的图像推荐方法的一种流程。该方法由电子设备执行。[Corrected 13.12.2024 in accordance with Rule 26]
Fig. 3A exemplarily shows a process of an image recommendation method provided by the present application. The method is executed by an electronic device.
[根据细则26改正 13.12.2024]
如图3A所示,该方法可包括如下步骤:[Corrected 13.12.2024 in accordance with Rule 26]
As shown in FIG. 3A , the method may include the following steps:
[根据细则26改正 13.12.2024]
S101,电子设备拍摄多个图像。[Corrected 13.12.2024 in accordance with Rule 26]
S101, an electronic device captures a plurality of images.
[根据细则26改正 13.12.2024]
电子设备拍摄的图像可以是静态照片、动态照片或视频,这里不做限定。[Corrected 13.12.2024 in accordance with Rule 26]
The images captured by the electronic device may be static photos, dynamic photos or videos, and there is no limitation here.
[根据细则26改正 13.12.2024]
电子设备拍摄多个图像的具体过程,可参考后续图3B所示方法中的S301-S304。[Corrected 13.12.2024 in accordance with Rule 26]
For the specific process of the electronic device capturing multiple images, reference may be made to S301 - S304 in the method shown in subsequent FIG. 3B .
[根据细则26改正 13.12.2024]
S102,电子设备确定拍摄的每一个图像的主题、分数、重复性。[Corrected 13.12.2024 in accordance with Rule 26]
S102, the electronic device determines the subject, score, and repeatability of each captured image.
[根据细则26改正 13.12.2024]
其中,每一个图像的分数可以由电子设备根据该图像的图像质量、构图、脸部美观度、任务动作中的任意一个或多个得到。重复性指一个图像和在该图像之前的历史拍摄图像是否重复。主题是指图像所反映的场景。[Corrected 13.12.2024 in accordance with Rule 26]
The score of each image can be obtained by the electronic device according to any one or more of the image quality, composition, facial beauty, and task action of the image. Repeatability refers to whether an image is repeated in the historical images taken before the image. Theme refers to the scene reflected by the image.
[根据细则26改正 13.12.2024]
电子设备确定图像的主题、分数、重复性的具体实现,可参考图3B中的S305。[Corrected 13.12.2024 in accordance with Rule 26]
For the specific implementation of the electronic device determining the theme, score, and repeatability of the image, please refer to S305 in FIG. 3B .
[根据细则26改正 13.12.2024]
S103,电子设备根据拍摄的多个图像各自的分数、主题和重复性,从该多个图像中确定出推荐图像。[Corrected 13.12.2024 in accordance with Rule 26]
S103: The electronic device determines a recommended image from the plurality of images according to the scores, themes and repetitiveness of the plurality of images respectively.
[根据细则26改正 13.12.2024]
S103的具体实现,可参考图3B中的S306-S310。[Corrected 13.12.2024 in accordance with Rule 26]
For the specific implementation of S103, please refer to S306-S310 in FIG. 3B .
[根据细则26改正 13.12.2024]
S104,电子设备显示推荐图像的指示信息。[Corrected 13.12.2024 in accordance with Rule 26]
S104, the electronic device displays indication information of the recommended image.
[根据细则26改正 13.12.2024]
S104的具体实现,可参考图3B中的S311。[Corrected 13.12.2024 in accordance with Rule 26]
For the specific implementation of S104, please refer to S311 in FIG. 3B .
[根据细则26改正 13.12.2024]
图3B示例性示出了本申请提供的图像推荐方法的另一种流程。该方法由电子设备执行。[Corrected 13.12.2024 in accordance with Rule 26]
Fig. 3B exemplarily shows another process of the image recommendation method provided by the present application. The method is executed by an electronic device.
[根据细则26改正 13.12.2024]
如图3B所示,该方法可包括如下步骤:[Corrected 13.12.2024 in accordance with Rule 26]
As shown in FIG3B , the method may include the following steps:
[根据细则26改正 13.12.2024]
S301,电子设备启动摄像头,并显示预览图像。[Corrected 13.12.2024 in accordance with Rule 26]
S301, the electronic device starts the camera and displays a preview image.
[根据细则26改正 13.12.2024]
电子设备可以运行系统类应用,或者运行第三方应用,从而启动摄像头来采集图像,并接收摄像头上报的预览流,基于该预览流在显示屏显示的预览界面中显示预览图像。电子设备启动的摄像头可以是任意一个摄像头,这取决于用户需求。[Corrected 13.12.2024 in accordance with Rule 26]
The electronic device can run system applications or third-party applications to start the camera to capture images, receive the preview stream reported by the camera, and display the preview image in the preview interface displayed on the display screen based on the preview stream. The camera started by the electronic device can be any camera, depending on user needs.
[根据细则26改正 13.12.2024]
电子设备启动摄像头后,可以持续地接收到摄像头上报的预览流,因而电子设备显示的预览图像也将包含持续的多帧画面(即多帧的预览图像帧)。[Corrected 13.12.2024 in accordance with Rule 26]
After the electronic device starts the camera, it can continuously receive the preview stream reported by the camera, so the preview image displayed by the electronic device will also include continuous multiple frames (ie, multiple preview image frames).
[根据细则26改正 13.12.2024]
例如,参考1A-图1B,电子设备可以运行相机应用,并在图1B的预览窗123中显示预览图像帧。图1B所示的用户界面12可以被称为预览界面。[Corrected 13.12.2024 in accordance with Rule 26]
For example, referring to FIG1A-FIG1B, the electronic device may run a camera application and display a preview image frame in the preview window 123 of FIG1B. The user interface 12 shown in FIG1B may be referred to as a preview interface.
[根据细则26改正 13.12.2024]
S302,从预览流中分析当前帧预览图像,获取该帧预览图像的标签(tag),该标签包括以下信息:分数、主题、是否是转场帧。[Corrected 13.12.2024 in accordance with Rule 26]
S302, analyzing the current frame preview image from the preview stream, and obtaining a tag of the frame preview image, the tag including the following information: score, theme, and whether it is a transition frame.
[根据细则26改正 13.12.2024]
当前预览帧图像是指,当前显示在显示屏上的一帧预览图像。当前帧预览图像,也可称为预览图像帧。[Corrected 13.12.2024 in accordance with Rule 26]
The current preview frame image refers to a preview image frame currently displayed on the display screen. The current preview frame image may also be referred to as a preview image frame.
[根据细则26改正 13.12.2024]
电子设备可以从预览流中多当前预览帧图像进行分析。[Corrected 13.12.2024 in accordance with Rule 26]
The electronic device can analyze the current preview frame image from the preview stream.
[根据细则26改正 13.12.2024]
对一帧预览图像打分时,可考虑以下任意一项或多项因子:[Corrected 13.12.2024 in accordance with Rule 26]
When scoring a preview image, any one or more of the following factors may be considered:
[根据细则26改正 13.12.2024]
1.图像质量。[Corrected 13.12.2024 in accordance with Rule 26]
1. Image quality.
[根据细则26改正 13.12.2024]
图像质量包括图像的清晰度和/或对称性。清晰度越高,和/或,对称性越好,则图像质量越高,图像的分数也越高。对称性指图像内容的对称程度(如建筑的左右对称),可以[0,满分]的得分体现。[Corrected 13.12.2024 in accordance with Rule 26]
Image quality includes image clarity and/or symmetry. The higher the clarity and/or the better the symmetry, the higher the image quality and the higher the image score. Symmetry refers to the degree of symmetry of the image content (such as the left-right symmetry of a building), which can be reflected by a score of [0, full score].
[根据细则26改正 13.12.2024]
2.脸部的美观度。[Corrected 13.12.2024 in accordance with Rule 26]
2. The beauty of the face.
[根据细则26改正 13.12.2024]
每一帧图像均包括主体,图像的主体是指画面中占比较大的人物、动物等类别的对象。一帧图像中可包括一个或多个主体。电子设备可使用主体检测算法检测识别图像中的主体类别,主体检测算法可以是卷积神经网络(convolutional neural networks,CNN)。[Corrected 13.12.2024 in accordance with Rule 26]
Each frame of an image includes a subject, and the subject of the image refers to an object of a category such as a person or an animal that occupies a relatively large proportion in the picture. A frame of an image may include one or more subjects. An electronic device may use a subject detection algorithm to detect and identify the subject category in an image, and the subject detection algorithm may be a convolutional neural network (CNN).
[根据细则26改正 13.12.2024]
如果图像主体为人物、动物,则可以依据该图像中人物、动物脸部的美观度来对该图像打分。[Corrected 13.12.2024 in accordance with Rule 26]
If the subject of the image is a person or an animal, the image may be scored based on the aesthetics of the face of the person or animal in the image.
[根据细则26改正 13.12.2024]
图像中脸部的美观度越高,则图像的分数也越高。[Corrected 13.12.2024 in accordance with Rule 26]
The more beautiful the face in the image is, the higher the score of the image will be.
[根据细则26改正 13.12.2024]
3.图像中人物的动作。[Corrected 13.12.2024 in accordance with Rule 26]
3. The movements of the characters in the image.
[根据细则26改正 13.12.2024]
如果图像主体包括人物,则可以根据人物动作的精彩程度来对图像进行打分。人物有运动的动作并且该动作为预设的精彩动作时,则可以认为该图像是精彩的。预设的精彩运动动作例如可包括跳跃、奔跑、抬手、抬腿等。[Corrected 13.12.2024 in accordance with Rule 26]
If the subject of the image includes a person, the image can be scored according to the excitement of the person's movements. If the person has a moving movement and the movement is a preset exciting movement, the image can be considered exciting. The preset exciting movement movements may include, for example, jumping, running, raising hands, raising legs, etc.
[根据细则26改正 13.12.2024]
图像中人物动作越精彩,则图像的分数也越高。[Corrected 13.12.2024 in accordance with Rule 26]
The more exciting the character's movements in the image, the higher the image score.
[根据细则26改正 13.12.2024]
4.构图。[Corrected 13.12.2024 in accordance with Rule 26]
4. Composition.
[根据细则26改正 13.12.2024]
构图指图像中各个对象的排列、规划、位置等。各个对象的排列及位置越协调、完整,则构图也就越美观,图像的分数也越高。[Corrected 13.12.2024 in accordance with Rule 26]
Composition refers to the arrangement, planning, and position of objects in an image. The more coordinated and complete the arrangement and position of objects, the more beautiful the composition will be, and the higher the image score will be.
[根据细则26改正 13.12.2024]
在根据上述4个因子中的任意一个或多个来对当前帧预览图像打分时,各个因子对最终分数的影响权重可以相同,也可以不同。各个因子对最终分数的权重可以根据实际需求预设,这里不做具体限定。[Corrected 13.12.2024 in accordance with Rule 26]
When scoring the current frame preview image according to any one or more of the above four factors, the weight of each factor on the final score can be the same or different. The weight of each factor on the final score can be preset according to actual needs and is not specifically limited here.
[根据细则26改正 13.12.2024]
下面以同时考虑上述4个因子为例,说明如何对当前帧预览图像打分。[Corrected 13.12.2024 in accordance with Rule 26]
The following takes the above four factors into consideration as an example to explain how to score the preview image of the current frame.
[根据细则26改正 13.12.2024]
公式1示例性示出了电子设备计算当前帧预览图像的公式:score=a1*score1+a2*score2+a3*score3+a4*score4 公式1[Corrected 13.12.2024 in accordance with Rule 26]
Formula 1 exemplarily shows a formula for calculating the preview image of the current frame by the electronic device: score = a1*score1+a2*score2+a3*score3+a4*score4 Formula 1
[根据细则26改正 13.12.2024]
其中,score为当前帧预览图像的分数,score1为在图像质量这一维度的得分,score2为在构图这一维度的得分,score3为在脸部美观度这一维度的得分,score4为在人物动作这一维度的得分。分数越高,表明对应维度的因子也越优秀。score1、score2、score3、score4也可分别被称为第一分数、第二分数、第三分数、第四分数。[Corrected 13.12.2024 in accordance with Rule 26]
Among them, score is the score of the preview image of the current frame, score1 is the score in the dimension of image quality, score2 is the score in the dimension of composition, score3 is the score in the dimension of facial beauty, and score4 is the score in the dimension of character action. The higher the score, the better the factor of the corresponding dimension. score1, score2, score3, and score4 can also be called the first score, the second score, the third score, and the fourth score, respectively.
[根据细则26改正 13.12.2024]
各个维度的打分制度一致。该打分制度可以是任意分数制,例如百分制、十分制等。该打分制度的分数区间,如十分制的[0,10]、百分制的[0,100]可以被称为第一分数区间。第一分数区间中的最高分如十分制的10分,百分制的100分,可称为满分。[Corrected 13.12.2024 in accordance with Rule 26]
The scoring system of each dimension is consistent. The scoring system can be any scoring system, such as a percentage system, a ten-point system, etc. The score interval of the scoring system, such as [0, 10] of a ten-point system and [0, 100] of a percent system, can be called a first score interval. The highest score in the first score interval, such as 10 points of a ten-point system and 100 points of a percent system, can be called a full score.
[根据细则26改正 13.12.2024]
在以下介绍打分过程的各实施方式中,高分包括和满分之间的差值小于预设值的分数,例如十分制中的9-10分,例如百分制中90-100分等;低分包括和满分之间的差值大于预设值的分数,例如十分制中的0-2分,例如百分制中0-20分等。[Corrected 13.12.2024 in accordance with Rule 26]
In the various implementations of the scoring process introduced below, a high score includes a score whose difference from the full score is less than a preset value, such as 9-10 points on a 10-point scale, such as 90-100 points on a 100-point scale, etc.; a low score includes a score whose difference from the full score is greater than a preset value, such as 0-2 points on a 10-point scale, such as 0-20 points on a 100-point scale, etc.
[根据细则26改正 13.12.2024]
a1、a2、a3、a4分别为图像质量、构图、脸部美观度、人物动作对最终分数的影响权重。a1、a2、a3、a4的总和为1。[Corrected 13.12.2024 in accordance with Rule 26]
a1, a2, a3, and a4 are the weights of image quality, composition, facial beauty, and character action on the final score. The sum of a1, a2, a3, and a4 is 1.
[根据细则26改正 13.12.2024]
参考图4,图4示例性示出了电子设备对当前帧预览图像打分的过程。该过程包括如下步骤:[Corrected 13.12.2024 in accordance with Rule 26]
Referring to FIG4 , FIG4 exemplarily shows a process of an electronic device scoring a preview image of a current frame. The process includes the following steps:
[根据细则26改正 13.12.2024]
步骤1,将初始的score1、score2、score3、score4均置为0。[Corrected 13.12.2024 in accordance with Rule 26]
Step 1: Set the initial score1, score2, score3, and score4 to 0.
[根据细则26改正 13.12.2024]
步骤2,计算当前帧预览图像的图像质量得分score1。[Corrected 13.12.2024 in accordance with Rule 26]
Step 2: Calculate the image quality score score1 of the current frame preview image.
[根据细则26改正 13.12.2024]
score1可基于图像质量评价(image quality assessment,IQA)算法计算得到。[Corrected 13.12.2024 in accordance with Rule 26]
score1 can be calculated based on an image quality assessment (IQA) algorithm.
[根据细则26改正 13.12.2024]
步骤3,判断当前帧预览图像是否包含主体,如果不包含主体,则直接转到步骤9;如果包含主体,则转到步骤4。[Corrected 13.12.2024 in accordance with Rule 26]
Step 3, determine whether the current frame preview image contains a subject, if not, go directly to step 9; if contained, go to step 4.
[根据细则26改正 13.12.2024]
步骤4,计算当前帧预览图像的构图得分score2。[Corrected 13.12.2024 in accordance with Rule 26]
Step 4: Calculate the composition score score2 of the current frame preview image.
[根据细则26改正 13.12.2024]
score2可基于构图得分算法计算得到。构图得分算法可以用于对存在主体的图像进行打分,用于评价主体在整体画面中的构图是否美观。构图得分算法可以是基于人体骨骼节点的计算方法。[Corrected 13.12.2024 in accordance with Rule 26]
score2 can be calculated based on a composition scoring algorithm. The composition scoring algorithm can be used to score images with a subject, and to evaluate whether the composition of the subject in the overall picture is beautiful. The composition scoring algorithm can be a calculation method based on human skeleton nodes.
[根据细则26改正 13.12.2024]
步骤5,判断图像主体类别,如果是动物,则转到步骤6;如果是人物,则转到步骤7。[Corrected 13.12.2024 in accordance with Rule 26]
Step 5, determine the category of the image subject, if it is an animal, go to step 6; if it is a person, go to step 7.
[根据细则26改正 13.12.2024]
步骤6,如果检测到动物的脸部,将脸部美观度得分score3置为高分,高分可以预设,例如可以为满分(例如百分制的100分)或者接近满分的数值(例如百分制中90-100分)。[Corrected 13.12.2024 in accordance with Rule 26]
Step 6, if an animal's face is detected, the facial beauty score score3 is set to a high score, which can be preset, for example, a full score (such as 100 points on a 100-point scale) or a value close to the full score (such as 90-100 points on a 100-point scale).
[根据细则26改正 13.12.2024]
对于动物来说,只要拍摄到脸部,对于用户来说该图像内容就是可接受的,因为可以给予脸部美观度一个高分。在一个具体的实施方式中,可以在检测到动物正脸的情况下,给予脸部美观度一个高分。[Corrected 13.12.2024 in accordance with Rule 26]
For animals, as long as the face is captured, the image content is acceptable to the user because a high score can be given for the facial beauty. In a specific embodiment, a high score can be given for the facial beauty when the front face of the animal is detected.
[根据细则26改正 13.12.2024]
高分可以设定为是和满分之间的差值小于预设值的分数。[Corrected 13.12.2024 in accordance with Rule 26]
A high score can be set as a score whose difference from the full score is less than a preset value.
[根据细则26改正 13.12.2024]
步骤7,计算人物的脸部美观度得分score3。[Corrected 13.12.2024 in accordance with Rule 26]
Step 7, calculate the facial beauty score score3 of the character.
[根据细则26改正 13.12.2024]
通常用户对人脸的美观度有较高的要求,因而可以采用更加详细的计算方式。例如,可根据图像中人物的表情、脸部的姿态、脸部在图像中的占比大小、人脸数量等,来计算score3。其中,人物的表情可包括任务是否睁眼、是否有笑容等,脸部姿态包括人脸是否正面面向镜头等。[Corrected 13.12.2024 in accordance with Rule 26]
Usually users have high requirements for the beauty of human faces, so a more detailed calculation method can be used. For example, score3 can be calculated based on the expression of the person in the image, the posture of the face, the proportion of the face in the image, the number of faces, etc. The expression of the person may include whether the person has open eyes or a smile, etc., and the facial posture includes whether the person is facing the camera.
[根据细则26改正 13.12.2024]
在一种实施方式中,score3可基于公式2计算:
[Corrected 13.12.2024 in accordance with Rule 26]
In one implementation, score3 may be calculated based on Formula 2:
[根据细则26改正 13.12.2024]
在公式2中,[Corrected 13.12.2024 in accordance with Rule 26]
In formula 2,
[根据细则26改正 13.12.2024]
为人脸脸部美观度的总得分score3,Nface为人脸个数,se,i为第i张人脸的睁闭眼得分,sm,i为第i张人脸的笑脸得分,sd,i为第i张人脸的姿态端正得分,sb为人脸大小影响系数,sN为多张人脸时人脸占比系数,sc为构图美观系数,sp为无人脸惩罚阈值。[Corrected 13.12.2024 in accordance with Rule 26]
score3 is the total score of facial beauty, N face is the number of faces, s e,i is the score of eye opening and closing of the ith face, s m,i is the score of smile of the ith face, s d,i is the score of posture correctness of the ith face, s b is the influence coefficient of face size, s N is the coefficient of face proportion when there are multiple faces, s c is the composition beauty coefficient, and s p is the penalty threshold for no face.
[根据细则26改正 13.12.2024]
其中,其中,睁闭眼得分se,i、笑脸得分sm,i、姿态端正得分sd,i的打分范围均在脸部美观度得分score3的打分区间内。例如,如果采用百分制对score3进行打分,则上述三个因子的得分也在[0,100]区间内。[Corrected 13.12.2024 in accordance with Rule 26]
Among them, the scoring ranges of the eye-opening and eye-closing score s e,i , the smiling face score s m,i , and the posture correct score s d,i are all within the scoring range of the facial beauty score score 3. For example, if score 3 is scored using a percentage system, the scores of the above three factors are also within the interval [0,100].
[根据细则26改正 13.12.2024]
人脸大小影响系数sb,多张人脸时人脸占比系数sN,构图美观系数sc,无人脸惩罚阈值sp取值均在[0,1]区间内。[Corrected 13.12.2024 in accordance with Rule 26]
The face size influence coefficient s b , the face ratio coefficient s N when there are multiple faces, the composition beauty coefficient sc , and the face-free penalty threshold s p are all in the interval [0, 1].
[根据细则26改正 13.12.2024]
下面展开介绍公式2中的各个参数:[Corrected 13.12.2024 in accordance with Rule 26]
The following is an introduction to the various parameters in formula 2:
[根据细则26改正 13.12.2024]
睁闭眼得分se,i:人物睁眼认为表情美观,赋第一值;人物闭眼认为不美观,赋第二值,第一值高于第二值。第一值可以是高分,第二值可以是低分。[Corrected 13.12.2024 in accordance with Rule 26]
Eyes open and closed score s e,i : If the character's eyes are open and the expression is considered beautiful, the first value is assigned; if the character's eyes are closed and the expression is considered ugly, the second value is assigned, and the first value is higher than the second value. The first value can be a high score, and the second value can be a low score.
[根据细则26改正 13.12.2024]
笑脸得分sm,i:人物微笑认为表情美观,赋第三值;人物无表情认为不美观,赋第四值,第三值高于第四值。第三值可以是高分,第四值可以是低分。[Corrected 13.12.2024 in accordance with Rule 26]
Smile score s m,i : A smiling face is considered beautiful and is assigned the third value; a non-expression face is considered unsightly and is assigned the fourth value. The third value is higher than the fourth value. The third value can be a high score, and the fourth value can be a low score.
[根据细则26改正 13.12.2024]
姿态端正得分sd,i:人脸面向镜头认为姿态端正,赋第五值;仰头、低头等非正脸面对镜头,画面中人脸姿态认为不端正,赋第六值,第五值高于第六值。第五值可以是高分,第六值可以是低分。人脸大小影响系数sb:合适大小的人脸面积(如第一范围内的人脸面积)赋第七值,面积过大(如人脸面积在第一范围外)时人脸不完整,认为不美观;面积过小时拍摄人物非主体(可能是路人),为背景干扰,认为不美观;不美观时人脸大小影响系数sb赋第八值,第七值高于第八值。第七值可以是取值范围内的较高值,第八值可以是取值氛围内的较低值。[Corrected 13.12.2024 in accordance with Rule 26]
Correct posture score sd,i : When the face faces the camera, the posture is correct and the fifth value is assigned; when the face faces the camera with the head up or down, the posture of the face in the picture is not correct and the sixth value is assigned. The fifth value is higher than the sixth value. The fifth value can be a high score and the sixth value can be a low score. Face size influence coefficient sb : When the face area of appropriate size (such as the face area within the first range) is assigned the seventh value, when the area is too large (such as the face area outside the first range), the face is incomplete and is considered unsightly; when the area is too small, the person is not the subject (maybe a passerby), it is background interference and is considered unsightly; when it is unsightly, the face size influence coefficient sb is assigned the eighth value, and the seventh value is higher than the eighth value. The seventh value can be a higher value within the value range, and the eighth value can be a lower value within the value atmosphere.
[根据细则26改正 13.12.2024]
人脸大小影响系数sb可以根据图5示出的三条高斯曲线查询得到。具体根据三条高斯曲线交点以上的部分计算。其中横轴为表示人脸框的面积和图像面积的比值开平方,纵轴为人脸大小影响系数sb。三条曲线从左到右依次代表远、中、近距离人脸大小和人脸大小影响系数sb的映射关系。这样可以综合不同距离人脸主观评价,限制过大和过小人脸的得分。[Corrected 13.12.2024 in accordance with Rule 26]
The face size influence coefficient s b can be obtained by querying the three Gaussian curves shown in FIG5 . Specifically, it is calculated based on the part above the intersection of the three Gaussian curves. It represents the square root of the ratio of the face frame area to the image area, and the vertical axis represents the face size influence coefficient s b . The three curves from left to right represent the mapping relationship between the face size at far, medium, and close distances and the face size influence coefficient s b . In this way, the subjective evaluation of faces at different distances can be integrated to limit the scores of faces that are too large or too small.
[根据细则26改正 13.12.2024]
其中,三条高斯曲线从左至右分别为:[Corrected 13.12.2024 in accordance with Rule 26]
Among them, the three Gaussian curves from left to right are:
[根据细则26改正 13.12.2024]
μ=0.1278,sigma=9.5远距离[Corrected 13.12.2024 in accordance with Rule 26]
μ=0.1278,sigma=9.5Long distance
[根据细则26改正 13.12.2024]
μ=0.3819,sigma=3.5中距离[Corrected 13.12.2024 in accordance with Rule 26]
μ=0.3819,sigma=3.5 medium distance
[根据细则26改正 13.12.2024]
μ=0.65,sigma=9.5近距离[Corrected 13.12.2024 in accordance with Rule 26]
μ=0.65,sigma=9.5Close distance
[根据细则26改正 13.12.2024]
图5示出的三条依次代表远、中、近距离人脸大小和人脸大小影响系数sb的映射关系的高斯曲线为预设的。其中,参数μ代表均值,sig代表标准差的倒数,三条线表示主体在近中远距离都存在一个最佳构图系数,曲线峰值即代表最佳的位置,采用交点以上的位置可以保证在合理距离内的系数值都维持一个较高的得分,w指人脸框宽度,h指人脸框高度,W指图像宽度,H指图像高度。人脸框是指电子设备分析当前帧预览图像时,将人脸所在位置用矩形或正方形框住所得到的一个框。[Corrected 13.12.2024 in accordance with Rule 26]
The three Gaussian curves shown in FIG5, which represent the mapping relationship between the face size at far, medium and near distances and the face size influence coefficient s b, are preset. Among them, the parameter μ represents the mean, sig represents the inverse of the standard deviation, and the three lines indicate that there is an optimal composition coefficient for the subject at near, medium and far distances. The peak of the curve represents the best position. The position above the intersection can ensure that the coefficient value within a reasonable distance maintains a high score. w refers to the face frame width, h refers to the face frame height, W refers to the image width, and H refers to the image height. The face frame refers to a frame obtained by framing the face position with a rectangle or square when the electronic device analyzes the preview image of the current frame.
[根据细则26改正 13.12.2024]
多个人脸时每个人脸占比系数sN:按照各人脸面积由大到小,认为各人脸对总体画面的影响能力依次降低。多个人脸的人脸占比系数sN为预设权重,其总和为1。即预设几个依次降低的人脸占比系数sN,然后根据图像中每个人脸的面积大小,对应到各个人脸。[Corrected 13.12.2024 in accordance with Rule 26]
When there are multiple faces, each face ratio coefficient s N : According to the area of each face from large to small, it is considered that the influence of each face on the overall picture decreases in turn. The face ratio coefficient s N of multiple faces is a preset weight, and the sum is 1. That is, several face ratio coefficients s N that decrease in turn are preset, and then correspond to each face according to the area size of each face in the image.
[根据细则26改正 13.12.2024]
构图美观系数主体人物要求人脸在画面中心一定范围(如第一区域)内;人脸处于边缘时认为不是主体人物,此时人脸不完整,认为构图不美观,因此该人脸会乘以惩罚系数k,降低该人脸的得分。惩罚系数k为预设的值。第九值高于第十值。第九值可以是取值范围内的较高值,第十值可以是取值氛围内的较低值。[Corrected 13.12.2024 in accordance with Rule 26]
Composition beauty coefficient The main character requires that the face is within a certain range (such as the first area) in the center of the picture; when the face is at the edge, it is considered not to be the main character, and the face is incomplete and the composition is considered unsightly, so the face will be multiplied by the penalty coefficient k to reduce the score of the face. The penalty coefficient k is a preset value. The ninth value is higher than the tenth value. The ninth value can be a higher value within the value range, and the tenth value can be a lower value within the value atmosphere.
[根据细则26改正 13.12.2024]
无人脸时惩罚阈值sp:检测到人体但未检测到人脸,可能存在人脸不在画面中、人物背身等情况,认为不美观,降低对应人脸脸部美观度的得分score3。[Corrected 13.12.2024 in accordance with Rule 26]
Penalty threshold s p when no face is detected: When a human body is detected but no face is detected, it may be that the face is not in the picture or the person is facing away, which is considered unsightly and the score of the facial beauty of the corresponding face is reduced by score3.
[根据细则26改正 13.12.2024]
按照上述公式2的计算方式,人脸姿态端正、睁眼微笑、面积大小适中时的score3较高,画面中人物都为主体人物时的score3较高。[Corrected 13.12.2024 in accordance with Rule 26]
According to the calculation method of formula 2 above, score3 is higher when the face posture is correct, the eyes are open and smiling, and the area is moderate, and score3 is higher when the characters in the picture are all main characters.
[根据细则26改正 13.12.2024]
上述提及的高分、低分均是相对概念,可以由电子设备根据实际需求来设置,本申请对其具体数值不做限定。[Corrected 13.12.2024 in accordance with Rule 26]
The high scores and low scores mentioned above are relative concepts and can be set by the electronic device according to actual needs. This application does not limit their specific values.
[根据细则26改正 13.12.2024]
在一些实施方式中,如果当前帧预览图像的主体既包括人物,又包括动物,则可以结合步骤6和步骤7的算法,利用权重来计算综合的脸部美观度得分score3。[Corrected 13.12.2024 in accordance with Rule 26]
In some implementations, if the subject of the current frame preview image includes both people and animals, the algorithms of step 6 and step 7 may be combined to calculate a comprehensive facial beauty score score3 using weights.
[根据细则26改正 13.12.2024]
步骤7之后,可以转到步骤8。[Corrected 13.12.2024 in accordance with Rule 26]
After step 7, you can go to step 8.
[根据细则26改正 13.12.2024]
步骤8,计算人物动作得分score4。[Corrected 13.12.2024 in accordance with Rule 26]
Step 8, calculate the character action score score4.
[根据细则26改正 13.12.2024]
如果图像中人物没有精彩动作,则将score4置为低分(例如0)。[Corrected 13.12.2024 in accordance with Rule 26]
If the person in the image does not have any exciting movements, score4 is set to a low score (eg, 0).
[根据细则26改正 13.12.2024]
如果图像中人物有精彩动作,则可以将动作评价算法输出的置信度乘以高分(例如满分)得到的数值,置为score4的值。其中,动作评价算法是一种评价图像中人物的动作以及该动作的概率的算法,可以是CNN算法。置信度是动作评价算法输出的图像中人物的动作是确定的动作的概率。score4的值在[0,满分]的范围内。[Corrected 13.12.2024 in accordance with Rule 26]
If the person in the image has a wonderful action, the confidence output by the action evaluation algorithm can be multiplied by a high score (e.g., full score) to obtain a value, which can be set as the value of score4. The action evaluation algorithm is an algorithm that evaluates the action of the person in the image and the probability of the action, which can be a CNN algorithm. The confidence is the probability that the action of the person in the image output by the action evaluation algorithm is a certain action. The value of score4 is in the range of [0, full score].
[根据细则26改正 13.12.2024]
步骤9,基于公式1计算当前帧预览图像的分数score。[Corrected 13.12.2024 in accordance with Rule 26]
Step 9: Calculate the score of the preview image of the current frame based on Formula 1.
[根据细则26改正 13.12.2024]
基于图4所示的方法来对当前帧预览图像打分,则当前帧预览图像的分数可以反映该图像的质量、图像中脸部的美观度、人物动作的精彩程度、构图等,分数越高时,则说明该图像的质量、图像中脸部的美观度、人物动作的精彩程度、构图等也都越优秀。[Corrected 13.12.2024 in accordance with Rule 26]
The current frame preview image is scored based on the method shown in FIG4 , and the score of the current frame preview image can reflect the quality of the image, the beauty of the face in the image, the excitement of the character's movements, the composition, etc. The higher the score, the better the quality of the image, the beauty of the face in the image, the excitement of the character's movements, the composition, etc.
[根据细则26改正 13.12.2024]
当然,不限于同时考虑图4所示流程的4个因子,在其他一些实施方式中,也可以仅考虑其中的部分因子来对当前帧预览图像打分。如果仅考虑部分因子,则各因子的权重可以发生变化,其权重总和始终为1。[Corrected 13.12.2024 in accordance with Rule 26]
Of course, it is not limited to considering the four factors of the process shown in FIG4 at the same time. In some other implementations, only some of the factors may be considered to score the preview image of the current frame. If only some of the factors are considered, the weight of each factor may change, and the sum of the weights is always 1.
[根据细则26改正 13.12.2024]
例如,在上述步骤5中,如果当前帧预览图像不包括动物、人物的等主题,例如拍摄的是风景时,则公式1中score3对应的权重系数a3置为0,其余权重a1、a2、a4相应视情况增加。[Corrected 13.12.2024 in accordance with Rule 26]
For example, in the above step 5, if the current frame preview image does not include subjects such as animals and people, such as when the picture is a landscape, the weight coefficient a3 corresponding to score3 in formula 1 is set to 0, and the remaining weights a1, a2, and a4 are increased accordingly.
[根据细则26改正 13.12.2024]
在一些实施方式中,电子设备还可以分析当前帧预览图像是否为转场帧。当用户快速移动电子设备时,该电子设备的摄像头上报的预览流为转场帧,转场帧的成像信息量低且图像质量较差,即信息量和图像质量达不到第一阈值的图像帧。电子设备可利用转场检测算法来识别转场帧。[Corrected 13.12.2024 in accordance with Rule 26]
In some embodiments, the electronic device may further analyze whether the current frame preview image is a transition frame. When the user moves the electronic device quickly, the preview stream reported by the camera of the electronic device is a transition frame, and the imaging information amount of the transition frame is low and the image quality is poor, that is, the image frame whose information amount and image quality do not reach the first threshold. The electronic device may use a transition detection algorithm to identify the transition frame.
[根据细则26改正 13.12.2024]
在一些实施方式中,电子设备还可以分析当前帧预览图像的主题。主题是指图像所包含的场景,例如可包括儿童、动物、建筑、植物、风景等主题。主题可以根据图像的内容分析得到。[Corrected 13.12.2024 in accordance with Rule 26]
In some implementations, the electronic device may also analyze the subject of the current frame preview image. The subject refers to the scene contained in the image, for example, it may include children, animals, buildings, plants, landscapes, etc. The subject may be obtained based on the content analysis of the image.
[根据细则26改正 13.12.2024]
在本申请一些实施方式中,电子设备可使用感知引擎对当前帧预览图像打分,以及,分析其是否为转场帧以及其主题等。感知引擎上可搭载上述提及的各类算法,用于计算所需的结果。[Corrected 13.12.2024 in accordance with Rule 26]
In some embodiments of the present application, the electronic device may use a perception engine to score the current frame preview image, and analyze whether it is a transition frame and its theme, etc. The perception engine may be equipped with the above-mentioned various algorithms to calculate the required results.
[根据细则26改正 13.12.2024]
S303,对当前帧预览图像进行图像编码,并保存当前帧预览图像的标签。[Corrected 13.12.2024 in accordance with Rule 26]
S303: perform image encoding on the current frame preview image and save the label of the current frame preview image.
[根据细则26改正 13.12.2024]
图像编码也称图像压缩,是指在满足一定质量(如信噪比的要求)的条件下,以较少比特数表示图像或图像中所包含信息的技术。这样可以节约电子设备的存储空间。[Corrected 13.12.2024 in accordance with Rule 26]
Image coding, also known as image compression, refers to the technology of representing an image or the information contained in the image with fewer bits under the condition of meeting certain quality requirements (such as signal-to-noise ratio requirements). This can save storage space of electronic devices.
[根据细则26改正 13.12.2024]
在一些实施方式中,电子设备可以将当前帧预览图像的标签单独编码到该当前帧预览图像的音频流里,可以和画面数据分开存储。[Corrected 13.12.2024 in accordance with Rule 26]
In some implementations, the electronic device may encode the tag of the current frame preview image separately into the audio stream of the current frame preview image, and may store it separately from the picture data.
[根据细则26改正 13.12.2024]
在用户输入拍摄图像的指令之前,电子设备的摄像头将持续不断地上报预览流,在此过程中电子设备将持续显示多帧预览图像。因而,上述S302-S303的步骤将持续执行多次,电子设备可保存多帧预览图像的压缩图像以及标签。保存的这部分数据都可以临时存储在电子设备中,和后续真正拍摄图像时保存的数据存储在不同位置。[Corrected 13.12.2024 in accordance with Rule 26]
Before the user inputs the command to capture an image, the camera of the electronic device will continuously report the preview stream, and during this process the electronic device will continue to display multiple frames of preview images. Therefore, the above steps S302-S303 will be continuously executed multiple times, and the electronic device can save compressed images and labels of multiple frames of preview images. This part of the saved data can be temporarily stored in the electronic device, and is stored in a different location from the data saved when the image is actually captured later.
[根据细则26改正 13.12.2024]
在一些实施方式中,电子设备可以仅保存预设数量的预览图像的压缩图像以及标签,生成时间靠前的超过该数量的预览图像的压缩图像及标签可以被丢弃。这样既不影响后续本方案的实施,还可以节约电子设备的存储空间。[Corrected 13.12.2024 in accordance with Rule 26]
In some implementations, the electronic device may only save a preset number of compressed images and labels of preview images, and compressed images and labels of preview images with earlier generation times exceeding the preset number may be discarded. This does not affect the subsequent implementation of the present solution and can also save storage space of the electronic device.
[根据细则26改正 13.12.2024]
通过上述S302-S303,在预览图像时即分析预览图像的标签信息,可以节约后续步骤的执行时间,降低时间成本。并且,由于预览流的存储量较小,这样也便于计算及分析过程的便捷性。[Corrected 13.12.2024 in accordance with Rule 26]
Through the above S302-S303, the tag information of the preview image is analyzed when the image is previewed, which can save the execution time of subsequent steps and reduce the time cost. In addition, since the storage capacity of the preview stream is small, this also facilitates the convenience of the calculation and analysis process.
[根据细则26改正 13.12.2024]
S304,检测到用于拍摄图像的用户操作,响应该用户操作,保存对应的图像。[Corrected 13.12.2024 in accordance with Rule 26]
S304: Detect a user operation for capturing an image, and save a corresponding image in response to the user operation.
[根据细则26改正 13.12.2024]
用于拍摄图像的用户操作可以分为以下几种类别:[Corrected 13.12.2024 in accordance with Rule 26]
User actions for capturing images can be divided into the following categories:
[根据细则26改正 13.12.2024]
1.在电子设备启动动态照片功能的情况下,输入的拍照操作。此种情况下,电子设备将预览流存储为动态照片。该拍照操作的形式可以包括多种,例如作用于显示屏的触摸操作、语音指令、特定表情等。例如,参考图1B,该拍照操作可以是电子设备的动态照片功能启动的情况下,作用于拍照控件122的用户操作。[Corrected 13.12.2024 in accordance with Rule 26]
1. When the electronic device starts the dynamic photo function, a photo operation is input. In this case, the electronic device stores the preview stream as a dynamic photo. The photo operation may be in various forms, such as a touch operation on the display screen, a voice command, a specific expression, etc. For example, referring to FIG. 1B , the photo operation may be a user operation on the photo control 122 when the dynamic photo function of the electronic device is started.
[根据细则26改正 13.12.2024]
针对动态照片,除了在S302-S303中分析拍摄图像的用户操作之前的预览图像的标签,还需要分析该用户操作之后一段时间内的摄像头上报的预览流图像的标签,具体分析方式参考前文。即,电子设备需要分析得到动态照片中各帧图像各自的标签。[Corrected 13.12.2024 in accordance with Rule 26]
For dynamic photos, in addition to analyzing the labels of the preview images before the user operation of taking the image in S302-S303, it is also necessary to analyze the labels of the preview stream images reported by the camera within a period of time after the user operation. The specific analysis method is referred to above. That is, the electronic device needs to analyze and obtain the labels of each frame image in the dynamic photo.
[根据细则26改正 13.12.2024]
2.在电子设备未启动动态照片功能的情况下,接收到的拍照操作。此种情况下,电子设备将预览流存储为静态照片。该拍照操作的形式可以为多种,这里不做限定。[Corrected 13.12.2024 in accordance with Rule 26]
2. When the electronic device does not start the dynamic photo function, a photo operation is received. In this case, the electronic device stores the preview stream as a static photo. The photo operation can be in various forms, which are not limited here.
[根据细则26改正 13.12.2024]
3.在电子设备启动“录像”模式后,接收到的启动录制的操作和结束录制的操作,将在此期间的预览流存储为视频。[Corrected 13.12.2024 in accordance with Rule 26]
3. After the electronic device starts the "recording" mode, the received operation of starting recording and the operation of ending recording will store the preview stream during this period as a video.
[根据细则26改正 13.12.2024]
可见,电子设备保存的图像可以包括预览界面所显示的一个或多个预览图像帧。[Corrected 13.12.2024 in accordance with Rule 26]
It can be seen that the image saved by the electronic device may include one or more preview image frames displayed on the preview interface.
[根据细则26改正 13.12.2024]
S304中的拍摄图像操作也可以多次执行,这样电子设备可以根据用户的需求保存多个图像。电子设备保存的多个图像可以包括一种或多种类型,例如可以同时包括动态照片、静态照片和视频等。[Corrected 13.12.2024 in accordance with Rule 26]
The image capturing operation in S304 may also be performed multiple times, so that the electronic device can save multiple images according to the needs of the user. The multiple images saved by the electronic device may include one or more types, such as dynamic photos, static photos and videos.
[根据细则26改正 13.12.2024]
示例性地,参考图2A,用户界面21展示有电子设备拍摄的多张动态照片的缩略图,包括缩略图211A~缩略图211P。[Corrected 13.12.2024 in accordance with Rule 26]
Exemplarily, referring to FIG. 2A , the user interface 21 displays thumbnails of multiple dynamic photos taken by the electronic device, including thumbnails 211A to 211P.
[根据细则26改正 13.12.2024]
不限于S301-S304所示的电子设备通过自身摄像头拍摄图像,在本申请其他一些实施方式中,电子设备可以保存相机以外的其他应用发送的图像,或者,从网络中下载图像,或者,接收其他电子设备分享的图像,并基于这些图像执行后续步骤。[Corrected 13.12.2024 in accordance with Rule 26]
Not limited to the electronic device shown in S301-S304 taking images through its own camera, in some other embodiments of the present application, the electronic device can save images sent by other applications other than the camera, or download images from the network, or receive images shared by other electronic devices, and perform subsequent steps based on these images.
[根据细则26改正 13.12.2024]
电子设备保存的图像可以被称为第一图像。[Corrected 13.12.2024 in accordance with Rule 26]
The image saved by the electronic device may be referred to as a first image.
[根据细则26改正 13.12.2024]
S305,获取所保存图像的标签(tag),该标签包括以下信息:所保存图像的主题、分数、是否是重复帧。[Corrected 13.12.2024 in accordance with Rule 26]
S305, obtaining a tag of the stored image, the tag including the following information: subject, score, and whether it is a repeated frame of the stored image.
[根据细则26改正 13.12.2024]
所保存图像的主题[Corrected 13.12.2024 in accordance with Rule 26]
The subject of the saved image
[根据细则26改正 13.12.2024]
针对动态照片,将动态照片包含的多帧画面中出现次数最高的主题作为该动态照片的主题。如果次数最高的主题包括多个,则可以按照预设的主题优先级从中选择优先级最高的主题,并将其作为该动态照片的主题。[Corrected 13.12.2024 in accordance with Rule 26]
For dynamic photos, the subject that appears most frequently in multiple frames of the dynamic photo is used as the subject of the dynamic photo. If there are multiple subjects with the highest frequency, the subject with the highest priority can be selected from them according to the preset subject priority and used as the subject of the dynamic photo.
[根据细则26改正 13.12.2024]
针对静态照片,该静态照片包含的一帧画面的主题即为该静态照片的主题。[Corrected 13.12.2024 in accordance with Rule 26]
For a static photo, the subject of a frame contained in the static photo is the subject of the static photo.
[根据细则26改正 13.12.2024]
针对视频,其主题的确认方式和动态照片相同,可参考相关描述。[Corrected 13.12.2024 in accordance with Rule 26]
For videos, the method of confirming the subject is the same as that of dynamic photos. Please refer to the relevant description.
[根据细则26改正 13.12.2024]
所保存图像的分数[Corrected 13.12.2024 in accordance with Rule 26]
Fraction of images saved
[根据细则26改正 13.12.2024]
保存图像之后,电子设备将计算该图像的分数。[Corrected 13.12.2024 in accordance with Rule 26]
After saving the image, the electronic device will calculate a score for the image.
[根据细则26改正 13.12.2024]
该保存图像的分数由其包含的一帧或多帧画面来衡量,当其包含的一帧或多帧画面的分数越高,该保存图像的分数也越高。[Corrected 13.12.2024 in accordance with Rule 26]
The score of the saved image is measured by one or more frames contained in it. The higher the score of the one or more frames contained in it is, the higher the score of the saved image is.
[根据细则26改正 13.12.2024]
针对动态照片,示例性提供一种打分方式:遍历动态照片中的图像队列,找到其包含的所有帧;可选的,去除其中的转场帧得到剩余帧序列FrameSeq[frameStart,…,frameEnd],此步骤可以保证最终评分的有效性;然后从FrameSeq中找到分数score最高的帧记为精彩帧WonderfulFrame,在精彩帧前后均寻找K帧,如果遇到不足K帧则按照得分为0补齐;设置精彩帧权重为1,前后K帧权重依次递减0.1。计算2K+1帧得分的加权平均分数weightAvgScore作为动态照片的打分结果。去除其中的转场帧得到剩余帧序列FrameSeq中包含的图像帧,也可以被称为第一预览图像帧。[Corrected 13.12.2024 in accordance with Rule 26]
For dynamic photos, an exemplary scoring method is provided: traverse the image queue in the dynamic photo and find all the frames it contains; optionally, remove the transition frames to obtain the remaining frame sequence FrameSeq [frameStart, ..., frameEnd]. This step can ensure the validity of the final score; then find the frame with the highest score from FrameSeq and record it as the wonderful frame WonderfulFrame, and look for K frames before and after the wonderful frame. If there are less than K frames, fill them with a score of 0; set the weight of the wonderful frame to 1, and the weights of the K frames before and after are reduced by 0.1. Calculate the weighted average score weightAvgScore of the 2K+1 frame scores as the scoring result of the dynamic photo. Remove the transition frames to obtain the image frames contained in the remaining frame sequence FrameSeq, which can also be called the first preview image frame.
[根据细则26改正 13.12.2024]
当然,上述仅为一种示例,可以基于上述示例的方法中做调整。例如,可以在精彩帧前寻找K帧,在精彩帧之后寻找不同于K的K’帧,计算1+K+K’帧的加权平均得分。[Corrected 13.12.2024 in accordance with Rule 26]
Of course, the above is only an example, and adjustments can be made based on the method of the above example. For example, a K frame can be found before the wonderful frame, a K' frame different from K can be found after the wonderful frame, and a weighted average score of 1+K+K' frames can be calculated.
[根据细则26改正 13.12.2024]
相当于,电子设备可以将精彩帧、剩余帧序列FrameSeq中精彩帧之前的第一预设数量个预览图像帧、剩余帧序列FrameSeq中精彩帧之后的第二预设数量个预览图像帧的加权平均法,确定为所保存图像的分数。[Corrected 13.12.2024 in accordance with Rule 26]
This is equivalent to the electronic device being able to determine the score of the saved image as a weighted average of the wonderful frame, the first preset number of preview image frames before the wonderful frame in the remaining frame sequence FrameSeq, and the second preset number of preview image frames after the wonderful frame in the remaining frame sequence FrameSeq.
[根据细则26改正 13.12.2024]
针对静态照片,该静态照片包含的一帧画面的分数即为该静态照片的分数。[Corrected 13.12.2024 in accordance with Rule 26]
For a static photo, the score of a frame contained in the static photo is the score of the static photo.
[根据细则26改正 13.12.2024]
针对视频,其分数的确认方式和动态照片相同,可参考相关描述。[Corrected 13.12.2024 in accordance with Rule 26]
For videos, the way to confirm their scores is the same as that for dynamic photos. Please refer to the relevant description.
[根据细则26改正 13.12.2024]
所保存图像的重复性[Corrected 13.12.2024 in accordance with Rule 26]
Repeatability of saved images
[根据细则26改正 13.12.2024]
如果有历史图像和该保存图像是重复的,则认为该保存图像是重复的;如果所有历史图像和该保存图像均不重复,则认为该保存图像是非重复的。[Corrected 13.12.2024 in accordance with Rule 26]
If there is a historical image that is repeated with the saved image, the saved image is considered to be repeated; if all historical images and the saved image are not repeated, the saved image is considered to be non-repeated.
[根据细则26改正 13.12.2024]
其中,历史拍摄图像的数量可以为一个或多个。历史拍摄图像的定义可以包括以下任意一种:[Corrected 13.12.2024 in accordance with Rule 26]
The number of historical images may be one or more. The definition of historical images may include any of the following:
[根据细则26改正 13.12.2024]
1.电子设备存储的全部图像,例如图库中的全部图像。[Corrected 13.12.2024 in accordance with Rule 26]
1. All images stored in the electronic device, such as all images in the gallery.
[根据细则26改正 13.12.2024]
2.电子设备最近一次启动相机后所拍摄的图像。[Corrected 13.12.2024 in accordance with Rule 26]
2. The image captured by the electronic device after the camera was last activated.
[根据细则26改正 13.12.2024]
3.电子设备当天内拍摄的图像。[Corrected 13.12.2024 in accordance with Rule 26]
3. Images taken by electronic devices on the same day.
[根据细则26改正 13.12.2024]
4.电子设备最近拍摄的第四预设数量之内的图像。[Corrected 13.12.2024 in accordance with Rule 26]
4. Images within a fourth preset number recently taken by the electronic device.
[根据细则26改正 13.12.2024]
5.电子设备在进入某个地点/区域后在此地点/区域所拍摄的图像。[Corrected 13.12.2024 in accordance with Rule 26]
5. Images taken by an electronic device at a certain place/area after entering the place/area.
[根据细则26改正 13.12.2024]
上述仅为历史拍摄图像的几种示例性定义,不应构成限定。本申请中的电子设备可以根据实际需求来定义历史拍摄图像,这里不做限定。[Corrected 13.12.2024 in accordance with Rule 26]
The above are only several exemplary definitions of historical photographed images and should not constitute limitations. The electronic device in this application can define historical photographed images according to actual needs, and no limitation is made here.
[根据细则26改正 13.12.2024]
下面示例性提供一种将保存图像和历史图像中任一个图像做重复性判断的方式:[Corrected 13.12.2024 in accordance with Rule 26]
The following is an exemplary method for determining the repeatability of any one of the saved images and the historical images:
[根据细则26改正 13.12.2024]
参考图6,图6示例性示出了对两个动态图像做重复性判断的过程。该过程可包括如下步骤:[Corrected 13.12.2024 in accordance with Rule 26]
Referring to FIG6 , FIG6 exemplarily shows a process of making a repeatability judgment on two dynamic images. The process may include the following steps:
[根据细则26改正 13.12.2024]
步骤1,将初始的相似度分数similarScore置为0。[Corrected 13.12.2024 in accordance with Rule 26]
Step 1: Set the initial similarity score similarScore to 0.
[根据细则26改正 13.12.2024]
步骤2,判断a.imageScore是否大于b.imageScore,若是,则转到步骤3;若否,则转到步骤4。[Corrected 13.12.2024 in accordance with Rule 26]
Step 2, determine whether a.imageScore is greater than b.imageScore, if so, go to step 3; if not, go to step 4.
[根据细则26改正 13.12.2024]
a代表电子设备当前所保存的图像,b代表历史图像中的一个图像。a.imageScore是电子设备所保存图像的分数,b.imageScore是历史图像中的一个图像的分数。[Corrected 13.12.2024 in accordance with Rule 26]
a represents the image currently saved by the electronic device, and b represents an image in the historical images. a.imageScore is the score of the image saved by the electronic device, and b.imageScore is the score of an image in the historical images.
[根据细则26改正 13.12.2024]
步骤3,将similarScore置为0。[Corrected 13.12.2024 in accordance with Rule 26]
Step 3, set similarScore to 0.
[根据细则26改正 13.12.2024]
这样可以将分数较高的图像a标记为非重复帧,则后续有较大概率推荐分数较高的图像a,使得推荐结果呈现高质量。[Corrected 13.12.2024 in accordance with Rule 26]
In this way, image a with a higher score can be marked as a non-repeated frame, so that image a with a higher score is more likely to be recommended later, so that the recommendation result is of high quality.
[根据细则26改正 13.12.2024]
步骤4,判断图像a、图像b是否一个是运动帧,另一个不是运动帧,若是,则转到步骤5;若否,则转到步骤6。[Corrected 13.12.2024 in accordance with Rule 26]
Step 4, determine whether one of image a and image b is a motion frame and the other is not a motion frame. If so, go to step 5; if not, go to step 6.
[根据细则26改正 13.12.2024]
图像是否为运动帧可基于动作评价算法确定。[Corrected 13.12.2024 in accordance with Rule 26]
Whether an image is a motion frame may be determined based on a motion evaluation algorithm.
[根据细则26改正 13.12.2024]
步骤5,将similarScore置为0。[Corrected 13.12.2024 in accordance with Rule 26]
Step 5, set similarScore to 0.
[根据细则26改正 13.12.2024]
步骤6,判断图像a、图像b是否均是运动帧,若是,则转到步骤7;若否,则转到步骤10。[Corrected 13.12.2024 in accordance with Rule 26]
Step 6, determine whether both image a and image b are motion frames, if so, go to step 7; if not, go to step 10.
[根据细则26改正 13.12.2024]
步骤7,图像a和图像b中的运动帧生成的时间间隔是否小于最小间隔intervalMin,若是,则转到步骤8;若否,则转到步骤9。最小间隔intervalMin可以按需预设。[Corrected 13.12.2024 in accordance with Rule 26]
Step 7: Is the time interval between the motion frames in image a and image b less than the minimum interval intervalMin? If yes, go to step 8; if no, go to step 9. The minimum interval intervalMin can be preset as needed.
[根据细则26改正 13.12.2024]
步骤8,将similarScore置为1。[Corrected 13.12.2024 in accordance with Rule 26]
Step 8, set similarScore to 1.
[根据细则26改正 13.12.2024]
步骤9,将similarScore置为0。[Corrected 13.12.2024 in accordance with Rule 26]
Step 9, set similarScore to 0.
[根据细则26改正 13.12.2024]
步骤10,判断图像a和图像b中的主体是否相同,若是,则转到步骤11;若否,则转到步骤12。[Corrected 13.12.2024 in accordance with Rule 26]
Step 10, determine whether the subjects in image a and image b are the same, if so, go to step 11; if not, go to step 12.
[根据细则26改正 13.12.2024]
这里的主体相同不仅是指同一个类别,还是指主体是相同的一个,例如同一个人、同一个动物等。[Corrected 13.12.2024 in accordance with Rule 26]
The same subject here not only refers to the same category, but also means that the subject is the same, such as the same person, the same animal, etc.
[根据细则26改正 13.12.2024]
步骤11,将similarScore置为1。[Corrected 13.12.2024 in accordance with Rule 26]
Step 11, set similarScore to 1.
[根据细则26改正 13.12.2024]
步骤12,利用均值哈希算法、欧式距离算法、余弦距离算法、汉明距离算法等任一个计算图像a和图像b的相似度,将similarScore置为计算得到的值。[Corrected 13.12.2024 in accordance with Rule 26]
Step 12, using any one of the mean hash algorithm, Euclidean distance algorithm, cosine distance algorithm, Hamming distance algorithm, etc. to calculate the similarity between image a and image b, and set similarScore to the calculated value.
[根据细则26改正 13.12.2024]
步骤13,判断similarScore是否大于相似阈值threshold,若是,则转到步骤14;若否,则转到步骤15。相似阈值threshold可以按需预设。[Corrected 13.12.2024 in accordance with Rule 26]
Step 13, determine whether similarScore is greater than a similarity threshold threshold, if so, go to step 14; if not, go to step 15. The similarity threshold threshold can be preset as needed.
[根据细则26改正 13.12.2024]
步骤14,确定保存图像为重复图像。[Corrected 13.12.2024 in accordance with Rule 26]
Step 14, determining to save the image as a duplicate image.
[根据细则26改正 13.12.2024]
步骤15,确定保存图像为非重复图像。[Corrected 13.12.2024 in accordance with Rule 26]
Step 15, determining that the saved image is a non-duplicate image.
[根据细则26改正 13.12.2024]
由于电子设备可以保存多个图像,因而S305也可以多次执行,用于分别计算保存的多个图像的分数。[Corrected 13.12.2024 in accordance with Rule 26]
Since the electronic device can store multiple images, S305 can also be executed multiple times to calculate the scores of the multiple stored images respectively.
[根据细则26改正 13.12.2024]
在一些实施方式中,电子设备可以将保存图像的标签单独编码到该图像的音频流里,可以和画面数据分开存储。[Corrected 13.12.2024 in accordance with Rule 26]
In some implementations, the electronic device may encode the tag for saving the image separately into the audio stream of the image, and may store it separately from the picture data.
[根据细则26改正 13.12.2024]
S306,检测到用于获取推荐图像的用户操作。[Corrected 13.12.2024 in accordance with Rule 26]
S306: Detecting a user operation for acquiring a recommended image.
[根据细则26改正 13.12.2024]
在一些实施方式中,电子设备可以生成并显示通知消息,该通知消息可用于提示当前可以推荐图像,或者,可提示当前可以创作视频。该通知消息可以由图库应用发送给通知应用,最终由通知应用展示出来。用于获取推荐图像的用户操作可包括作用于该通知消息的用户操作(如点击操作、触摸操作等)。[Corrected 13.12.2024 in accordance with Rule 26]
In some embodiments, the electronic device may generate and display a notification message, which may be used to prompt that an image can be recommended at present, or may prompt that a video can be created at present. The notification message may be sent by the gallery application to the notification application, and finally displayed by the notification application. The user operation for obtaining the recommended image may include a user operation acting on the notification message (such as a click operation, a touch operation, etc.).
[根据细则26改正 13.12.2024]
示例性地,参考图2B,用户界面22中的通知消息221为一种可能的实现形式。不限于在下拉通知栏中显示通知消息,电子设备还可以在生成通知消息后将其显示在显示屏顶端,如无用户与其交互,则可以在停留一段时间后自动消失。[Corrected 13.12.2024 in accordance with Rule 26]
For example, referring to FIG2B , the notification message 221 in the user interface 22 is a possible implementation form. Not limited to displaying the notification message in the pull-down notification bar, the electronic device can also display the notification message at the top of the display screen after generating it, and if there is no user interaction with it, it can automatically disappear after staying for a period of time.
[根据细则26改正 13.12.2024]
该通知消息的生成及显示时间可包括以下任一种:[Corrected 13.12.2024 in accordance with Rule 26]
The generation and display time of the notification message may include any of the following:
[根据细则26改正 13.12.2024]
1.周期性地生成通知消息,例如每天下午4点或9点自动生成,或者,在每周的固定时间生成。即,可以在预设的固定时间生成并显示固定消息。[Corrected 13.12.2024 in accordance with Rule 26]
1. Generate notification messages periodically, such as automatically generating at 4:00 p.m. or 9:00 p.m. every day, or generating at a fixed time every week. That is, a fixed message can be generated and displayed at a preset fixed time.
[根据细则26改正 13.12.2024]
2.在电子设备新保存了第三预设数量个图像后生成通知消息。[Corrected 13.12.2024 in accordance with Rule 26]
2. Generate a notification message after the electronic device has newly saved a third preset number of images.
[根据细则26改正 13.12.2024]
3.在电子设备进入某个地点/区域,在该地点/区域拍摄了多个图像,之后离开该地点/区域后生成通知消息。该地点/区域可以被称为第一地点。[Corrected 13.12.2024 in accordance with Rule 26]
3. When the electronic device enters a certain place/area, captures a plurality of images in the place/area, and then leaves the place/area, a notification message is generated. The place/area may be referred to as the first place.
[根据细则26改正 13.12.2024]
在另一些实施方式中,提供图像推荐功能的应用(如图库应用或其他应用)的用户界面中可以显示有“一键推荐”控件,用户可以在该“一键推荐”控件上输入用户操作,以触发后续步骤。电子设备检测到的作用于该“一键推荐”控件的用户操作,即为用于获取推荐图像的用户操作。本申请实施例对应用在哪个用户界面提供“一键推荐”控件、该“一键推荐”控件的形式均不作限定。“一键推荐”控件的名称仅为示例,其作用已经介绍清楚,该控件也可以被称为其他名字。[Corrected 13.12.2024 in accordance with Rule 26]
In other embodiments, a “one-click recommendation” control may be displayed in the user interface of an application that provides an image recommendation function (such as a gallery application or other application), and the user can input a user operation on the “one-click recommendation” control to trigger subsequent steps. The user operation acting on the “one-click recommendation” control detected by the electronic device is the user operation for obtaining a recommended image. The embodiments of the present application do not limit the user interface in which the “one-click recommendation” control is provided and the form of the “one-click recommendation” control. The name of the “one-click recommendation” control is only an example, and its function has been clearly explained. The control may also be called by other names.
[根据细则26改正 13.12.2024]
S307,遍历多个图像,获取各个图像的标签。[Corrected 13.12.2024 in accordance with Rule 26]
S307, traverse multiple images and obtain a label of each image.
[根据细则26改正 13.12.2024]
这里的多个图像可以包括以下任意一种:[Corrected 13.12.2024 in accordance with Rule 26]
The multiple images here can include any of the following:
[根据细则26改正 13.12.2024]
1.电子设备存储的全部图像,例如图库中的全部图像。[Corrected 13.12.2024 in accordance with Rule 26]
1. All images stored in the electronic device, such as all images in the gallery.
[根据细则26改正 13.12.2024]
2.电子设备最近一次启动相机到关闭相机期间所拍摄的图像。[Corrected 13.12.2024 in accordance with Rule 26]
2. Images captured by the electronic device from the time the camera was last turned on to the time it was last turned off.
[根据细则26改正 13.12.2024]
3.电子设备当天内拍摄的图像。[Corrected 13.12.2024 in accordance with Rule 26]
3. Images taken by electronic devices on the same day.
[根据细则26改正 13.12.2024]
4.电子设备最近拍摄的第五预设数量个图像。[Corrected 13.12.2024 in accordance with Rule 26]
4. The fifth preset number of images most recently taken by the electronic device.
[根据细则26改正 13.12.2024]
5.电子设备在进入某个地点/区域到离开该地点/区域期间所拍摄的图像。[Corrected 13.12.2024 in accordance with Rule 26]
5. Images captured by an electronic device between entering a certain place/area and leaving the place/area.
[根据细则26改正 13.12.2024]
电子设备可以从存储器中提取各个图像的标签。[Corrected 13.12.2024 in accordance with Rule 26]
The electronic device may extract the labels of the respective images from the memory.
[根据细则26改正 13.12.2024]
示例性地,参考图2A,假设缩略图211A-缩略图211P均为电子设备最近一次启动相机到关闭相机器件所拍摄的图像,则电子设备可以提取这些缩略图对应的原图像的标签。[Corrected 13.12.2024 in accordance with Rule 26]
Exemplarily, referring to FIG. 2A , assuming that thumbnails 211A to 211P are images captured from the last time the electronic device started up the camera to the last time the camera was turned off, the electronic device can extract tags of the original images corresponding to these thumbnails.
[根据细则26改正 13.12.2024]
S308,按照主题,将S307中遍历的多个图像分组。[Corrected 13.12.2024 in accordance with Rule 26]
S308, grouping the multiple images traversed in S307 according to themes.
[根据细则26改正 13.12.2024]
示例性地,如果该多个图像包括缩略图211A-缩略图211P对应的原图像,则可以将该多个图像分为以下几组:[Corrected 13.12.2024 in accordance with Rule 26]
Exemplarily, if the multiple images include original images corresponding to thumbnails 211A to 211P, the multiple images may be divided into the following groups:
[根据细则26改正 13.12.2024]
风景组:缩略图211A、缩略图211B、缩略图211F、缩略图211J、缩略图211L、缩略图211N、缩略图211O、缩略图211P,对应的原图像。[Corrected 13.12.2024 in accordance with Rule 26]
Landscape group: thumbnail 211A, thumbnail 211B, thumbnail 211F, thumbnail 211J, thumbnail 211L, thumbnail 211N, thumbnail 211O, thumbnail 211P, and corresponding original images.
[根据细则26改正 13.12.2024]
人物组:缩略图211G、缩略图211H、缩略图211I、缩略图211K、缩略图211M,对应的原图像。[Corrected 13.12.2024 in accordance with Rule 26]
Character group: thumbnail 211G, thumbnail 211H, thumbnail 211I, thumbnail 211K, thumbnail 211M, and corresponding original images.
[根据细则26改正 13.12.2024]
猫组:缩略图211E,对应的原图像。[Corrected 13.12.2024 in accordance with Rule 26]
Cat group: thumbnail 211E, corresponding original image.
[根据细则26改正 13.12.2024]
狗组:缩略图211C、缩略图211D,对应的原图像。[Corrected 13.12.2024 in accordance with Rule 26]
Dog group: thumbnail 211C, thumbnail 211D, and corresponding original images.
[根据细则26改正 13.12.2024]
S309,对每组内的图像按照重复性,以及,分数进行排序。[Corrected 13.12.2024 in accordance with Rule 26]
S309, sorting the images in each group according to the repeatability and the score.
[根据细则26改正 13.12.2024]
在一些实施方式中,针对每组图像,先将非重复的图像排列在前,重复的图像排列在后;然后在非重复的图像中再按照分数由高到低排序,在重复的图像中也按照分数由高到低排序。[Corrected 13.12.2024 in accordance with Rule 26]
In some embodiments, for each group of images, non-repeated images are arranged first and repeated images are arranged last; then, the non-repeated images are sorted from high to low according to the scores, and the repeated images are also sorted from high to low according to the scores.
[根据细则26改正 13.12.2024]
在另一些实施方式中,针对每组图像,先按照分数由高到低排序,当存在分数相同的图像时,将非重复的图像排在前面,将重复的图像排在后面。[Corrected 13.12.2024 in accordance with Rule 26]
In other implementations, for each group of images, they are first sorted from high to low according to the scores. When there are images with the same scores, the non-duplicate images are placed in front and the duplicate images are placed in the back.
[根据细则26改正 13.12.2024]
S310,从各组图像中分别选择排序靠前的图像,作为推荐图像。[Corrected 13.12.2024 in accordance with Rule 26]
S310, selecting images with the highest ranking from each group of images as recommended images.
[根据细则26改正 13.12.2024]
在一些实施方式中,电子设备可以从不同主题组中分别选择排序靠前的top K个图像形成推荐序列。这样可以保障推荐图像的多样性和高质量。K可以预设,这里对其具体数值不做限定。[Corrected 13.12.2024 in accordance with Rule 26]
In some implementations, the electronic device may select the top K images from different theme groups to form a recommendation sequence. This can ensure the diversity and high quality of the recommended images. K can be preset, and its specific value is not limited here.
[根据细则26改正 13.12.2024]
在另一些实施方式中,电子设备也可以从不同主题组中选择不同数量的排序靠前个图像形成推荐序列。例如,电子设备可以根据每个主题组包含的实际图像数量,从中选取一定比例值的数量出来形成推荐序列。[Corrected 13.12.2024 in accordance with Rule 26]
In other embodiments, the electronic device may also select different numbers of top ranked images from different theme groups to form a recommendation sequence. For example, the electronic device may select a certain proportion of the actual number of images in each theme group to form a recommendation sequence.
[根据细则26改正 13.12.2024]
在又一些实施方式中,电子设备也可以仅从部分主题组中选择图像形成推荐序列,例如电子设备可以从预设的主题组中选择图像。[Corrected 13.12.2024 in accordance with Rule 26]
In some other embodiments, the electronic device may also select images from only part of the subject group to form a recommendation sequence. For example, the electronic device may select images from a preset subject group.
[根据细则26改正 13.12.2024]
上述几种实施方式仅为示例,具体实现中,也可以有其他的选择推荐序列的方式。[Corrected 13.12.2024 in accordance with Rule 26]
The above-mentioned several implementation modes are only examples. In specific implementation, there may be other ways of selecting the recommendation sequence.
[根据细则26改正 13.12.2024]
电子设备获取多个推荐图像之后,还可以对多个推荐图像进行排序,本申请对该排序方式不做限定,例如可以按照分数由高到低排序,按照一定的主题顺序排序,按照保存时间的先后顺序排序等等。[Corrected 13.12.2024 in accordance with Rule 26]
After the electronic device obtains multiple recommended images, it can also sort the multiple recommended images. This application does not limit the sorting method. For example, it can be sorted from high to low according to the score, sorted according to a certain theme order, sorted according to the order of storage time, etc.
[根据细则26改正 13.12.2024]
S311,显示推荐图像的指示信息。[Corrected 13.12.2024 in accordance with Rule 26]
S311, displaying indication information of recommended images.
[根据细则26改正 13.12.2024]
推荐图像的指示信息可以包括缩略图,也可以包括名称、被选中的选择标记框或其他的指示信息,这里不做限定。[Corrected 13.12.2024 in accordance with Rule 26]
The indication information of the recommended image may include a thumbnail, or may include a name, a selected selection mark box, or other indication information, which is not limited here.
[根据细则26改正 13.12.2024]
在一些实施方式中,电子设备可以启动提供图像推荐功能的应用,然后在该应用提供的用户界面中,显示推荐图像的指示信息。[Corrected 13.12.2024 in accordance with Rule 26]
In some implementations, the electronic device may launch an application that provides an image recommendation function, and then display indication information of the recommended image in a user interface provided by the application.
[根据细则26改正 13.12.2024]
示例性地,参考图2C,电子设备可以在图库应用的用户界面23中显示S307中遍历的多个图像的缩略图,并将电子设备推荐的图像通过选中选择标记框的方式标记出来,并且还在对应的选择标记框中添加数字,以表明对应的图像在推荐图像中的排序。[Corrected 13.12.2024 in accordance with Rule 26]
Exemplarily, referring to FIG. 2C , the electronic device may display thumbnails of the multiple images traversed in S307 in the user interface 23 of the gallery application, and mark the images recommended by the electronic device by selecting a selection mark box, and also add numbers in the corresponding selection mark boxes to indicate the ranking of the corresponding images in the recommended images.
[根据细则26改正 13.12.2024]
可选的,S312,根据用户操作调整推荐图像。[Corrected 13.12.2024 in accordance with Rule 26]
Optionally, S312, adjust the recommended image according to the user operation.
[根据细则26改正 13.12.2024]
针对推荐图像的调整可包括:调整多个推荐图像的排序、增加推荐图像、删除推荐图像等等。[Corrected 13.12.2024 in accordance with Rule 26]
The adjustment for the recommended images may include: adjusting the order of the multiple recommended images, adding recommended images, deleting recommended images, etc.
[根据细则26改正 13.12.2024]
用于调整推荐图像的用户操作的实现形式可以有多种,这里不做限定。[Corrected 13.12.2024 in accordance with Rule 26]
There may be many implementation forms of the user operation for adjusting the recommended image, which are not limited here.
[根据细则26改正 13.12.2024]
示例性地,可参考前文图2C的相关文字介绍,其示例性给出了几种调整推荐图像的方式。[Corrected 13.12.2024 in accordance with Rule 26]
For example, reference may be made to the related textual introduction of FIG. 2C , which exemplarily provides several methods for adjusting the recommended images.
[根据细则26改正 13.12.2024]
S313,检测到用于生成视频的用户操作。[Corrected 13.12.2024 in accordance with Rule 26]
S313: A user operation for generating a video is detected.
[根据细则26改正 13.12.2024]
用于生成视频的用户操作可以实现为多种形式,例如作用于显示屏上的用户操作、语音指令、手势、表情等等,这里不做限定。[Corrected 13.12.2024 in accordance with Rule 26]
The user operation for generating the video may be implemented in various forms, such as user operation on the display screen, voice commands, gestures, expressions, etc., which are not limited here.
[根据细则26改正 13.12.2024]
在一些实施方式中,S313也可以是可选步骤,电子设备无需接收到该用户操作,可以在确定推荐图像之后,直接利用该推荐图像生成视频。[Corrected 13.12.2024 in accordance with Rule 26]
In some implementations, S313 may also be an optional step, and the electronic device does not need to receive the user operation, and can directly generate a video using the recommended image after determining the recommended image.
[根据细则26改正 13.12.2024]
S314,根据推荐图像生成视频。[Corrected 13.12.2024 in accordance with Rule 26]
S314, generating a video according to the recommended image.
[根据细则26改正 13.12.2024]
在一些实施方式中,电子设备检测到用于生成视频的用户操作后,可以首先询问用户以获取使用“一键成片”功能的相关权限。向用户获取授权的示例性用户界面可参考图2D-图2F所示的用户界面,这里不再赘述。[Corrected 13.12.2024 in accordance with Rule 26]
In some embodiments, after the electronic device detects a user operation for generating a video, it may first ask the user to obtain the relevant permission to use the "one-click video" function. An exemplary user interface for obtaining authorization from the user can refer to the user interface shown in Figures 2D-2F, which will not be repeated here.
[根据细则26改正 13.12.2024]
根据推荐图像生成视频的过程可包括如下步骤:[Corrected 13.12.2024 in accordance with Rule 26]
The process of generating a video based on the recommended image may include the following steps:
[根据细则26改正 13.12.2024]
首先,分析素材(即推荐图像)。例如可分析其大小、数量、时长、主题等信息。[Corrected 13.12.2024 in accordance with Rule 26]
First, the material (i.e., the recommended images) is analyzed, for example, its size, quantity, duration, theme, and other information.
[根据细则26改正 13.12.2024]
然后,根据素材信息匹配音视频模板。音视频模板可以分为视频模板和音频模板,也可以合成为一个模板。其中,视频模板可包括转场特效、滤镜、图像裁剪方式、可视化元素(如贴纸)等等。音频模板包括音频。音视频模板可以存储于电子设备中,也可以由电子设备通过网络从云端服务器获取到。在一些实施方式中,匹配音视频模板之后,用户还可根据实际需求将其调整至自己想要的形式。[Corrected 13.12.2024 in accordance with Rule 26]
Then, match the audio and video template according to the material information. Audio and video templates can be divided into video templates and audio templates, or they can be combined into one template. Among them, the video template may include transition effects, filters, image cropping methods, visualization elements (such as stickers), etc. The audio template includes audio. The audio and video template can be stored in the electronic device, or it can be obtained by the electronic device from the cloud server through the network. In some embodiments, after matching the audio and video template, the user can also adjust it to the form they want according to actual needs.
[根据细则26改正 13.12.2024]
再然后,电子设备开始根据匹配的音视频模板和推荐素材生成视频。生成视频中各个图像出现的先后顺序可以和电子设备确定的各个图像在推荐图像中的顺序一致。如果推荐图像包含动态照片,则视频中包含的该动态照片可以呈现完整的时长,视频同理。在其他实施方式中,用户可以自行选择音视频模板。[Corrected 13.12.2024 in accordance with Rule 26]
Then, the electronic device starts to generate a video based on the matched audio and video template and the recommended material. The order in which the images appear in the generated video can be consistent with the order in which the images appear in the recommended image determined by the electronic device. If the recommended image includes a dynamic photo, the dynamic photo included in the video can be presented in full length, and the same applies to the video. In other embodiments, the user can select the audio and video template by himself.
[根据细则26改正 13.12.2024]
在上述分析素材、匹配模板、生成视频过程中,电子设备均可以输出一些提示信息,以提示用户当前正在执行的步骤。这些提示信息的示例可参考图2G-图2I的相关描述。[Corrected 13.12.2024 in accordance with Rule 26]
In the above process of analyzing materials, matching templates, and generating videos, the electronic device can output some prompt information to remind the user of the steps currently being performed. Examples of these prompt information can refer to the relevant descriptions of Figures 2G-2I.
[根据细则26改正 13.12.2024]
在一些实施方式中,电子设备生成视频后,还可以自动播放视频,以便用户查看视频效果。示例性地,参考图2K,用户界面30示出了一种生成视频后自动播放视频的效果。当然,电子设备也可以在接收到用户触发播放视频的操作后,再播放视频。[Corrected 13.12.2024 in accordance with Rule 26]
In some embodiments, after the electronic device generates a video, it can also automatically play the video so that the user can view the video effect. Exemplarily, referring to FIG. 2K, the user interface 30 shows an effect of automatically playing the video after the video is generated. Of course, the electronic device can also play the video after receiving the user's operation to trigger the video to play.
[根据细则26改正 13.12.2024]
S315,电子设备保存生成的视频。[Corrected 13.12.2024 in accordance with Rule 26]
S315, the electronic device saves the generated video.
[根据细则26改正 13.12.2024]
电子设备可以在生成视频之后,自动保存视频。[Corrected 13.12.2024 in accordance with Rule 26]
The electronic device can automatically save the video after generating it.
[根据细则26改正 13.12.2024]
或者,电子设备也可以在生成视频之后,响应于接收到的用户操作,再保存该视频。示例性地,该用户操作例如可以是作用于图2J所示用户界面30中的导出控件296C上的用户操作。[Corrected 13.12.2024 in accordance with Rule 26]
Alternatively, the electronic device may also save the video in response to a received user operation after generating the video. Exemplarily, the user operation may be a user operation acting on the export control 296C in the user interface 30 shown in FIG. 2J .
[根据细则26改正 13.12.2024]
电子设备可以将视频保存至提供图像推荐功能的应用(例如图库)下的存储路径,还可将其存储至“剪辑”服务下的存储路径,或者同时存储至两个路径,这里不做限定。[Corrected 13.12.2024 in accordance with Rule 26]
The electronic device can save the video to a storage path under an application that provides image recommendation functions (such as a gallery), and can also store it to a storage path under a "clipping" service, or store it to both paths at the same time, without limitation here.
[根据细则26改正 13.12.2024]
S316,检测到用于分享视频的用户操作,将该视频分享至对应的对象。[Corrected 13.12.2024 in accordance with Rule 26]
S316: Detect a user operation for sharing a video, and share the video to a corresponding object.
[根据细则26改正 13.12.2024]
电子设备保存生成的视频之后,就可以在基于其存储路径的用户界面中展示该视频,以供用户查看。示例性地,图2M-图2O示例性示出了电子设备展示该视频的一种方式。[Corrected 13.12.2024 in accordance with Rule 26]
After the electronic device saves the generated video, it can display the video in a user interface based on its storage path for the user to view. 2M-2O exemplarily illustrate a way for the electronic device to display the video.
[根据细则26改正 13.12.2024]
电子设备检测到用于分享视频的用户操作后,可以将该视频分享至对应的对象。其中,该用于分享视频的用户操作可以实现为多种形式,这里不做限定,例如可包括图2O中作用于分享控件352上的用户操作。分享对象可以是联系人的设备、电子设备中的应用(如社交平台、备忘录、笔记等)、发现的附近设备、应用中的联系人所在的设备等等。电子设备将视频分享至的应用可以被称为第一应用,将视频分享至的设备可被称为第一设备。[Corrected 13.12.2024 in accordance with Rule 26]
After the electronic device detects the user operation for sharing the video, the video can be shared to the corresponding object. Among them, the user operation for sharing the video can be implemented in various forms, which are not limited here, for example, it can include the user operation acting on the sharing control 352 in Figure 2O. The sharing object can be the contact's device, the application in the electronic device (such as a social platform, memo, notes, etc.), the discovered nearby device, the device where the contact in the application is located, etc. The application to which the electronic device shares the video can be called the first application, and the device to which the video is shared can be called the first device.
[根据细则26改正 13.12.2024]
不限于电子设备先展示视频,然后再分享该视频,在其他一些实施方式中,电子设备也可以先展示各个对象,然后选中其中的一个或多个对象,然后从图库或其他应用中找到生成的视频分享至该一个或多个对象。[Corrected 13.12.2024 in accordance with Rule 26]
It is not limited to the electronic device displaying the video first and then sharing the video. In some other implementations, the electronic device may also first display various objects, then select one or more of the objects, and then find the generated video from the gallery or other applications and share it with the one or more objects.
[根据细则26改正 13.12.2024]
上述图3B所示的图像推荐方法可以为用户推荐高质量及内容精彩的、不相似(即内容各异)的图像,从而让用户能够关注到这部分推荐的图像。并且,电子设备还可利用其推荐的图像生成视频,满足用户制作高质量且内容精彩且内容不重复的视频的需求。电子设备还可将生成的视频分享至社交平台或联系人,满足用户分享视频的需求。[Corrected 13.12.2024 in accordance with Rule 26]
The image recommendation method shown in FIG. 3B can recommend high-quality, exciting, and non-similar (i.e., different content) images to users, so that users can pay attention to these recommended images. In addition, the electronic device can also generate videos using the recommended images to meet the user's needs for making high-quality, exciting, and non-repetitive videos. The electronic device can also share the generated videos to social platforms or contacts to meet the user's needs for sharing videos.
[根据细则26改正 13.12.2024]
上述图3B所示方法中,S305中评判图像是否是重复帧后,还可以利用判断结果执行重复图像的删除。此删除可以由电子设备直接执行,或者,由电子设备将建议删除的图像展示给用户并由用户决定是否删除重复图像。[Corrected 13.12.2024 in accordance with Rule 26]
In the method shown in FIG. 3B , after judging whether the image is a duplicate frame in S305 , the duplicate image can be deleted using the judgment result. The deletion can be directly performed by the electronic device, or the electronic device can show the image recommended for deletion to the user and the user can decide whether to delete the duplicate image.
[根据细则26改正 13.12.2024]
上述图3B所示的方法中,S305中确定了图像的主题后,电子设备还可以向用户推荐同主题图像,以便用户查看到更多的同主题图像。[Corrected 13.12.2024 in accordance with Rule 26]
In the method shown in FIG. 3B above, after determining the theme of the image in S305, the electronic device may also recommend images with the same theme to the user so that the user can view more images with the same theme.
[根据细则26改正 13.12.2024]
下面介绍本申请实施例提供的电子设备。[Corrected 13.12.2024 in accordance with Rule 26]
The electronic device provided by the embodiments of the present application is introduced below.
[根据细则26改正 13.12.2024]
图7示出了本申请实施例提供的电子设备100的硬件结构示意图。该电子设备100用于执行前文方法实施例提供的图像推荐方法。[Corrected 13.12.2024 in accordance with Rule 26]
Fig. 7 shows a schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application. The electronic device 100 is used to execute the image recommendation method provided in the above method embodiment.
[根据细则26改正 13.12.2024]
电子设备100可以包括处理器101,存储器102,无线通信模块103,移动通信模块104,天线103A,天线104A,电源开关105,传感器模块106,对焦马达107,摄像头108,显示屏109等。其中,传感器模块106可以包括陀螺仪传感器106A,加速度传感器106B,环境光传感器106C,图像传感器106D,距离传感器106E等。其中,无线通信模块103可以包括WLAN通信模块,蓝牙通信模块等。上述多个部分可以通过总线传输数据。[Corrected 13.12.2024 in accordance with Rule 26]
The electronic device 100 may include a processor 101, a memory 102, a wireless communication module 103, a mobile communication module 104, an antenna 103A, an antenna 104A, a power switch 105, a sensor module 106, a focus motor 107, a camera 108, a display screen 109, etc. Among them, the sensor module 106 may include a gyroscope sensor 106A, an acceleration sensor 106B, an ambient light sensor 106C, an image sensor 106D, a distance sensor 106E, etc. Among them, the wireless communication module 103 may include a WLAN communication module, a Bluetooth communication module, etc. The above multiple parts can transmit data through a bus.
[根据细则26改正 13.12.2024]
处理器101可以包括一个或多个处理单元,例如:处理器101可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。[Corrected 13.12.2024 in accordance with Rule 26]
The processor 101 may include one or more processing units, for example, the processor 101 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and/or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[根据细则26改正 13.12.2024]
存储器102可以用于存储计算机可执行程序代码,可执行程序代码可以包括指令。处理器101通过运行存储在存储器102的指令,从而执行电子设备100的各种功能应用以及数据处理。[Corrected 13.12.2024 in accordance with Rule 26]
The memory 102 may be used to store computer executable program codes, which may include instructions. The processor 101 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the memory 102 .
[根据细则26改正 13.12.2024]
电子设备100的无线通信功能可以通过天线103A,天线104A,移动通信模块104,无线通信模块103,调制解调处理器以及基带处理器等实现。[Corrected 13.12.2024 in accordance with Rule 26]
The wireless communication function of the electronic device 100 can be implemented through the antenna 103A, the antenna 104A, the mobile communication module 104, the wireless communication module 103, the modem processor and the baseband processor.
[根据细则26改正 13.12.2024]
天线103A和天线104A可以用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。[Corrected 13.12.2024 in accordance with Rule 26]
Antenna 103A and antenna 104A can be used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas.
[根据细则26改正 13.12.2024]
移动通信模块104可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块104可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块104可以由天线104A接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块104还可以对经调制解调处理器调制后的信号放大,经天线104A转为电磁波辐射出去。[Corrected 13.12.2024 in accordance with Rule 26]
The mobile communication module 104 can provide solutions for wireless communications including 2G/3G/4G/5G, etc., applied to the electronic device 100. The mobile communication module 104 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 104 can receive electromagnetic waves through the antenna 104A, and filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 104 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 104A.
[根据细则26改正 13.12.2024]
调制解调处理器可以包括调制器和解调器。[Corrected 13.12.2024 in accordance with Rule 26]
A modem processor may include a modulator and a demodulator.
[根据细则26改正 13.12.2024]
无线通信模块103可以提供应用在电子设备100上的包括无线局域网(wireless local area networks,WLAN),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块103经由天线103A接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器101。无线通信模块103还可以从处理器101接收待发送的信号,对其进行调频,放大,经天线103A转为电磁波辐射出去。[Corrected 13.12.2024 in accordance with Rule 26]
The wireless communication module 103 can provide wireless communication solutions including wireless local area networks (WLAN), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 103 receives electromagnetic waves via the antenna 103A, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 101. The wireless communication module 103 can also receive the signal to be sent from the processor 101, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 103A.
[根据细则26改正 13.12.2024]
电子设备100可以通过ISP,摄像头108,视频编解码器,GPU,显示屏109以及应用处理器等实现拍摄功能。[Corrected 13.12.2024 in accordance with Rule 26]
The electronic device 100 can realize the shooting function through the ISP, the camera 108, the video codec, the GPU, the display screen 109 and the application processor.
[根据细则26改正 13.12.2024]
ISP用于处理摄像头108反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感光元件上,光信号转换为电信号,摄像头感光元件将所述电信号传递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度,肤色进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些实施例中,ISP可以设置在摄像头108中。[Corrected 13.12.2024 in accordance with Rule 26]
The ISP is used to process the data fed back by the camera 108. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera 108.
[根据细则26改正 13.12.2024]
摄像头108可用于捕获静态照片或动态照片或视频。物体通过镜头生成光学图像投射到图像传感器。图像传感器可以把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP可以将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,电子设备100可以包括1个或N个摄像头193,N为大于1的正整数。[Corrected 13.12.2024 in accordance with Rule 26]
The camera 108 can be used to capture still photos or dynamic photos or videos. The object generates an optical image through the lens and projects it onto the image sensor. The image sensor can convert the optical signal into an electrical signal, and then transmit the electrical signal to the ISP to convert it into a digital image signal. The ISP can output the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[根据细则26改正 13.12.2024]
视频编解码器用于对数字图像压缩或解压缩。电子设备100可以支持一种或多种图像编解码器。这样,电子设备100代开或保存多种编码格式的图片或视频。[Corrected 13.12.2024 in accordance with Rule 26]
The video codec is used to compress or decompress digital images. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can open or save pictures or videos in multiple coding formats.
[根据细则26改正 13.12.2024]
电子设备100可以通过GPU,显示屏109,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏109和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器101可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。[Corrected 13.12.2024 in accordance with Rule 26]
The electronic device 100 can realize the display function through a GPU, a display screen 109, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 109 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 101 may include one or more GPUs, which execute program instructions to generate or change display information.
[根据细则26改正 13.12.2024]
显示屏109用于显示图像,视频等。显示屏109包括显示面板。在一些实施例中,电子设备100可以包括1个或N个显示屏109,N为大于1的正整数。[Corrected 13.12.2024 in accordance with Rule 26]
The display screen 109 is used to display images, videos, etc. The display screen 109 includes a display panel. In some embodiments, the electronic device 100 may include 1 or N display screens 109, where N is a positive integer greater than 1.
[根据细则26改正 13.12.2024]
可以理解的是,本发明实施例示意的结构并不构成对电子设备100的具体限定。在本申请另一些实施例中,电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。[Corrected 13.12.2024 in accordance with Rule 26]
It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[根据细则26改正 13.12.2024]
在本申请实施例中,摄像头108可用于采集图像。处理器101中的AP或GPU等可用于分析当前帧预览图像以获取该预览图像的标签,分析用户指定保存的图像以获取该图像的标签,还用于从多个图像中确定出推荐图像。处理器101中的AP或GPU等还可用于根据推荐图像生成视频。[Corrected 13.12.2024 in accordance with Rule 26]
In the embodiment of the present application, the camera 108 can be used to capture images. The AP or GPU in the processor 101 can be used to analyze the current frame preview image to obtain the label of the preview image, analyze the image saved by the user to obtain the label of the image, and determine the recommended image from multiple images. The AP or GPU in the processor 101 can also be used to generate a video based on the recommended image.
[根据细则26改正 13.12.2024]
存储器102可用于存储预览图像及该预览图像的标签,用户指定保存的图像以及该图像的标签,以及,基于推荐图像生成的视频。[Corrected 13.12.2024 in accordance with Rule 26]
The memory 102 may be used to store preview images and labels of the preview images, images saved as specified by the user and labels of the images, and videos generated based on recommended images.
[根据细则26改正 13.12.2024]
显示屏109可用于显示展示给用户的各类信息,如上述实施例提及的用户界面等。[Corrected 13.12.2024 in accordance with Rule 26]
The display screen 109 may be used to display various types of information for the user, such as the user interface mentioned in the above embodiment.
[根据细则26改正 13.12.2024]
显示屏109、摄像头108、麦克风等信息输入器件还可用于接收用户操作,电子设备可响应这些用户操作执行对应的功能。[Corrected 13.12.2024 in accordance with Rule 26]
Information input devices such as the display screen 109, the camera 108, and the microphone may also be used to receive user operations, and the electronic device may respond to these user operations and execute corresponding functions.
[根据细则26改正 13.12.2024]
无线通信模块103、移动通信模块104等可用于将电子设备基于推荐图像生成的视频分享至其他设备。[Corrected 13.12.2024 in accordance with Rule 26]
The wireless communication module 103 , the mobile communication module 104 , etc. may be used to share the video generated by the electronic device based on the recommended image to other devices.
[根据细则26改正 13.12.2024]
电子设备100中各器件所执行的操作,具体可参考前文方法实施例的相关描述,这里不再详细展开。[Corrected 13.12.2024 in accordance with Rule 26]
The operations performed by the various components in the electronic device 100 may be specifically referred to the relevant description of the above method embodiment, which will not be elaborated here.
[根据细则26改正 13.12.2024]
电子设备100的软件系统可以采用分层架构,事件驱动架构,微核架构,微服务架构,或云架构。本申请实施例以分层架构的移动操作系统为例,示例性说明电子设备100的软件结构。[Corrected 13.12.2024 in accordance with Rule 26]
The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The present application embodiment takes a mobile operating system with a layered architecture as an example to exemplify the software structure of the electronic device 100.
[根据细则26改正 13.12.2024]
图8是本申请实施例的电子设备100的软件结构框图。[Corrected 13.12.2024 in accordance with Rule 26]
FIG. 8 is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.
[根据细则26改正 13.12.2024]
分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将移动操作系统分为四层,从上至下分别为应用程序层,应用程序框架层/核心服务层,系统库和运行时,以及内核层。[Corrected 13.12.2024 in accordance with Rule 26]
The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the mobile operating system is divided into four layers, from top to bottom: application layer, application framework layer/core service layer, system library and runtime, and kernel layer.
[根据细则26改正 13.12.2024]
应用程序层可以包括一系列应用程序包。[Corrected 13.12.2024 in accordance with Rule 26]
The application layer can include a series of application packages.
[根据细则26改正 13.12.2024]
如图8所示,应用程序包可以包括相机,日历,通话,地图,导航,WLAN,蓝牙,音乐,视频,短信息等应用程序。应用程序层还可包括前文实施例提及的用于提供图像推荐功能的应用,如图库或其他的第三方应用。[Corrected 13.12.2024 in accordance with Rule 26]
As shown in Figure 8, the application package may include applications such as camera, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc. The application layer may also include the application for providing image recommendation function mentioned in the above embodiment, such as gallery or other third-party applications.
[根据细则26改正 13.12.2024]
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。[Corrected 13.12.2024 in accordance with Rule 26]
The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[根据细则26改正 13.12.2024]
如图8所示,应用程序框架层可以包括窗口管理器,内容提供器,视图系统,电话管理器,资源管理器,通知管理器等。[Corrected 13.12.2024 in accordance with Rule 26]
As shown in FIG. 8 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.
[根据细则26改正 13.12.2024]
窗口管理器用于管理窗口程序。[Corrected 13.12.2024 in accordance with Rule 26]
A window manager is used to manage window programs.
[根据细则26改正 13.12.2024]
内容提供器用来存放和获取数据,并使这些数据可以被应用程序访问。[Corrected 13.12.2024 in accordance with Rule 26]
Content providers are used to store and retrieve data and make it accessible to applications.
[根据细则26改正 13.12.2024]
视图系统包括可视控件,例如显示文字的控件,显示图片的控件等。[Corrected 13.12.2024 in accordance with Rule 26]
The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc.
[根据细则26改正 13.12.2024]
电话管理器用于提供电子设备的通信功能。[Corrected 13.12.2024 in accordance with Rule 26]
The phone manager is used to provide the communication function of the electronic device.
[根据细则26改正 13.12.2024]
资源管理器为应用程序提供各种资源,比如本地化字符串,图标,图片,布局文件,视频文件等等。[Corrected 13.12.2024 in accordance with Rule 26]
The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[根据细则26改正 13.12.2024]
通知管理器使应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。[Corrected 13.12.2024 in accordance with Rule 26]
The notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages and disappear automatically after a short stay without user interaction.
[根据细则26改正 13.12.2024]
运行时可以指程序运行时所需的一切代码库、框架等。[Corrected 13.12.2024 in accordance with Rule 26]
Runtime can refer to all code libraries, frameworks, etc. required for the program to run.
[根据细则26改正 13.12.2024]
系统库可以包括多个功能模块。例如:表面管理器(surface manager),媒体库(Media Libraries),三维图形处理库(例如:OpenGL ES),2D图形引擎(例如:SGL)等。[Corrected 13.12.2024 in accordance with Rule 26]
The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[根据细则26改正 13.12.2024]
表面管理器用于对显示子系统进行管理,并且为多个应用程序提供了2D和3D图层的融合。[Corrected 13.12.2024 in accordance with Rule 26]
The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[根据细则26改正 13.12.2024]
媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式,例如:MPEG4,H.264,MP3,AAC,AMR,JPG,PNG等。[Corrected 13.12.2024 in accordance with Rule 26]
The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[根据细则26改正 13.12.2024]
三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。[Corrected 13.12.2024 in accordance with Rule 26]
The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[根据细则26改正 13.12.2024]
2D图形引擎是2D绘图的绘图引擎。[Corrected 13.12.2024 in accordance with Rule 26]
A 2D graphics engine is a drawing engine for 2D drawings.
[根据细则26改正 13.12.2024]
内核层是硬件和软件之间的层。内核层至少包含显示驱动,摄像头驱动,音频驱动,传感器驱动。[Corrected 13.12.2024 in accordance with Rule 26]
The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
[根据细则26改正 13.12.2024]
应理解,上述方法实施例中的各步骤可以通过处理器中的硬件的集成逻辑电路或者软件形式的指令完成。结合本申请实施例所公开的方法步骤可以直接体现为硬件处理器执行完成,或者用处理器中的硬件及软件模块组合执行完成。[Corrected 13.12.2024 in accordance with Rule 26]
It should be understood that each step in the above method embodiment can be completed by an integrated logic circuit of hardware in a processor or by instructions in the form of software. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.
[根据细则26改正 13.12.2024]
本申请还提供一种电子设备,该电子设备可以包括:存储器和处理器。其中,存储器可用于存储计算机程序;处理器可用于调用所述存储器中的计算机程序,以使得该电子设备执行上述任意一个实施例中电子设备侧执行的方法。[Corrected 13.12.2024 in accordance with Rule 26]
The present application also provides an electronic device, which may include: a memory and a processor. The memory may be used to store a computer program; the processor may be used to call the computer program in the memory so that the electronic device executes the method executed by the electronic device side in any of the above embodiments.
[根据细则26改正 13.12.2024]
本申请还提供一种电子设备,该电子设备可以包括:存储器和处理器。其中,存储器可用于存储计算机程序;处理器可用于调用所述存储器中的计算机程序,以使得该电子设备执行上述任意一个实施例中电子设备侧执行的方法。[Corrected 13.12.2024 in accordance with Rule 26]
The present application also provides an electronic device, which may include: a memory and a processor. The memory may be used to store a computer program; the processor may be used to call the computer program in the memory so that the electronic device executes the method executed by the electronic device side in any of the above embodiments.
[根据细则26改正 13.12.2024]
本申请还提供了一种芯片系统,所述芯片系统包括至少一个处理器,用于实现上述任一个实施例中电子设备侧所涉及的功能。[Corrected 13.12.2024 in accordance with Rule 26]
The present application also provides a chip system, which includes at least one processor for implementing the functions involved in the electronic device side in any of the above embodiments.
[根据细则26改正 13.12.2024]
在一种可能的设计中,所述芯片系统还包括存储器,所述存储器用于保存程序指令和数据,存储器位于处理器之内或处理器之外。[Corrected 13.12.2024 in accordance with Rule 26]
In one possible design, the chip system also includes a memory, which is used to store program instructions and data, and the memory is located inside or outside the processor.
[根据细则26改正 13.12.2024]
该芯片系统可以由芯片构成,也可以包含芯片和其他分立器件。[Corrected 13.12.2024 in accordance with Rule 26]
The chip system may be composed of the chip, or may include the chip and other discrete devices.
[根据细则26改正 13.12.2024]
可选地,该芯片系统中的处理器可以为一个或多个。该处理器可以通过硬件实现也可以通过软件实现。当通过硬件实现时,该处理器可以是逻辑电路、集成电路等。当通过软件实现时,该处理器可以是一个通用处理器,通过读取存储器中存储的软件代码来实现。[Corrected 13.12.2024 in accordance with Rule 26]
Optionally, the processor in the chip system may be one or more. The processor may be implemented by hardware or by software. When implemented by hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented by software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.
[根据细则26改正 13.12.2024]
可选地,该芯片系统中的存储器也可以为一个或多个。该存储器可以与处理器集成在一起,也可以和处理器分离设置,本申请实施例并不限定。示例性地,存储器可以是非瞬时性处理器,例如只读存储器ROM,其可以与处理器集成在同一块芯片上,也可以分别设置在不同的芯片上,本申请实施例对存储器的类型,以及存储器与处理器的设置方式不作具体限定。[Corrected 13.12.2024 in accordance with Rule 26]
Optionally, the memory in the chip system may also be one or more. The memory may be integrated with the processor or may be separately arranged with the processor, which is not limited in the embodiments of the present application. Exemplarily, the memory may be a non-transient processor, such as a read-only memory ROM, which may be integrated with the processor on the same chip or may be arranged on different chips respectively. The embodiments of the present application do not specifically limit the type of memory and the arrangement of the memory and the processor.
[根据细则26改正 13.12.2024]
示例性地,该芯片系统可以是现场可编程门阵列(field programmable gate array,FPGA),可以是专用集成芯片(application specific integrated circuit,ASIC),还可以是系统芯片(system on chip,SoC),还可以是中央处理器(central processor unit,CPU),还可以是网络处理器(network processor,NP),还可以是数字信号处理电路(digital signal processor,DSP),还可以是微控制器(micro controller unit,MCU),还可以是可编程控制器(programmable logic device,PLD)或其他集成芯片。[Corrected 13.12.2024 in accordance with Rule 26]
Exemplarily, the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.
[根据细则26改正 13.12.2024]
本申请还提供一种计算机程序产品,所述计算机程序产品包括:计算机程序(也可以称为代码,或指令),当所述计算机程序被运行时,使得计算机执行上述任一个实施例中电子设备侧所执行的方法。[Corrected 13.12.2024 in accordance with Rule 26]
The present application also provides a computer program product, which includes: a computer program (also referred to as code, or instruction), which, when executed, enables a computer to execute the method executed by the electronic device side in any of the above embodiments.
[根据细则26改正 13.12.2024]
本申请还提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序(也可以称为代码,或指令)。当所述计算机程序被运行时,使得计算机执行上述任一个实施例中电子设备侧所执行的方法。[Corrected 13.12.2024 in accordance with Rule 26]
The present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program (also referred to as code or instruction). When the computer program is executed, the computer executes the method executed by the electronic device side in any of the above embodiments.
[根据细则26改正 13.12.2024]
本申请的各实施方式可以任意进行组合,以实现不同的技术效果。[Corrected 13.12.2024 in accordance with Rule 26]
The various implementation modes of the present application can be combined arbitrarily to achieve different technical effects.
[根据细则26改正 13.12.2024]
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线)或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如固态硬盘(solid state disk,SSD))等。[Corrected 13.12.2024 in accordance with Rule 26]
In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in this application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.
[根据细则26改正 13.12.2024]
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,该流程可以由计算机程序来指令相关的硬件完成,该程序可存储于计算机可读取存储介质中,该程序在执行时,可包括如上述各方法实施例的流程。而前述的存储介质包括:ROM或随机存储记忆体RAM、磁碟或者光盘等各种可存储程序代码的介质。[Corrected 13.12.2024 in accordance with Rule 26]
Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.
[根据细则26改正 13.12.2024]
总之,以上所述仅为本申请技术方案的实施例而已,并非用于限定本申请的保护范围。凡根据本申请的揭露,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。[Corrected 13.12.2024 in accordance with Rule 26]
In short, the above is only an embodiment of the technical solution of this application, and is not intended to limit the protection scope of this application. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of this application shall be included in the protection scope of this application.
Claims (26)
根据权利要求3-5任一项所述的方法,其特征在于,在所述第j预览图像帧的主体包含人物的情况下,确定所述第三分数,具体包括:[Corrected 13.12.2024 in accordance with Rule 26]
The method according to any one of claims 3 to 5, characterized in that, when the subject of the j-th preview image frame includes a person, determining the third score specifically comprises:
根据权利要求6或7所述的方法,其特征在于,所述第i张人脸和所述电子设备之间的距离不同时,相同的所述第i张人脸的大小对应不同的sb。[Corrected 13.12.2024 in accordance with Rule 26]
The method according to claim 6 or 7, characterized in that when the distance between the i-th face and the electronic device is different, the same size of the i-th face corresponds to different s b .
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310558291.5A CN117688196B (en) | 2023-05-17 | 2023-05-17 | Image recommendation method and related device |
CN202310558291.5 | 2023-05-17 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2024234800A1 WO2024234800A1 (en) | 2024-11-21 |
WO2024234800A9 true WO2024234800A9 (en) | 2025-01-16 |
Family
ID=90125171
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2024/081113 WO2024234800A1 (en) | 2023-05-17 | 2024-03-12 | Image recommendation method and related apparatus |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN117688196B (en) |
WO (1) | WO2024234800A1 (en) |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6401121B2 (en) * | 2015-07-29 | 2018-10-03 | 富士フイルム株式会社 | RECOMMENDATION DEVICE, RECOMMENDATION METHOD, PROGRAM, AND RECORDING MEDIUM |
CN110786002B (en) * | 2018-07-24 | 2022-02-25 | 深圳市大疆创新科技有限公司 | Video processing method, device and computer readable storage medium |
CN109005350A (en) * | 2018-08-30 | 2018-12-14 | Oppo广东移动通信有限公司 | Image repeated shooting prompting method and device, storage medium and mobile terminal |
CN109634535A (en) * | 2018-10-30 | 2019-04-16 | 深圳市赛亿科技开发有限公司 | Data processing method and system in a kind of photo-printer print procedure |
KR102665654B1 (en) * | 2019-02-19 | 2024-05-14 | 삼성전자주식회사 | Electronic device for recommending composition and operating method thereof |
CN112866557A (en) * | 2019-11-28 | 2021-05-28 | 荣耀终端有限公司 | Composition recommendation method and electronic device |
CN112036277B (en) * | 2020-08-20 | 2023-09-29 | 浙江大华技术股份有限公司 | Face recognition method, electronic equipment and computer readable storage medium |
CN114697530B (en) * | 2020-12-31 | 2023-11-10 | 华为技术有限公司 | Photographing method and device for intelligent view finding recommendation |
CN114827445B (en) * | 2021-01-29 | 2023-09-01 | 华为技术有限公司 | Image processing method and related device |
CN113377971B (en) * | 2021-05-31 | 2024-02-27 | 北京达佳互联信息技术有限公司 | Multimedia resource generation method and device, electronic equipment and storage medium |
CN116955680A (en) * | 2021-07-29 | 2023-10-27 | 福建榕基软件工程有限公司 | Shooting composition scheme generation method and terminal |
-
2023
- 2023-05-17 CN CN202310558291.5A patent/CN117688196B/en active Active
-
2024
- 2024-03-12 WO PCT/CN2024/081113 patent/WO2024234800A1/en unknown
Also Published As
Publication number | Publication date |
---|---|
CN117688196B (en) | 2024-12-27 |
WO2024234800A1 (en) | 2024-11-21 |
CN117688196A (en) | 2024-03-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021190078A1 (en) | Method and apparatus for generating short video, and related device and medium | |
US9798464B2 (en) | Computing device | |
US10811050B2 (en) | Highlighting media through weighting of people or contexts | |
EP3195601B1 (en) | Method of providing visual sound image and electronic device implementing the same | |
WO2017157272A1 (en) | Information processing method and terminal | |
CN111930994A (en) | Video editing processing method and device, electronic equipment and storage medium | |
US11792504B2 (en) | Personalized videos | |
US10541000B1 (en) | User input-based video summarization | |
WO2022022262A1 (en) | Processing method for multimedia resource, publishing method and electronic device | |
CN114827342B (en) | Video processing method, electronic device and readable medium | |
US20160111128A1 (en) | Creating composition of content captured using plurality of electronic devices | |
US20240171701A1 (en) | Image obtaining method and electronic device | |
WO2021031733A1 (en) | Method for generating video special effect, and terminal | |
WO2022012299A1 (en) | Display device and person recognition and presentation method | |
CN113852757B (en) | Video processing method, device, equipment and storage medium | |
WO2022078172A1 (en) | Display device and content display method | |
US20240314400A1 (en) | Content display method, apparatus, device and medium | |
US12401890B2 (en) | Photographing method and electronic device | |
CN116347009B (en) | Video generation method and electronic device | |
WO2024234800A9 (en) | Image recommendation method and related apparatus | |
CN115883958A (en) | Portrait shooting method | |
CN113873319A (en) | Video processing method and device, electronic equipment and storage medium | |
CN115515008B (en) | Video processing method, terminal and video processing system | |
US20250047969A1 (en) | Providing a template for media content generation | |
CN117812377A (en) | Display device and intelligent editing method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 24806160 Country of ref document: EP Kind code of ref document: A1 |