WO2015134660A1 - Systems and methods for previewing beauty cosmetic applications using an electronic device - Google Patents

Abstract

Systems and methods for previewing beauty cosmetic application through an integrated application of an electronic device such as, but not limited to, a smartphone or tablet computer. A representative picture is selected, a desired portion of the picture is identified to apply a cosmetic, a color is selected from a color palette, and the selected color is applied to the desired portion of the picture.

Description

SYSTEMS AND METHODS FOR PREVIEWING BEAUTY COSMETIC

APPLICATIONS USING AN ELECTRONIC DEVICE

This application claims priority to U.S. Non-Provisional Patent Application 14/196,615, filed March 4, 2014 and entitled: "Systems and Methods for Previewing Beauty Cosmetic Applications Using an Electronic Device", the contents of which are expressly incorporated herein by reference.

BACKGROUND

[0001] Accenting human body appearances or coordinating clothing outfits with beauty

cosmetics such as but not limited to, lipstick, mascara, blush, eye shadow and hair coloring can be a time intensive and expense task. In particular, users either trial beauty cosmetics at the point of sale or purchase them for later use and evaluation. Typically, users review what different merchants offer, compare the offered merchandise with what users already own, and review the latest trends. Some users may also wish to identify availability of merchandise. In addition to the pitfalls of actually trying the product due time and expense, some beauty cosmetics may have undesirable lasting effects on the user such as allergic reactions or not being easily removable.

SUMMARY

[0002] The disclosure is directed to systems and methods for previewing beauty cosmetic

application in accordance with some embodiments of the invention. In particular, the disclosure is directed to previewing application of cosmetics through an integrated application of an electronic device such as, but not limited to, a smartphone or tablet computer. The integrated application may also be operative to interface with one or more cosmetic provider systems to provide access to different services and different information available from the cosmetic providers. For example, the integrated application may connect to servers available from one or more stores or cosmetic providers to receive data reflecting their latest collections. The integrated application may also receive recommendations from cosmetic providers regarding recommended combinations of merchandise. [0003] In some embodiments, the user can use the integrated application to select a picture from a photo gallery in the electronic device or accessible in cloud based storage, or allow the user to take a photo and then "try on" various beauty cosmetic colors from a palette of options. By way of example and not limitation, the picture size and orientation may be user adjusted with finger rotate, pinch and zoom features of the electronic device to frame the picture in a desirable fashion. Once the selected picture is desirably adjusted, the user may lock the picture so that the integrated application can identify and outline the body feature (e.g. lips or eyes) to which the beauty cosmetic appearances are to be trialed.

[0004] In some embodiments, the feature outline may be manually "fine-tuned" by the user by touching and dragging discrete points forming the feature outline.

[0005] In some embodiments, the integrated application may include a pre-loaded palette colors with various shades for different skin tones.

[0006] In some embodiments, the integrated application may permit the user to take a picture of makeup of choice and use an eyedropper tool or similarly functioning tool to select a color from the picture to trial on the selected body feature.

[0007] In some embodiments, the integrated application may permit the user to choose a picture from an photo gallery stored on the electronic device or accessible in cloud based storage, and select a color with the eyedropper or similarly functioning tool.

[0008] In some embodiments, the integrated application may permit the user to select a color choose from a color spectrum wheel for application to the body feature.

[0009] In some embodiments, the integrated application may permit the user to add gloss to the selected color to make the appearance sheerer.

[0010] In some embodiments, the integrated application may permit the user to bookmark a

selected color as a favorite library.

[0011] In some embodiments, the integrated application may permit the user to share the image via email. [0012] In some embodiments, the integrated application may permit the user to share the image via social media.

[0013] In some embodiments, the integrated application can provide functions to attract or entice a user to view a particular cosmetic provider. For example, through the integrated application, a user can be provided with promotions and invitations to special events, access product availability, access a store locator, and are provided with opportunities to pre-order and reserve cosmetic items. In some embodiments, the integrated application can provide enhanced cosmetic item information to a user. For example, a user may scan an advertisement including a barcode, embedded pixel pattern, or other information- including pattern with an electronic device. As another example, social networking features can be provided by allowing a user to share different look collections created by combining various cosmetic items. These collections may then be provided to a social website or otherwise shared such that friends and acquaintances can provide feedback on the collections.

[0014] In some embodiments, the integrated application can provide a user with sales assistance.

For example, cosmetic items in the store may include an optical pattern (e.g., a barcode). A use may then scan the optical pattern to obtain additional information or features associated with that cosmetic item. For example, the optical pattern may be scanned by taking a digital image of the price tag with a camera of the user's electronic device. By analyzing the digital image of the optical pattern, the integrated application may access information associated with the cosmetic item such as ratings, availability, comparisons (e.g., price comparisons of the same or similar items from other cosmetic providers or other store locations), outfit recommendations, and other suitable features.

[0015] In some embodiments, the integrated application can provide a user with up-selling and cross-selling opportunities. For example, the integrated application may access a database of cosmetic items currently owned by the user. Based on that database, the integrated application may locate cosmetic items available for purchase from one or more cosmetic providers that can be matched with the user's currently owned cosmetic items to produce an outfit. These matching cosmetic items may then be recommended to the user for purchasing.

[0016] In some embodiments, the integrated application can provide a user with post-purchase opportunities. For example, the user can be provided with opportunities to rate and review a store, a cosmetic provider, a cosmetic item, or any combination of the above. As another example, an interface can be providing allowing a user to mix-and-match currently purchased cosmetic items to build outfits. As another example, using historical data to identify buying trends of a particular user, cosmetic providers can deliver personalized notifications directly to the user's electronic device.

BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The above and other features of the present invention, its nature and various advantages will be more apparent upon consideration of the following detailed description, taken in conjunction with the accompanying drawings in which:

[0018] FIG. 1 is a block diagram of an illustrative electronic device for previewing application of beauty cosmetics in accordance with some embodiments of the invention;

[0019] FIG. 2 is a flow diagram of an exemplary but not exclusive method for previewing

application of beauty cosmetics using an electronic device, practiced in accordance with some embodiments of the invention;

[0020] FIG. 3 is an exemplary but not exclusive screen shot of an illustrative electronic device executing the integrated application for previewing cosmetic application in accordance with some embodiments of the invention;

[0021] FIG. 4 is another exemplary but not exclusive screen shot of an illustrative electronic device executing the integrated application for previewing cosmetic application in accordance with some embodiments of the invention; and,

[0022] FIG. 5 is another exemplary but not exclusive screen shot of an illustrative electronic device executing the integrated application for previewing cosmetic application in accordance with some embodiments of the invention. DETAILED DESCRIPTION

[0023] FIG. 1 is a block diagram of an illustrative but not limiting electronic device for

providing an application operative for previewing application of beauty cosmetics in accordance with some embodiments of the invention. Electronic device 100 can include control circuitry 102, storage 104, memory 106, input/output ("1/0") circuitry 108, and communications circuitry 110. In some embodiments, one or more of the components of electronic device 100 can be combined or omitted (e.g., storage 104 and memory 106 may be combined). In some embodiments, electronic device 100 can include other components not combined or included in those shown in FIG. 1 (e.g., motion detection components, a power supply such as a battery or kinetics, a display, bus, a positioning system, a camera, an input mechanism, etc.), or several instances of the components shown in FIG. 1. For the sake of simplicity, only one of each of the components is shown in FIG. 1.

[0024] Electronic device 100 can include any suitable type of electronic device. For example, electronic device 100 can include a portable electronic device that the user may hold in his or her hand, such as a smartphone (e.g., an iPhone made available by Apple Inc. of Cupertino, Calif, or an Android device such as those produced and sold by Samsung). As another example, electronic device 100 can include a larger portable electronic device, such as a tablet or laptop computer. As yet another example, electronic device 100 can include a substantially fixed electronic device, such as a desktop computer.

[0025] Control circuitry 102 can include any processing circuitry or processor operative to

control the operations and performance of electronic device 100. For example, control circuitry 102 can be used to run operating system applications, firmware applications, media playback applications, media editing applications, or any other application. In some embodiments, control circuitry 102 can drive a display and process inputs received from a user interface.

[0026] Storage 104 can include, for example, one or more storage mediums including a hard- drive, solid state drive, flash memory, permanent memory such as ROM, any other suitable type of storage component, or any combination thereof. Storage 104 can store, for example, media data (e.g., music and video files), application data (e.g., for implementing functions on electronic device 100), firmware, user preference information data (e.g., media playback preferences), authentication information (e.g. libraries of data associated with authorized users), lifestyle information data (e.g., food preferences), exercise information data (e.g., information obtained by exercise monitoring equipment), transaction information data (e.g., information such as credit card information), wireless connection information data (e.g., information that can enable electronic device 100 to establish a wireless connection), subscription information data (e.g., information that keeps track of podcasts or television shows or other media a user subscribes to), contact information data (e.g., telephone numbers and email addresses), calendar information data, and any other suitable data or any combination thereof.

[0027] Memory 106 can include cache memory, semi-permanent memory such as RAM, and/or one or more different types of memory used for temporarily storing data. In some embodiments, memory 106 can also be used for storing data used to operate electronic device applications, or any other type of data that can be stored in storage 104. In some embodiments, memory 106 and storage 104 can be combined as a single storage medium.

[0028] I/O circuitry 108 can be operative to convert (and encode/decode, if necessary) analog signals and other signals into digital data. In some embodiments, I/O circuitry 108 can also convert digital data into any other type of signal, and vice-versa. For example, I/O circuitry 108 can receive and convert physical contact inputs (e.g., from a multi-touch screen), physical movements (e.g., from a mouse or sensor), analog audio signals (e.g., from a microphone), or any other input. The digital data can be provided to and received from control circuitry 102, storage 104, memory 106, or any other component of electronic device 100. Although I/O circuitry 108 is illustrated in FIG. 1 as a single component of electronic device 100, several instances of I/O circuitry 108 can be included in electronic device 100.

[0029] Electronic device 100 can include any suitable interface or component for allowing a user to provide inputs to I/O circuitry 108. For example, electronic device 100 can include any suitable input mechanism, such as for example, a button, keypad, dial, a click wheel, or a touch screen. In some embodiments, electronic device 100 can include a capacitive sensing mechanism, or a multi-touch capacitive sensing mechanism.

[0030] In some embodiments, electronic device 100 can include specialized output circuitry associated with output devices such as, for example, one or more audio outputs. The audio output can include one or more speakers (e.g., mono or stereo speakers) built into electronic device 100, or an audio component that is remotely coupled to electronic device 100 (e.g., a headset, headphones or earbuds that can be coupled to

communications device with a wire or wirelessly).

[0031] In some embodiments, I/O circuitry 108 can include display circuitry (e.g., a screen or projection system) for providing a display visible to the user. For example, the display circuitry can include a screen (e.g., an LCD screen) that is incorporated in electronics device 100. As another example, the display circuitry can include a movable display or a projecting system for providing a display of content on a surface remote from electronic device 100 (e.g., a video projector). In some embodiments, the display circuitry can include a coder/decoder (CODEC) to convert digital media data into analog signals. For example, the display circuitry (or other appropriate circuitry within electronic device 100) can include video CODECs, audio CODECs, or any other suitable type of CODEC.

[0032] The display circuitry also can include display driver circuitry, circuitry for driving

display drivers, or both. The display circuitry can be operative to display content (e.g., media playback information, application screens for applications implemented on the electronic device, information regarding ongoing communications operations, information regarding incoming communications requests, or device operation screens) under the direction of control circuitry 102. Alternatively, the display circuitry can be operative to provide instructions to a remote display.

[0033] Communications circuitry 110 can include any suitable communications circuitry

operative to connect to a communications network and to transmit communications (e.g., voice or data) from electronic device 100 to other devices within the communications network. Communications circuitry 110 can be operative to interface with the communications network using any suitable communications protocol such as, for example, Wi-Fi (e.g., a 802.11 protocol), Bluetooth., radio frequency systems (e.g., 900 MHz, 1.4 GHz, and 5.6 GHz communication systems), infrared, GSM, GSM plus EDGE, CDMA, LTE and other cellular protocols, VOIP, or any other suitable protocol.

[0034] In some embodiments, communications circuitry 110 can be operative to create a

communications network using any suitable communications protocol. For example, communications circuitry 110 can create a short-range communications network using a short-range communications protocol to connect to other devices. For example, communications circuitry 110 can be operative to create a local communications network using the Bluetooth protocol to couple electronic device 100 with a Bluetooth headset.

[0035] Electronic device 100 can include one more instances of communications circuitry 110 for simultaneously performing several communications operations using different communications networks, although only one is shown in FIG. 1 to avoid

overcomplicating the drawing. For example, electronic device 100 can include a first instance of communications circuitry 110 for communicating over a cellular network, and a second instance of communications circuitry 110 for communicating over Wi-Fi or using Bluetooth. In some embodiments, the same instance of communications circuitry 110 can be operative to provide for communications over several communications networks.

[0036] In some embodiments, electronic device 100 can be coupled a host device for data

transfers, synching the communications device, software or firmware updates, providing performance information to a remote source (e.g., providing riding characteristics to a remove server) or performing any other suitable operation that can require electronic device 100 to be coupled to a host device. Several electronic devices 100 can be coupled to a single host device using the host device as a server. Alternatively or additionally, electronic device 100 can be coupled to several host devices (e.g., for each of the plurality of the host devices to serve as a backup for data stored in electronic device 100).

[0037] In some embodiments, an electronic device (e.g., electronic device 100 of FIG. 1) may include an integrated application operative to interface with a cosmetic provider system to provide access to different cosmetic items and services made available by the cosmetic provider. As used herein, the term "cosmetic provider" can refer to a merchant, a shop (e.g., a physical store, an on-line store, or both), or to any other entity suitable for providing cosmetic items to a user. By way of example and not limitation, the cosmetic items can include for example, lipstick, lip gloss, lip liner, lip plumper, lip balm, lip conditioner, lip primer, lip booster, lip glazes and glosses, foundations, concealers, rouge, blush or blusher, eyeliner, eye shadows, hair coloring, and nail polish.

[0038] In some embodiments, a single, integrated application of the electronic device can be used to provide the access to the different services and cosmetic items of a cosmetic provider. For example, the single, integrated application can allow the cosmetic provider to attract customers by sending promotions directly to a user, can provide a store locator so a user can easily locate the cosmetic provider, or otherwise can attract a user to the cosmetic provider. As another example, the integrated application can provide a user with enhanced information regarding the cosmetic items of a cosmetic provider by allowing a user to monitor trends of cosmetic items, scan a tag of a cosmetic item with the user's electronic device to access additional information regarding the cosmetic item, and the like. As yet another example, the integrated application can provide a user with in-store sales assistance (e.g., by providing availability information of a desired cosmetic item) and can provide a user with post-purchase opportunities (e.g., by sending bounce back offers to a customer). In this manner, through an integrated application, a provider can maintain a constant connection between themselves and the user.

[0039] Reference is now made to FIG. 2, a flow diagram of an exemplary but not exclusive

method for previewing application of beauty cosmetics using an electronic device along with FIGs 3 and 4 that depict exemplary but not exclusive screen shots of an illustrative electronic device executing the integrated application for previewing cosmetic application in accordance with some embodiments of the invention.

[0040] At step 200 in FIG 2, the integrated application prompts the user to either select a picture from a photo gallery in the electronic device or cloud based storage, or the user can take a self-portrait photo (i.e. "selfie") for "trying on" various beauty cosmetic colors from a palette of options. It should be noted that while FIGs 3 and 4 depict lips as the exemplary body part, those skilled in the art will readily recognize other parts (e.g. cheeks, eyes, ears and hair) without departing from the scope and spirit of the present invention. Preferably, the picture 300 is a high resolution (e.g. megapixel in size or greater), brightly lit, and forward- facing picture. As depicted is FIGs. 3 and 4, preferably the lips are to be closed. In some embodiments the picture may be rotated and in some embodiments the picture may be a side angle.

[0041] At step 202, the picture 300 maybe manually adjusted in size and orientation by

preferably using the touch screen on the electronic device and pinch to zoom and using fingers to rotate the image to the desired dimensions and orientation. If the picture is satisfactory at step 204, then the "USE" button in the title bar is tapped by the user at step 206 to accept the settings and lock the selected picture. Otherwise, the user repeats step 202 to manually adjust the picture size and orientation or alternatively, may obtain a new picture from step 200.

[0042] At step 208, the integrated application identifies the desired body part to apply the

cosmetic - which in the exemplary embodiment is the lips. Using facial recognition technology, the app identifies the outline of the lips. In one embodiment the outline is demarcated with a series of straight lines that may be referred to as the lip lines, and may be connected by several small circles. At step 210, the lip lines may be adjusted by touching and dragging the circles (FIG. 3) so that the lines better match the edges of the natural lip lines. At step 212, the Lip Line Guide lock at the bottom of the screen is set by the user after final adjustments.

[0043] The lipstick compact icon in the top left corner (Figs. 3 and 4) or similarly functioning icon or control is tapped or engaged to display color palettes at step 214, which may include two or more color palettes. In one embodiment, the integrated application is preloaded with shades of different skin tones. In one embodiment the integrated application is pre-loaded with different shades of make-up. By tapping a color from the preloaded palette, the shade is applied to the lips in the picture. The palette can be dragged up and down to view additional colors. [0044] A customized palette can be created in several ways. A picture including the desired color can be taken and the eyedropper tool or other similarly functioning tool may be used to select the color from the picture for addition to the customized palette.

Alternatively, the eyedropper tool can be used to select a color from an existing picture from within the image gallery. A color spectrum wheel can also be used to select a color. With each option, the selected color can be previewed on the screen and the Apply button or similarly functioning button selected to add the selection to the custom color palette. In addition to color palettes, it is contemplated that those skilled in the art will appreciate that texture palettes may be provided as well.

[0045] The lips icon, or similarly functioning icon or control, in the upper right corner (or other accessible location in the app) open more options. In this menu, the user may have the option of one or more of the following:

• Start Over (select a new image)

• Clear Color

• Add Gloss to make the color appear more sheer

• the color can be bookmarked to a favorite library

• Save the image to your device gallery

• Share the image via email or social media (e.g. Facebook or Twitter)

• Return to the main screen (Home)

[0046] When a color in the Try On Color section is bookmarked, it may be added to the Favorite Shades library. Here, a user can view their favorite colors for easy. A user also may note whether they have or want the color, and may optionally provide a ranking, for instance, of one to five stars. If necessary to edit or clean up the Favorite Shades library, a user may simply tap the Edit button in the title bar (or similarly functioning tool in an accessible location) and use the delete icon to remove any colors no longer wanted.

[0047] Social Media - a user may apply a kiss to a photo in their favorite lipstick color and send it via email to a friend, a loved one, or a special crush. In this embodiment the user may select a photo from the device gallery, or take a picture with the device camera. Once the user has selected an image, they may engage controls, for instance, such as by tapping the lips icon in the upper left column to open the color and lips drawer. Tap to select the color, then tap on the lip print style the user wants to use for their kiss. The kiss print will appear somewhere on the picture. Drag it to the desired position, pinch and zoom to make the lips larger or smaller, and use two fingers to rotate the angle of the lip print.

[0048] Engage additional controls, for instance by tapping the envelope icon in the top right part of the title bar to open the secondary menu. Here, a user can:

• Start Over (choose a new image)

• Clear Color

• Save the image to their device gallery

• Share the image with the kiss print via email, Facebook or Twitter

• Return to the main screen (Home)

[0049] To interface with the cosmetic provider, the integrated application can use any suitable approach. In some embodiments, the electronic device can securely connect to one or more servers associated with the cosmetic provider (e.g., through communication circuitry 110 of FIG. 1). For example, the integrated application can connect to servers available from one or more stores or high cosmetic providers to receive data reflecting their cosmetic items. The received data can include information such as, for example, cosmetic item sizes, cosmetic item colors, cosmetic item prices, cosmetic item styles, availability of cosmetic items, or any other suitable information. As another example, the integrated application can connect to the servers to receive recommendations from cosmetic providers regarding recommended combinations of cosmetic items. In some embodiments, the integrated application can allow a user to connect to the cosmetic provider's server through a secure connection to perform transactions (e.g., using a credit card). In this manner, a user may, for example, pay for or reserve a particular cosmetic item of the cosmetic provider.

[0050] To provide for social networking features, the user catalogue may be accessible by a social website such as an on-line blog, a news-feed, a personal news-feed (e.g., Twitter), a social networking site (e.g., Facebook), or any other suitable social website. Acquaintances, friends, or other members of the social website may then access the user's collection to view the collection, provide feedback on the collection (e.g., comment on cosmetic items they like or dislike, rate cosmetic items, or provide other suitable feedback), provide recommendations (e.g., recommend cosmetic items to complete an outfit), and the like.

[0051] The processes discussed above are intended to be illustrative and not limiting. Persons skilled in the art will appreciate that steps of the process discussed herein can be omitted, modified, combined, or rearranged, and any additional steps can be performed without departing from the scope of the invention.

[0052] The inventions can be implemented by software, but can also be implemented in

hardware or a combination of hardware and software. The invention can also be embodied as computer-readable code on a computer-readable medium. The computer- readable medium can include any data storage device that can store data which can thereafter be read by a computer system. Examples of the computer readable medium include read-only memory ("ROM"), random-access memory ("RAM"), CD-ROMs, DVDs, magnetic tape, optical data storage device, flash storage devices, or any other suitable storage devices. The computer-readable medium can also be distributed over network coupled computer systems.

[0053] Insubstantial changes from the claimed subject matter as viewed by a person with

ordinary skill in the art, now known or later devised, are expressly contemplated as being equivalently within the scope of this disclosure. Therefore, obvious substitutions now or later known to one with ordinary skill in the art are defined to be within the scope of the defined elements.

[0054] The above-described embodiments of the present invention are presented for purposes of illustration and not of limitation.

Claims

CLAIMS What is claimed is:

1. On an electronic device, a method for viewing application of a cosmetic comprising:

selecting a picture representative of a test subject matter;

identifying a desired portion on the test subject matter to apply the cosmetic;

selecting a color from a color palette to apply to the desired portion on the test subject matter; and,

applying the selected color to the desired portion on the test subject matter.

2. The method of claim 1, wherein the step of selecting a picture representative of a test subject matter is obtaining a picture from a gallery.

3. The method of claim 2, wherein the gallery is stored on the electronic device.

4. The method of claim 2, wherein the gallery is stored on cloud based storage.

5. The method of claim 1, wherein the step of selecting a picture representative of a test subject matter is obtaining a picture by taking a picture with a camera.

6. The method of claim 1, further comprising a step of adjusting size and orientation of the picture representative of the test subject matter prior to the step of identifying a desired portion on the test subject matter to apply the cosmetic.

7. The method of claim 6, wherein the step of adjusting size and orientation is pinch to zoom and using fingers to rotate the picture on a screen of the electronic device.

8. The method of claim 1 , wherein the desired portion on the test subject matter are lips.

9. The method of claim 1, wherein the desired portion on the test subject matter are cheeks.

10. The method of claim 1, wherein the step of identifying a desired portion on the test subject matter to apply the cosmetic further comprises manually adjusting an outline of the desired portion on the test subject matter.

11. The method of claim 1 further comprising a step of providing a preloaded color palette.

12. The method of claim 1 further comprising a step of creating a custom color palette.

13. The method of claim 12, wherein the step of creating a custom color palette is using an

eyedropper tool to select a color from a gallery picture.

14. An electronic device for previewing application of cosmetics, the electronic device

comprising: a processor operable to run an integrated application providing functions to select a picture representative of a test subject matter; identify a desired portion on the test subject matter to apply the cosmetic; select a color from a color palette to apply to the desired portion on the test subject matter; and, apply the selected color to the desired portion on the test subject matter.

15. The electronic device of claim 14, wherein the electronic device comprises a portable

electronic device.

16. The electronic device of claim 14, wherein the processor is further operable to bookmark a favorite color to a library.

17. The electronic device of claim 16, wherein the processor is further operable to apply a kiss symbol to a photo in the favorite color and send the photo via email.

18. The electronic device of claim 14, further comprising an integrated camera.

19. The electronic device of claim 14, wherein the processor is further operable to add gloss to make the color appear sheerer.

20. Machine-readable media previewing application of cosmetics, the machine-readable media comprising machine-readable instructions recorded thereon for: selecting a picture representative of a test subject matter;

identifying a desired portion on the test subject matter to apply the cosmetic;

selecting a color from a color palette to apply to the desired portion on the test subject matter; and,

applying the selected color to the desired portion on the test subject matter.