TWI838887B - Artificial intelligence importing personal photo background color recommendation system and method thereof - Google Patents
Artificial intelligence importing personal photo background color recommendation system and method thereof Download PDFInfo
- Publication number
- TWI838887B TWI838887B TW111136799A TW111136799A TWI838887B TW I838887 B TWI838887 B TW I838887B TW 111136799 A TW111136799 A TW 111136799A TW 111136799 A TW111136799 A TW 111136799A TW I838887 B TWI838887 B TW I838887B
- Authority
- TW
- Taiwan
- Prior art keywords
- color
- module
- personal photo
- artificial intelligence
- learning model
- Prior art date
Links
- 238000013473 artificial intelligence Methods 0.000 title claims abstract description 86
- 238000000034 method Methods 0.000 title claims abstract description 21
- 238000013136 deep learning model Methods 0.000 claims abstract description 71
- 238000012545 processing Methods 0.000 claims abstract description 33
- 238000003672 processing method Methods 0.000 claims abstract description 12
- 239000003086 colorant Substances 0.000 claims description 47
- 238000013528 artificial neural network Methods 0.000 claims description 42
- 238000012549 training Methods 0.000 claims description 19
- 238000005516 engineering process Methods 0.000 claims description 15
- 238000013139 quantization Methods 0.000 claims description 8
- 238000004891 communication Methods 0.000 claims description 3
- 239000000284 extract Substances 0.000 claims 1
- 230000002349 favourable effect Effects 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 8
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 4
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 4
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000005457 optimization Methods 0.000 description 4
- 101000827703 Homo sapiens Polyphosphoinositide phosphatase Proteins 0.000 description 3
- 102100023591 Polyphosphoinositide phosphatase Human genes 0.000 description 3
- 210000004209 hair Anatomy 0.000 description 3
- 210000003061 neural cell Anatomy 0.000 description 3
- 230000001737 promoting effect Effects 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 235000000177 Indigofera tinctoria Nutrition 0.000 description 1
- 101100233916 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) KAR5 gene Proteins 0.000 description 1
- BQCADISMDOOEFD-UHFFFAOYSA-N Silver Chemical compound [Ag] BQCADISMDOOEFD-UHFFFAOYSA-N 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 210000000720 eyelash Anatomy 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 1
- 229910052737 gold Inorganic materials 0.000 description 1
- 239000010931 gold Substances 0.000 description 1
- 239000000118 hair dye Substances 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 229940097275 indigo Drugs 0.000 description 1
- COHYTHOBJLSHDF-UHFFFAOYSA-N indigo powder Natural products N1C2=CC=CC=C2C(=O)C1=C1C(=O)C2=CC=CC=C2N1 COHYTHOBJLSHDF-UHFFFAOYSA-N 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 229910052709 silver Inorganic materials 0.000 description 1
- 239000004332 silver Substances 0.000 description 1
- 238000005728 strengthening Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Landscapes
- Image Processing (AREA)
Abstract
Description
本發明係有關一種個人照片背景顏色推薦技術,特別是指一種人工智慧(Artificial Intelligence;AI)導入個人照片背景顏色推薦系統及其方法。 The present invention relates to a personal photo background color recommendation technology, and in particular to an artificial intelligence (AI)-introduced personal photo background color recommendation system and method thereof.
使用者之個人照片(如大頭照片/上半身照片/全身照片)可廣泛作成履歷(求職)照片、交友照片、升學(招生)照片、網路照片、選舉照片、名片照片等,亦能運用於求職履歷、人力銀行、交友軟體、宣傳(廣告)網站、選舉看板、個人服務等各種不同用途上,且研究報告指出觀看者僅需於短暫時間(如100毫秒)內觀看個人照片之陌生面孔便能形成印象及特徵之判斷,故個人照片對於面試者、交友對象、網路用戶、選民等不同觀看者之良好印象甚為重要。 The user's personal photos (such as headshots/upper body photos/full body photos) can be widely used as resume (job search) photos, social photos, further education (enrollment) photos, network photos, election photos, business card photos, etc., and can also be used in various purposes such as job search resumes, human resources banks, dating software, promotional (advertising) websites, election billboards, personal services, etc., and research reports point out that viewers only need to look at unfamiliar faces in personal photos for a short time (such as 100 milliseconds) to form an impression and feature judgment, so personal photos are very important for different viewers such as interviewers, dating targets, Internet users, voters, etc. to leave a good impression.
以個人照片作成履歷照片為例,依據求職網站(如104或1111人力銀行)之說明,公司之人資主管常常必須從數量龐大之履歷表中篩選出 有潛力之求職者,而履歷表中之個人照片(履歷照片)便容易成為人資主管決定是否面試或考慮求職者之一重要因素。 Taking the example of using personal photos as resume photos, according to the description of job search websites (such as 104 or 1111 job banks), company HR managers often have to screen out potential job seekers from a large number of resumes, and the personal photo (resume photo) in the resume can easily become an important factor for HR managers to decide whether to interview or consider job seekers.
又,現今之個人照片大多是由攝像館所拍攝或由使用者自行拍攝而產生,但目前並無相關研究提出如何優化個人照片之背景顏色以提升觀看者之視覺印象,亦無相關技術針對個人照片之產出提出背景顏色之改善或建議方法。 In addition, most personal photos today are taken by photo studios or by users themselves, but there is currently no relevant research on how to optimize the background color of personal photos to enhance the viewer's visual impression, nor is there any relevant technology to improve or recommend methods for the production of background colors for personal photos.
再者,個人照片給予觀看者不同之印象或形象可追溯至使用色彩系統或色彩學之理論,且色彩系統或色彩學是用科學量化之方式定義色彩,以方便使用者進行精確與客觀之應用,但各種色彩系統會有不同產業特性或定義方式而各自發展出相異之優點及特色。 Furthermore, the different impressions or images that personal photos give to viewers can be traced back to the theory of using color systems or color science. Color systems or color science define colors in a scientific and quantitative way to facilitate users to apply them accurately and objectively. However, various color systems have different industry characteristics or definition methods and have developed different advantages and characteristics.
另外,色彩調和是指二種或二種以上之色彩相互配色,色彩調和之現象可產生秩序與和諧以使人產生愉悅之感覺。顏色之感覺跟每個人之主觀意識、不同文化、外在環境或人生歷練之背景有關,但對於沒有受過色彩專業訓練的人,欲使用色彩調和之理論與方法是相對複雜與困難的。所以,網路上提供許多顏色匹配分析工具,但這些顏色匹配分析工具對於非專業人員之操作難度很高,也無法確認能否提升顏色匹配或色彩調和之效果。 In addition, color harmony refers to the matching of two or more colors. The phenomenon of color harmony can produce order and harmony to make people feel pleasant. The feeling of color is related to each person's subjective consciousness, different cultures, external environment or life experience background, but for people who have not received professional color training, it is relatively complicated and difficult to use the theory and method of color harmony. Therefore, there are many color matching analysis tools available on the Internet, but these color matching analysis tools are very difficult for non-professionals to operate, and it is impossible to confirm whether they can improve the effect of color matching or color harmony.
因此,如何提供一種創新之個人照片背景顏色推薦技術,以解決上述之任一問題或提供相關之功能/服務,已成為本領域技術人員之一大研究課題。 Therefore, how to provide an innovative personal photo background color recommendation technology to solve any of the above problems or provide related functions/services has become a major research topic for technical personnel in this field.
本發明提供一種創新之人工智慧導入個人照片背景顏色推薦系統及其方法,係能將個人照片中之使用者之身體部位顏色及/或穿戴物顏色輸入人工智慧模組之深度學習模型中以產生推薦背景顏色,亦能利用推薦背景顏色對使用者之個人照片之背景顏色進行優化以提升觀看者對使用者之滿意度,或者透過人工智慧模組之深度學習模型或多層感知器之神經網路產生不同推薦背景顏色以取代、更新或優化不同個人照片之背景顏色,抑或者由色彩組合收集模組透過色彩組合資料庫及/或網路爬蟲技術自動收集複數色彩組合資料集,又或者由資料訓練模組對人工智慧模組之深度學習模型或多層感知器之神經網路進行訓練。 The present invention provides an innovative artificial intelligence-introduced personal photo background color recommendation system and method, which can input the body part color and/or clothing color of the user in the personal photo into the deep learning model of the artificial intelligence module to generate a recommended background color, and can also use the recommended background color to optimize the background color of the user's personal photo to improve the viewer's satisfaction with the user, or generate different recommended background colors through the deep learning model of the artificial intelligence module or the neural network of multi-layer sensors to replace, update or optimize the background colors of different personal photos, or the color combination collection module automatically collects multiple color combination data sets through the color combination database and/or web crawler technology, or the data training module trains the deep learning model of the artificial intelligence module or the neural network of multi-layer sensors.
本發明之人工智慧導入個人照片背景顏色推薦系統包括:一色彩擷取模組,係自具有使用者之個人照片之個人照片影像檔中擷取出使用者之身體部位顏色與穿戴物顏色之至少一者;一具有深度學習模型之人工智慧模組,係與色彩擷取模組互相連接或通訊,以由色彩擷取模組將個人照片中之使用者之身體部位顏色與穿戴物顏色之至少一者輸入人工智慧模組之深度學習模型中,再由人工智慧模組之深度學習模型依據色彩擷取模組所輸入之個人照片中之使用者之身體部位顏色與穿戴物顏色之至少一者產生推薦背景顏色;以及一影像處理模組,係與具有深度學習模型之人工智慧模組互相連接或通訊,以由影像處理模組透過影像處理方式將人工智慧模組之深度學習模型依據色彩擷取模組所輸入之個人照片中之使用者之身體部位顏色與穿戴物顏色之至少一者而產生之推薦背景顏色取代或更新個人照片影像檔之個人照片之背景顏色。 The artificial intelligence-introduced personal photo background color recommendation system of the present invention comprises: a color capture module, which captures at least one of the body part color and the color of the clothing of the user from a personal photo image file having the personal photo of the user; an artificial intelligence module with a deep learning model, which is interconnected or communicated with the color capture module, so that the color capture module inputs at least one of the body part color and the color of the clothing of the user in the personal photo into the deep learning model of the artificial intelligence module, and then the deep learning model of the artificial intelligence module is used to recommend the background color of ... A recommended background color is generated based on at least one of the body part color and the color of the clothing of the user in the personal photo input by the color capture module; and an image processing module is interconnected or communicated with the artificial intelligence module having a deep learning model, so that the image processing module replaces or updates the background color of the personal photo in the personal photo image file with the recommended background color generated by the deep learning model of the artificial intelligence module based on at least one of the body part color and the color of the clothing of the user in the personal photo input by the color capture module through image processing.
本發明之人工智慧導入個人照片背景顏色推薦方法包括:由 一色彩擷取模組自具有使用者之個人照片之個人照片影像檔中擷取出使用者之身體部位顏色與穿戴物顏色之至少一者,以由色彩擷取模組將個人照片中之使用者之身體部位顏色與穿戴物顏色之至少一者輸入人工智慧模組之深度學習模型中;以及由人工智慧模組之深度學習模型依據色彩擷取模組所輸入之個人照片中之使用者之身體部位顏色與穿戴物顏色之至少一者產生推薦背景顏色,以由影像處理模組透過影像處理方式將人工智慧模組之深度學習模型依據色彩擷取模組所輸入之個人照片中之使用者之身體部位顏色與穿戴物顏色之至少一者而產生之推薦背景顏色取代或更新個人照片影像檔之個人照片之背景顏色。 The method for recommending background color of a personal photo by artificial intelligence includes: extracting at least one of the color of a user's body part and the color of an item of clothing from a personal photo image file having the user's personal photo by a color capture module, inputting at least one of the color of the user's body part and the color of an item of clothing in the personal photo into a deep learning model of an artificial intelligence module by the color capture module; and A recommended background color is generated based on at least one of the body part color and the color of the clothing of the user in the personal photo input by the color capture module, and the image processing module replaces or updates the background color of the personal photo in the personal photo image file with the recommended background color generated by the deep learning model of the artificial intelligence module based on at least one of the body part color and the color of the clothing of the user in the personal photo input by the color capture module through image processing.
為使本發明之上述特徵與優點能更明顯易懂,下文特舉實施例,並配合所附圖式作詳細說明。在以下描述內容中將部分闡述本發明之額外特徵及優點,且此等特徵及優點將部分自所述描述內容可得而知,或可藉由對本發明之實踐習得。應理解,前文一般描述與以下詳細描述二者均為例示性及解釋性的,且不欲約束本發明所欲主張之範圍。 In order to make the above features and advantages of the present invention more clearly understandable, the following examples are given and detailed descriptions are provided in conjunction with the attached drawings. The following description will partially explain the additional features and advantages of the present invention, and these features and advantages will be partially known from the description or can be learned through the practice of the present invention. It should be understood that both the general description above and the detailed description below are exemplary and explanatory, and are not intended to limit the scope of the present invention.
1:人工智慧導入個人照片背景顏色推薦系統 1: Artificial intelligence is introduced into the personal photo background color recommendation system
2:背景顏色推薦子系統 2: Background color recommendation subsystem
11:接收模組 11: Receiving module
12:色彩擷取模組 12: Color capture module
13:人工智慧模組 13: Artificial intelligence module
14:影像處理模組 14: Image processing module
15:背景顏色資料庫 15: Background color database
16:顯示模組 16: Display module
21:色彩組合資料庫 21: Color combination database
22:色彩組合收集模組 22: Color combination collection module
23:色彩資料量化模組 23: Color data quantization module
24:資料訓練模組 24: Data training module
25:應用程式介面 25: Application Programming Interface
A:個人照片影像檔 A: Personal photo image file
A1:個人照片 A1: Personal photo
A2:背景顏色 A2: Background color
B1:身體部位顏色 B1: Body part color
B2:穿戴物顏色 B2: Color of clothing
C:深度學習模型 C: Deep learning model
C':多層感知器之神經網路 C': Neural network with multiple layers of sensors
C1:輸入層 C1: Input layer
C2:隱藏層 C2: Hidden layer
C3:輸出層 C3: Output layer
D1:推薦背景顏色 D1: Recommended background color
D2:候選背景顏色 D2: Candidate background color
E:影像處理方式 E: Image processing method
F:網路爬蟲技術 F: Web crawler technology
G:色彩組合資料集 G: Color combination data set
H:訓練資料 H: Training data
S1至S2:步驟 S1 to S2: Steps
圖1為本發明之人工智慧導入個人照片背景顏色推薦系統之一架構示意圖。 Figure 1 is a schematic diagram of the architecture of the artificial intelligence-introduced personal photo background color recommendation system of the present invention.
圖2為本發明之人工智慧導入個人照片背景顏色推薦系統之另一架構示意圖。 Figure 2 is another schematic diagram of the artificial intelligence-introduced personal photo background color recommendation system of the present invention.
圖3為本發明之人工智慧導入個人照片背景顏色推薦方法之一流程示意圖。 Figure 3 is a schematic diagram of a process of introducing artificial intelligence into a personal photo background color recommendation method of the present invention.
圖4為本發明之人工智慧導入個人照片背景顏色推薦系統及其方法中,有關深度學習模型(例如多層感知器之神經網路)之示意圖。 FIG4 is a schematic diagram of a deep learning model (e.g., a neural network of multi-layer perceptrons) in the artificial intelligence-introduced personal photo background color recommendation system and method of the present invention.
以下藉由特定的具體實施形態說明本發明之實施方式,熟悉此技術之人士可由本說明書所揭示之內容了解本發明之其它優點與功效,亦可因而藉由其它不同具體等同實施形態加以施行或運用。 The following describes the implementation of the present invention through a specific concrete implementation form. People familiar with this technology can understand other advantages and effects of the present invention from the content disclosed in this manual, and can also implement or use it through other different specific equivalent implementation forms.
圖1為本發明之人工智慧導入個人照片背景顏色推薦系統1之一架構示意圖,圖2為本發明之人工智慧導入個人照片背景顏色推薦系統1之另一架構示意圖,圖3為本發明之人工智慧導入個人照片背景顏色推薦方法之一流程示意圖。 FIG1 is a schematic diagram of the structure of the artificial intelligence-introduced personal photo background color recommendation system 1 of the present invention, FIG2 is another schematic diagram of the structure of the artificial intelligence-introduced personal photo background color recommendation system 1 of the present invention, and FIG3 is a schematic diagram of the process of the artificial intelligence-introduced personal photo background color recommendation method of the present invention.
如圖1所示,人工智慧導入個人照片背景顏色推薦系統1主要包括互相連接或通訊之一接收模組11、一色彩擷取模組12、一人工智慧模組13、一影像處理模組14、一背景顏色資料庫15與一顯示模組16,且接收模組11、色彩擷取模組12、人工智慧模組13、影像處理模組14、背景顏色資料庫15與顯示模組16可先組成一背景顏色推薦子系統2。例如,接收模組11可分別連接或通訊色彩擷取模組12、影像處理模組14與顯示模組16,且人工智慧模組13可分別連接或通訊色彩擷取模組12、影像處理模組14與背景顏色資料庫15。
As shown in FIG1 , the artificial intelligence-introduced personal photo background color recommendation system 1 mainly includes a
如圖2所示,人工智慧導入個人照片背景顏色推薦系統1亦可進一步包括互相連接或通訊之一色彩組合資料庫21、一色彩組合收集模組22、一色彩資料量化模組23、一資料訓練模組24與一應用程式介面
(Application Programming Interface;API)25等。例如,色彩組合收集模組22可分別連接或通訊色彩組合資料庫21與色彩資料量化模組23,資料訓練模組24可分別連接或通訊色彩資料量化模組23與背景顏色推薦子系統2(見圖1),且背景顏色推薦子系統2可進一步連接或通訊應用程式介面(API)25。
As shown in FIG2 , the artificial intelligence-introduced personal photo background color recommendation system 1 may further include a
在一實施例中,接收模組11可為接收器(晶片/電路)、接收軟體(程式)等,色彩擷取模組12可為色彩擷取器(晶片/電路)、色彩擷取軟體(程式)等。人工智慧模組13可為人工智慧晶片(電路)、人工智慧軟體(程式)等,人工智慧模組13之深度學習模型C可為多層感知器(Multilayer Perceptron;MLP)之神經網路C'(見圖4)。影像處理模組14可為影像處理器(晶片/電路)、影像處理軟體(程式)等,背景顏色資料庫15可為用於儲存複數背景顏色A2、推薦背景顏色D1及/或候選背景顏色D2之資料之伺服器、儲存器、記憶體、記憶卡、硬碟等,顯示模組16可為顯示器、顯示面板、顯示軟體(程式)等。
In one embodiment, the
在一實施例中,色彩組合資料庫21可為用於儲存複數色彩組合資料集G(如配色資料集)之資料之伺服器、儲存器、記憶體、記憶卡、硬碟等,色彩組合收集模組22可為色彩組合收集器(晶片/電路)、色彩組合收集軟體(程式)等,色彩資料量化模組23可為色彩資料量化器(晶片/電路)、色彩資料量化軟體(程式)等,資料訓練模組24可為資料訓練器(晶片/電路)、資料訓練軟體(程式)等,應用程式介面(API)25可為應用程式設計介面、應用程式開發介面等。
In one embodiment, the
在一實施例中,個人照片A1(或稱個人相片)可為單一使用者 之大頭照片(頭部照片)、上半身照片或全身照片等,且個人照片A1可廣泛作成履歷(求職)照片、交友照片、升學照片、網路照片、選舉照片、名片照片等,亦能運用於求職履歷、人力銀行、交友軟體、宣傳(廣告)網站、選舉看板、個人服務等各種不同用途上。個人照片A1之背景顏色A2可為個人照片A1之單一背景顏色或複數背景顏色,且複數背景顏色可為至少二個(如二、三或四個以上)背景顏色之組合。 In one embodiment, the personal photo A1 (or personal photo) can be a headshot (head photo), upper body photo or full body photo of a single user, and the personal photo A1 can be widely used as a resume (job search) photo, a dating photo, a study photo, an online photo, an election photo, a business card photo, etc. It can also be used for various purposes such as job search resumes, job banks, dating software, promotional (advertising) websites, election billboards, personal services, etc. The background color A2 of the personal photo A1 can be a single background color or multiple background colors of the personal photo A1, and the multiple background colors can be a combination of at least two (such as two, three or more than four) background colors.
在一實施例中,身體部位顏色B1可為個人照片A1中之使用者之頭髮部位顏色(如頭髮部位之毛髮/染髮顏色)、人臉部位顏色(如人臉部位之眼睛/眼影/睫毛/腮紅/口唇顏色)、皮膚部位顏色(如胸部/背部/手部/腳部之皮膚部位之皮膚/化妝/刺青顏色)等,穿戴物顏色B2可為個人照片A1中之使用者所穿著之服裝(如衣服/褲子/鞋子)之顏色、或所配戴之飾品(如帽子/包包/項鍊/手錶)之顏色。個人照片A1之背景顏色A2、身體部位顏色B1、穿戴物顏色B2、推薦背景顏色D1或候選背景顏色D2可例如為紅、橙、黃、綠、藍、靛、紫、金、銀、銅、黑、白、灰等單一顏色或複數顏色之組合,亦即一個顏色或二個以上顏色之組合。 In one embodiment, the body part color B1 may be the color of the hair part (such as the hair/hair dye color), the face part color (such as the eyes/eye shadow/eyelashes/blush/lip color), the skin part color (such as the skin/makeup/tattoo color of the chest/back/hands/feet), etc. of the user in the personal photo A1. The clothing color B2 may be the color of the clothing (such as clothes/pants/shoes) or the color of the accessories (such as hats/bags/necklaces/watches) worn by the user in the personal photo A1. The background color A2 of the personal photo A1, the body part color B1, the clothing color B2, the recommended background color D1 or the candidate background color D2 may be, for example, a single color or a combination of multiple colors such as red, orange, yellow, green, blue, indigo, purple, gold, silver, copper, black, white, gray, etc., that is, a combination of one color or two or more colors.
在一實施例中,本發明所述「連接或通訊」可代表以有線方式(如有線網路)或無線方式(如無線網路)互相連接或通訊,「至少一」代表一個以上(如一、二或三個以上),「複數」代表二個以上(如二、三、四、五或十個以上)。但是,本發明並不以上述實施例所提及者為限。 In one embodiment, the "connection or communication" described in the present invention may represent interconnection or communication in a wired manner (such as a wired network) or a wireless manner (such as a wireless network), "at least one" represents more than one (such as one, two or more than three), and "plurality" represents more than two (such as two, three, four, five or more than ten). However, the present invention is not limited to those mentioned in the above embodiments.
本發明之人工智慧導入個人照片背景顏色推薦系統1及其方法中,可包括如圖1、圖2與圖3之步驟S1至步驟S2所示之內容。 The artificial intelligence-introduced personal photo background color recommendation system 1 and its method of the present invention may include the contents shown in steps S1 to S2 of Figures 1, 2 and 3.
在步驟S1中,由色彩擷取模組12自具有使用者之個人照片
A1之個人照片影像檔A中擷取出使用者之身體部位顏色B1與穿戴物顏色B2之至少一者,以由色彩擷取模組12將個人照片A1中之使用者之身體部位顏色B1與穿戴物顏色B2之至少一者輸入人工智慧模組13之深度學習模型C中。
In step S1, the
在步驟S2中,由人工智慧模組13之深度學習模型C依據色彩擷取模組12所輸入之個人照片A1中之使用者之身體部位顏色B1與穿戴物顏色B2之至少一者產生推薦背景顏色D1,以由影像處理模組14透過影像處理方式E將人工智慧模組13之深度學習模型C依據色彩擷取模組12所輸入之個人照片A1中之使用者之身體部位顏色B1與穿戴物顏色B2之至少一者而產生之推薦背景顏色D1取代或更新個人照片影像檔A之個人照片A1之背景顏色A2。
In step S2, the deep learning model C of the
申言之,接收模組11可先接收具有使用者之個人照片A1之個人照片影像檔A,以由色彩擷取模組12自接收模組11所接收之具有個人照片A1之個人照片影像檔A中擷取出使用者之身體部位顏色B1(如頭髮/人臉/皮膚部位之顏色)與穿戴物顏色B2(如服裝/飾品之顏色)之至少一者,再由色彩擷取模組12將使用者之身體部位顏色B1與穿戴物顏色B2之至少一者輸入人工智慧模組13之深度學習模型C中,俾由人工智慧模組13之深度學習模型C依據色彩擷取模組12所輸入之使用者之身體部位顏色B1與穿戴物顏色B2之至少一者產生(輸出)推薦背景顏色D1。
In other words, the receiving
繼之,由影像處理模組14透過影像處理方式E(如影像處理技術/影像處理演算法)將人工智慧模組13之深度學習模型C所產生(輸出)之推薦背景顏色D1取代(替換)或更新個人照片影像檔A之個人照片A1之
背景顏色A2,再由顯示模組16顯示影像處理模組14將人工智慧模組13之深度學習模型C所產生之推薦背景顏色D1取代(替換)或更新背景顏色A2後所形成之個人照片影像檔A之個人照片A1,俾供使用者將推薦背景顏色D1取代(替換)或更新背景顏色A2後所形成之具有個人照片A1之個人照片影像檔A運用於求職履歷、人力銀行、交友軟體、升學(招生)網站、宣傳(廣告)網站、選舉看板、個人服務等各種不同用途上。
Next, the
在一實施例中,使用者可透過電子裝置(如智慧型手機/電腦/伺服器等)將具有個人照片A1之個人照片影像檔A輸入人工智慧導入個人照片背景顏色推薦系統1中,再由人工智慧模組13之深度學習模型C依據個人照片A1中之使用者之身體部位顏色B1與穿戴物顏色B2之至少一者產生推薦背景顏色D1,俾由影像處理模組14透過影像處理方式E(如影像處理技術/影像處理演算法)將推薦背景顏色D1套設至個人照片A1之背景顏色A2上,從而自動推薦出最符合個人照片A1之推薦背景顏色D1以優化個人照片A1之背景顏色A2。
In one embodiment, a user can input a personal photo image file A having a personal photo A1 into an artificial intelligence into a personal photo background color recommendation system 1 through an electronic device (such as a smart phone/computer/server, etc.), and then the deep learning model C of the
在一實施例中,人工智慧模組13可預先依據個人照片A1中之使用者之身體部位顏色B1與穿戴物顏色B2產生一候選背景顏色D2,以由人工智慧模組13將候選背景顏色D2更新至深度學習模型C中以替代成為推薦背景顏色D1,俾由影像處理模組14透過影像處理方式E將候選背景顏色D2所替代而成之推薦背景顏色D1套設至個人照片A1之背景顏色A2上。
In one embodiment, the
在一實施例中,人工智慧模組13可啟動或執行一色彩建議回饋方法以輸入常見或常用之推薦背景顏色D1至深度學習模型C中,再由
人工智慧模組13利用常見或常用之推薦背景顏色D1動態地更新深度學習模型C或其背景顏色訓練子模型。
In one embodiment, the
如圖1至圖2所示,人工智慧模組13之深度學習模型C可依據個人照片A1中之使用者之身體部位顏色B1與穿戴物顏色B2之至少一者自動產生推薦背景顏色D1,色彩組合收集模組22可透過色彩組合資料庫21與網路爬蟲(web crawler)技術F之至少一者自動收集複數色彩組合資料集G(如配色資料集),且資料訓練模組24能對人工智慧模組13之深度學習模型C所採用之多層感知器之神經網路C'進行訓練,俾使人工智慧模組13之深度學習模型C所採用之多層感知器之神經網路C'產生不同推薦背景顏色D1來優化不同個人照片A1之背景顏色A2,有利於藉由推薦背景顏色D1加深或強化觀看者對於使用者或其個人照片A1之印象。
As shown in FIG. 1 and FIG. 2, the deep learning model C of the
資料訓練模組24對人工智慧模組13之深度學習模型C所採用之多層感知器之神經網路C'進行訓練後,多層感知器之神經網路C'可依據個人照片A1中之使用者之身體部位顏色B1與穿戴物顏色B2之至少一者產生推薦背景顏色D1,以由影像處理模組14透過影像處理方式E將多層感知器之神經網路C'所產生之推薦背景顏色D1套設至個人照片A1之背景顏色A2上。
After the
圖4為本發明之人工智慧導入個人照片背景顏色推薦系統1及其方法中有關深度學習模型C(例如多層感知器之神經網路C')之示意圖,並參閱圖1至圖2予以說明。 FIG4 is a schematic diagram of the artificial intelligence-introduced personal photo background color recommendation system 1 and its method related to the deep learning model C (e.g., a neural network C' of multi-layer perceptrons) of the present invention, and is explained with reference to FIG1 to FIG2.
如圖4所示,人工智慧模組13之深度學習模型C可採用多層感知器之神經網路C'之架構以訓練所收集之複數色彩組合資料集G(如
配色資料集或大數據色彩運用資料),且多層感知器之神經網路C'可依序包括至少一輸入層(Input Layer)C1、複數隱藏層(Hidden Layer)C2與至少一輸出層(Output Layer)C3。例如,多層感知器之神經網路C'之加權(Weighting)運算可採用一包括複數(如12個)神經細胞之輸入層C1與一包括複數(如3個)神經細胞之輸出層C3,輸入層C1與輸出層C3間之迴歸(Regression)預測學習可採用複數(如4層)隱藏層C2,且每一隱藏層C2可包括複數(如1024個)神經細胞,但不以此為限。
As shown in FIG4 , the deep learning model C of the
如圖2所示,色彩組合收集模組22可透過色彩組合資料庫21與網路爬蟲技術F之至少一者自動收集複數色彩組合資料集G(如配色資料集)之色票資料(如44986筆之五色色票資料),再由色彩資料量化模組23對色彩組合收集模組22所收集之複數色彩組合資料集G(如配色資料集)之色票資料(如44986筆之五色色票資料)進行量化以提供預定數量或種類之色票(如130種色票/顏色)。
As shown in FIG2 , the color
資料訓練模組24可透過機器學習演算法將色彩組合收集模組22所收集之複數色彩組合資料集G(如配色資料集)之色票資料(如44986筆之五色色票資料)進行預測模型訓練以產生複數訓練資料(如總共完成112925筆之訓練資料H),再透過多層感知器之神經網路C'建構所需要之深度學習模型C。各種色彩組合資料集G(如配色資料集)於實際應用上之特徵資料較難以輕易描述,且色彩組合資料集G(如配色資料集)之色彩協調有非常高之變化性(Variety)及參雜各種複雜之因素。
The
如圖1、圖2與圖4所示,人工智慧模組13可利用多層感知器之神經網路C'之架構依據複數色彩組合資料集G(如配色資料集)之色票
資料(如44986筆之五色色票資料)訓練出深度學習模型C,以供人工智慧模組13於得到複數顏色(顏色訊號)之特徵時,能透過深度學習模型C預測出新的顏色組合(如新的最佳顏色組合)。當人工智慧模組13得到新的顏色組合時,已訓練完成之深度學習模型C可利用多層感知器之神經網路C'依據新的顏色組合預測出最佳或最適合之推薦背景顏色D1。
As shown in Figures 1, 2 and 4, the
例如,人工智慧模組13可透過深度學習模型C將已知之二個顏色輸入多層感知器之神經網路C',以由多層感知器之神經網路C'依據已知之二個顏色推薦新的第三個顏色而預測出新的三個顏色組合之推薦背景顏色D1。或者,人工智慧模組13可透過深度學習模型C將已知之三個顏色輸入多層感知器之神經網路C',以由多層感知器之神經網路C'依據已知之三個顏色推薦新的第四個顏色而預測出新的四個顏色組合之推薦背景顏色D1。又或者,人工智慧模組13可透過深度學習模型C將已知之四個顏色輸入多層感知器之神經網路C',以由多層感知器之神經網路C'依據已知之四個顏色推薦新的第五個顏色而預測出新的五個顏色組合之推薦背景顏色D1。
For example, the
人工智慧導入個人照片背景顏色推薦系統1之系統介面可提供應用程式介面(API)25,以供使用者之電子裝置透過應用程式介面(API)25傳送或上傳具有個人照片A1之個人照片影像檔A至人工智慧導入個人照片背景顏色推薦系統1之接收模組11,且由色彩擷取模組12自接收模組11所接收之具有個人照片A1之個人照片影像檔A中擷取出使用者之身體部位顏色B1與穿戴物顏色B2之至少一者,再由色彩擷取模組12將使用者之身體部位顏色B1與穿戴物顏色B2之至少一者輸入人工智慧模
組13之深度學習模型C中,進而由人工智慧模組13之深度學習模型C依據使用者之身體部位顏色B1與穿戴物顏色B2之至少一者產生推薦背景顏色D1,俾由影像處理模組14透過影像處理方式E將人工智慧模組13之深度學習模型C所產生之推薦背景顏色D1取代(替換)或更新個人照片影像檔A之個人照片A1之背景顏色A2。
The system interface of the artificial intelligence imported personal photo background color recommendation system 1 can provide an application program interface (API) 25, so that the user's electronic device can transmit or upload the personal photo image file A with the personal photo A1 to the receiving
綜上,本發明之人工智慧導入個人照片背景顏色推薦系統及其方法至少具有下列特色、優點或技術功效。 In summary, the artificial intelligence-introduced personal photo background color recommendation system and method of the present invention has at least the following features, advantages or technical effects.
一、本發明之色彩擷取模組能將個人照片中之使用者之身體部位顏色及/或穿戴物顏色自動輸入人工智慧模組之深度學習模型中,以利深度學習模型依據使用者之身體部位顏色及/或穿戴物顏色自動產生推薦背景顏色。 1. The color capture module of the present invention can automatically input the body part color and/or the color of the clothing of the user in the personal photo into the deep learning model of the artificial intelligence module, so that the deep learning model can automatically generate a recommended background color based on the body part color and/or the color of the clothing of the user.
二、本發明能利用推薦背景顏色對使用者之個人照片之背景顏色進行優化,以利提升觀看者對於使用者或其個人照片之滿意度。 2. The present invention can optimize the background color of the user's personal photo using the recommended background color, so as to improve the viewer's satisfaction with the user or his personal photo.
三、本發明之人工智慧模組之深度學習模型或多層感知器之神經網路能產生不同推薦背景顏色來取代、更新或優化不同個人照片之背景顏色,有利於藉由推薦背景顏色加深或強化觀看者對於使用者或其個人照片之良好印象。 3. The deep learning model or multi-layer sensor neural network of the artificial intelligence module of the present invention can generate different recommended background colors to replace, update or optimize the background colors of different personal photos, which is beneficial to deepen or strengthen the viewer's good impression of the user or his personal photo through the recommended background color.
四、本發明之影像處理模組能提供影像處理方式(如影像處理技術/影像處理演算法),以利將人工智慧模組之深度學習模型所產生之推薦背景顏色自動取代或更新個人照片影像檔之個人照片之背景顏色。 4. The image processing module of the present invention can provide an image processing method (such as image processing technology/image processing algorithm) to automatically replace or update the background color of the personal photo in the personal photo image file with the recommended background color generated by the deep learning model of the artificial intelligence module.
五、本發明之人工智慧模組能依據個人照片中之使用者之身體部位顏色與穿戴物顏色產生候選背景顏色,並自動將候選背景顏色更新 至深度學習模型中以替代成為推薦背景顏色,亦能自動將候選背景顏色所替代而成之推薦背景顏色套設至個人照片之背景顏色上。 5. The artificial intelligence module of the present invention can generate candidate background colors based on the colors of the user's body parts and the colors of the items he/she wears in the personal photo, and automatically update the candidate background colors to the deep learning model to replace them as recommended background colors. It can also automatically apply the recommended background colors replaced by the candidate background colors to the background colors of the personal photo.
六、本發明能由人工智慧模組啟動或執行色彩建議回饋方法,以利輸入常見或常用之推薦背景顏色至深度學習模型中,亦能由人工智慧模組利用常見或常用之推薦背景顏色動態地更新深度學習模型或其背景顏色訓練子模型。 6. The present invention can activate or execute the color suggestion feedback method by the artificial intelligence module to facilitate the input of common or frequently used recommended background colors into the deep learning model. The artificial intelligence module can also dynamically update the deep learning model or its background color training sub-model using common or frequently used recommended background colors.
七、本發明之人工智慧模組之深度學習模型能採用具有輸入層、隱藏層與輸出層之多層感知器之神經網路,以利用多層感知器之神經網路自動訓練複數色彩組合資料集(如配色資料集)。 7. The deep learning model of the artificial intelligence module of the present invention can use a neural network with multiple layers of sensors having input layers, hidden layers, and output layers to automatically train a plurality of color combination data sets (such as color matching data sets) using the neural network with multiple layers of sensors.
八、本發明之色彩組合收集模組能透過色彩組合資料庫及/或網路爬蟲技術自動收集複數色彩組合資料集(如配色資料集),且資料訓練模組能自動對人工智慧模組之深度學習模型或多層感知器之神經網路進行訓練,以利產生不同推薦背景顏色來優化不同個人照片之背景顏色。 8. The color combination collection module of the present invention can automatically collect multiple color combination data sets (such as color matching data sets) through the color combination database and/or web crawler technology, and the data training module can automatically train the deep learning model of the artificial intelligence module or the neural network of the multi-layer sensor to generate different recommended background colors to optimize the background colors of different personal photos.
九、本發明能作為個人照片之優化系統、優化方法或優化工具,亦能依據不同使用者之身體部位顏色及/或穿戴物顏色等特徵自動產生個人照片之推薦背景顏色,以利提升觀看者對於使用者或其個人照片之良好印象(如可信度、親和力、專業能力)。 9. The present invention can be used as a personal photo optimization system, optimization method or optimization tool, and can also automatically generate recommended background colors for personal photos based on the characteristics of different users' body parts colors and/or clothing colors, so as to enhance viewers' good impression of the user or his or her personal photos (such as credibility, affinity, professional ability).
十、本發明能應用於例如人力銀行、求職網站、交友軟體(交友網站)、個人廣告、個人照片優化應用程式等產業或產品,亦能運用於求職、交友、升學(招生)、選舉、廣告等眾多領域,極具產業利用性及商業實用價值。 10. This invention can be applied to industries or products such as job banks, job search websites, dating software (dating websites), personal advertising, and personal photo optimization applications. It can also be used in many fields such as job hunting, dating, further education (enrollment), elections, and advertising, and has great industrial applicability and commercial practical value.
上述實施形態僅例示性說明本發明之原理、特點及其功效, 並非用以限制本發明之可實施範疇,任何熟習此項技藝之人士均能在不違背本發明之精神及範疇下,對上述實施形態進行修飾與改變。任何使用本發明所揭示內容而完成之等效改變及修飾,均仍應為申請專利範圍所涵蓋。因此,本發明之權利保護範圍應如申請專利範圍所列。 The above implementation forms are only illustrative of the principles, features and effects of the present invention, and are not intended to limit the scope of implementation of the present invention. Anyone familiar with this technology can modify and change the above implementation forms without violating the spirit and scope of the present invention. Any equivalent changes and modifications completed using the content disclosed by the present invention should still be covered by the scope of the patent application. Therefore, the scope of protection of the present invention should be as listed in the scope of the patent application.
1:人工智慧導入個人照片背景顏色推薦系統 1: Artificial intelligence is introduced into the personal photo background color recommendation system
2:背景顏色推薦子系統 2: Background color recommendation subsystem
11:接收模組 11: Receiving module
12:色彩擷取模組 12: Color capture module
13:人工智慧模組 13: Artificial intelligence module
14:影像處理模組 14: Image processing module
15:背景顏色資料庫 15: Background color database
16:顯示模組 16: Display module
A:個人照片影像檔 A: Personal photo image file
A1:個人照片 A1: Personal photo
A2:背景顏色 A2: Background color
B1:身體部位顏色 B1: Body part color
B2:穿戴物顏色 B2: Color of clothing
C:深度學習模型 C: Deep learning model
D1:推薦背景顏色 D1: Recommended background color
D2:候選背景顏色 D2: Candidate background color
E:影像處理方式 E: Image processing method
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW111136799A TWI838887B (en) | 2022-09-28 | 2022-09-28 | Artificial intelligence importing personal photo background color recommendation system and method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW111136799A TWI838887B (en) | 2022-09-28 | 2022-09-28 | Artificial intelligence importing personal photo background color recommendation system and method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW202414340A TW202414340A (en) | 2024-04-01 |
| TWI838887B true TWI838887B (en) | 2024-04-11 |
Family
ID=91618502
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW111136799A TWI838887B (en) | 2022-09-28 | 2022-09-28 | Artificial intelligence importing personal photo background color recommendation system and method thereof |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TWI838887B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118778915A (en) * | 2024-07-25 | 2024-10-15 | 深圳黑蚂蚁环保科技有限公司 | A self-service photography printing system based on AIGC large model |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015200515A1 (en) * | 2014-06-26 | 2015-12-30 | Amazon Technologies, Inc. | Automatic image-based recommendations using a color palette |
| CN109903349A (en) * | 2019-01-28 | 2019-06-18 | 浙江工商大学 | A Color Harmony Prediction Method Based on Maximum Likelihood Estimation |
| CN111241372A (en) * | 2020-01-17 | 2020-06-05 | 浙江工商大学 | Learning to predict the degree of color harmony based on user preferences |
| CN111292394A (en) * | 2020-02-07 | 2020-06-16 | 腾讯科技(深圳)有限公司 | A kind of image color matching relationship determination method and device |
| TW202022649A (en) * | 2018-12-03 | 2020-06-16 | 國立臺灣師範大學 | Method and system for mapping from natural language to color combination |
| CN112270221A (en) * | 2020-10-14 | 2021-01-26 | 西安工程大学 | A clothing personalized recommendation method integrating four seasons color theory |
| CN112652024A (en) * | 2020-12-11 | 2021-04-13 | 浙江工商大学 | Method for replacing colors of image again based on color harmony |
-
2022
- 2022-09-28 TW TW111136799A patent/TWI838887B/en active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015200515A1 (en) * | 2014-06-26 | 2015-12-30 | Amazon Technologies, Inc. | Automatic image-based recommendations using a color palette |
| TW202022649A (en) * | 2018-12-03 | 2020-06-16 | 國立臺灣師範大學 | Method and system for mapping from natural language to color combination |
| CN109903349A (en) * | 2019-01-28 | 2019-06-18 | 浙江工商大学 | A Color Harmony Prediction Method Based on Maximum Likelihood Estimation |
| CN111241372A (en) * | 2020-01-17 | 2020-06-05 | 浙江工商大学 | Learning to predict the degree of color harmony based on user preferences |
| CN111292394A (en) * | 2020-02-07 | 2020-06-16 | 腾讯科技(深圳)有限公司 | A kind of image color matching relationship determination method and device |
| CN112270221A (en) * | 2020-10-14 | 2021-01-26 | 西安工程大学 | A clothing personalized recommendation method integrating four seasons color theory |
| CN112652024A (en) * | 2020-12-11 | 2021-04-13 | 浙江工商大学 | Method for replacing colors of image again based on color harmony |
Non-Patent Citations (2)
| Title |
|---|
| 網路文獻 簡穩容及周遵儒 色彩調和理論於 網頁自動配色應用之研究 臺灣博碩論文知識加值系統(https://ndltd.ncl.edu.tw/) 2013年 https://hdl.handle.net/11296/h9374j * |
| 網路文獻 陳佳安及周遵儒 運用資料探勘於自動化色彩語意分析之研究 臺灣博碩論文知識加值系統(https://ndltd.ncl.edu.tw/) 2019年 https://hdl.handle.net/11296/cxv6ce; * |
Also Published As
| Publication number | Publication date |
|---|---|
| TW202414340A (en) | 2024-04-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Lin et al. | UNISON framework of data-driven innovation for extracting user experience of product design of wearable devices | |
| Lin et al. | How the authentic experience of a traditional cultural festival affects the attendee's perception of festival identity and place identity | |
| Schneider et al. | Gesture and gaze: Multimodal data in dyadic interactions | |
| Zhou et al. | Dress for fit: An exploration of female activewear consumption | |
| US11544768B2 (en) | System and method for fashion recommendations | |
| Chang et al. | A crowdsourcing development approach based on a neuro-fuzzy network for creating innovative product concepts | |
| TWI838887B (en) | Artificial intelligence importing personal photo background color recommendation system and method thereof | |
| Shin et al. | Impact of social influence and users' perception of coolness on smartwatch behavior | |
| CN109360629A (en) | Emotional prediction method, apparatus, equipment and storage medium based on machine learning | |
| Chen et al. | Research on the image design of clothing patterns | |
| Ye et al. | Digital protection analysis of national traditional sports health cultural heritage based on big data in the era of data cloud | |
| Zhao et al. | [Retracted] Artificial Intelligence Auxiliary Algorithm for Wushu Routine Competition Decision Based on Feature Fusion | |
| Edwards | Wearable technology and body mapping | |
| CN118411229A (en) | Deep learning-based clothing recommendation method and system | |
| CN117557338A (en) | A clothing matching simulation demonstration system based on artificial intelligence | |
| Adilova et al. | Aesthetic preference prediction in interior design: Fuzzy approach | |
| Mingliang et al. | Interior design innovation ability with artificial intelligence and virtual reality technology | |
| Zhao | A step toward an intelligent and integrated computer-aided design of apparel products | |
| Ochs et al. | From the symbolic analysis of virtual faces to a smiles machine | |
| Zhu et al. | Recognition and analysis of kawaii style for fashion clothing through deep learning | |
| Tang et al. | Soft wearable robot design based on deep learning with Colab | |
| Chen et al. | Personalized design of clothing pattern based on KE and IPSO-BP neural network | |
| Guo | The application of artificial intelligence in biomechanical feedback and learning effectiveness enhancement in ideological and political education. | |
| Jiang et al. | Fuzzy evaluation of kansei attributes using convolutional neural networks | |
| Datta | Emotive Materials: Towards a shared language of the meaning of materials |