TWI554900B - Apparatus and method for providing information - Google Patents

Description

Device and method for providing information [Cross-reference to related applications]

The present application claims the following priority of each patent application filed by the Korea Intellectual Property Office: Korean Patent Application No. 10-2014-0098633, filed on July 31, 2014, and Korean Patent Application, February 13, 2015 The Korean Patent Application No. 10-2015-0044996, filed on Jan. 31, 2015, the disclosure of which is hereby incorporated by reference.

Apparatuses and methods consistent with the exemplary embodiments are directed to an apparatus and method for providing information.

Due to the rapid distribution of portable terminals, the use of portable terminals becomes crucial in daily life. Portable terminals provide a variety of functions, such as voice call services, data transfer services, and a variety of additional services.

In detail, communication between users using smart terminals has become more and more popular. Along with, the development of more convenient communications for communication has been developed. Various technologies of the environment.

However, the prior art cannot provide customized services by using user information such as user location information.

One or more exemplary embodiments provide a method and an electronic device for providing information of interest to a user by considering location information of the user and for obtaining information of interest of the user.

One or more example embodiments include an electronic device that generates queries that a user may need when using a user, performs a search operation, and obtains information of interest.

Additional aspects will be set forth in part in the description which follows.

According to an aspect of an exemplary embodiment, an electronic device is provided, comprising: a display configured to display one or more messages in response to execution of an application for exchanging one or more messages between an electronic device and another electronic device And a processor configured to extract keywords from one or more messages for processing the search query by using the location information of the keywords and the electronic device.

The display can be further configured to display a graphical user interface (GUI) configured to receive user input regarding the keyword, and the processor can be further configured to obtain results regarding the search query based on the user input Information, and the display can be configured to display information.

The processor can be further configured to pass the second application installed in the electronic device At least one of the program and the internet search service obtains information.

The processor can be further configured to execute the second application and obtain information by inputting the search query to the second application.

The display can be further configured to display a graphical user interface (GUI) configured to receive user input regarding the keyword and to display a query edit window for editing the search query based on the user input.

The display can be further configured to display a search query determined by the processor via the query edit window, and to receive editing of the search query by the user.

The processor can be further configured to obtain information about the results of the search query edited according to the received edits.

The processor may be further configured to obtain at least one of: location information of the electronic device measured by using a global positioning system (GPS) processor included in the electronic device, and Or location information of an electronic device that is extracted by multiple messages.

The processor can be further configured to determine the search query by prioritizing the use of location information extracted from the one or more messages prior to the use of location information obtained by using the GPS processor.

The processor can be configured to determine a search query based on user information associated with the electronic device.

According to an aspect of an exemplary embodiment, a method of providing information in an electronic device is provided, the method comprising: displaying an output in response to execution of an application for exchanging one or more messages between the electronic device and another electronic device Multiple messages; and extracting keywords from one or more messages; and using keywords and electronic devices Information processing search query.

The method can further include receiving user input regarding the keyword; and obtaining information about the result of the search query in response to the user input; and displaying the information.

The obtaining may include obtaining information via at least one of a second application installed in the electronic device and an internet search service.

The obtaining may include executing the second application and obtaining information by inputting the search query to the second application.

The method can further include receiving user input regarding the keyword; and displaying a query edit window for editing the search query based on the user input.

The method may further include displaying the search query via the query edit window; and receiving the edit of the search query by the user.

This acquisition may include obtaining information about the results of the search query edited according to the received edit.

The method can further include obtaining at least one of: location information of the electronic device measured by using a Global Positioning System (GPS) processor included in the electronic device; and a location from the one or more messages News.

The determination may include determining the search query by prioritizing the use of location information extracted from the one or more messages over the use of location information obtained by using the GPS processor.

The determining can include determining a search query based on user information associated with the electronic device.

According to an aspect of an exemplary embodiment, an electronic device is provided, which may include: a display configured to display a message transmitted to or received from another electronic device; and a processor configured to determine a keyword based on the message and to determine the search by using the keyword and the user's information Inquire.

The processor can be further configured to determine the keyword by using the previous message and the current message displayed on the display.

The processor can be further configured to perform a seek operation by using a search query and to control the display to display the results of the seek operation.

The processor can be further configured to perform a search query corresponding to the keyword in response to user input regarding the keyword displayed on the display, and to control the display to display a result of performing the search query.

The user information may include at least one of the following: location information of the user's electronic device, communication history information of the user, and search log information of the user.

The processor can be further configured to display the results of executing the search query and the message on the display.

The processor can be further configured to control the display to display the keywords in the original display state after a predetermined period of time elapses.

The display can be further configured to differentially display keywords in one or more messages.

The method can further include distinguishably displaying keywords in one or more messages.

The display can be further configured to differentially display keywords in the message.

According to an aspect of an exemplary embodiment, there is an electronic device comprising: a processor configured to be in an electronic device and another electronic device via an application The keywords are extracted from the application content, the search query is generated based on the keywords, and the information is obtained based on the results of the search query; and the output interface is configured to provide the obtained information to the user when executing the application.

The application can include at least one of: an application for performing a text chat, an application for performing a voice chat, and an application for performing a video chat.

When performing at least one of an application for performing a voice chat and an application for performing a video chat, the processor may be further configured to transmit the voice signal by using a speech to text (STT) engine Convert to text and extract keywords from converted text.

The processor can include a natural language processor configured to recognize the meaning of the words contained in the content, and the processor can be further configured to determine whether to extract the keywords based on the recognized meaning of the words.

The output interface can be further configured to provide the obtained information to the user by using at least one of the following operations: converting the application execution screen, dividing the application execution screen, outputting the voice signal, performing the message service, and executing the electronic Mail services, implementation of social network services (SNS), and execution of application services.

The electronic device can interoperate with the second electronic device, and the processor can be further configured to extract key from content communicated between the second electronic device and another electronic device by executing the application in the second electronic device a word, generating a search query based on the keyword, and obtaining information based on the result of executing the search query; and the output interface is configured to provide the obtained information to the user via the electronic device.

1‧‧‧Query editing window

2‧‧‧Back button

4‧‧‧Message Service Button/User Name Box

5, 6, 7, 8‧‧‧ messages

9, 1100-2‧‧‧ display

10‧‧‧Setting switch

10_a‧‧‧Setting bar

20‧‧‧Back button/area

21‧‧‧Transition page button

30‧‧‧Voice call connection button/area

40‧‧‧User Name Box

100‧‧‧Electronic device/smart watch

101‧‧‧Electronic device/smart phone

105, 106, 1000, 20000‧‧‧ electronic devices

130‧‧‧Application list

610‧‧‧ Candidate List Window

800, 900, 910, 1010‧‧‧ examples

1100‧‧‧ query generation architecture

1100-1‧‧‧GPS module (or GPS processor)

1110‧‧‧ display panel

1200‧‧‧Natural Language Processor/Memory

1210‧‧‧Named Entity Recognizer

1210-1‧‧‧ device driver

1210-2‧‧‧System Resource Manager

1220‧‧‧Intermediate software

1220-1‧‧‧Application Manager

1220-2‧‧‧Windows Manager

1220-3‧‧‧Multimedia Manager

1220-4‧‧‧Resource Manager

1220-5‧‧‧Power Manager

1220-6‧‧‧DB Manager

1220-7‧‧‧Package Manager

1220-8‧‧‧Connection Manager

1220-9‧‧‧Notification Manager

1220-10‧‧‧Location Manager

1220-11‧‧‧Graphics Manager

1220-12‧‧‧Security Manager

1220-13‧‧‧Execution stage library

1230‧‧‧Classifier

1240, 4503‧‧‧Applications

1240-1‧‧‧Home Application

1240-2‧‧‧Dial application

1240-3‧‧‧Text Message App

1240-4‧‧‧IM (IM) application

1240-5‧‧‧ browser application

1240-6‧‧‧ camera application

1240-7‧‧‧Alarm App

1240-8‧‧‧Phonebook application

1240-9‧‧‧Call Log Application

1240-10‧‧‧Email application

1240-11‧‧‧ calendar application

1240-12‧‧‧Media Player App

1240-13‧‧·Photobook application

1240-14‧‧‧clock application

1250‧‧‧ Frequency Measurer/GPS Chip

1300‧‧‧ Communicator

1310‧‧‧ Wi-Fi chip

1320‧‧‧Blue chip

1330‧‧‧Wireless communication chip

1340‧‧‧Near Field Communication (NFC) Wafer

1350‧‧‧Video Processor

1400‧‧‧Optical Processor/GPS Database

1450‧‧‧User input device

1460‧‧‧ button

1470‧‧‧Touch panel

1480‧‧‧ pen recognition panel

1500‧‧‧ microphone

1510‧‧‧Text assisted section

1513‧‧‧Context-aware text extractor

1515‧‧‧Query Generator

1520‧‧‧Image assisted part

1530‧‧‧Voice Aid Section

1550‧‧‧Service knotter

1550‧‧‧Image capture device

1600‧‧‧Speaker

1650‧‧‧ motion detector

1700‧‧‧ controller

1710‧‧‧ Random Access Memory (RAM)

1720‧‧‧ROM

1730‧‧‧Central Processing Unit (CPU)

1740‧‧‧Graphical Processor Unit (GPU)

1750‧‧ ‧ busbar

1850, 3500‧‧‧ search engine

1860, 3600‧‧‧ Image Analysis Engine

1870, 3700‧‧‧ voice assist engine

2000‧‧‧External Search Server

2100‧‧‧Output interface

2200‧‧‧Message Service Server

2201‧‧‧Information Database

2210‧‧‧Email server

2211‧‧‧Email database

2220‧‧‧SNS server

2221‧‧‧SNS database

2230‧‧‧Application Service Server

2231‧‧‧Database

2400‧‧‧Input interface

2600‧‧‧Voice chat interface screen

2601, 2603‧‧‧ screen

2700‧‧‧ processor

3000‧‧‧Cloud Server

3200‧‧‧Natural Language Processor

3400‧‧‧ data computing device

3410‧‧‧Text Extractor

3430‧‧‧Data storage

3431‧‧‧Cloud Named Entity Identification Database

3433‧‧‧ Knowledge DB

4501‧‧‧Setting screen

4505‧‧‧ device

4507‧‧‧All

4701, 4801, 4901, 5001‧‧‧ display

4703, 4803, 4903‧‧‧ virtual pictures

4711, 4713, 4715, 4717, 4719, 4805, 4807, 4181, 4813, 4815, 4817, 4819, 4911, 4913, 4915, 4917, 4919, 5003‧‧‧ keywords

4921, 4923, 4925, 4927, 4929‧‧ Search results

5005‧‧‧Search Results/Preset Area

12100‧‧‧ core program

12300‧‧‧API

S110, S110_a, S110_b, S130, S130_a, S130_b, S150_a, S170, S170_a, S170_b, S190, S190_a, S190_b, S210, S220, S230, S240, S250, S260, S310, S320, S330, S340, S350, S410, S420, S430, S440, S450, S510, S520, S530, S540, S550‧‧‧ operation

The above and/or other aspects will become more apparent from the description of the exemplary embodiments.

FIG. 1A illustrates a user interface (UI) of an electronic device, according to an example embodiment.

FIG. 1B illustrates a UI of an electronic device according to another exemplary embodiment.

2A illustrates a flow diagram of a method of providing information performed by an electronic device, in accordance with an example embodiment.

2B illustrates a flow chart of a method of providing information performed by an electronic device, in accordance with another example embodiment.

2C illustrates a flow chart of a method of providing information performed by an electronic device, in accordance with still another example embodiment.

3, 4A through 4C, 5, 6A through 6C, and 7 illustrate a detailed UI environment provided during communication via a messaging service.

8, 9A to 9B, and FIG. 10 illustrate a detailed UI environment provided during communication via a voice chat service.

11 through 15 illustrate a detailed UI environment provided during communication via a mail service.

16 through 19 illustrate a detailed UI environment provided during communication via a social networking service (SNS).

Figure 20 illustrates the detailed UI environment provided when using the scheduler service.

Figure 21 illustrates the detailed UI environment provided when using the word processor application.

22A to FIG. 22I illustrate an example in which when the electronic device is a smart phone or a personal computer (PC) and the user performs a text chat by using a smart phone or a tablet PC, the user interface will borrow Information obtained by the electronic device is provided to the user.

23A to 23E illustrate an example in which, when the electronic device is a smart phone or a tablet PC and the user performs a voice chat by using a smart phone or a tablet PC, the information obtained by the electronic device is provided via the output interface. To the user.

24A to 24F illustrate an example in which, when the electronic device is a smart watch and the user performs a text chat by using the smart watch, the information obtained by the electronic device is provided to the user via the output interface.

25A and 25B illustrate an example in which when the electronic device is a smart watch and the user performs a text chat by using the smart watch and the smart phone for the electronic device interoperating with the smart watch, the output is via the output. The interface provides information to the user via information obtained by the electronic device.

26A and 26B illustrate an example in which, when the electronic device is a smart watch and the user performs a voice chat by using the smart watch, the information obtained by the electronic device is provided to the user via the output interface.

27A and 27B illustrate other examples in which, when the electronic device is smart glasses and the user performs text chat by using the smart glasses, the information obtained by the electronic device is provided to the user via the output interface.

28A and 28B illustrate an example in which, when the electronic device is smart glasses and the user performs voice chat by using the smart glasses, the information obtained by the electronic device is provided to the user via the output interface.

29A and 29B illustrate an example in which an electronic device includes various electronic devices, and the user communicates with another user via at least one of voice chat and text chat by using the electronic device, via an output interface. Information obtained by the electronic device is provided to the user.

30A to 30G and 31A to 31B illustrate a setting UI provided by an electronic device according to an exemplary embodiment.

32 through 35 are flowcharts illustrating a method of providing information performed by an electronic device, according to an example embodiment.

Figure 36 illustrates an electronic device in accordance with an example embodiment.

FIG. 37 is a block diagram illustrating an electronic device according to another exemplary embodiment.

Figure 38 illustrates the configuration of the natural language processor illustrated in Figures 36 and 37.

FIG. 39 is a block diagram illustrating an electronic device, according to an exemplary embodiment.

FIG. 40 is a block diagram illustrating an operation of an identification entity performed by an electronic device, according to an example embodiment.

Figure 41 illustrates a table graph generated by a named entity recognizer after the named entity recognizer identifies the entity, in accordance with an exemplary embodiment.

42 is a block diagram illustrating operations performed by an electronic device to obtain user input, in accordance with an example embodiment.

43 is a block diagram illustrating an operation performed by an electronic device to obtain user input, in accordance with another example embodiment.

Figure 44 is a block diagram showing the configuration of a user terminal device in accordance with an exemplary embodiment.

45A is a diagram showing the software configuration of a user terminal device according to an exemplary embodiment. Block diagram.

45B illustrates a user setting screen provided by an electronic device, in accordance with an exemplary embodiment.

FIG. 46 illustrates a UI of an electronic device according to another exemplary embodiment.

47 to 50 illustrate an example of a UI provided by the electronic device 100 for performing communication via a message service.

Some example embodiments are described in more detail below with reference to the drawings, in which like reference numerals refer to In this regard, example embodiments may have different forms and should not be construed as limited to the description set forth herein. Accordingly, the exemplary embodiments are described below to explain the aspects of the invention. For ease of explanation, it is possible to enlarge the size of the components in the drawings. In other words, since the size and thickness of the components in the drawings are arbitrarily explained for convenience of explanation, the following exemplary embodiments are not limited to this case.

All terms including descriptive or technical terms used herein are to be interpreted as having a meaning that is obvious to those skilled in the art. However, the terms may have different meanings depending on the purpose of the person skilled in the art, the precedent condition, or the appearance of new technology. Moreover, some terms may be arbitrarily selected by the applicant, and in this case, the meaning of the selected terms will be described in detail in the description of the present invention. Therefore, the terms used herein must be defined based on the meaning of the terms along with the description throughout the specification.

Throughout this specification, when a part "includes" or "includes" a part, There is no specific description to the contrary, otherwise the part may contain other parts without excluding other parts. Throughout the specification, it will be understood that when a component is referred to as "connected to another component" or "coupled to another component, it can be directly connected to or coupled to another component, or Electrically connected to or coupled to another component by having an intervening component interposed therebetween. In the following description, terms such as "unit", "module" or the like indicate a unit for processing at least one function or operation, wherein the unit and module may be implemented as hardware or software or by combining hardware. Implemented with software.

Throughout this specification, the term "user" may mean a user of an electronic device. Throughout this specification, a communication service may mean a one-to-one service, a one-to-many service, or a many-to-many service that facilitates the exchange of information between users (eg, a conversation between users).

Throughout this specification, an application indicates a set of computer programs designed to perform a particular task. Throughout this manual, the application can vary. For example, the application can include, but is not limited to, a game application, a video reproduction application, a map application, a memo application, a calendar application, a phone book application, a broadcast application, an exercise support application, and a payment. Apps, photo binder apps, and more. An application can also be called an "application".

The inventive concept will now be described more fully hereinafter with reference to the accompanying drawings in which FIG. However, the inventive concept may be embodied in many different forms and should not be construed as being limited to the example embodiments set forth herein. The embodiments are provided so that the present invention will be thorough and complete, and hair The concept of Ming is fully conveyed to those who are familiar with the field. In the following description, well-known functions or constructions are not described in detail, as they will obscure the invention in unnecessary detail. Throughout the specification, like reference numerals in the drawings refer to the

The term "and/or" as used herein includes any and all combinations of one or more of the associated listed items. An expression such as "at least one of" is used to modify the entire list of parts before the list of parts, and does not modify the individual parts of the list.

Throughout this specification, a message may mean a unit text set or a unit speech set that includes at least one selected from the group consisting of words, phrases, and clauses that may be part of a conversation between users.

Throughout this specification, a keyword may be included in a message and may mean a word, phrase, and/or clause related to the meaning of the message obtained by performing a natural language analysis on the message.

Throughout this specification, a query may mean a word, phrase, and/or clause used to search for a target of information that matches a query condition.

FIG. 1A illustrates a user interface (UI) of an electronic device 100 in accordance with an example embodiment.

The electronic device 100 can be embodied as: a smart phone, a personal computer (PC), a wearable device, a personal digital assistant (PDA), a laptop, a cellular phone, an action Telephone, enterprise digital assistant (EDA), portable multimedia player (PMP), personal navigation device (PND), portable navigation device (portable Navigation device; PND), handheld game console, mobile internet device (MID), or e-book (e-book).

Throughout this specification, a wearable device can include a head-mounted display (HMD) that is worn over the head. For example, an HMD can include, but is not limited to, glasses, a helmet, a hat, or the like. Throughout this specification, the wearable device can include a ring, a necklace, a bracelet, a shoe, an earring, a hair band, a cloth, a glove, a thimble, or the like.

The electronic device 100 according to an exemplary embodiment can display messages 5, 6, 7, and 8 on its screen via a communication service. Throughout this specification, a message may mean a set of text units or sets of speech units that are part of a conversation between users and that are exchanged in a sequence between the electronic device 100 and another electronic device. For example, referring to FIG. 1A, the user (Chris) transmits a message to Hyunjin at 8:28 am on August 6, 2013. "What do you want to do?" Do?)". Also, for example, referring to FIG. 1A, Hyunjin transmits a message 8 "I want to eat pizza." at 08:30 am on August 6, 2013. For example, in FIG. 1A, the text in each dialog box included in the conversation between Chris and Hyunjin can be defined as a message.

The electronic device 100 according to an exemplary embodiment may determine whether a keyword is extracted from a message. The electronic device 100 according to an exemplary embodiment may extract at least one keyword from a message displayed on a screen via a communication service. For example, the electronic device 100 can extract at least one keyword from text and images in the message. For example, the electronic device 100 may extract at least one keyword from a multimedia file attached to the message. Multimedia files can include image files, video files, and sound files. The essential The word may be included in the message or may be related to the content of the message and may include at least one of a word, a phrase, and a clause related to the meaning of the message. For example, the electronic device 100 can extract "pizza" as a keyword from the message 8.

The electronic device 100 according to an exemplary embodiment may display the extracted keywords. Referring to FIG. 1A, the electronic device 100 marks a keyword by using a bottom line. Alternatively, the electronic device 100 can distinguish between the keyword and other content of the message 8 by changing the font, by changing the font size, by highlighting the keyword, by performing bold lettering on the keyword By blinking the keyword, by coloring the keyword, or by coloring the dialog.

The electronic device 100 according to an exemplary embodiment may generate a query related to a keyword extracted from a message, and may obtain information based on the query and location information of the electronic device 100. A query may mean at least one of a word, a phrase, and a clause for searching for a target of information that matches a query condition. Queries can be related to keywords. The query can be generated based on at least one keyword.

The electronic device 100 according to another exemplary embodiment may generate a query based on the keyword and the location information of the electronic device 100. For example, the electronic device 100 may obtain information via a query generated based on the keyword and the location information of the electronic device 100, and may display the information.

The electronic device 100 can obtain information in the electronic device 100 or information that can be obtained from the server. The electronic device 100 can obtain information from the search engine website.

Further, the electronic device 100 can provide information obtained by a processor of the electronic device 100. In an exemplary embodiment, information is provided to the user visually or acoustically for identification. For example, when the user touches the rest of the message 8 When the keywords are marked in different ways, the electronic device 100 can provide the obtained information.

In an exemplary embodiment, the processor of the electronic device 100 may obtain information related to keywords marked in a manner different from the rest of the message 8 regardless of the request from the user, and may store the information in the electronic device 100. Memory (not shown). Moreover, when the user touches a keyword (eg, highlighted) that is marked in a different manner, the electronic device 100 can output the memory obtained from the user of the electronic device 100 regardless of the request from the user and is stored in the electronic device 100. Information in the memory and information can be provided to the user.

In an exemplary embodiment, when the user touches a differently labeled (eg, highlighted) keyword, the processor of the electronic device 100 can obtain information related to the keyword, and can provide the information to the user. The information is not stored in the memory of the electronic device 100.

A method of extracting a keyword performed by the electronic device 100, a method of generating a query based on the extracted keyword, and a method of obtaining information based on the query and location information of the electronic device 100 will be described in detail later with reference to FIG. 2A.

FIG. 1B illustrates a UI of an electronic device 100 in accordance with another exemplary embodiment.

The electronic device 100 according to an exemplary embodiment may provide a query generated by a processor of the electronic device 100. The electronic device 100 according to an exemplary embodiment may receive a query edited by a user. For example, the user can write the second query by editing the first query generated by the processor, and can input the second query into the query editing window 1 provided through the graphical user interface (GUI) of the electronic device 100. . The user can input the first query generated by the processor to the electronic device 100 as a second query. The electronic device 100 may obtain information based on the edited second query and may be based on The edited second query and the location information of the electronic device 100 obtain information.

For example, as illustrated, the electronic device 100 can provide a query edit window 1 and can provide the word "pizza" as a preset value for the query. In addition, the electronic device 100 can receive a query edited by the user, can obtain information by using various methods, and can provide the obtained information to the user. A detailed description about the operation of the electronic device 100 is provided in detail with reference to FIGS. 2A and 2B.

Hereinafter, the operation of the electronic device 100 will be described.

2A illustrates a flow diagram of a method of providing information, which is performed by electronic device 100 and is described corresponding to FIG. 1A, in accordance with an example embodiment.

Referring to FIG. 2A, the processor of the electronic device 100 may extract a keyword from a message displayed on the screen of the electronic device 100 via a communication service (S110). The method for the processor to extract keywords may include semantic analysis and/or statistical analysis as illustrated in Table 1.

[1. Extraction of keywords]

For example, as illustrated in FIGS. 1A and 1B, the message displayed on the screen can be "What do you want to do?" (first message 7) and "I want to I want to eat pizza (second message 8). The processor can analyze the meanings of the first message and the second messages 7 and 8, and can extract "pizza" as a keyword from the second message 8.

The processor of the electronic device 100 can perform semantic analysis and/or statistical analysis on the message, and thus can extract "pizza" as a keyword. The processor of the electronic device 100 can extract the keywords by considering the situation related to the message. For example, the processor of the electronic device 100 may extract keywords based on the type of words included in the message, the relationship between the words, and the meaning of the words.

The processor can identify the entities in the message by using the method described with reference to Figures 36 through 41, and can extract the keywords by considering the number of times each of the entities is used. A method of identifying an entity performed by a processor will be described later.

The processor of the electronic device 100 can control various processing operations of the electronic device 100. For example, the processor of the electronic device 100 may include processing such as a central processor unit (CPU), a micro controller unit (MCU), or a micro processor unit (MPU). Device.

[1-1. Semantic Analysis]

The processor of the electronic device 100 can extract keywords by performing semantic analysis.

For example, the processor can extract "pizza" as a keyword by further considering the content of the conversation between the users and the related information of the user. Here, the user related information may include at least one of a user's location log, information previously input by the user, and historical information about the user. User related information may mean information about only one user or information about at least two users.

The processor may extract keywords based on, for example, but not limited to, at least one of: 1) content of the session between the users, 2) location log of the user, 3) information previously entered by the user, and 4 ) Historical information about the user.

The processor can perform natural language analysis on the content of the conversation between users, can identify the content of the conversation between users, and can extract keywords. For example, in the example embodiment of FIG. 1A, the processor may extract keywords based on: content extracted from a session between the user and another communicating party, content of the session regarding the location of the user, Conversational content about the user's mental state (eg, sensation), and/or conversational content about the user's past experience.

For example, the processor can perform extraction based on the session content, and in the example embodiment of FIG. 1A, the processor can extract "pizza" from the message 8 as a key. The processor can recognize the meaning of the message contained in the session between the users, and can predict the type of information the user desires based on the meaning of the message. For example, the processor can analyze the meaning of the message as "the user wants to eat pizza" and can predict based on the meaning that the user currently wants to find near the current location of the user. Pizza restaurant (first case), or the phone number of the pizza restaurant that the user needs near the user's current location (second case). this Whereas, the user's situation may indicate an environmental element associated with the user.

In addition, when the processor extracts keywords based on the meaning of the message, the processor can consider the location log of the user.

For example, the user's location log may include the frequency of the user passing through where the user is currently located or the frequency with which the user traversed a particular place, the number of times the user traversed the user's current location, or the user. The number of times a particular place passes, the total time the user stays where the user is currently located or stays in a particular place, the total time the user stays in the user's current location, or stays in a particular place Time, and/or when the user first visited the current place or a specific place.

The electronic device 100 can check the location information of the user, and can use the location information to extract keywords. The location information of the user can be continuously checked in real time, and the location information can be stored in the electronic device 100.

The location information of the user can be measured by the location information of the electronic device 100. For example, the location information of the electronic device 100 may include a Global Positioning System (GPS)-coordinate value, a base station identification (ID), a service set identifier (SSID), and an access point (access). Point; AP) network address. The user's location information can be measured by using a measurement method including, for example, various wireless communication technologies: diffuse infrared, ultrasonic, Bluetooth, ultra-wideband (UWB), Radio-frequency identification (RFID), Wi-Fi protected setup (WPS) or the like.

The location information may indicate about the user or the electronic device 100 according to time Log information for the location. For example, the electronic device 100 can include a GPS module. A method of measuring the position of the electronic device 100 performed by the GPS module will be described in detail with reference to FIG.

In addition, when the processor extracts a keyword based on the meaning of the message, the processor can consider the information previously entered by the user.

For example, the information previously entered by the user may include the user's address, the user's preferences for the pizza restaurant, the user's propensity to select the menu, and the user's estimated schedule.

For example, when the user's address is relatively far from the current location and the total time period in which the user stays at the current location is less than the reference time (eg, one hour), the processor can recognize that the current location of the user is not familiar to the user. The place. Based on the analysis, the processor can predict that the user currently wants to find a pizza restaurant near the current location of the user (first situation) or a phone number of the pizza restaurant that the user needs to be near the user's current location (second situation).

In addition, when the processor predicts a keyword based on the meaning of the message, the processor can consider historical information about the user.

For example, the history information about the user may indicate the history of the user recorded in the electronic device 100 and the server. Further, the history of the user may include a history recorded by the user when the user uses the electronic device 100, and a history recorded by the user to the server when the user uses the application service. Further, the history of the user may include content that is not directly recorded by the user but indirectly recorded when the user uses the electronic device 100 or the server. For example, historical information about a user may include user related information, such as a user. Current location, user's payment history, user's cumulative history, user's call history, or the like.

[1-2. Statistical Analysis]

The processor of the electronic device 100 can extract keywords via statistical analysis.

The processor can determine the priority of the reference content. For example, when the processor performs semantic analysis based on the content of the session between the users, the location log of the user, the user input information, and the historical information about the user, the processor may determine the analysis basis of the extracted keywords. Prioritized analytical basis. For example, when the location of the electronic device 100 measured by the GPS module of the electronic device 100 is different from the location information mentioned in the content of the session between the users, the processor can be used by priority. The location information mentioned in the content of the conversation between the participants to extract the keywords.

Additionally, the processor can determine the priority of the user's predicted situation. For example, in the example embodiment of FIGS. 1A and 1B, the processor may determine that a situation has a high probability of occurrence, wherein the situation is one of the following: in the first case, the user currently wants To find a pizza restaurant near the user's current location; and in the second case, the user needs the phone number of the pizza restaurant near the user's current location.

Based on the user's accumulated location information, if the user frequently visits a particular pizza restaurant, the processor can determine that the first situation in which the user currently wants to find a pizza restaurant near the user's current location is the first priority.

Alternatively, for example, when the user is currently located outdoors, and based on the user's accumulated location information (or cumulative location history), if the user is in the pre- Moving within a fixed time (eg, 30 minutes), or if the outing is recorded to the user's scheduler, the processor can determine that the user currently wants to find the first situation of the pizza restaurant near the user's current location. Is the first priority.

For example, when the number of times the user calls the pizza restaurant is equal to or greater than a preset number of times in the user's call history, the processor may determine that the user needs a phone number of the pizza restaurant near the user's current location. The second case is the first priority.

Alternatively, for example, when the user is currently located in the user's friend's house, and according to the user's schedule, the user intends to stay in the place within a predetermined time (for example, 3 hours), processing The second condition in which the user can determine the phone number of the pizza restaurant in the vicinity of the user's current location is the first priority.

Although the processor determines the first situation or the second situation in the above examples, the exemplary embodiments are not limited thereto. The processor of the electronic device 100 can determine one of any number of different situations based on the meaning of the message and the historical information of the user.

The processor can extract the keyword "pizza" by performing the aforementioned statistical analysis and/or semantic analysis.

[1-3. Limitations in the extraction of keywords]

The processor of the electronic device 100 can set the keyword in consideration of the number of occurrences of the corresponding word. For example, the processor may set a word that is repeatedly mentioned by the user in the session more than a predetermined number of times as a keyword. For example, when a user mentions a word at least five times in a conversation or has a frequency of use of at least about 20%, The processor can set the word as a keyword.

For example, the processor can perform named entity identification and can measure the number of repetitions or repetition rate (or repetition rate) of each of the entities. For example, the processor measures the number of repetitions or repetition rates of each of the entities identified via the external server.

A method of identifying an entity via a processor or a server will be described later.

In addition, the external server may perform named entity identification, and may calculate the number of repetitions or repetition rate of each of the entities, and the processor may receive information about the number of repetitions or repetition rates of each of the entities, and may Reference materials to set keywords.

For example, the processor may not set an entity that refers to a number of times less than a preset number of times as a keyword. Further, for example, the processor may not set an entity that mentions a rate less than a preset rate as a keyword. The aforementioned algorithm for limiting the extraction of keywords may also be applied to the algorithm used to generate the query.

The processor can mark the extracted keywords differently than other words in the message. The processor may receive a user input selecting the extracted keyword, and may perform operations S130 to S190. In another example embodiment, the processor may perform operations S130 through S190 without receiving user input.

Moreover, the processor can limit the extraction of keywords by using semantic analysis methods as described above. In other words, the electronic device 100 can identify the entity based on: 1) the content of the conversation between the users, 2) the location log of the user, 3) the information previously input by the user, and 4) the historical information about the user. And can limit the identification of the entity.

For example, when the electronic device 100 receives the message "please go to the pizza meal" By performing a semantic analysis, the processor recognizes the funeral hall next to the pizza restaurant (also known as the funeral hall next to the pizza restaurant). > is an entity, or can identify the <pizza restaurant> as an entity, but may not extract the identified entity as a keyword.

For example, the processor can recognize the connection words used in the funeral hall next to the pizza restaurant to connect the words of the stated place (eg, in close proximity, nearby or The rear part), and the "funny hall next to the pizza restaurant" is recognized as an entity.

[1-4. Extraction of keywords by user input]

The processor can determine the keyword by receiving user input. Users can select keywords from the conversational message. Users can select keywords in a preset way. For example, the user can select a keyword by setting a preset manner. For example, the user can select a keyword in a long press touch and drag operation.

The processor can generate and provide a query related to the keyword (S130). The method for the processor to generate the query is semantic analysis and/or statistical analysis as shown in Table 2.

[2. Query generation]

As depicted in the example embodiment of FIG. 1B, the processor may perform semantic analysis and/or statistical analysis based on the extracted keywords, and may generate a "good day pizza" as a query. For example, the processor may generate a "good day pizza" as a query based on at least one of: 1) the content of the conversation between the users, 2) the location log of the user, 3) Information previously entered by the user, and 4) historical information about the user.

The processor can analyze the content of the conversation between users and can generate a "good day pizza" as a query. For example, if the processor semantically recognizes that the user wants to eat at the restaurant "good day pizza" from the content of the conversation between the users, the processor can generate a "good day pizza" ( Good day pizza)" as a query.

The processor can analyze the user's location log and can generate a "good day pizza" as a query. The processor can analyze the user's location log and can provide a query that matches the user's situation.

For example, if the processor recognizes that the user wants to find a pizza restaurant near the current location, and frequently appears in the cumulative history of the user's location, the user has visited the restaurant "good day pizza" (good day pizza) The record can be used by the processor to generate a "location of good day pizza" as a query.

For example, if the processor recognizes that the user wants to have the phone number of the pizza restaurant near the current location, and frequently appears in the user's call history, the user is called to call the restaurant "good day pizza" (good day pizza) The record of the "", the processor can generate the phone number of the "good day pizza" (telephone number of Good day pizza)" as a query.

For example, if the processor recognizes that the user wants to find a pizza restaurant near the current location or a pizza restaurant with a pizza restaurant near the current location, and frequently appears in the payment details receiving message in the user's history. The user can record the "good day pizza" payment in the restaurant, and the processor can generate "good day pizza" as the query.

The processor can analyze the information previously entered by the user and can generate a "good day pizza" as a query. The processor can recognize the restaurant "good day pizza" from the information input to the electronic device 100 as the user's favorite pizza restaurant.

The user can directly record the restaurant "good day pizza" as the user's favorite pizza restaurant to the electronic device 100. Further, the user can record a plurality of pieces of information about the restaurant "good day pizza" to the electronic device 100. In this case, the processor can identify the restaurant "good day pizza" as the user's favorite pizza restaurant by performing statistical analysis.

The processor can identify the restaurant "good day pizza" as the user's favorite pizza restaurant from the information input to the server via the application service. For example, by referring to comments written by the user and input to the server via a social networking service (SNS), the processor can determine that the user prefers the restaurant "good day pizza."

The user can use the application service to record the restaurant "good day pizza" as the user's favorite pizza restaurant directly to the server. Library. And, the user can record a plurality of pieces of information about the restaurant "good day pizza" to the server's database via the application service. In this case, the processor can use the statistical method to identify the restaurant "good day pizza" as the user's favorite pizza restaurant.

As described above, the processor can perform semantic analysis and/or statistical analysis, and thus can extract "good day pizza" as a query.

The electronic device 100 can receive an information provision request from a user and can extract the query. For example, display 9 (see FIG. 1A) can receive user input (eg, a touch) that selects a portion of a keyword that is displayed on the screen, and can extract the query. For example, before the electronic device 100 receives the information provision request from the user, the electronic device 100 may determine the keyword, and may display the keyword by marking the keyword in a manner different from other content, and the electronic device After receiving the information provision request from the user, the electronic device 100 may extract the keyword.

Throughout this specification, the information provision request may include an input by the user requesting the electronic device 100 to provide information. For example, the user may input the request by using various input methods (eg, touch, click, double click, etc.) that request the electronic device 100 to provide information, and the user's request may be referred to as an information provision request. . And, the user can input a specific command including voice and/or text to request the electronic device 100 to provide information, and the user's request can be referred to as an information provision request or an information provision request input.

The aforementioned algorithm for limiting the extraction of keywords may also be applied to the algorithm used to generate the query.

The processor may obtain information based on the query and the location information of the electronic device 100 (S170). The method for the processor to generate information is as shown in Table 3.

[3. Access to information]

The electronic device 100 can perform various types of information capturing operations based on the query and the location information of the electronic device 100, and thus can obtain information. The information obtained by the electronic device 100 may include two-dimensional (2D) images, three-dimensional (3D) images, 2D animations, 3D animations, texts generated by using various languages, and various fields of content. And an application that provides a variety of services.

After the electronic device 100 receives the user input selecting the keyword, the electronic device 100 may perform an operation of obtaining information corresponding to the selected keyword.

In addition, before the electronic device 100 receives the user input of the selected keyword, the electronic device 100 may perform an operation of obtaining information corresponding to the selected keyword, and may store the obtained information in the storage of the electronic device 100. . The electronic device 100 can receive user input selecting a keyword, and can provide information stored in the storage to the user.

In the following, the operation of obtaining information is described in detail.

[3-1. Access to information via application services]

The electronic device 100 can obtain relevant information from an external search server.

For example, the electronic device 100 can obtain information via an application service.

The electronic device 100 can determine the service according to the current state of the application, and can perform various types of information capturing operations based on the query and the location information of the electronic device 100, and thus can obtain information.

For example, according to the location information of the user, when it is determined that the user is located in South Korea, the electronic device 100 may select a map application service provided by the South Korean service provider, and when the user is located in Japan, the electronic device 100 may select A map application service provided by a Japanese service provider.

For example, the electronic device 100 can refer to the number of times the user uses the map application, and can select a map application service frequently used by the user of the electronic device 100.

The electronic device 100 can request the user to select an application service, can receive a response from the user, and can select an application service based on the response from the user.

For example, the electronic device 100 may select a candidate application to be used (for example, the first application to the fifth application) in consideration of a user's situation, and may request the user to select the first application to the fifth application. At least one of the plurality of applications, and when the user selects the first application, the electronic device 100 can capture the information by using the first application.

According to an exemplary embodiment, the electronic device 100 may select an application service that matches the current situation of the user from among application services selected by the user.

For example, the electronic device 100 can select the first application from the first application to the fifth application selected by the user according to the current situation of the user. For example, if the user previously selected the first restaurant application to the fifth restaurant For the application, the electronic device 100 can select the "good day pizza" restaurant application according to the current situation of the user.

According to an exemplary embodiment, the electronic device 100 may request the user to select at least one of the application services selected by the user, receive a response from the user, and select an application service according to the response from the user.

For example, the electronic device 100 can request the user to select at least one of the first application to the fifth application selected by the user, and when the user selects the first application, the electronic device 100 can use the first An application captures information.

[3-2. Access to information via the Internet search service]

The electronic device 100 can obtain relevant information from an external search server.

For example, the electronic device 100 can obtain information via an internet search service.

The electronic device 100 can determine the internet search service, and can perform various types of information capture based on the query and the location information of the electronic device 100, and thus can obtain information. The query can indicate an automatically extracted query or a query edited by the user.

For example, the Internet search service can indicate commercial search services including Yahoo, Google, Bing, Navigator, and the like. For example, the Internet search service can indicate search services that can be accessed by authorized users, such as a university library database, a thesis search engine website, or a research library.

The electronic device 100 can obtain information based on the query and the location information of the electronic device 100, and can provide the information to the user.

Therefore, the electronic device 100 according to an exemplary embodiment may allow a user to The user conveniently receives information related to an ongoing communication service when using the communication service.

[3-3. Acquisition of information in electronic devices]

The electronic device 100 can obtain the information of interest from the internal storage device. In the following, the information of interest is referred to as attention information.

For example, the electronic device 100 can obtain the attention information from the image file stored in the internal storage device, the phone number list, the address list, and the newly retrieved information list. When the electronic device 100 is a wearable device, the electronic device 100 may obtain attention information from a storage device included in another electronic device, and the other electronic device is communicated with the electronic device 100 via short-range communication such as Bluetooth. connection.

Accordingly, the electronic device 100 according to an exemplary embodiment may allow a user to conveniently receive information related to a communication service when the user uses the communication service.

The output interface provides information obtained by the processor (S190). The method for the processor to provide information is as shown in Table 4.

[4. Deployment of information]

The electronic device 100 can provide the information obtained based on the query and the location information of the electronic device 100 to the user in various manners.

For example, the electronic device 100 can provide the obtained information to the user via at least one of voice, video, and text. The method of providing the obtained information, which is performed by the electronic device 100, may vary depending on the type of the electronic device 100. A method of providing the obtained information performed by the electronic device 100 will be described in detail with reference to FIGS. 22 to 29.

2B illustrates a flow diagram of a method of providing information, which is performed by electronic device 100 and is described in correspondence with FIG. 1B, in accordance with another example embodiment.

The electronic device 100 may extract a keyword from a message used in communication, may generate a first query related to the keyword, and may provide the first query to the user (S110_a and S130_a). The electronic device 100 can provide the first query by using various methods. For example, the electronic device 100 can provide a query by generating a dialog box, by using a pop-up window, or by performing a screen transition.

The electronic device 100 can receive the second query edited by the user (S150_a).

[5. Edit Query]

The electronic device 100 can receive the edited second query from the user (S150_a). The electronic device 100 may allow editing of the query in a manner that edits the query by text, gesture, voice, or sketch.

When the first query generated by the electronic device 100 is provided to the user, the user can edit the query by reflecting its exact intent to the query. Throughout this specification, the term "edited query" may mean a query that is edited by a user.

The user can edit the query provided by the electronic device 100 via the output interface. For example, the user can edit the query provided by the electronic device 100 and can input the edited query to the electronic device 100. For example, the user may not change The query provided by the electronic device 100 is changed and the query can be entered when the query is provided. The electronic device 100 can receive an edited query or an unedited query entered by the user.

The electronic device 100 may obtain information based on the edited query and the location information of the electronic device 100 (S170_a). The electronic device 100 can provide the obtained information in various manners (S190_a). A method of providing the obtained information, which is performed by the electronic device 100, will be described in detail with reference to FIGS. 22 through 29.

2C illustrates a flow chart of a method of providing information performed by electronic device 100, in accordance with an example embodiment.

The electronic device 100 may extract a keyword from a message used in communication, may generate a query based on the keyword and the location information, and may provide the generated query to the user (S110_b and S130_b).

The electronic device 100 can recognize location information in various ways and can provide a query. For example, the electronic device 100 can generate a query by considering location information of the electronic device 100 obtained by the GPS module of the electronic device 100, or can be considered by considering words and words included in the message. The connection information (for example, the connection information used to connect the words of the place where the statement is placed (for example, beside, near or behind)), the meaning of the word, etc., generates a query.

The electronic device 100 may generate keywords and/or queries using the location information obtained in the foregoing manner. And, the electronic device 100 can use the location information to obtain information to be provided to the user.

The electronic device 100 may obtain information based on the query (S170_b). The electronic device 100 can provide information in various ways (S190_b). The electronic device 100 can provide information in various manners as described with reference to FIGS. 22-29.

In the following, detailed scenarios are described below.

[Scenario 1: Message Service]

3 through 7 illustrate a detailed UI environment provided during communication via a messaging service.

Referring to FIG. 3, the electronic device 100 can display communication content between users via a message service.

The electronic device 100 can provide an interface including a back button 20, a voice call connection button 30, a user name box 40, and a communication window (reference numerals 5, 6, 7, and 8). The username box 40 can include a back button 20 and a voice call connect button 30.

The user can return to the previous menu by using the back button 20 (eg, touch or double tap back button 20). The user can perform a voice chat by using a voice call connection button 30 (eg, a touch or double tap voice call connection button 30). Username box 40 can display the name or nickname of the other party in the session. And, the user name box 40 can display the name or nickname of the user of the electronic device 100. The communication window can display messages 5, 6, 7, and 8 exchanged between the user and the other party.

The electronic device 100 can determine whether keywords are extracted from each of the messages 5, 6, 7, and 8 by using the natural language processor 1200 (refer to FIG. 36). The electronic device 100 can recognize the meaning of each of the messages 5, 6, 7, and 8, and can determine whether to extract a keyword therefrom.

And, the electronic device 100 can extract "pizza" as a keyword via statistical analysis and/or semantic analysis. For example, the electronic device 100 may extract "pizza" as a keyword based on the following: 1) between users The content of the session, 2) the user's location log, 3) the information previously entered by the user, and 4) historical information about the user.

For example, the electronic device 100 may perform natural language analysis on 1) the content of the conversation between users, and may extract "pizza" as a keyword. The electronic device 100 can recognize the meaning of the message contained in the content of the session between the users, and can predict the user's needs based on the meaning of the message. For example, the electronic device 100 can analyze the meaning of the message as "the user wants to eat pizza", and can predict based on the meaning: 1) the user wants to find a pizza restaurant, or 2) The user needs the phone number of the pizza restaurant near the user's current location, and can extract "pizza" as a keyword.

And, for example, the electronic device 100 can perform natural language analysis on the content of the session, and can extract "pizza" as a keyword by further considering the following: 2) the user's location log, 3) use Information previously entered, and 4) historical information about the user.

For example, the user's location log may include the frequency of the user passing through the location where the user is currently located, the number of times the user passes through the location where the user is currently located, and the user staying where the user is currently located. The total time, the total time the user stayed at the user's current location during a particular time period, and/or the time when the user first visited the current location.

For example, the information previously entered by the user may include the user's address, the user's preferences for the pizza restaurant, the user's propensity to select the menu, and/or the location based on the user's estimated schedule.

For example, historical information about the user may indicate that the information is recorded in the electronic device. Set 100 and the history of the user in the server. Further, the history of the user may include a history recorded by the user when the user uses the electronic device 100, and a history recorded by the user to the server when the user uses the application service. In addition, the history of the user may include content that is not directly recorded by the user but indirectly recorded when the user uses the electronic device 100 or the application service.

Referring to FIGS. 4A-4C, the electronic device 100 can continuously monitor the user's conversation content, as illustrated in FIG. 4, and can respectively indicate or mark the keywords included in the message.

For example, the electronic device 100 may highlight a keyword included in the message (as shown in FIG. 4A), may add a bottom line to the keyword (as shown in FIG. 4B), or may change the keyword-containing The color of the dialog box (as shown in Figure 4C).

The electronic device 100 may allow the user to adjust the duration of the individual indication or flag on the keyword via the settings (refer to FIG. 31E).

Although not illustrated, the electronic device 100 can indicate or tag keywords to distinguish keywords and other content of the message by using various methods.

For example, the electronic device 100 can mark the keywords included in the message by using different fonts or placing the box around the keyword.

For example, the electronic device 100 can mark a keyword included in the message by using a hyperlink.

For example, the electronic device 100 can mark the keywords included in the message by using a blinking effect.

For example, the electronic device 100 can mark the keywords included in the message by using the avatar.

For example, the electronic device 100 can mark the keywords included in the message by using a dialog box.

For example, the electronic device 100 can mark the keywords included in the message by using a superscript or a subscript.

For example, the electronic device 100 can mark the keywords included in the message by using colors of colors other than the content of the message.

The above examples are given for illustrative purposes only, and example embodiments are not limited thereto. The electronic device 100 can indicate or tag keywords to distinguish keywords and other content of the message by using any method.

Referring to FIG. 5, the electronic device 100 can receive a user input corresponding to an indication or indicia that requires input. The user can enter the request by using various methods. The electronic device 100 can receive an information provision request input.

The information provision request input may instruct the user to request input of information provided by the electronic device 100. For example, the user can input the request by using various input methods (eg, touch, click, double click, etc.) that request the electronic device 100 to provide information. And, the user can input a specific command including voice and/or text to request the electronic device 100 to provide information.

For example, the electronic device 100 can select a keyword by receiving a user's voice via a microphone or a voice recognition processor. For example, the electronic device 100 can select a keyword by receiving a user's click through a mouse, a touch panel, or a touch pad. For example, the electronic device 100 can select a keyword by receiving a user's touch via a touch panel or a touch pad. For example, the electronic device 100 can select a keyword by receiving a preset specific gesture action of the user via the sensing camera. For example, the electronic device 100 can receive an input of a selection keyword via a virtual keyboard or a virtual touch screen.

Referring to FIGS. 6A through 6C, the electronic device 100 may provide a query related to a keyword.

6A illustrates a screen of electronic device 100 that displays a keyword (eg, "pizza") in a primary box and displays a candidate query in candidate list window 610 below the primary box. For example, a candidate query for the keyword "pizza" may include "good day pizza", "good day pizza number", "good day" "good day pizza location" and "good day pizza menu".

The electronic device 100 may generate a candidate query by performing statistical analysis and/or semantic analysis based on the extracted keywords. As illustrated, the electronic device 100 can generate candidate queries "good day pizza", "good day pizza number", and "good day pizza position" based on each of the following: " pizza location"" and "good day pizza menu": 1) the content of the conversation between users, 2) the location log of the user, 3) the information previously entered by the user, and 4) Historical information about the user.

The electronic device 100 may add a candidate query according to 1) the content of the session between the users.

For example, the electronic device 100 may continuously perform natural language processing on the content of the conversation between the users, and may recognize the meaning of the content of the session when the electronic device 100 monitors the content of the conversation between the users. When the electronic device 100 recognizes "pizza" as the main theme and the user wants to order "pizza", Based on the content of the conversation between the users, the electronic device 100 can predict the phone number of the restaurant that the user needs. Further, if the word "good day pizza" is used in the content of the conversation between the users, the electronic device 100 can add "good day pizza number" as a candidate. Inquire.

For example, when the electronic device 100 recognizes "pizza" as the main theme and the user wants to order "good day pizza", the electronic device is based on the content of the conversation between the users. 100 predicts that users need information about pizza restaurants. In addition, when a type of pizza that the user wants to eat is included in the content of the conversation between the users, the electronic device 100 may add a "good day pizza menu" as a candidate query.

The electronic device 100 may add a candidate query according to 2) the user's location log.

For example, the electronic device 100 recognizes that the user wants to find a pizza restaurant near the current location or a pizza restaurant with a pizza restaurant near the current location, and frequently appears in the payment details receiving message in the user's history. The user can add "good day pizza" as a candidate for the record of payment in the "good day pizza" restaurant.

For example, if the electronic device 100 recognizes that the user wants to find a pizza restaurant near the current location, and frequently appears in the cumulative history of the user's location, the user visits the "good day pizza" restaurant. For the record, the electronic device 100 may add a "good day pizza location" as a candidate query.

For example, if the electronic device 100 recognizes that the user wants to have the phone number of the pizza restaurant near the current location, and the user frequently calls the "good day pizza" in the user's call history. For the record of the restaurant, the electronic device 100 may add a "good day pizza number" as a candidate query.

The electronic device 100 can add a candidate query by analyzing 3) information previously input by the user.

For example, the electronic device 100 can analyze the information previously input by the user, and can recognize that the "good day pizza" restaurant is the favorite pizza restaurant of the user.

The user can directly record the "good day pizza" restaurant as the user's favorite pizza restaurant to the electronic device 100. In addition, if the user records a plurality of pieces of information about the "good day pizza" restaurant to the electronic device 100, the electronic device 100 can recognize that "good day pizza" is used. The favorite pizza restaurant. If there is no direct record of the information about the user's favorite pizza restaurant, the electronic device 100 can identify the "good day pizza" restaurant as the user's favorite pizza restaurant by performing statistical analysis, and A "good day pizza number" can be added as a candidate query.

The electronic device 100 can determine that the "good day pizza" restaurant is the user's favorite pizza restaurant through the information input by the application service to the server. Users can use the application service to record the "good day pizza" restaurant as the user's favorite pizza restaurant directly to the server. Library. In addition, if the user records a plurality of pieces of information about the "good day pizza" restaurant to the server's database via the application service, the electronic device 100 can determine "good day pizza" (good Day pizza)" The restaurant is a favorite pizza restaurant. If there is no direct record of the information about the user's favorite restaurant in the server, the electronic device 100 can identify the "good day pizza" restaurant as the user's favorite pizza restaurant by performing statistical analysis. And "good day pizza number" can be added as a candidate query.

The electronic device 100 may add a candidate query according to 4) historical information about the user. The electronic device 100 can check the payment history of the user and find a plurality of records for payment at the "good day pizza" restaurant, and the electronic device 100 can determine that the "good day pizza" restaurant is User's favorite pizza restaurant. When the electronic device 100 checks the user's search history and detects that the user retrieves the menu of the "good day pizza" restaurant several times, the electronic device 100 may add a "good day pizza menu" ( Good day pizza menu)" as a candidate query.

FIG. 6B illustrates a UI displaying a query for an extracted keyword (eg, "pizza") in the form of a preset value in an input box. The keywords can be determined by using various methods described with reference to FIGS. 2A through 2C. For example, the electronic device 100 can generate the same query as the determined keyword and can edit the query via an input interface provided by the electronic device 100.

Figure 6C illustrates a UI displaying a query in the form of a preset value (e.g., "good day pizza") in an input box.

The query can be determined by using various methods described with reference to FIGS. 2A through 2C. For example, a query can be generated based on the keyword and location information, as described with reference to FIG. 2C. For example, when the keyword is "pizza" and the word "good day pizza" is mentioned in the message between users for several times, the electronic device 100 can generate " Good day pizza is used as an inquiry.

The keywords can be edited via an input interface provided by the electronic device 100. For example, the user can edit the query "good day pizza" to "good day pizza location", "good day pizza number", " Good day pizza menu" or the like. The electronic device 100 can obtain information based on a query edited by a user.

Referring to FIG. 7, the electronic device 100 may provide a search result via a screen transition. Further, the electronic device 100 can provide search results by using various methods that will be described with reference to FIGS. 22 to 29. The electronic device 100 can provide a message service button 4 in the username box for returning to the message service. Alternatively, the electronic device 100 may provide a back button 2 for returning to the messaging service.

[Scenario 2: Voice Chat Service]

8 through 10 illustrate a detailed UI environment provided during communication via a voice chat service. Throughout this specification, a voice chat service may include, but is not limited to, a voice call service. Additionally, the voice chat service can include, but is not limited to, a video call service.

Referring to Figure 8, an example of a voice chat service (or video call service) In 800, the electronic device 100 can display the communication content between the users via a voice chat service, as illustrated in FIG.

A user of the electronic device 100 can conduct a conversation with another party via a voice chat service. During the conversation between the user and the other party, the user delivers the voice message "I want to eat pizza." The user's voice message can be converted into text by using a voice-to-text (STT) module (or STT engine), and the text can be displayed on the screen of the electronic device 100.

The electronic device 100 can determine whether the keyword is extracted from each of the messages converted into text by using the STT module via the natural language processor 1200 (refer to FIG. 36). The electronic device 100 can recognize the meaning of each of the messages and can determine whether to extract keywords from each of the messages.

Further, the electronic device 100 can extract "pizza" as a keyword by performing statistical analysis and/or semantic analysis. The method of extracting keywords (which is performed by the electronic device 100) may include the method described with reference to FIG.

For example, the electronic device 100 may perform natural language analysis on 1) the content of the conversation between the users, and extract "pizza" as a keyword by further considering the following: 2) the user's Location log, 3) information previously entered by the user, and 4) historical information about the user.

Similar to FIG. 4, the electronic device 100 can continuously monitor the user's session content, and can separately indicate or mark the keywords included in the message for the keyword extraction target, similar to the manner of FIG.

Moreover, similar to FIG. 5, the electronic device 100 can receive user input corresponding to an indication or indicia that requires input. The user can use the method as described with reference to FIG. Various methods described in the input request.

Referring to FIGS. 9A and 9B, the electronic device 100 can provide a query related to a keyword.

FIG. 9A illustrates an example 900 of a voice chat service in which a UI that displays a keyword (eg, "pizza") in a preset value in an input box is provided. The keywords can be determined by using various methods described in operation S110 of FIG. 2A. The electronic device 100 can generate the same query as the keyword and can edit the query via an input interface provided from the electronic device 100.

Figure 9B illustrates an example 910 of a voice chat service in which a UI that displays a query (e.g., "good day pizza") in a preset value form in an input box is provided. The query can be determined by using various methods as described in operation S130 of FIG. 2A. The keywords can be edited via an input interface provided by the electronic device 100. In addition, the electronic device 100 can provide a candidate query as illustrated in FIG. 6A instead of the method illustrated in FIGS. 9A and 9B.

Referring to FIG. 10, in an example 1010 of a voice chat service, the electronic device 100 may divide a screen of the electronic device 100 into two regions 20 and 30, and may provide a search result to the divided two regions 20 and 30. Area 30. The electronic device 100 can divide the screen into two regions 20 and 30, and can display the chat application screen in the upper portion of the screen on the region 20, and can display the search engine service screen in the lower portion of the screen on the region 30. . In addition, the user can select to display the chat application screen on the entire portion of the screen by touching the chat application screen in the upper portion.

In addition, the electronic device 100 can be described by referring to FIG. 22 to FIG. The various methods described provide search results.

[Scenario 3: Mail Service]

11 through 15 illustrate a detailed UI environment provided during communication via a mail service.

Referring to FIG. 11, the electronic device 100 can display communication contents between users via a mail service.

A user of the electronic device 100 can communicate with another party via email. The email received by the user contains comments about the appointment time and place.

The electronic device 100 may determine whether a keyword is extracted from each of the sentences in the message via the natural language processor 1200 (refer to FIG. 36). The electronic device 100 can recognize the meaning of each of the messages and can determine whether to extract the keywords.

Further, the electronic device 100 can extract keywords by performing statistical analysis and/or semantic analysis. The method of extracting keywords (which is performed by the electronic device 100) may include the method described with reference to FIG.

For example, the electronic device 100 may perform natural language analysis on the content of the session between the users, and extract "Shabumi" as a keyword by further considering the following: 2) the location log of the user, 3 The information previously entered by the user, and 4) historical information about the user.

Similar to FIG. 4, the electronic device 100 can continuously monitor the user's session content, and can separately indicate or mark the keywords included in the message for the keyword extraction target, similar to the manner of FIG.

Referring to FIG. 12, similar to FIG. 5, electronic device 100 can receive user input corresponding to an indication or indicia. The user can use the method as described with reference to FIG. Various methods to enter the request.

Referring to FIG. 13, the electronic device 100 can provide a list 130 of applications related to keywords. For example, the electronic device 100 may check the category of the keyword, and if the keyword is a place-related word, the electronic device 100 may recognize the category as a place and may provide a list 130 of the application related to the map.

In another exemplary embodiment, the electronic device 100 may not provide a list of applications related to keywords, and may obtain information by using a preset application.

Figure 14 illustrates the UI for displaying keywords (e.g., "Shabumi") in a preset value in an input box. The keywords can be determined by using various methods described in operation S110 of FIG. 2A. For example, the electronic device 100 can generate the same query as the keyword. The query can be determined by using various methods as described in operation S130 of FIG. 2A.

The query can be edited via the input interface. For example, the electronic device 100 may extract "Shabumi" as a keyword and may generate a query in the form of "Shabumi" in the same manner as the keyword. The user can edit the query to the "Shabumi Dogok branch" via the input interface. Moreover, the electronic device 100 can automatically generate a query in the form of "Shabumi restaurant". The electronic device 100 can obtain information about the location of the "Shabumi restaurant" via the application service.

Referring to FIG. 15, the electronic device 100 may provide a search result via screen division. Further, the electronic device 100 can provide search results by using various methods that will be described with reference to FIGS. 22 to 29.

[Scenario 4: Social Network Services]

16 through 19 illustrate a detailed UI environment provided during communication via the SNS.

Referring to FIG. 16, the electronic device 100 may display communication contents between users via an SNS.

The electronic device 100 may display the content of the other party's memo via the SNS. As shown in Figure 16, you can extract such things as "batman" from the other party (Jung)'s memo "watching batman with Sumin in LA" The words "Sumin" and "Los Angeles (LA)" are used as keywords. The electronic device 100 may determine whether the keyword is extracted from each of the sentences included in the message via the natural language processor 1200 (refer to FIG. 36). The electronic device 100 can recognize the meaning of each of the messages and can determine whether to extract the keywords.

In addition, the electronic device 100 can extract "batman", "Sumin", and "L.A." as keywords by performing statistical analysis and/or semantic analysis. The method of extracting keywords (which is performed by the electronic device 100) may include the method described with reference to FIG.

For example, the electronic device 100 may perform natural language analysis on the content of the session between the users, and extract "batman", "Sumin", and further by considering the following: "Los Angeles (LA)" as a keyword: 2) the user's location log, 3) the information previously entered by the user, and 4) historical information about the user.

In addition, similar to FIG. 4, the electronic device 100 can continuously monitor the user's Session content, and keywords that are included in the message for the keyword extraction target, respectively, may be indicated or marked in a manner similar to that of FIG.

Referring to Figure 17, similar to Figure 5, electronic device 100 can receive user input corresponding to an indication or indicia. The user can input the request by using various methods as described with reference to FIG. Users can select a query from among the keywords. When the user selects "batman" as a keyword, the electronic device 100 can obtain information about "batman" via the application service.

Referring to FIG. 18, the electronic device 100 can provide a list of applications related to keywords. For example, the electronic device 100 may check the category of the keyword, and if the keyword is a word related to the movie, the electronic device 100 may recognize the category as a movie and may provide a list of applications related to the movie.

Referring to FIG. 19, the electronic device 100 may provide a search result via a screen transition. Also, the electronic device 100 can provide search results by using various methods described with reference to FIGS. 22 to 29.

[Scenario 5: Scheduler]

Figure 20 illustrates the detailed UI environment provided when using the scheduler service.

Referring to FIG. 20, the electronic device 100 may be a tablet PC. The electronic device 100 can provide a scheduler application service to a user. Users can manage their time schedules by using the Scheduler Application Service.

For example, assume that the user has a schedule registered with the scheduler application on September 24, 2013. In addition, it is assumed that the registered schedule instructs the user to use the "Kaur" tour Kyung Bok Palace and dinner with "Kaur".

The electronic device 100 can recognize from the user's call history that the user does not call a restaurant near Kyung Bok Palace, and can search for history from the user's Internet. The user is not searched in Gyeongbokgung. Restaurants near (Kyung Bok Palace). Moreover, the electronic device 100 can recognize that the user does not access the Kyung Bok Palace by using the GPS module included in the electronic device 100. In this case, the electronic device 100 can extract "Kyung Bok" recorded on the scheduler application service as a keyword, or extract it as a Korean character of Kyung Bok Palace. As a keyword, "tasty restaurant near Kyung Bok Palace" can be automatically generated as an inquiry, and Kyung Bok can be recorded on the scheduler application service. Provide instructions or marks on .

When the user selects the marked (for example, highlighted) text "Kyung Bok", the electronic device 100 can generate the query "tasty restaurant near Kyung Bok Palace". Provided to the search service, you can get instant information about the inquiry and provide the information you have obtained. In addition, the electronic device 100 can retrieve information about the generated "tasty restaurant near Kyung Bok Palace", and the obtained information can be stored in the electronic device 100, and can be The stored information is provided to the user whenever the user wants.

[Scenario 6: Document Processor]

Figure 21 illustrates the detailed UI environment provided when using the word processor application.

Referring to FIG. 21, the electronic device 100 can be a laptop. Electronic device 100 A paper processor application service can be provided to the user. Users can generate and edit files by using the word processor application.

For example, a user can edit a news article written in English. The electronic device 100 can recognize the user's English vocabulary in consideration of user information, and can indicate or mark words that the user may have difficulty understanding.

22A-27B illustrate a method of providing the obtained information to a user via an output interface, which is performed by the electronic device 100.

The electronic device 100 can provide the obtained information to the user via the output interface in various manners as described with reference to Table 4.

22A to FIG. 22I illustrate an example in which, when the electronic device 100 is a smart phone or a tablet PC and the user performs a text chat by using a smart phone or a tablet PC, the electronic device 100 is obtained via the output interface. Information is provided to the user.

FIG. 22A illustrates a case where a user performs a text chat by using the electronic devices 100 and 105.

Referring to FIG. 22A, the first user of the electronic device 100 and the second user of the electronic device 105 perform a conversation via text chat. During the session between the first user and the second user, the first user delivers the message "I want to eat pizza" to the second user.

Referring to the chat message 7, Chris, the second user of the electronic device 105, asks questions about Hyunjin, the first user of the electronic device 100, at 8:28 am on August 6, 2013. What do you want to do?). Referring to the chat message 8, the first user of the electronic device 100 is Xuanzang (Hyunjin) replied "I want to eat pizza" to Chris (Chris), the second user of the electronic device 105, at 8:30 am on August 6, 2013. Therefore, at 8:30 am on August 6, 2013, the session is in progress.

When the electronic device 100 monitors the session between the first user and the second user, the electronic device 100 may extract a keyword from a message requiring additional information, and may provide a query to the first user. The first user can edit the provided query. The electronic device 100 can obtain information based on the edited query and the location information of the electronic device 100. The electronic device 100 can provide information to the first user via the output interface in the manner illustrated in FIGS. 22B to 221 .

FIG. 22B illustrates an example of providing information obtained by the electronic device 100 of FIG. 22A to a first user via screen transition.

As illustrated in FIG. 22B, the electronic device 100 can convert a text chat interface screen displayed on the screen of the electronic device 100 into a screen displaying the obtained information. For example, the electronic device 100 can close the text chat interface screen displayed on the screen, and can display the obtained information and the interface of the search engine that provides the obtained information. The first user can return to the text chat interface screen. The first user can return to the text chat interface screen by touching or double tapping the user name box 4 at the top of the screen.

FIG. 22C illustrates an example in which information obtained by the electronic device 100 of FIG. 22A is provided to the first user via screen division.

As illustrated in FIG. 22C, the electronic device 100 can convert a portion of the image of the text chat interface displayed on the screen of the electronic device 100 into a display. The image of the information. For example, the electronic device 100 can close a portion of the text chat interface screen displayed on the screen of the electronic device 100, and can display the obtained information and the interface of the search engine that provides the obtained information. The first user can return to the text chat interface screen by selecting the back button 2 at the top of the screen of the electronic device 100.

FIG. 22D illustrates an example of providing information obtained by the electronic device 100 of FIG. 22A to a first user by using voice.

As illustrated in FIG. 22D, the electronic device 100 can continuously display an image of a text chat interface displayed on the screen of the electronic device 100, and can provide the obtained information by using voice. For example, the electronic device 100 can continuously display an image of a text chat interface displayed on the screen of the electronic device 100, and can summarize the obtained information, and can output the corresponding voice data by using a speaker. The results obtained by "good day pizza" provide information for the voices of A, B, and C (a result obtained by searching for a query 'good day pizza'is A, B, and C).

The type of language provided by the electronic device 100 may vary, including Korean, English, French, German, Spanish, Japanese, Chinese, and the like. For example, the type of language provided by the electronic device 100 can be set by the first user via settings. For example, the type of language provided by the electronic device 100 can be provided by the electronic device 100.

FIG. 22E illustrates an example of providing information obtained by the electronic device 100 of FIG. 22A to a first user via voice and picture segmentation.

As illustrated in FIG. 22E, the electronic device 100 can be displayed on the electronic device A portion of the image of the text chat interface on the screen of 100 is converted into an image showing the obtained information, and the obtained information can be provided by using voice. In addition, for example, the electronic device 100 can convert the portion of the image of the text chat interface displayed on the screen of the electronic device 100 into an image displaying the obtained information, and can display the inquiry to the first user by using the voice. A message that summarizes the information obtained and provides a portion of the information obtained. For example, the electronic device 100 can display a question to the first user, "Do you want to see the image result obtained by searching for the "good day pizza"? (Do you want to see an image result obtained by searching for a query 'good day pizza'?)".

Figure 22F illustrates an example of providing information obtained by the electronic device 100 of Figure 22A to one or more users via a messaging service.

As illustrated in FIG. 22F, the electronic device 100 can continuously display an image of the text chat interface on the screen of the electronic device 100, and the message service server 2200 can provide the obtained information to the first user's electronic device via the message service. The device 100 and/or the electronic device 105 of the second user. In addition, for example, the electronic device 100 can continuously display the image of the text chat interface on the screen of the electronic device 100 to allow the first user and the second user to continue to perform the text chat, and the message service server 2200 can The obtained information is transmitted to a specific telephone number of one or more of the third users. For example, the message service server 2200 can retrieve a specific phone number from the message database 2201.

FIG. 22G illustrates an example of providing information obtained by the electronic device 100 of FIG. 22A to one or more users via an email service.

As illustrated in FIG. 22G, the electronic device 100 may be at the electronic device 100 The image of the text chat interface is continuously displayed on the screen, and the email server 2210 can provide the obtained information to the email address of the first user and/or the email address of the second user via an email service. . In addition, for example, the electronic device 100 can continuously display the image of the text chat interface on the screen of the electronic device 100 to allow the first user and the second user to continue to perform the text chat, and the email server 2210 can be served via email. The obtained information is transmitted to a specific email account of one or more of the third users. For example, the email server 2210 can retrieve a particular email account from the email repository 2211.

Figure 22H illustrates an example of providing information obtained by the electronic device 100 of Figure 22A to one or more users via an SNS.

As illustrated in FIG. 22G, the electronic device 100 can continuously display an image of the text chat interface on the screen of the electronic device 100, and the SNS server 2220 can provide the obtained information to the SNS account of the first user via the SNS and / or the second user's SNS account. In addition, for example, the electronic device 100 may continuously display an image of the text chat interface on the screen of the electronic device 100 to allow the first user and the second user to continue to perform the text chat, and the SNS server 2220 may The obtained information is transmitted to the message board of a particular SNS account of one or more of the third users. For example, the SNS server 2220 can retrieve a particular SNS account from the SNS repository 221.

Figure 22I illustrates an example of providing information obtained by the electronic device 100 of Figure 22A to one or more users via an application service.

As illustrated in FIG. 22I, the electronic device 100 can continuously display an image of the text chat interface on the screen of the electronic device 100, and the application service server The 2230 may provide the obtained information to the first user's application account and/or the second user's application account via the application service. In addition, for example, the electronic device 100 can continuously display the image of the text chat interface on the screen of the electronic device 100 to allow the first user and the second user to continue to perform the text chat, and the application service server 2230 can pass the application. The service transmits the information obtained to the message board of a particular application account of one or more of the third users. For example, the application service server 2230 can retrieve a particular application account from the repository 2231.

23A to 23E illustrate an example in which, when the electronic device 100 is a smart phone or a tablet PC and the user performs a voice chat by using a smart phone or a tablet PC, the electronic device 100 is obtained via the output interface. Information is provided to the user.

FIG. 23A illustrates a case where a user performs a voice chat by using the electronic devices 100 and 105.

Referring to FIG. 23A, the first user of the electronic device 100 and the second user of the electronic device 105 conduct a conversation via voice chat. During the session between the first user and the second user, the first user delivers the voice message "I want to eat pizza." The voice message of the first user can be converted into text by using the STT module, and the text can be displayed on the screen of the electronic device 100.

When the electronic device 100 monitors a session, the electronic device 100 may extract a keyword from a message requiring additional information and may provide a query to the first user. The first user can edit the provided query. The electronic device 100 can obtain information based on the edited query and the location information of the electronic device 100. The electronic device 100 can be as shown in FIG. 23B to The manner illustrated in 23E provides information to the first user via the output interface.

FIG. 23B illustrates an example of providing information obtained by the electronic device 100 of FIG. 23A to a first user via screen transition.

As illustrated in FIG. 23B, the electronic device 100 can convert a voice chat interface screen displayed on the screen of the electronic device 100 into a screen displaying the obtained information. For example, the electronic device 100 can close the voice chat interface screen displayed on the screen, and can display the obtained information and the interface of the search engine that provides the obtained information.

FIG. 23C illustrates an example of providing information obtained by the electronic device 100 of FIG. 23A to a first user via screen division.

As illustrated in FIG. 23C, the electronic device 100 can convert a portion of the screen of the voice chat interface displayed on the screen of the electronic device 100 into a screen displaying the obtained information. For example, the electronic device 100 can close a portion of the voice chat interface screen displayed on the screen of the electronic device 100, and can display the obtained information and the interface of the search engine that provides the obtained information.

FIG. 23D illustrates an example of providing information obtained by the electronic device 100 of FIG. 23A to a first user by using voice.

As illustrated in FIG. 23D, the electronic device 100 can continuously display a picture of the voice chat interface on the screen of the electronic device 100, and can provide the obtained information by using voice. For example, the electronic device 100 can continuously display a screen of the voice chat interface on the screen of the electronic device 100, can summarize the obtained information, and can provide information by using voice.

Figure 23E illustrates the electronic loading by Figure 23A via voice and picture segmentation. The information obtained by setting 100 is provided to the instance of the first user.

As illustrated in FIG. 23E, the electronic device 100 may convert a portion of the screen of the voice chat interface displayed on the screen of the electronic device 100 into a screen displaying the obtained information, and may provide the obtained information by using voice. In addition, for example, the electronic device 100 can convert a portion of the screen of the voice chat interface displayed on the screen of the electronic device 100 into a screen displaying the obtained information, and can summarize a part of the obtained information, and can use voice. Provide information.

In addition, during the voice chat, the obtained information may be transmitted to one of the first user, the second user, and/or the third user via a message service, an email service, an SNS, and/or an application service. Many, similar to the example embodiments described above with respect to text chat descriptions between users.

Here, the obtained information may be transmitted to the first information according to at least one user using the message service, at least one user using the email service, at least one user using the SNS, and/or at least one user using the application service. At least one of the user, the second user, and/or one or more of the third users.

24A to 24F illustrate an example in which, when the electronic device 100 is a smart watch and the user performs a text chat by using the smart watch, the information obtained by the electronic device 100 is provided to the user via the output interface.

FIG. 24A illustrates a case where a user performs a text chat by using a smart watch for the electronic devices 100 and 105.

Referring to FIG. 24A, the first user of the electronic device 100 and the second user of the electronic device 105 perform a conversation via text chat. In the first user and second use During the conversation between the users, the first user delivers the message "I want to eat pizza." When the electronic device 100 monitors the session, the electronic device 100 may extract a keyword from a message requiring additional information and may provide a query to the first user. The first user can edit the provided query. The electronic device 100 can obtain information based on the edited query and the location information of the electronic device 100. According to an exemplary embodiment, the electronic device 100 may provide information to the first user via the output interface in the manner illustrated in FIGS. 24B-24F.

FIG. 24B illustrates an example of providing primary information among a plurality of segments of information obtained by the electronic device 100 of FIG. 24A to a first user.

As illustrated in FIG. 24B, the electronic device 100 can convert a text chat interface screen displayed on the screen of the electronic device 100 into a screen displaying main information among a plurality of segments of the obtained information. For example, the electronic device 100 can display one of a plurality of segments of the main information (eg, the image depicted in FIG. 24C) among the plurality of segments of the obtained information.

24C illustrates an example of a method of providing a user with primary information among a plurality of segments of information obtained by the electronic device 100 of FIG. 24A, which is performed by the electronic device 100.

As illustrated in FIG. 24C, the electronic device 100 can display the main information among the plurality of segments of the obtained information (for example, (a), (b), (c), (d), and (e) of FIG. 24C. One of a plurality of segments of the image depicted in the image. For example, the first user can check each of the plurality of segments of the primary information by using the transition page button 21 provided by the electronic device 100.

Figure 24D illustrates the electronic device 100 of Figure 22A by using speech. The information obtained is provided to an instance of the first user.

As illustrated in FIG. 24D, the electronic device 100 can continuously display an image of a text chat interface displayed on the screen of the electronic device 100, and can provide the obtained information by using voice. For example, the electronic device 100 can continuously display an image of a text chat interface displayed on the screen of the electronic device 100, can summarize the obtained information, and can provide information by using voice.

FIG. 24E illustrates an example of providing primary image information among the image information obtained by the electronic device 100 of FIG. 22A to the first user by using voice.

As illustrated in FIG. 24E, the electronic device 100 can convert the text chat interface screen displayed on the screen of the electronic device 100 into a screen for displaying the main image information among the obtained image information, and can be obtained by using voice providing. Image information. In addition, for example, the electronic device 100 can convert a part of the text chat interface screen displayed on the screen of the electronic device 100 into a screen for displaying the obtained image information, and can summarize a part of the obtained image information, and can be used by using Voice provides image information.

FIG. 24F illustrates an example of providing main text information among the text information obtained by the electronic device 100 of FIG. 22A to the first user by using voice.

As illustrated in FIG. 24F, the electronic device 100 can convert a text chat interface screen displayed on the screen of the electronic device 100 into a screen for displaying main text information among the obtained text information, and can be obtained by using voice providing. Text information. In addition, for example, the electronic device 100 can convert a part of the text chat interface screen displayed on the screen of the electronic device 100 into a screen for displaying the obtained text information, and can summarize a part of the obtained text information, and can be used by using language Sound provides text information.

25A and 25B illustrate an example in which the electronic device 100 is a smart watch, and the user performs a text chat by using the smart watch 100 and the smart phone for the electronic device 101 interoperating with the smart watch 100. The information obtained by the electronic device 100 is provided to the user via the output interface.

Referring to FIG. 25A, the smart watch 100 and the smart phone 101 can interoperate with each other. For example, the smart watch 100 can be connected to the smart phone 101 via short-range communication. For example, the smart watch 100 and the smart phone 101 can share a portion of the display screen. For example, when the smart phone 101 receives a message from a server (not shown), the smart watch 100 can notify the user of the received message in a vibrating manner. For example, when the smart phone 101 receives a voice call from a server, the smart watch 100 can notify the user of the received voice call in a vibrating manner.

For example, some of the messages received by the electronic device 101 can be displayed on the electronic device 100. In addition, some messages continuously exchanged between the electronic device 100 and the electronic device 105 may be displayed on the electronic device 101 and the electronic device 106, respectively. For example, the electronic device 106 can be a smart phone that interoperates with the electronic device 105, and the electronic device 105 can be a smart watch. The first user of the electronic device 101 can check the information exchanged between the first user and the second user of the electronic device 105 and the electronic device 106 via the touch screen. For example, the first user of the electronic device 101 can vertically scroll between the first user and the second user by performing a touch input such as horizontal movement or toggle on the touch screen. Exchanged messages.

The first user of the electronic device 100 and the electronic device 101 and the second user of the electronic device 105 and the electronic device 106 perform a conversation via text chat. During the session between the first user and the second user, the first user delivers the message "I want to eat pizza." In this case, the electronic device 100 can display a relatively small portion of the session, and the electronic device 101 can display a relatively large portion of the session.

When the electronic device 100 monitors the session, the electronic device 100 may extract a keyword from a message requiring additional information and may provide a query to the first user. The first user can edit the provided query. The electronic device 100 can obtain information based on the edited query and the location information of the electronic device 100.

The electronic device 100 can continuously analyze the conversation between the first user and the second user, and can monitor each message. In addition, when the electronic device 100 monitors each message, the electronic device 100 can determine whether each message is an inquiry message, and can determine whether it is necessary to obtain information for each message. In addition, the electronic device 100 can extract keywords from each message. Moreover, electronic device 100 can mark a portion of each message and other portions of each message continuously and in different ways, wherein the portions correspond to the extracted keywords. In addition, the electronic device 100 can maintain the mark of each message for a preset period of time. Further, the electronic device 100 may maintain the mark for a preset period of time by setting a flag for adjusting each message, and then de-mark after a preset period of time (refer to FIG. 30E).

In addition, the electronic device 100 can display a mark of each message via an output interface to allow the first user to scroll through the check mark, for example. In addition, when the first user performs a touch input on the mark of each message, the electronic device 100 may Get information about the tag for each message and display the information via the output interface. In addition, when the first user performs a touch input on the mark of each message, the electronic device 100 can display the information obtained by the previous mark on each message via the output interface.

The electronic device 100 can provide information to the first user via the output interface in the manner illustrated in FIG. 25B.

25B illustrates an example in which information obtained by the electronic device 100 of FIG. 25A is provided to a first user via the electronic device 100 and the electronic device 101 interoperating with the electronic device 100.

As illustrated in FIG. 25B, the electronic device 100 can convert the text chat interface screen displayed on the screen of the electronic device 100 into a screen displaying the main information among the obtained information. In addition, the electronic device 101 can convert the text chat interface screen displayed on the screen of the electronic device 101 into a screen for displaying the obtained information. For example, the electronic device 100 can display a plurality of main information among the obtained information (for example, each of the images depicted in (a) to (e) as illustrated in FIG. 24C). One of the fragments. In addition, the electronic device 101 can close the text chat interface screen displayed on the screen, and can display the obtained information and the interface of the search engine that provides the obtained information.

26A and 26B illustrate an example in which, when the electronic device 100 is the smart watch 100 and the user performs a voice chat by using the smart watch 100, the information obtained by the electronic device 100 is provided to the use via the output interface. By.

Referring to FIG. 26A, the electronic device 100 and the interoperable with the electronic device 100 The first user of the electronic device 101 and the electronic device 105 and the second user of the electronic device 106 interoperating with the electronic device 105 conduct a conversation via voice chat. During the session between the first user and the second user, the first user delivers the message "I want to eat pizza." In this case, the electronic device 100 can display the call image, and the electronic device 101 can convert the voice message into a text message and can display the text message via STT conversion.

When the electronic device 100 monitors the session, the electronic device 100 may extract a keyword from a message requiring additional information and may provide a query to the first user. The first user can edit the provided query. The electronic device 100 can obtain information based on the edited query and the location information of the electronic device 100. The electronic device 100 can provide information to the first user via the output interface in the manner illustrated in FIG. 26B.

FIG. 26B illustrates an example in which information obtained by the electronic device 100 of FIG. 26A is provided to a first user via the electronic device 100 and the electronic device 101 interoperating with the electronic device 100.

As illustrated in FIG. 26B, the electronic device 100 can convert the voice chat interface screen 2600 displayed on the screen of the electronic device 100 into a screen 2601 displaying the main information among the obtained information. In addition, the electronic device 101 can convert the text chat interface screen displayed on the screen of the electronic device 101 into a screen 2603 displaying the obtained information. For example, the electronic device 100 can display one of a plurality of segments of the main information (for example, each of the images (a) to (e) illustrated in FIG. 24C) among the obtained information. In addition, the electronic device 101 can close the text chat interface screen displayed on the screen, and can display the obtained information and the interface of the search engine that provides the obtained information.

27A and 27B illustrate an example in which, when the electronic device 100 is a smart glasses and the user performs a text chat by using the smart glasses, the information obtained by the electronic device 100 is provided to the user via the output interface.

Referring to FIG. 27A, the first user of the electronic device 100 and the second user of the electronic device 105 perform a conversation via text chat. During the session between the first user and the second user, the first user delivers the message "I want to eat pizza."

The first user and the second user can perform text chat by using an input interface of the electronic device 100 and an input interface of the electronic device 105, respectively. For example, the input interface can include a virtual keyboard, a virtual touch screen, or the like.

In addition, the first user and the second user can perform text chat by using the output interface of the electronic device 100 and the output interface of the electronic device 105, respectively. For example, the output interface can include a small projector and/or the like.

When the electronic device 100 monitors the session, the electronic device 100 may extract a keyword from a message requiring additional information and may provide a query to the first user. The first user can edit the provided query. The electronic device 100 can obtain information based on the edited query and the location information of the electronic device 100. The electronic device 100 can provide information to the first user via the output interface in the manner as illustrated in FIG. 27B.

FIG. 27B illustrates an example of providing information obtained by the electronic device 100 of FIG. 27A to the first user via the electronic device 100.

As illustrated in FIG. 27B, the electronic device 100 can convert a text chat interface screen displayed on the screen of the electronic device 100 into a screen displaying the obtained information.

28A and 28B illustrate an example in which, when the electronic device 100 is smart glasses and the user performs voice chat by using the smart glasses, the information obtained by the electronic device 100 is provided to the user via the output interface.

Referring to FIG. 28A, the first user of the electronic device 100 and the second user of the electronic device 105 conduct a conversation via voice chat. During the session between the first user and the second user, the first user delivers the message "I want to eat pizza."

In addition, the first user and the second user can perform voice chat by using the output interface of the electronic device 100 and the output interface of the electronic device 105, respectively. For example, the output interface can include a small projector and/or the like. The electronic device 100 can provide information to the first user via the output interface in the manner as illustrated in FIG. 28B.

FIG. 28B illustrates an example of providing information obtained by the electronic device 100 of FIG. 28A to the first user via the electronic device 100.

As illustrated in FIG. 28B, the electronic device 100 can convert a voice chat interface screen displayed on the screen of the electronic device 100 into a screen displaying the obtained information.

29A and 29B illustrate an example in which the electronic device 100 includes various electronic devices (including smart glasses), and the user uses at least one of a voice chat and a text chat by using the electronic device with another user. During communication, information obtained by the electronic device 100 is provided to the user via the output interface.

As illustrated in Figure 29A, multiple users may communicate via various types of chat communications as described above with reference to Figures 22-28, and as illustrated in Figure 29B, The user can receive the information obtained by the electronic device 100 via the various types of chats described above with reference to FIGS. 22-28.

For example, the first user can perform a text chat by using a smart watch in the manner described with reference to FIG. 25, and the second user can perform a text chat by using the smart glasses in the manner described with reference to FIG.

For example, the first user can perform a text chat by using the smart watch in the manner described with reference to FIG. 25, and the second user can perform the voice chat by using the smart glasses in the manner described with reference to FIG. In this case, the voice message input by the second user can be converted into a text message via STT conversion and the text message can be delivered to the first user. In addition, in another exemplary embodiment, the text message input by the first user may be converted into a voice message and the voice message may be delivered to the second user.

For example, a chat in the aforementioned combination may be used in communication of a video conference such as among at least three users.

Further, for example, the chat performed in the aforementioned combination manner can be applied to various communication services such as an SNS provided via an application, and various communication services such as an email service provided via a server.

The electronic device 100 can provide information to the user in various ways as described with reference to FIGS. 22-29.

30A through 31B illustrate a setting UI provided by the electronic device 100, according to an exemplary embodiment.

Referring to FIG. 30A, the electronic device 100 may provide a setting UI for the user regarding the on/off of the information providing operation. The user can select whether to root through the setting UI. The information is received according to an information providing method according to an exemplary embodiment. The user can set the on/off of the information providing operation according to the exemplary embodiment.

The setting of the electronic device 100 may include an operation of presenting the electronic device 100 to receive a setting input by the user, and providing a use environment of the electronic device 100 based on the setting input.

Although FIG. 30A illustrates a presentation query generation operation, the query generation operation may be referred to as a different name depending on the applied product, such as an autonomous search engine, an autonomous information search, or the like, and thus the name of the operation does not limit the concept of the present invention. category.

The electronic device 100 can provide another detailed setting UI to the user. For example, when the information providing operation is set to be on, the electronic device 100 may allow the user to select a method of obtaining information.

For example, the electronic device 100 may allow the user to select whether to obtain information by performing an application search or an internet search. In addition, the electronic device 100 can obtain information by performing an application search and an Internet search in synchronization.

Referring to FIG. 30B, when the electronic device 100 provides the user with a setting UI regarding the on/off of the information providing operation, the electronic device 100 can provide the setting UI detailed in different manners to the user in different manners.

For example, when the information providing operation is set to be on, the electronic device 100 may allow the user to select how to provide information. For example, the electronic device 100 may allow the user to select to provide information in text, voice, or video.

For example, when the information providing operation is set to on, the electronic device 100 may allow the user to select how to receive the edited query. For example, electronic equipment Setting 100 allows the user to select whether to receive the edited query in text or voice.

Referring to 30C, when the electronic device 100 provides the user with a setting UI regarding the on/off of the information providing operation, the electronic device 100 can provide the detailed setting UI to the user in different manners.

For example, when the information providing operation is set to on, the electronic device 100 may allow the user to select who to provide the message information. For example, the electronic device 100 can be configured to extract keywords only from the message of the first user "user 1" and provide information about the keywords.

Alternatively, for example, when the information providing operation is set to ON, the electronic device 100 may allow the user to select who to provide the information to. For example, the electronic device 100 can be configured to provide information to the first user "user 1" and the second user "user 2".

Referring to 30D, when the electronic device 100 provides the user with a setting UI regarding the on/off of the information providing operation, the electronic device 100 can provide the detailed setting UI to the user in different manners.

For example, when the information providing operation is set to ON, the electronic device 100 may allow the user to select which information to refer to when extracting the keyword. Alternatively, for example, when the information providing operation is set to ON, the electronic device 100 may allow the user to select which information to refer to when generating the query. Alternatively, for example, when the information providing operation is set to ON, the electronic device 100 may allow the user to select which information to refer to when the information is obtained based on the edited query and the location information of the electronic device 100.

Referring to 30E, when the electronic device 100 provides the user with a setting UI regarding the on/off of the information providing operation, the electronic device 100 can be detailed in different manners. The setting UI is provided to the user.

For example, when the information providing operation is set to on, the electronic device 100 may allow the user to select a keyword display duration. For example, the user can set the keyword display duration to one minute, and then, when the highlighted keyword is displayed, the electronic device 100 can stop highlighting the keyword after one minute elapses.

Referring to FIG. 30F, when the electronic device 100 obtains information based on the edited query and the location information of the electronic device 100, the electronic device 100 may allow the user to select a search engine to use. For example, when the electronic device 100 obtains information based on the edited query and the location information of the electronic device 100, the electronic device 100 can be configured to select a commercial Internet search engine such as Google, Bing, Yahoo, or Navigator. .

Referring to FIG. 30G, the electronic device 100 may provide a setting UI for the user regarding setting a field of interest. In addition, when the electronic device 100 provides the user with a setting UI for setting the field of interest, the electronic device 100 can provide the detailed setting UI to the user in different manners.

For example, the electronic device 100 may allow a user to select a category of a keyword when extracting a keyword. Alternatively, for example, when the information providing operation is set to be on, the electronic device 100 may allow the user to select a category of the information when the information is obtained based on the edited query and the location information of the electronic device 100.

Referring to FIG. 31A, during communication, the electronic device 100 can provide a setting switch 10 for the user to turn on/off the information providing operation by using the communication medium. The user can determine whether or not to activate the information providing operation by using the setting switch 10. The user can set the setting switch 10 to be on, and thus the electronic device 100 can be set to perform an information providing operation according to the inventive concept. The user can set the setting switch 10 to off, and thus the electronic device 100 can be set to not perform the information providing operation according to the inventive concept.

Referring to FIG. 31B, during communication, the electronic device 100 can provide a setting bar 10_a for user input (text, image, and voice) to the user by using the communication medium. The user can select how to receive user input by using the setting bar 10_a.

For example, the user can set the setting bar 10_a to "text", and thus the electronic device 100 can be set to search via a text search. In addition, the user can set the setting bar 10_a to "text + image", and thus the electronic device 100 can be set to search for a query via at least one of text and video. In addition, the user can set the setting bar 10_a to "all", and thus the electronic device 100 can be set to search for a query via at least one of text, video, and voice.

For example, if the user sets the setting bar 10_a to "text", the electronic device 100 can generate a query based on the text generated by the user or the text provided to the user via the screen of the electronic device 100. For example, if the user sets the setting bar 10_a to "text + image", the electronic device 100 can generate an inquiry based on the text and image generated by the user and/or the text and image provided to the user via the screen. User input can be set via settings rather than communication interface.

32 through 35 are flowcharts illustrating a method of providing information, which is performed by the electronic device 100, according to an exemplary embodiment.

Referring to FIG. 32, the processor of the electronic device 100 can be directly displayed via the communication service. At least one message displayed on the screen of the electronic device 100 extracts a plurality of keywords (S210). The processor may determine the priority of the keywords (S220). The processor may generate a query based on the priority of the keywords and may provide a query (S230). The input interface of the electronic device 100 can receive an edited query from the user (S240). The processor may obtain information based on the edited query and the location information of the electronic device 100 (S250). The output interface of the electronic device 100 can provide information obtained by the processor (S260).

The method of providing information according to an exemplary embodiment (which is performed by the electronic device 100) may determine the priority of the keywords, and may generate the queries based on the priority order.

For example, as illustrated in FIG. 17, multiple keywords may be extracted, such as "batman", "Sumin", and "L.A.". For example, the electronic device 100 may determine the priority of the keyword based on at least one of: 1) the content of the session between the users, 2) the location log of the user, and 3) the user's previous input. Information, and 4) historical information about the user. For example, the keyword with the highest priority among the keywords can be generated as a query.

The method of providing information according to another exemplary embodiment, which is performed by the electronic device 100, may obtain information by using a query generated in operation S230. Also, the method of providing information according to another exemplary embodiment, which is performed by the electronic device 100, can obtain information by using the edited query received in operation S240. Further, the method of providing information according to another exemplary embodiment, which is performed by the electronic device 100, may obtain information by using the query generated in operation S230 and the edited query received in operation S240, and Displayable capital News. Further, the method of providing information according to another exemplary embodiment, which is performed by the electronic device 100, may obtain information by using the query generated in operation S230 and the edited query received in operation S240, and The information obtained in operation S250 can be displayed.

Referring to FIG. 33, the processor may extract a keyword from at least one message displayed on the screen via a communication service (S310). The processor may generate a query related to the keyword based on the user related information, and may provide a query (S320). The input interface can receive an edited query from the user (S330). The processor may obtain information based on the edited query and the location information of the electronic device 100 (S340). The output interface provides information obtained by the processor (S350).

The method of providing information according to an exemplary embodiment (which is performed by the electronic device 100) may extract a keyword based on user related information or may generate a query. For example, the user related information may include at least one of a user's location log, information previously input by the user, and historical information about the user.

Referring to FIG. 34, the processor may extract a plurality of keywords from at least one message displayed on the screen via the communication service (S410). The processor can generate and provide a query related to the keyword (S420). The input interface can receive an edited query from the user (S430). The processor may obtain a plurality of segments of the information based on the edited query (S440). The output interface can provide a plurality of segments of information obtained by the processor (S450).

According to a method of providing information according to an exemplary embodiment, the method is performed by the electronic device 100, the processor may obtain a plurality of information based on the edited query. Fragments, and multiple segments of information can be provided by considering the prioritization of multiple segments of information. For example, the electronic device 100 may determine the priority of the plurality of segments of the information based on the user-related information. For example, the user related information may include at least one of a user's location log, information previously input by the user, and historical information about the user.

Referring to FIG. 35, the processor may extract a plurality of keywords from at least one message displayed on the screen via the communication service (S510). The processor can generate and provide a query related to the keyword (S520). The input interface can receive an edited query from the user (S530). The processor may obtain a plurality of segments of the information based on the edited query and the current time (S540). The output interface can provide a plurality of segments of information obtained by the processor (S550).

The method of providing information according to an exemplary embodiment (which is performed by the electronic device 100) may obtain information based on the edited query and the current time. For example, if the current time is the lunch time of the user, the electronic device 100 can obtain the information by prioritizing the keywords related to the restaurant.

FIG. 36 illustrates an electronic device 1000 in accordance with an example embodiment.

Referring to FIG. 36, the electronic device 1000 can provide communication service applications APP1, APP2, APP3, APP4, and APP5 (also referred to as applications) to users of the electronic device 1000. The user can communicate with a user of another electronic device (not shown) by using a service provided by one of the communication service applications APP1 to APP5.

For example, the communication service applications APP1 to APP5 may include a message service application, a mail service application, and an SNS application. Message service Applications can include, for example, Microsoft Network (MSN) Instant Messenger, Yahoo Messenger, Nateon, Buddybuddy, KakaoTalk, KakaoStory, and Skype or similar. For example, the communication service applications APP1 to APP5 may include Facebook, Twitter, KakaoTalk, Skype, or the like.

For example, each of the communication service applications APP1 through APP5 can provide at least one of: a one-to-one communication service, a one-to-many communication service, and a many-to-many communication service. For example, each of the communication service applications APP1 to APP5 may provide a one-to-one communication type messenger service or a one-to-one communication type video call service. For example, each of the communication service applications APP1 to APP5 can provide a one-to-many communication type video presentation service. For example, each of the communication service applications APP1 to APP5 can provide a many-to-many communication type video conferencing service.

For example, each of the communication service applications APP1 through APP5 can provide voice or video communication services. For example, each of the communication service applications APP1 to APP5 can provide a communication service by using 3D images. For example, each of the communication service applications APP1 to APP5 can provide a communication service by using a 3D hologram.

The electronic device 1000 can include a query generation architecture 1100. The query generation architecture 1100 can exchange information with the communication service applications APP1 to APP5 via an application programming interface (API).

The electronic device 1000 can generate a check by using the query generation architecture 1100. Inquire, regardless of the type of application for the user. For example, the electronic device 1000 can generate a query regardless of whether the application installed in the electronic device 1000 is a mail service application, a chat service application, or an SNS application. The electronic device 1000 according to an exemplary embodiment may generate a query of any application installed therein by using the query generation architecture 1100.

The query generation architecture 1100 can extract at least one keyword from a message displayed on the screen of the electronic device 1000 via the communication service. The query generation architecture 1100 can extract at least one keyword from the message by using the natural language processor 1200.

The query generation architecture 1100 can provide queries related to at least one keyword. For example, the query generation architecture 1100 can generate a query related to at least one keyword by performing statistical analysis and/or semantic analysis.

For example, the query generation architecture 1100 can generate a "good day pizza" as a query based on at least one keyword by performing statistical analysis and/or semantic analysis. For example, the query generation architecture 1100 can generate "good day pizza" as a query based on: 1) the content of the conversation between users, 2) the location log of the user, and 3) use Information previously entered, and 4) historical information about the user.

The query generation architecture 1100 can include a natural language processor 12000. The natural language processor 1200 can recognize the meaning of the message by considering the contextual elements associated with the message. For example, the natural language processor 1200 of the electronic device 1000 can identify the meaning of the message based on the type of words included in the message, the relationship between the words, and the meaning of the words. The natural language processor 1200 can determine the category of the search based on the recognized meaning.

The electronic device 1000 can provide the user with a query generated by using the query generation architecture 1100. For example, the electronic device 1000 can provide an image to the user via the screen as a query generated by using the query generation architecture 1100. For example, the electronic device 1000 can provide voice to the user via the speaker as a query generated by using the query generation architecture 1100.

The electronic device 1000 can receive an edited query from a user. For example, the electronic device 1000 can provide the generated query to the user, and can receive the query edited by the user via the interface.

The electronic device 1000 can obtain information based on the query edited by the user and the location information of the user. The electronic device 1000 can obtain information from the external search server 2000. For example, the electronic device 1000 can obtain information from the external search server 2000 via an application service. For example, the electronic device 1000 can obtain information from the external search server 2000 via a search service provided by an internet website.

Accordingly, the electronic device 1000 according to an exemplary embodiment may allow a user to conveniently receive information related to an ongoing communication when the user uses the communication service.

FIG. 37 is a block diagram illustrating an electronic device 1000 in accordance with another example embodiment.

Referring to FIG. 37, the electronic device 1000 may provide the communication service applications APP1, APP2, APP3, APP4, and APP5 to the user of the electronic device 1000. The user can communicate with a user of another electronic device (not shown) by using a service provided by one of the communication service applications APP1 to APP5.

The electronic device 1000 can include a query generation architecture 1100. The query generation architecture 1100 can exchange information with the communication service applications APP1 to APP5 via the API. The query generation architecture 1100 can extract at least one keyword from a message displayed on the screen of the electronic device 1000 via the communication service.

The query generation architecture 1100 can extract at least one keyword from the message by using the natural language processor 3200 included in the cloud server 3000.

The query generation architecture 1100 can provide queries related to at least one keyword. For example, the query generation architecture 1100 can generate a query related to at least one keyword by performing statistical analysis and/or semantic analysis.

The query generation architecture 1100 can identify the meaning of the message by exchanging information with the natural language processor 3200 included in the cloud server 3000. The natural language processor 3200 can recognize the meaning of the message based on the situation associated with the message. The natural language processor 3200 can determine the category of the search based on the recognized meaning. The electronic device 1000 can provide the user with a query generated by using the query generation architecture 1100. The electronic device 1000 can obtain information based on the query edited by the user and the location information of the user.

Thus, by using the external natural language processor 3200, the electronic device 1000 according to an exemplary embodiment can allow a user to conveniently receive information related to ongoing communication when the user uses the communication service.

38 illustrates the configuration of the natural language processor 1200 illustrated in FIG. 36 and the natural language processor 3200 illustrated in FIG.

The natural language processor 1200 or 3200 can include a named entity recognizer 1210 and a classifier 1230. The named entity recognizer 1210 can recognize the meaning of each of the words used in the message in communication. In addition, the named entity recognizer 1210 can recognize the meaning of each of the messages. Category classifier 1230 can separately message Category classification. That is, the category classifier 1230 can check the keywords of each of the messages by analyzing the content of each of the messages, and can classify the categories of the messages, respectively.

FIG. 39 is a block diagram illustrating an electronic device 1000 in accordance with another example embodiment.

Referring to FIG. 39, the electronic device 1000 may provide the communication service applications APP1, APP2, APP3, APP4, and APP5 to the user of the electronic device 1000. The user can communicate with a user of another electronic device (not shown) by using a service provided by one of the communication service applications APP1 to APP5.

The electronic device 1000 can include a query generation architecture 1100. The query generation architecture 1100 can exchange information with the communication service applications APP1 to APP5 via the API. The query generation architecture 1100 can extract at least one keyword from a message displayed on the screen of the electronic device 1000 via the communication service.

The electronic device 1000 can further include a GPS database 1400. The GPS module (or GPS processor) 1100-1 can continuously track the position of the electronic device 1000 by using a position tracking engine included in the electronic device 1000. The GPS database 1400 can continuously accumulate data of locations tracked by the GPS module 1100-1, and can continuously store information about the location of the electronic device 1000.

The GPS module 1100-1 can receive GPS signals from GPS satellites, can determine the location of the electronic device 1000, and can generate location information. To do this, the GPS module 1100-1 can include a GPS antenna and a GPS receiver. The GPS module 1100-1 analyzes the navigation data included in the GPS signal, and extracts latitude and longitude data, time information, or the like of the electronic device 1000. GPS signals contain knowledge of GPS satellites The (ID) code, the track position, and the time information, and the GPS module 1100-1 calculates the coordinates of the position of the electronic device 1000 by calculating the difference between the speeds of the electromagnetic waves transmitted from the plurality of GPS satellites. The foregoing operations can be performed by a GPS positioning program embedded in the GPS module 1100-1.

Here, the GpS positioning program can determine the position of the electronic device 1000 by using one or more of the following: conventional GPS (C-GPS) positioning, differential GPS (DGPS) positioning, assistance GPS (assisted GPS; A-GPS) positioning, and dual differential GPS positioning. Moreover, in order to achieve more precise positioning based on A-GPS positioning, DGPS positioning, dual differential GPS positioning, etc., the GPS positioning program can receive an error correction related signal from an external base station or the like, and can correct the positioning position.

If the electronic device 1000 is a terminal that does not include the GPS module 1100-1, the electronic device 1000 can connect a separate GPS set including a GPS antenna, a GPS receiver, etc. to the electronic device 1000, and can receive information about the GPS set. Information about the location of the group location.

Therefore, the electronic device 1000 according to the exemplary embodiment can continuously track the position of the electronic device 1000, can continuously store the location data, and thus can allow the user to conveniently receive the communication related to the ongoing communication when the user uses the communication service. News.

FIG. 40 is a block diagram illustrating an operation of an identification entity, which is performed by the electronic device 1000, according to an exemplary embodiment.

Referring to FIG. 40, the natural language processor 1200 included in the electronic device 1000 can include a named entity recognizer 1210 and a frequency measurer 1250.

The frequency measurer 1250 can measure the frequency of use of the identified entities in the session. For example, the named entity recognizer 1210 can recognize <Peter. Peter Higgs> for the sentence [Who is Peter. Higgs? (Who is Peter Higgs?)] entity. The frequency measurer 1250 can be identified as a physical <Peter by the named entity identifier 1210. Peter Higgs> Counts the number of times in a session between users.

The frequency measurer 1250 can calculate the entity <Peter. Peter Higgs > The ratio of the frequency of use in conversations between users. For example, the named entity recognizer 1210 can also recognize the <Nobel Prize> as an entity. When using the entity <Nobel Prize> seven times in the session, and use the entity <Peter in the session. When Peter Higgs is up to fourteen times, the frequency measuring device 1250 can calculate the entity <Peter. The frequency of Peter Higgs is 0.67. The frequency measurer 1250 can divide the number of times that a particular entity is used by the total number of times all of the entities are used. > to calculate the frequency of use.

The named entity recognizer 1210 can receive information about each of the entities from the cloud server 3000.

Cloud server 3000 can include data computing device 3400. The data computing device 3400 can include a text extractor 3410 and a data store 3430. The data store 3430 may include various types of databases, such as a cloud-named-entity recognition database (cloud NER DB) 3431 and a knowledge DB 3433.

The text extractor 3410 can self-store knowledge stored in the data store 3430 Look for text in DB 3433. The text extractor 3410 can store the sought data in the cloud NER DB 3431 of the cloud server 3000. The data computing device 3400 can configure information about the cloud NER DB 3431 according to the table graph illustrated in FIG. 41, and can store the information in the data storage 3430.

The electronic device 1000 according to an exemplary embodiment may include a named entity recognizer 1210 that can identify each of the entities included in one or more messages in the session between users, and can each of the used entities The frequency count of one. Thus, by using entity information such as the frequency of using each of the entities in the session, the electronic device 1000 can extract the keywords, can generate a query, or can limit the extraction of the keywords or queries.

FIG. 41 illustrates a table graph generated by the named entity recognizer 1210 after the named entity recognizer 1210 recognizes the entity, according to an example embodiment.

Referring to FIG. 41, the named entity recognizer 1210 of FIG. 40 can recognize <Peter. Peter Higgs>, <European Center for Nuclear Research>, <United States> and <Switzerland> are entities. The named entity recognizer 1210 may extract information about each of the entities (hereinafter, referred to as entity information) from the data storage 3430 included in the cloud server 3000. For example, entity information can include relevance, mood, type, and link information.

The electronic device 1000 can extract a keyword or generate a query by using the entity information. Therefore, the electronic device 1000 uses the entity information in the natural language analysis so that the electronic device 1000 can further clearly recognize the intention of the user included in the message.

FIG. 42 is a block diagram illustrating an operation of obtaining user input, which is performed by the electronic device 1000, according to an exemplary embodiment.

Referring to FIG. 42, the user context aware architecture 1500 included in the electronic device 1000 can include a text assisting portion 1510, an image assisting portion 1520, and a voice assisting portion 1530. Further, the user context aware architecture 1500 can include a service binder 1550. The text assisting portion 1510 can include a context aware text extractor 1513 and a query generator 1515.

The service binder 1550 can receive user input and can deliver user input to one of the text assisting portion 1510, the image assisting portion 1520, and the voice assisting portion 1530 depending on the type of input. Again, the service binder 1550 can receive the generated query from the text assisting portion 1510 and can deliver the generated query to the user.

The text assisting portion 1510 can generate a query regarding textual user input received via the service binder 1550. The text assisting portion 1510 can continuously search for text by using the context-aware text extractor 1513, and can generate a query by using the query generator 1515. The generated query can be connected to the search server 2000 or the cloud server 3000, and thus can be connected to the search engine 3500, the image analysis engine 3600, or the voice assistance engine 3700.

The image assisting portion 1520 can receive an image and can generate text corresponding to the received image. The generated text can be transmitted to the query generator 1515, and then the query generator 1515 can generate the query in the same manner as the textual user input.

The voice assisting portion 1530 can receive the voice and can generate text corresponding to the received voice. The generated text can be transmitted to the query generator 1515 and then checked The query generator 1515 can generate a query in the same manner as the text type user input.

The startup text assisting portion 1510, the image assisting portion 1520, and the voice assisting portion 1530 can be activated or deactivated via the interface depicted in FIG. 31B. For example, when the user sets the setting bar 10_a to "text" by using the interface of FIG. 31B, the image assisting part 1520 and the voice assisting part 1530 can be deactivated, and even if the electronic device 1000 receives the image input or voice. Input, electronic device 1000 may also not generate a query corresponding to image input or voice input.

FIG. 43 is a block diagram illustrating an operation of obtaining user input, which is performed by electronic device 1000, in accordance with another example embodiment.

Referring to FIG. 43, the electronic device 1000 can include a search engine 1850, an image analysis engine 1860, and/or a voice assistance engine 1870. That is, unlike the example embodiment of FIG. 42, search engine 1850, image analysis engine 1860, and/or voice assistance engine 1870 may be included in electronic device 1000. The electronic device 1000 can use the search engine 1850, the image analysis engine 1860, or the voice assistance engine 1870 to receive queries and obtain information.

FIG. 44 is a block diagram showing a configuration of a user terminal device 1000 according to an exemplary embodiment. The user terminal device 1000 illustrated in FIG. 44 may correspond to the electronic device 100 of FIG.

As illustrated in FIG. 44, the configuration of the user terminal device 1000 can be applied to various types of devices, including a mobile phone, a tablet PC, a PDA, an MP3 player, an inquiry machine, an electronic photo frame, a navigation device, and a digital television ( Digital television; TV), or a wearable device including a wristwatch, HMD, or the like.

Referring to FIG. 44, the user terminal device 1000 may include the following At least one of: display 1100-2, controller 1700, memory 1200, GPS chip 1250, communicator 1300, video processor 1350, audio processor 1400, user input device 1450, microphone 1500, image capture device 1550, speaker 1600, and motion detector 1650.

The display 1100-2 can include a display panel 1110 and a controller (not shown) that controls the display panel 1110. The display panel 1110 can be embodied as various displays, including a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, an active matrix OLED (AMOLED) display, and a plasma. A plasma display panel (PDP) or the like. Display panel 1110 can be formed to be flexible, transparent, and/or wearable. The display panel 1110 can be combined with the touch panel 1470 of the user input device 1450, and thus can be provided as a touch screen (not shown). For example, the touch screen can include an integrated module having a stacked structure including the display panel 1110 and the touch panel 1470.

The memory 1200 can include at least one of an internal memory (not shown) and an external memory (not shown).

The internal memory may include at least one of: a volatile memory (for example, a dynamic random access memory (DRAM), a static random access memory (SRAM) ), synchronous dynamic random access memory (SDRAM), etc., non-volatile memory (for example, one-time programmable read-only memory (OTPROM) Programmable read only memory (programmable read only Memory;PROM), erasable and programmable read only memory (EPROM), electrically erasable and programmable read only memory (EEPROM) , mask read-only memory (ROM), flash ROM, etc., hard disk drive (HDD), and solid state drive (SSD). According to an example embodiment, the controller 1700 can load commands or materials received from at least one of the non-volatile memory and another component into the volatile memory and can process the commands or materials. Additionally, controller 1700 can store data received from another component or generated by another component in non-volatile memory.

The external memory may include at least one of: compact flash (CF) memory, secure digital (SD) memory, and micro secure digital (Micro-SD) memory. Body, small secure digital (Mini-SD) memory, extreme digital (xD) memory, and memory stick.

The memory 1200 can store various programs and materials for use in the operation of the user terminal device 1000. For example, the memory 1200 can temporarily or semi-permanently store a portion of the content to be displayed on the lock screen.

The controller 1700 can control the display 1100-2 to display portions of the content stored in the memory 1200. In other words, the controller 1700 can display a portion of the content stored in the memory 1200 on the display 1100-2. Alternatively, when a gesture of the user is performed in the area of the display 1100-2, the controller 1700 may perform a control operation corresponding to the gesture of the user.

The controller 1700 can include at least one of: a random access memory (RAM) 1710, a ROM 1720, a central processing unit (CPU) 1730, and a graphics processor unit. Unit; GPU) 1740, and bus 1750. The RAM 1710, the ROM 1720, the CPU 1730, and the GPU 1740 may be connected to each other via the bus bar 1750.

The CPU 1730 can access the memory 1200 and perform a booting operation by using an operating system (OS) stored in the memory 1200. Further, the CPU 1730 performs various operations by using various programs, a plurality of contents, a plurality of pieces of data, and the like stored in the memory 1200.

The ROM 1720 stores a set of commands for starting the system. For example, when an on command is input to the user terminal device 1000 and power is supplied to the user terminal device 1000, the CPU 1730 can store the memory in the memory 1200 according to a command stored in the ROM 1720. The OS is copied to the RAM 1710, the OS can be executed, and thus the system can be booted. When the power-on operation is completed, the CPU 1730 copies various programs stored in the memory 1200 to the RAM 1710, and performs various operations by executing the program copied to the RAM 1710. When the user terminal device 1000 is activated, the GPU 1740 displays the user interface screen in the area of the display 1100-2. More specifically, GPU 1740 can produce a screen that displays electronic files containing various items such as content, graphics, menus, or the like. The GPU 1740 calculates the coordinate value of the object to be displayed according to the layout of the user interface screen, and calculates the attribute value of the shape, size, or color of the object. Next, GPU 1740 can generate a user interface screen with various layouts including objects based on the calculated attribute values. The generated by GPU 1740 can be made The user interface screen is provided to display 1100-2 and thus can be displayed in the area of display 1100-2.

The GPS chip 1250 can receive GPS signals from GPS satellites and can calculate the current location of the user terminal device 1000. The controller 1700 can calculate the position of the user by using the GPS wafer 1250 in a situation where the navigation program is used or the current location of the user is required.

The communicator 1300 can perform communication with various external devices in accordance with various types of communication methods. The communicator 1300 can include at least one selected from the group consisting of a Wi-Fi wafer 1310, a Bluetooth chip 1320, a wireless communication chip 1330, and a near field communication (NFC) wafer 1340. The controller 1700 can perform communication with various external devices by using the communicator 1300.

The Wi-Fi chip 1310 and the Bluetooth chip 1320 can perform communication by using WiFi and Bluetooth, respectively. If a Wi-Fi chip 1310 or a Bluetooth chip 1320 is used, the WiFi chip 1310 or the Bluetooth chip 1320 can first transmit and receive various types of connection information (including service set identification (SSID), work phase key or Similarly, a communication connection can be established by using connection information, and then various types of information can be transmitted and received. The wireless communication chip 1330 can indicate a wafer that performs communication in accordance with various communication standards, such as the Institute of Electrical and Electronics Engineers (IEEE), Zigbee, 3rd generation (3G), and third generation. 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE) or the like. The NFC wafer 1340 indicates the use of the following various radio frequency identifications (radio frequency-identifications) when using NFC; A wafer operating in the 13.56 MHz band in the RF-ID) band: such as 135 kHz, 13.56 megahertz (MHz), 433 megahertz, 860-960 megahertz, 2.45 GHz or the like.

The video processor 1350 can process the video material contained in the content received by using the communicator 1300, or can process the video material contained in the content stored in the memory 1200. The video processor 1350 can perform various image processing on the video material, such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, or the like.

The audio processor 1400 can process the audio data contained in the content received by using the communicator 1300, or can process the audio data contained in the content stored in the memory 1200. The audio processor 1400 can perform various processing on the audio material, such as decoding, amplification, noise filtering, or the like.

When the rendering program for the multimedia content is executed, the controller 1700 can reproduce the multimedia content by driving the video processor 1350 and the audio processor 1400. The speaker 1600 can output audio data generated in the audio processor 1400.

User input device 1450 can receive input from various instructions of the user. The user input device 1450 can include at least one selected from the group of buttons 1460, touch panel 1470, and pen recognition panel 1480.

The button 1460 can have various types, such as a mechanical button, a roller, or the like, which can be formed in a front portion, a side portion, a rear portion, and the like of an outer surface of the body of the user terminal device 1000.

The touch panel 1470 can sense a user's touch input and can output a value corresponding to a touch event of a signal generated by the sensed touch input. When touched When the control panel 1470 is combined with the display panel 1110 and thus formed as a touch screen, the touch screen can be configured as, for example, a capacitive touch screen, resistive, by using various types of touch sensors. Touch screen or piezo touch screen. The capacitive touch screen can calculate the touch coordinates by sensing a small amount of electricity generated when the user's body part touches the surface of the capacitive touch screen that is coated with a dielectric material. The resistive touch screen can include two embedded electrode plates, and can sense the flow of current that occurs when the user touches the resistive touch screen (the situation causes the upper plate of the touched point) The touched coordinates are calculated by touching the lower plates with each other. The touch event occurring on the touch screen can be generated mainly by a human finger, and can also be generated by an object formed by a conductive material capable of changing the capacitance.

The pen recognition panel 1480 can sense a proximity input or a touch input of a stylus (eg, a stylus or a tablet pen) performed by a user, and can output the sensed pen proximity event or the sensed The pen touches the event. The pen recognition panel 1480 can include, for example, an electromagnetic resonance (EMR) type pen recognition panel, and can sense a touch according to a change in the intensity of an electromagnetic field that occurs when the stylus approaches or touches the touch screen. Input or proximity input. In more detail, the pen recognition panel 1480 may include an electromagnetic induction coil sensor (not shown) having a grid structure, and for sequentially supplying an alternating current (AC) signal having a predetermined frequency to the electromagnetic induction. An electrical signal processor (not shown) of each toroid of the coil sensor. When a pen having an internal resonant circuit is positioned near the toroidal coil of the pen recognition panel 1480, the magnetic field transmitted from the toroidal coil generates a current in the resonant circuit in the pen based on mutual electrostatic induction. Due to the current, an induction field is generated from the coil of the resonant circuit forming the pen, and the pen recognition panel 1480 is capable of receiving signals. The toroid detects the inductive field and thus senses the touch input or proximity input of the pen. The pen recognition panel 1480 can be configured to occupy a predetermined area below the display panel 1110, such as can have a size that can cover the display area of the display panel 1110.

The microphone 1500 can receive input of a user's voice or other sounds and can convert the user's voice or other sound into audio material. The controller 1700 can use the voice of the user input via the microphone 1500 in the call related operation, or can convert the voice of the user into audio data and can store the audio data in the memory 1200.

Image capturer 1550 can capture still images or animations based on control by the user. The number of image capturers 1550 can be multiple and include a front camera, a rear camera, or the like.

If the image capturer 1550 and the microphone 1500 are provided, the controller 1700 can perform a control operation according to the user's voice input via the microphone 1500 or the motion of the user recognized by the image capturer 1550. For example, the user terminal device 1000 can operate in a motion control mode or a voice control mode. If the user terminal device 1000 is operating in the motion control mode, the controller 1700 can activate the image capture device 1550 and can capture the image of the user, can track the change of the user's motion, and can perform control operations corresponding thereto. . If the user terminal device 1000 operates in the voice control mode (ie, voice recognition mode), the controller 1700 can analyze the voice of the user input via the microphone 1500, and can perform control according to the voice of the analyzed user. operating.

The motion detector 1650 can detect the movement of the body of the user terminal device 1000. The user terminal device 1000 can be rotated or tilted in various directions. Here, the motion detector 1650 can detect such as a rotation direction, a rotation angle, a tilt angle, or the like by using at least one of a magnetic sensor, a gyro sensor, an acceleration sensor, and the like. Mobile characteristics.

In addition, the exemplary embodiment may further include: a universal serial bus (USB) port for connecting the user terminal device 1000 and the USB connector; various external input ports, including a headset, a mouse, and a regional network. A local area network (LAN) or the like for connection with various external terminals; a digital multimedia broadcasting (DMB) chip for receiving and processing DMB signals; various sensors; or the like.

The names of the components in the user terminal device 1000 can vary. Moreover, the user terminal device 1000 according to an example embodiment may include at least one of the aforementioned components, or may be embodied by more or fewer components than the aforementioned components.

45A is a block diagram illustrating a software configuration of a user terminal device 1000, in accordance with an exemplary embodiment.

Referring to FIG. 45A, the memory 1200 may store an OS for controlling resources of the user terminal device 1000, an application for performing an operation of the application, or the like. The OS may include a core program 12100, an intermediate software 1220, an API 12300, and the like. Examples of the OS may include Android (Android), iOS, Windows, Symbian, Tizen, Bada, or the like.

The core program 12100 can include at least one of a device driver 1210-1 and a system resource manager 1210-2 capable of managing resources. The device driver 1210-1 can allow access to and control of the hardware of the user terminal device 1000 by using software. In order to do this, the device driver 1210-1 can be divided into interfaces. And discrete driver modules provided by discrete hardware companies. For example, the device driver 1210-1 may include at least one of the following: a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, and Wi. -Fi driver, audio driver, and inter-process communication (IPC) driver. System resource manager 1210-2 can include at least one of a handler manager, a memory manager, and a file system manager. System resource manager 1210-2 can perform control, allocation, or retrieval of system resources.

The intermediate software 1220 can include a plurality of modules that are pre-emphasized to provide functionality that is typically requested by various applications. The intermediate software 1220 can provide functionality via the API 12300 to control the application 1240 to effectively utilize the resources of the user terminal device 1000. The intermediate software 1220 can include at least one of a plurality of modules including: an application manager 1220-1, a window manager 1220-2, a multimedia manager 1220-3, a resource manager 1220-4, and power Manager 1220-5, DB Manager 1220-6, Package Manager 1220-7, Connection Manager 1220-8, Notification Manager 1220-9, Location Manager 1220-10, Graphics Manager 1220-11, and Security Manager 1220-12.

The application manager 1220-1 can manage the lifecycle of at least one of the applications 1240. The window manager 1220-2 can manage GUI resources for use in the picture. The multimedia manager 1220-3 can detect a format for reproducing various types of multimedia files, and can encode or decode media files by using a codec suitable for the format of the media file. The resource manager 1220-4 can manage resources of at least one of the applications 1240, such as source code, memory, or storage space. Power tube The processor 1220-5 can interoperate with a Basic Input/Output System (BIOS) to manage the battery or power supply and provide power information for operation. The DB manager 1220-6 can manage a repository to be used in at least one of the applications 1240, to be generated, to be searched, or to be changed. The package manager 1220-7 can manage the installation or update of applications distributed in the form of package files. The connection manager 1220-8 can manage wireless connections such as Wi-Fi, Bluetooth, or the like. The notification manager 1220-9 can display or notify an event when the user is not disturbed by an event, such as a received message, an appointment, a method notification, or the like. The location manager 1220-10 can manage location information of the user terminal device 1000. The graphics manager 1220-11 can manage graphics effects to be provided to the user, as well as UIs related to graphics effects. Security Manager 1220-12 can provide general security functions requested by system security or user authentication. If the user terminal device 1000 has a telephone function, the intermediate software 1220 may further include a call manager (not shown) for managing the voice or video call function of the user terminal device 1000.

The intermediate software 1220 may further include an execution stage library 1220-13 or other library modules (not shown). The execution stage library 1220-13 is a library module for the compiler to add new functionality to by using the programming language when executing the application. For example, execution stage library 1220-13 may perform input/output, memory management, or operations for performing mathematical functions. The intermediate software 1220 can generate and use a new intermediate software module by combining various functions of the aforementioned internal configuration component modules. The intermediate software 1220 can provide modules that are specialized according to each type of OS to provide differentiated functionality. The intermediate software 1220 can dynamically delete some of the existing configuration components or dynamically add new configuration components. Can omit the example Some of the configuration components in the example may include other configuration components, or some configuration components may be replaced with other configuration components with different names but performing similar functions.

The API 12300 is a set of API programming functions and can be configured differently for each type of OS. Android or iOS provides one API set for each platform, and Tizen provides at least two API sets for each platform.

The application 1240 can include at least one pre-loaded application installed as a preset, or a third-party application installed and used by the user when the user uses the user terminal device 1000. For example, the application 1240 can include at least one of: a home application 1240-1 for returning to the home screen; a dialing application 1240-2 for establishing a call with the other party; for receiving Text message application 1240-3 from the other party based on the phone number identification; instant message (IM) application 1240-4; browser application 1240-5; camera application 1240-6; alarm Application 1240-7; phone book application 1240-8 for managing other party's phone number or address; call log for managing the user's call log, text message reception/transmission log or unanswered call log An application 1240-9; an email application 1240-10 for receiving emails from another party based on the email account identification; a calendar application 1240-11; a media player application 1240-12; a photo album application Program 1240-13; and clock application 1240-14. The names of the aforementioned components of the software according to the exemplary embodiment may vary depending on each type of OS. Furthermore, the software according to example embodiments may include or omit at least one of the foregoing components, or may further include at least one additional component.

The application 1240 can receive the query via the intermediate software 1220 and the API 12300. When the keyword is extracted by performing natural language analysis while executing the application, the user terminal device 1000 can determine the query corresponding to the keyword via the API 12300 and the intermediate software 1220. For example, when the keyword "6th of a certain month" is extracted when the user executes the text message application 1240-3, the user terminal device 1000 can pass through the API 12300 and the middle. The software 1220 searches for the schedule data generated in the calendar application 1240-11, and displays the search results on the execution window of the text message application 1240-3.

Moreover, when the keyword "execute xx" is extracted when the user executes the text message application 1240-3, the user terminal device 1000 can be in the calendar application 1240-11 via the API 12300 and the intermediate software 1220. The phone book application 1240-8 and the email application 1240-10 search for the data corresponding to "execute xx", and the search result can be displayed on the execution window of the text message application 1240-3.

The user terminal device 1000 can deliver the extracted keywords to the intermediate software 1220 via a dedicated API, and can access the data generated in another application via the DB manager 1220-6, and can be provided by reference materials. Search results.

A plurality of segments of the data generated in the application 1240 may be stored in a DB (not shown), and when the keywords are extracted when the application is executed, the user terminal device 1000 may be via the API 12300 and the intermediate software 1220. The DB is accessed and the search results can be provided by referring to the data stored in the DB.

FIG. 45B illustrates a user setting screen provided by the electronic device 100, according to an exemplary embodiment.

Referring to FIG. 45B, the electronic device 100 may provide a setting screen 4501 for the user regarding the information providing operation. The user can select an information providing method via the setting screen 4501. Although FIG. 45B illustrates the operation "query generation", this operation may be stated in different ways depending on the product, and thus, the statement of the operation does not limit the scope of the inventive concept.

There are three types of query generation available, namely, "Application 4503", "Device 4505" and "All 4507". When the user selects the "application 4503" displayed on the setting screen 4501, the electronic device 100 can generate a query by considering only the executed application, and can provide a search result executed by using the query. For example, when the user selects "application 4503" from the setting screen 4501 and executes the text message application 1240-3, the electronic device 100 can extract keywords by performing natural language analysis, and can consider only text. The message application 1240-3 determines the query and can perform a search operation.

When the user selects "device 4505" from the setting screen 4501, the electronic device 100 can determine the query by considering the generated data in the executed application and another application stored in the DB (not shown). And the search operation can be performed. For example, when the user selects "device 4505" from the setting screen 4501 and executes the text message application 1240-3, the electronic device 100 can extract keywords by performing natural language analysis, and can consider the calendar application. The program 1240-11, the phone book application 1240-8, and the email application 1240-10 determine the query corresponding to the keyword via the API 12300 and the intermediate software 1220, and can display the search result in the text message application 1240-3. Execute on the window.

The electronic device 100 can deliver the extracted keywords to the dedicated API to The intermediate software 1220 can access the data generated in another application via the DB manager 1220-6, and can provide the search result by using the reference material.

The plurality of segments of the data generated in the application 1240 may be stored in the DB, and when the keyword is extracted when the application is executed, the electronic device 100 may access the DB via the API 12300 and the intermediate software 1220, and may be Provide search results by referring to the data stored in the DB.

When the user selects "all 4507" from the setting screen 4501, the electronic device 100 can select all "applications 4503" and "device 4505", and can perform a search operation.

FIG. 46 illustrates a UI of an electronic device 20000 according to another example embodiment. The electronic device 20000 may correspond to the electronic device 100 of FIG.

The electronic device 20000 can include a processor 2700, an input interface 2400, and an output interface 2100.

The processor 2700 can include a mobile application processor or a CPU. Processor 2700 can be referred to as a controller or the like. In addition, the processor 2700 can further include a core, a display controller, and an image signal processor (ISP).

The processor 2700 according to an example embodiment may extract at least one keyword from a message displayed on a screen of the electronic device 20000 via a communication service. Moreover, processor 2700 in accordance with an example embodiment can generate a query related to a keyword. Moreover, the processor 2700 according to an example embodiment can obtain information based on the edited query and the location information of the electronic device 20000.

The input interface 2400 can be used by the user to input data to control the electronic device. Set the unit of 20000. For example, the input interface 2400 can be a keypad, a hemispherical switch, or a touchpad (eg, a touch capacitive touch panel, a piezoresistive touch panel, an infrared beam sensing type touch panel, and a surface acoustic wave type). Touchpad, integrated strain gauge type touchpad, piezoelectric effect type touchpad, etc.), jog wheel, micro switch or the like. In addition, the input interface 2400 can include a touch screen, a touch panel, a microphone, and/or a keyboard.

Additionally, input interface 2400 can include at least one module for receiving input from a user's profile. For example, the input interface 2400 can include a motion recognition module, a touch recognition module, a voice recognition module, and the like.

The touch recognition module can sense a user's touch gesture on the touch screen, and can transmit information about the touch gesture to the processor 2700. The speech recognition module can recognize the user's speech by using a speech recognition engine, and can deliver the recognized speech to the processor 2700. The motion recognition module can recognize the motion of the object and can deliver information about the motion of the object to the processor 2700.

Throughout this specification, user input via input interface 2400 of electronic device 20000 can include, but is not limited to, at least one selected from the group consisting of: touch input, bend input, voice input, key input, and more. Modal input.

The touch input indicates a gesture performed by the user on the touch screen to control the electronic device 20000. For example, the touch input according to one or more example embodiments may include a touch gesture, a touch and hold gesture, a double tap gesture, a drag gesture, a horizontal motion gesture, a toggle gesture Action, drag and drop gestures or the like.

"tap" for the user by using a finger or touching a tool (eg, electronics) Pen) Touch the screen and then immediately lift your finger or touch the tool from the screen.

"Touch and hold" means that the user touches the screen by using a finger or a touch tool (for example, an electronic pen) and then maintains the touch motion for a predetermined time (for example, 2 seconds) or more after touching the screen. Long hours of exercise. For example, the time difference between the touch start time and the touch end time is greater than or equal to a predetermined time (eg, 2 seconds). When the touch input duration exceeds a predetermined time, a feedback signal may be provided in a visual, acoustic or tactile manner in order to inform the user that the touch input is lightly touched or touched and held. In other example embodiments, the predetermined time may vary.

"Double Touch" is a motion in which the user quickly touches the screen twice by using a finger or a touch tool such as a stylus.

"Drag" is the movement of the user to touch the screen by using a finger or a touch tool and move the finger or the touch tool to another position on the screen while maintaining the touch motion. The drag motion enables movement of the object or horizontal movement.

"Horizontal Movement" is a motion in which the user performs a drag motion without selecting an object. Since no objects are selected in the horizontal moving motion, no objects move in the page, but the page itself moves on the screen or the object group can be moved within the page.

"Toggle" is a motion in which a user quickly performs a drag motion at a speed greater than a predetermined speed (for example, 100 pixels/second) by using a finger or a touch tool. The drag (horizontal movement) motion or the toggle motion may be distinguished from each other based on whether the moving speed of the finger or the touch tool is greater than a predetermined speed (eg, 100 pixels/second).

"Drag and drop" is a motion in which a user drags an object to a preset position on the screen by a finger or a touch tool and then places the object in the position.

"Pinch" is the two fingers that the user moves in the opposite direction and touches the screen. exercise. The pinching motion is a gesture of zooming in (opening the pinch) or shrinking (closing the pinch) object or page. The magnification value or the contraction value is determined based on the distance between the two fingers.

"Slip" is a motion in which a user touches an object on a screen by using a finger or a touch tool while moving the object horizontally or vertically for a predetermined distance. Sliding motion in the diagonal direction may not be recognized as a slip event.

The "motion input" indicates the movement of the user by the device to control the electronic device 20000. For example, the motion input can include an input of the user rotating the electronic device 20000, the tilting electronic device 20000, or the mobile electronic device 20000 in an up direction, a down direction, a right direction, and/or a left direction. The electronic device 2000 can sense a motion input preset by a user by using an acceleration sensor, a tilt sensor, a gyro sensor, a three-axis magnetic sensor, or the like.

Throughout the specification, "bend input" instructs a user to bend an entire area or a partial area of the electronic device 20000 to control the input of the electronic device 20000, and here, the electronic device 20000 may be a flexible display device. According to an exemplary embodiment, the electronic device 20000 may sense a bending position (coordinate value), a bending direction, a bending angle, a bending speed, a number of times the bending motion is performed, a number of times the bending motion occurs, a holding time of the bending motion, and the like.

Throughout the specification, "key input" instructs the user to control the input of the electronic device 2000 by using a physical button formed on the electronic device 20000 or by using a virtual button provided by the electronic device 20000.

Throughout this specification, "multimodal input" indicates a combination of at least two input methods. For example, the electronic device 20000 can receive the touch input of the user and Motion input, or can receive the user's touch input and voice input. Moreover, the electronic device 20000 can receive the touch input and the eye input of the user. The eye input indicates that the user adjusts the blinking motion of his eyes, the gaze position, the moving speed of the user's eyes, and the like to control the input of the electronic device 20000.

The input interface 2400 in accordance with an example embodiment can receive an edited query from a user.

The output interface 2100 can output an audio signal, a video signal or an alarm signal, and can include a display module, a sound output module, or the like. In addition, the output interface 2100 can include a flat panel display capable of displaying 2D images and a flat panel display capable of displaying 3D images. The output interface 2100 can include means capable of outputting a 3D hologram.

Output interface 2100 in accordance with an example embodiment may provide a query generated by processor 2700. The output interface 2100 according to an example embodiment may provide information obtained by the processor 2700.

The electronic device 20000 can exchange information with the search server via communication with a search server (not shown). For example, electronic device 2000 can communicate with a search server by using at least one protocol. For example, the electronic device 2000 can communicate with the search server by using at least one of: a simple file transfer protocol (TFTP), a simple network management protocol (simple network management protocol; SNMP), simple mail transfer protocol (SMTP), post office protocol (POP), internet control message protocol (ICMP), serial line interface Protocol; SLIP), point-to-point protocol (PPP), dynamic host configuration protocol (DHCP), network basic input/output system (NetBIOS), Internet packet exchange/sequenced packet exchange (IPX/SPX), Internet control message protocol (ICMP), Internet protocol (IP), bit Address resolution protocol (ARP), transmission control protocol (TCP), user datagram protocol (UDP), Windows software slot (Winsock), dynamic host configuration protocol (dynamic) Host configuration protocol; DHCP) and routing information protocol (RIP), but one or more exemplary embodiments are not limited thereto.

The electronic device 20000 can perform short-range communication by using a short-range communication module. Examples of short-range communication may include wireless LAN (eg, Wi-Fi), Bluetooth, Zigbee, Wi-Fi direct (WFD), UWB, or infrared data association (IrDA), but One or more exemplary embodiments are not limited thereto.

47 to 50 illustrate an example of a UI provided by the electronic device 100 for performing communication via a message service.

Referring to FIG. 47, the electronic device 100 may display a message received from another electronic device and a message transmitted to another electronic device on a display 4701 in chronological order. Reference numeral 4703 of FIG. 47 indicates a virtual screen showing the enlarged and expanded view of the message displayed on the display 4701. Only a part of the virtual screen 4703 is displayed on On the display 4701. That is, when the electronic device 100 displays the messages in chronological order, the electronic device 100 may display the previously displayed message on the upper area of the display 4701, and may display the chronologically displayed messages on the display 4701 when scrolling. on.

When the electronic device 100 continuously monitors the content of the conversation between the users, the electronic device 100 may respectively indicate or may separately mark the keywords included in the message, and may maintain the indication or mark within a preset time period. The electronic device 100 may extract at least one keyword from the message, and may determine a query of the search service based on the extracted at least one keyword and the context information of the user. The electronic device 100 may extract at least one keyword by performing natural language analysis on the content of the message. The electronic device 100 can extract keywords by using the previous message and the current message displayed on the display 4701. Further, the electronic device 100 may use the extracted keyword as a query for the search service, or may infer another keyword from the extracted keyword and may use the inferred keyword as a query for the search service.

The display 4701 can tag keywords in different ways to distinguish from other content of the displayed message, wherein the keyword is used in determining the query.

On the virtual screen 4703 of Fig. 47, the keywords 4711, 4713, 4715, 4717, and 4719 of the communication message are marked to distinguish from other contents of the communication message. The keywords may be tagged in a manner different from other content (or in a manner distinguishable from other content) within a preset time period (eg, within one hour). That is, after a predetermined period of time elapses, the keywords marked in different ways may be returned to the state in which they were originally displayed. The keyword can return to its original state after an hour and can be displayed as if it were other content. Alternatively, the time period in which the keyword is located may be determined in a manner different from other content according to user input. For example, if The user sets the two hours to mark the time period in which the keyword is located in a manner different from the other content of the communication message, and the keyword can be marked in a different manner than the other content within two hours.

Referring to FIG. 48, the electronic device 100 may display a message received from another electronic device and a message transmitted to another electronic device on a display 4801 in chronological order. Reference numeral 4803 of FIG. 48 indicates a virtual screen showing an enlarged and expanded view of the message displayed on the display 4801. Only a portion of the virtual screen 4803 is displayed on the display 4801. That is, when the electronic device 100 displays the messages in time series, the electronic device 100 may display the previously displayed message on the upper area of the display 4801, and may display the chronologically displayed messages on the display 4801 when scrolling. on.

When the electronic device 100 continuously monitors the content of the conversation between the users, the electronic device 100 may respectively indicate or may respectively mark the keywords included in the message on the display 4801, and may maintain the indication or the preset time period. mark. The electronic device 100 may extract at least one keyword by using one or more keywords included in the message, and may determine a query of the search service based on the extracted at least one keyword and the context information of the user. The electronic device 100 may extract at least one keyword by performing natural language analysis on the content of the message. The electronic device 100 can extract keywords by using the previous message and the current message displayed on the display 4801. Further, the electronic device 100 may use the extracted keyword as a query for the search service, or may infer another keyword from the extracted keyword and may use the inferred keyword as a query for the search service.

Display 4801 can tag keywords differently to distinguish from displayed Other content of the message, where the keyword is used in determining the query.

On the virtual screen 4803 of Fig. 48, the keywords 4701, 4813, 4815, 4817, and 4819 of the communication message are marked in a manner different from the other contents of the communication message. The keywords may be tagged in a different time period (eg, within one hour) than other content. The keyword can return to its original state after an hour and can be displayed as if it were other content. The keyword 4805 (corresponding to the keyword 4711 in FIG. 47) may be marked differently from the other contents in FIG. 47, but after one hour, the keyword 4805 is returned to the state in which it was originally displayed and thus is equivalent to other contents. display. On the other hand, compared with FIG. 47, newly added keywords 4817 and 4819 can be marked differently from other contents.

Referring to FIG. 49, the electronic device 100 may display a message received from another electronic device and a message transmitted to another electronic device on a display 4901 in chronological order. Reference numeral 4903 of FIG. 49 indicates a virtual screen showing an enlarged and expanded view of the message displayed on the display 4901. Only a portion of the virtual screen 4903 is displayed on the display 4901. That is, when the electronic device 100 displays the messages in chronological order, the electronic device 100 may display the previously displayed message on the upper area of the display 4901, and may display the chronologically displayed messages on the display 4901 when scrolling. on.

When the electronic device 100 continuously monitors the content of the conversation between the users, the electronic device 100 may respectively indicate or may respectively mark the keywords included in the message on the display 4901, and may maintain the indication or the preset time period. mark. The electronic device 100 may extract at least one keyword by using one or more keywords included in the message, and may be based on the extracted at least one keyword and the user's upper and lower The text information determines the query of the search service. The electronic device 100 may extract at least one keyword by performing natural language analysis on the content of the message. The electronic device 100 can extract keywords by using the previous message and the current message displayed on the display 4901. Further, the electronic device 100 may use the extracted keyword as a query for the search service, or may infer another keyword from the extracted keyword and may use the inferred keyword as a query for the search service.

The display 4901 can tag keywords in different ways to distinguish keywords that are different from other content of the displayed message, wherein the keywords are used in determining the query.

On the virtual screen 4903 of Fig. 49, the keywords 4911, 4913, 4915, 4917, and 4919 of the communication message are marked in a manner different from the other contents of the communication message. The keywords may be tagged in a different time period (eg, within one hour) than other content. The keyword can return to its original state after an hour and can be displayed as if it were other content.

The electronic device 100 may determine the query by using the extracted or inferred keyword and the context information of the user, and may perform a search operation. The user's context information may include the user's location information, the user's communication history information, and the user's search log information. In addition, the context information of the user may include, but is not limited to, at least one of the following: the surrounding environment information of the user's electronic device 100, the status information of the user's electronic device 100, and the status information of the user. And the user's schedule information.

The surrounding environment information of the electronic device 100 indicates information about the environment within a predetermined radius of the electronic device 100, and may include, but is not limited to, weather information, temperature information, humidity information, lighting information, noise information, and sound information.

The status information of the electronic device 100 may include, but is not limited to, information about a mode of the electronic device 100 (eg, a sound mode, a vibration mode, a silent mode, a power saving mode, a blocking mode, a multi-window mode, an automatic rotation mode, etc.) Location information of the electronic device 100, time information of the electronic device 100, communication module activation information (for example, Wi-Fi on/Bluetooth off/GPS on/NFC on, etc.), and network access status information of the electronic device 100 And information about at least one application executed in the electronic device 100 (eg, ID information of the application, type of application, usage time of the application, time period of use of the application, etc.).

The user's status information may indicate information about the user's movement, the user's life mode, or the like, and may include, but is not limited to, information about each of the following: the user's walking status, the user's exercise. The state, the driving state of the user, the sleep state of the user, and the mood of the user.

When the inquiry is determined, the electronic device 100 may perform the search operation without user input, and may temporarily or permanently store the search result in the memory of the electronic device 100. The search result may be displayed on the display 4901 according to the user's request, or the search result may be displayed on the preset area of the display 4901 regardless of the user's request.

The electronic device 100 may extract keywords 4911, 4913, 4915, 4917, and 4919, and may perform a search operation by using the extracted keywords 4911, 4913, 4915, 4917, and 4919 and context information of the user, and may temporarily or The search results 4921, 4923, 4925, 4927, and 4929 are permanently stored in the memory. For example, the electronic device 100 may perform a search operation based on the extracted keyword 4911 and the location information of the user, and may store the search result 4921 in the memory. In the body. Here, the search result 4921 may not be displayed on the display 4901. Alternatively, the search result 4921 can be displayed on the display 4901 based on user input. Alternatively, the search result 4921 can be displayed on a preset area of the display 4901 regardless of user input.

The electronic device 100 may perform a search operation based on the extracted keyword 4911 and the location information of the user, and may store the search result 4921 in the memory. Here, the search result 4921 may not be displayed on the display 4901. Alternatively, the search result 4921 can be displayed on the display 4901 according to the user's request. Alternatively, the search result 4921 can be displayed on a preset area of the display 4901 regardless of the user's request.

The electronic device 100 may perform a search operation based on the extracted keyword 4913, the user's location information, and time information, and may store the search result 4923 in the memory. The search result 4923 can be filtered in consideration of the location close to the user's current location and the current time. Here, the search result 4923 may not be displayed on the display 4901. Alternatively, the search result 4923 can be displayed on the display 4901 according to the user's request. Alternatively, the search result 4923 can be displayed on a preset area of the display 4901 regardless of the user's request.

The electronic device 100 may perform a search operation based on the extracted keywords 4915, 4917, and 4919, the location of the user, and the history information of the user, and may store the search results 4925, 4927, and 4929 in the memory. The search results 4925, 4927, and 4929 can be filtered in consideration of the location close to the user's current location as well as historical information (eg, frequently visited restaurants, shopping malls, subway stations, etc.). Here, search results 4925, 4927, and 4929 may not be displayed on the display. On 4901. Alternatively, search results 4925, 4927, and 4929 can be displayed on display 4901 as requested by the user. Alternatively, search results 4925, 4927, and 4929 can be displayed on a preset area of display 4901 regardless of the user's request.

Referring to FIG. 50, the electronic device 100 may display a message received from another electronic device and a message transmitted to another electronic device on a display 5001 in chronological order. Moreover, the electronic device 100 can display the search result 5005 on the display 5001 when displaying the message.

When the electronic device 100 displays the messages in chronological order, the electronic device 100 can display the message by scrolling up the previously displayed message.

When the electronic device 100 continuously monitors the content of the conversation between the users, the electronic device 100 may respectively indicate or may separately mark the keywords included in the message, and may maintain the indication or mark within a preset time period. The electronic device 100 may extract at least one keyword 5003 by using a message, and may determine a query of the search service based on the keyword 5003 and the context information of the user. The user's context information may include the user's location information, the user's communication history information, and the user's search log information.

The electronic device 100 can extract the keyword 5003 by performing natural language analysis on the content of the message. The electronic device 100 can extract the keyword 5003 by using the previous message and the current message displayed on the display 5001.

The display 5001 can tag the keywords 5003 in different ways to distinguish the keywords 5003 from other content of the displayed message, wherein the keyword 5003 is used in determining the query.

The keyword 5003 can be marked in a manner different from other content within a preset time period (for example, within one hour). The keyword 5003 can be returned to its initially displayed state after one hour and can be displayed equally as other content.

The electronic device 100 can determine the query by using the keyword 5003 and the context information of the user, and can perform a search operation. The context information of the user may include the location information of the user, the communication history information of the user, the search log information of the user, and the sensing information of the electronic device 100.

When the inquiry is determined, the electronic device 100 may perform the search operation without user input, and may temporarily or permanently store the search result in the memory. The search result may be displayed on the preset area 5005 of the display 5001 according to the user's request, or the search result may be displayed on the preset area 5005 of the display 5001 regardless of the user's request.

The search results can include the distance from the user's current location, as well as the recommended ranking.

The electronic device 100 can receive a user input selecting a keyword, can perform a search operation, and can display the search result on the preset area 5005 of the display 5001.

At least one of the components, components or units represented by the blocks as illustrated in the various figures above may be embodied as various numbers of hardware, software and functions for performing the various functions described above in accordance with an example embodiment. / or firmware structure. For example, at least one of such components, components or units may use a direct circuit structure, such as memory, processing, logic, or the like that can perform various functions via control of one or more microprocessors or other control devices. Look up tables, etc. In addition, in such components, components or units At least one of the modules may be embodied, in particular, by a module, a program, or a portion of a code that contains one or more executable instructions for performing the specified logical functions. Furthermore, at least one of such components, components or units may further comprise a processor, such as a central processing unit (CPU), a microprocessor, or the like, that performs the respective functions. The functional aspects of the above exemplary embodiments may be implemented by algorithms that are executed by one or more processors and stored in a computer readable recording medium. Furthermore, any number of prior art techniques for electronic configuration, signal processing and/or control, data processing, and the like, may be utilized by components, components or units represented by blocks or processing steps.

It should be understood that the example embodiments described herein are to be considered in a Descriptions of features or aspects within each example embodiment should generally be considered as other similar features or aspects that may be used in other example embodiments.

Although one or more exemplary embodiments have been described with reference to the drawings, it will be understood by those skilled in the art that the form and details may be practiced without departing from the spirit and scope as defined by the following claims. Various changes.

S110, S130, S170, S190‧‧‧ operations

Claims (14)

An electronic device comprising: a display; and a processor configured to: control the display to display one or more text messages exchanged between the electronic device and another electronic device on a display of the display; Or the text message extracts a keyword, and generates a search query based on the keyword; visually distinguishing the keyword from other words in the or the text message in the monitor; controlling a communication interface And transmitting a search request to a search server based on the search query; controlling the display to display a first application of the first application on the screen in response to receiving a selectively input of the keyword that is visually different And a second window of the second application, wherein the first window displays a search result received from the search server, and the second window displays the or the text message. The electronic device of claim 1, wherein the display is further configured to display a graphical user interface (GUI) configured to receive a user input regarding the keyword, and The processor is further configured to obtain information regarding the results of the search query based on the user input, and the display is further configured to display the information. An electronic device according to claim 2, wherein the processor More preferably configured to obtain the information via at least one of the second application and an internet search service installed in the electronic device. The electronic device of claim 3, wherein the processor is further configured to execute the second application, and the information is obtained by inputting the search query to the second application. The electronic device of claim 1, wherein the display is further configured to display a graphical user interface (GUI) configured to receive a user input regarding the keyword, and A query editing window for editing the search query is displayed based on the user input. The electronic device of claim 5, wherein the display is further configured to display the search for the determination by the processor via the query edit window. Query, and configured to receive user edits to the search query. The electronic device of claim 6, wherein the processor is further configured to obtain information regarding a result of the search query edited in accordance with the received edit. The electronic device of claim 1, wherein the processor is further configured to obtain at least one of: by using a global positioning system (GPS) processor included in the electronic device Measuring the location information of the electronic device and the location information of the electronic device extracted from the or the text message. The electronic device of claim 8, wherein the processor is further configured to use the location information extracted from the or the text message than the location obtained by using the GPS processor The use of information is prioritized to determine the search query. The electronic device of claim 1, wherein the processor is configured to determine the search query based on user information associated with the electronic device. A method of providing information in an electronic device, the method comprising: controlling the display to display one or more text messages exchanged between the electronic device and another electronic device on a display of the display; and from the or the The text message extracts a keyword and generates a search query based on the keyword; and visually distinguishing the keyword from other words in the text message in the monitor; controlling a communication interface based on The search query transmits a search request to a search server; in response to receiving a selection input of the visually distinguishable keyword, the display is controlled to display a first window of the first application on the screen and a second window of the second application, wherein the first window displays a search result received from the search server, and the second window displays the or the text message. The method of claim 11, further comprising: receiving a user input regarding the keyword; and obtaining information about the result of the search query in response to the user input; and displaying the information. The method of providing the method of claim 12, wherein the obtaining comprises obtaining the information via at least one of the second application installed in the electronic device and an internet search service. The method of providing the invention of claim 11, further comprising: receiving a user input regarding the keyword; and displaying a query editing window for editing the search query according to the user input.