KR102804046B1 - Electronic device and method for controlling thereof - Google Patents

Abstract

A method for controlling an electronic device according to various embodiments of the present invention may include an operation of obtaining a plurality of text messages, an operation of analyzing each of the plurality of text messages to obtain keywords corresponding to the plurality of text messages, an operation of transmitting a query including the keywords, and an operation of receiving a result of the keyword analysis and performing an operation corresponding to the received result of the keyword analysis.

Description

{ELECTRONIC DEVICE AND METHOD FOR CONTROLLING THEREOF}

The present invention relates to an electronic device and a method for controlling the same, and more particularly, to an electronic device for processing acquired text and a method for controlling the same.

Recently, programs or algorithms that can analyze the user's speech or input text to determine the user's intention have been actively developed. For example, conventional programs or algorithms can convert the user's input speech into text and perform natural language processing on the text. Natural language processing can be an artificial intelligence technology that deals with understanding, generating, and analyzing human language, and can determine the roles of each component of the text. In addition, a separate user intention analysis algorithm can perform natural language analysis included in the text by analyzing the result of natural language processing. Conventional electronic devices can analyze text divided into one sentence, for example, to determine the user's intention and perform an action corresponding to the determined user intention. However, conventional electronic devices can analyze the user's intention only when a clear referential target is included in the text divided into one sentence, and thus there is a problem that it is difficult to determine the user's exact intention.

The present invention has been made to solve the above-described problems or other problems, and various embodiments of the present invention can provide an electronic device and a control method thereof capable of analyzing a plurality of texts to more clearly understand a user's intention and performing an operation corresponding thereto.

A method for controlling an electronic device according to various embodiments of the present invention may include: an operation of obtaining a plurality of text messages; an operation of analyzing each of the plurality of text messages to obtain keywords corresponding to the plurality of text messages; an operation of transmitting a query including the keywords; and an operation of receiving a result of the keyword analysis and performing an operation corresponding to the received result of the keyword analysis.

An electronic device according to various embodiments of the present invention includes: a communication module; a processor electrically connected to the communication module; and a memory electrically connected to the processor, wherein the memory may store instructions that, when executed, cause the processor to obtain a plurality of text messages, analyze each of the plurality of text messages to obtain keywords corresponding to the plurality of text messages, transmit a query including the keywords using the communication module, receive a result of the keyword analysis, and perform an operation corresponding to the received result of the keyword analysis.

A method for controlling an electronic device according to various embodiments of the present invention may include: displaying an execution screen of a chat application executed in the electronic device on the display unit; displaying a plurality of text messages received from another electronic device through a communication unit and a plurality of text messages input through an input unit of the electronic device on the execution screen; determining an external device capable of providing information based on at least one of the plurality of text messages displayed on the screen; receiving information from the determined external device; and displaying the received information on the display unit. The plurality of text messages displayed on the execution screen and the received information may be arranged in chronological order and displayed on the execution screen. A UI element capable of receiving a user input may be displayed on the execution screen.

According to various embodiments of the present invention, an electronic device and a control method thereof can be provided that analyzes multiple texts to more clearly identify the intention of a user or multiple users and perform an action corresponding thereto. Accordingly, in a situation where multiple texts occur, such as a conversation between multiple users, the intention of the multiple users can be more clearly identified. In addition, even when one user speaks or inputs multiple texts at intervals of time, the user's intention can be clearly identified.

FIG. 1 illustrates a block diagram of an electronic device and a network according to various embodiments of the present invention.
FIG. 2 is a block diagram of an electronic device according to various embodiments.
FIG. 3 is a block diagram of a program module according to various embodiments.
FIG. 4 illustrates a flowchart for explaining a method of controlling an electronic device according to various embodiments of the present invention.
FIGS. 5a and 5b illustrate conceptual diagrams of electronic devices according to various embodiments of the present invention.
FIG. 6 illustrates a conceptual diagram for explaining text message acquisition according to various embodiments of the present invention.
FIGS. 7A and 7B illustrate flowcharts for explaining a method of controlling an electronic device according to various embodiments of the present invention.
FIG. 8a illustrates a conceptual diagram for explaining natural language analysis of an electronic device according to various embodiments of the present invention.
FIG. 8b illustrates a conceptual diagram for explaining a template according to various embodiments of the present invention.
FIG. 8c illustrates the results of applying a machine learning or deep learning algorithm to patterns based on user intent according to various embodiments of the present invention.
FIG. 9 illustrates a flowchart for explaining a method of controlling an electronic device according to various embodiments of the present invention.
FIG. 10a illustrates a conceptual diagram of an electronic device according to various embodiments of the present invention.
FIG. 10b illustrates a conceptual diagram for explaining keyword generation according to various embodiments of the present invention.
FIG. 10c illustrates a conceptual diagram of an electronic device according to various embodiments of the present invention.
FIG. 10d illustrates a conceptual diagram for explaining a keyword generation process according to various embodiments of the present invention.
FIG. 11 illustrates a flowchart for explaining a method of controlling an electronic device according to various embodiments of the present invention.
FIGS. 12a and 12b illustrate flowcharts for explaining a method of controlling an electronic device according to various embodiments of the present invention.
FIG. 13 illustrates a conceptual diagram of an electronic device according to various embodiments of the present invention.
FIG. 14 illustrates a conceptual diagram for explaining a receiver server according to various embodiments of the present invention.
FIG. 15 illustrates a flowchart for explaining a method of controlling an electronic device according to various embodiments of the present invention.
FIGS. 16A to 16C illustrate flowcharts for explaining keyword generation using additional information according to various embodiments of the present invention.
FIGS. 17A to 17D illustrate conceptual diagrams for explaining keyword generation using additional information according to various embodiments of the present invention.
FIG. 18 illustrates a conceptual diagram for explaining the operation of an electronic device in an IoT (internet of things) environment according to various embodiments of the present invention.
FIG. 19 illustrates a flowchart for explaining a method of controlling an electronic device according to various embodiments of the present invention.
FIG. 20 illustrates a flowchart for explaining a method of controlling an electronic device according to various embodiments of the present invention.
FIGS. 21A and 21B illustrate conceptual diagrams for explaining a process of processing user voice from a single user according to various embodiments of the present invention.
FIG. 22 illustrates a flowchart describing a method of controlling an electronic device according to various embodiments of the present invention.
FIG. 23 illustrates a conceptual diagram for explaining the operation of an electronic device according to various embodiments of the present invention.
FIG. 24 illustrates a flowchart describing a method of controlling an electronic device according to various embodiments of the present invention.
FIGS. 25A to 25C illustrate examples of calling and communicating with an in-home IoT device in an electronic device according to various embodiments of the present invention.

Hereinafter, various embodiments of the present document will be described with reference to the attached drawings. However, it should be understood that the technology described in this document is not limited to specific embodiments, but includes various modifications, equivalents, and/or alternatives of the embodiments of the present document. In connection with the description of the drawings, similar reference numerals may be used for similar components.

In this document, the expressions "have," "can have," "include," or "may include" indicate the presence of a given feature (e.g., a numerical value, function, operation, or component such as a part), but do not exclude the presence of additional features.

In this document, the expressions "A or B," "at least one of A and/or B," or "one or more of A or/and B" can include all possible combinations of the listed items. For example, "A or B," "at least one of A and B," or "at least one of A or B" can all refer to (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.

The expressions "first," "second," "first," or "second," etc., used in this document can describe various components, regardless of order and/or importance, and are only used to distinguish one component from another, but do not limit the components. For example, a first user device and a second user device can represent different user devices, regardless of order or importance. For example, without departing from the scope of the rights set forth in this document, a first component can be referred to as a second component, and similarly, a second component can also be referred to as a first component.

When it is stated that a component (e.g., a first component) is "(operatively or communicatively) coupled with/to" or "connected to" another component (e.g., a second component), it should be understood that the component can be directly coupled to the other component, or can be connected via another component (e.g., a third component). On the other hand, when it is stated that a component (e.g., a first component) is "directly coupled to" or "directly connected" to another component (e.g., a second component), it should be understood that no other component (e.g., a third component) exists between the component and the other component.

The expression "configured to", as used herein, can be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" does not necessarily mean something is "specifically designed to" in terms of hardware. Instead, in some contexts, the expression "a device configured to" can mean that the device is "capable of" doing something in conjunction with other devices or components. For example, the phrase "a processor configured to perform A, B, and C" can mean a dedicated processor (e.g., an embedded processor) for performing the operations, or a generic-purpose processor (e.g., a CPU or application processor) that can perform the operations by executing one or more software programs stored in a memory device.

The terms used in this document are only used to describe specific embodiments and may not be intended to limit the scope of other embodiments. The singular expression may include the plural expression unless the context clearly indicates otherwise. The terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by a person of ordinary skill in the art described in this document. Among the terms used in this document, terms defined in general dictionaries may be interpreted as having the same or similar meaning in the context of the related technology, and shall not be interpreted in an ideal or excessively formal meaning unless explicitly defined in this document. In some cases, even if a term is defined in this document, it cannot be interpreted to exclude the embodiments of this document.

An electronic device according to various embodiments of the present document may include, for example, at least one of a smartphone, a tablet personal computer, a mobile phone, a video phone, an e-book reader, a desktop personal computer, a laptop personal computer, a netbook computer, a workstation, a server, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a mobile medical device, a camera, or a wearable device. According to various embodiments, the wearable device may include at least one of an accessory type (e.g., a watch, a ring, a bracelet, an anklet, a necklace, glasses, a contact lens, or a head-mounted device (HMD)), a fabric or clothing-integrated type (e.g., an electronic garment), a body-attached type (e.g., a skin pad or a tattoo), or a bio-implantable type (e.g., an implantable circuit). Meanwhile, the electronic device may also receive power wirelessly from a wireless power transmitter, and thus, the electronic device may be referred to as a wireless power receiver.

In some embodiments, the electronic device may be a home appliance. The home appliance may include at least one of, for example, a television, a digital video disk (DVD) player, an audio, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a washing machine, an air purifier, a set-top box, a home automation control panel, a security control panel, a TV box (e.g., Samsung HomeSync ^TM , Apple TV ^TM , or Google TV ^TM ), a game console (e.g., Xbox ^TM , PlayStation ^TM ), an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame.

In another embodiment, the electronic device may be any of various medical devices (e.g., various portable medical measuring devices (e.g., blood glucose meters, heart rate monitors, blood pressure monitors, or body temperature monitors), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), a camera, or an ultrasound device), a navigation device, a global navigation satellite system (GNSS), an event data recorder (EDR), a flight data recorder (FDR), an automobile infotainment device, electronic equipment for ships (e.g., a navigation device for ships, a gyrocompass, etc.), avionics, a security device, a head unit for a vehicle, an industrial or household robot, an automatic teller's machine (ATM) of a financial institution, a point of sales (POS) of a store, or an internet of things device (e.g., a light bulb, various sensors, an electric or gas meter, a sprinkler device, a fire alarm, a thermostat, It may include at least one of the following: streetlight, toaster, exercise equipment, hot water tank, heater, boiler, etc.

According to some embodiments, the electronic device may include at least one of a piece of furniture or a part of a building/structure, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (e.g., a water, electricity, gas, or radio wave measuring device, etc.). In various embodiments, the electronic device may be a combination of one or more of the various devices described above. The electronic device according to some embodiments may be a flexible electronic device. In addition, the electronic device according to the embodiments of the present document is not limited to the devices described above, and may include new electronic devices according to technological advancement.

Hereinafter, electronic devices according to various embodiments are described with reference to the attached drawings. In this document, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

Referring to FIG. 1, an electronic device (101) within a network environment (100) in various embodiments is described. The electronic device (101) may include a bus (110), a processor (120), a memory (130), an input/output interface (150), a display (160), and a communication module (170). In some embodiments, the electronic device (101) may omit at least one of the components or additionally include other components.

The bus (110) may include, for example, circuitry that connects components (110-170) to each other and transmits communications (e.g., control messages and/or data) between the components.

The processor (120) may include one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP). The processor (120) may, for example, perform calculations or data processing related to control and/or communication of at least one other component of the electronic device (101).

The memory (130) may include volatile and/or nonvolatile memory. The memory (130) may store, for example, instructions or data related to at least one other component of the electronic device (101). According to one embodiment, the memory (130) may store software and/or programs (140). The programs (140) may include, for example, a kernel (141), middleware (143), an application programming interface (API) (145), and/or an application program (or “application”) (147). At least a portion of the kernel (141), the middleware (143), or the API (145) may be referred to as an operating system (OS).

The kernel (141) may control or manage system resources (e.g., a bus (110), a processor (120), or a memory (130)) used to execute operations or functions implemented in other programs (e.g., a middleware (143), an API (145), or an application program (147)). In addition, the kernel (141) may provide an interface that allows the middleware (143), the API (145), or the application program (147) to control or manage system resources by accessing individual components of the electronic device (101).

Middleware (143) may act as an intermediary to enable, for example, an API (145) or an application program (147) to communicate with the kernel (141) and exchange data.

In addition, the middleware (143) can process one or more work requests received from the application program (147) according to priority. For example, the middleware (143) can assign a priority for using system resources (e.g., bus (110), processor (120), memory (130), etc.) of the electronic device (101) to at least one of the application programs (147). For example, the middleware (143) can perform scheduling or load balancing, etc. for the one or more work requests by processing the one or more work requests according to the priority assigned to the at least one of the work requests.

API (145) is, for example, an interface for an application (147) to control a function provided by the kernel (141) or middleware (143), and may include at least one interface or function (e.g., command) for, for example, file control, window control, image processing, or character control.

The input/output interface (150) may serve as an interface that can transmit, for example, a command or data input from a user or another external device to other component(s) of the electronic device (101). In addition, the input/output interface (150) may output a command or data received from other component(s) of the electronic device (101) to the user or another external device.

The display (160) may include, for example, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, a microelectromechanical systems (MEMS) display, or an electronic paper display. The display (160) may, for example, display various contents (e.g., text, images, videos, icons, or symbols) to the user. The display (160) may include a touch screen and may receive, for example, a touch, gesture, proximity, or hovering input using an electronic pen or a part of the user's body.

The communication module (170) can establish communication between, for example, the electronic device (101) and an external device (e.g., a first external electronic device (102), a second external electronic device (104), or a server (106)). For example, the communication module (170) can be connected to a network (162) via wireless communication or wired communication to communicate with an external device (e.g., a second external electronic device (104) or a server (106)).

The wireless communication may use, for example, a cellular communication protocol, such as at least one of LTE (long-term evolution), LTE-A (LTE Advance), CDMA (code division multiple access), WCDMA (wideband CDMA), UMTS (universal mobile telecommunications system), WiBro (Wireless Broadband), or GSM (Global System for Mobile Communications). In addition, the wireless communication may include, for example, short-range communication (164). The short-range communication (164) may include, for example, at least one of WiFi (wireless fidelity), Bluetooth, NFC (near field communication), or GNSS (global navigation satellite system). Depending on the usage area or bandwidth, the GNSS may include, for example, at least one of GPS (Global Positioning System), Glonass (Global Navigation Satellite System), Beidou Navigation Satellite System (hereinafter "Beidou"), or Galileo, the European global satellite-based navigation system. Hereinafter, in this document, "GPS" may be used interchangeably with "GNSS". The wired communication may include at least one of, for example, a universal serial bus (USB), a high definition multimedia interface (HDMI), a recommended standard232 (RS-232), or a plain old telephone service (POTS). The network (162) may include at least one of a telecommunications network, for example, a computer network (e.g., a LAN or WAN), the Internet, or a telephone network.

Each of the first and second external electronic devices (102, 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, the server (106) may include a group of one or more servers. According to various embodiments, all or part of the operations executed in the electronic device (101) may be executed in another one or more electronic devices (e.g., the electronic device (102, 104), or the server (106). According to one embodiment, when the electronic device (101) is to perform a certain function or service automatically or upon request, the electronic device (101) may request at least some functions related thereto from another device (e.g., the electronic device (102, 104), or the server (106)) instead of executing the function or service by itself or in addition. The other electronic device (e.g., the electronic device (102, 104), or the server (106)) may execute the requested function or additional function and transmit the result to the electronic device (101). The electronic device (101) may process the received result as is or additionally to provide the requested function or service. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

In various embodiments of the present invention, the memory (130) may store instructions that, when executed, cause the processor (120) to obtain a plurality of text messages, analyze each of the plurality of text messages, obtain keywords corresponding to the plurality of text messages, transmit a query including the keywords using the communication module (170), receive the keyword analysis results, and perform an operation corresponding to the received keyword analysis results.

In various embodiments of the present invention, the memory (130) may store instructions that, when executed, cause the processor (120) to obtain recipient information related to a recipient performing keyword analysis, and transmit the query including the keyword and the recipient information using the communication module, and the keyword analysis result may be performed by an electronic device corresponding to the recipient information.

In various embodiments of the present invention, the memory (130) may store instructions that, when executed, cause the processor (120) to perform natural language processing on each of the plurality of text messages and generate the keywords using the natural language processing results for each of the plurality of text messages.

In various embodiments of the present invention, the memory (130) may store instructions that, when executed, cause the processor (120) to compare a preset template with the natural language processing result and generate the keyword based on the comparison result.

In various embodiments of the present invention, the memory (130) may store instructions that, when executed, cause the processor (120) to apply a machine learning or deep learning algorithm to the natural language processing result, determine the intent of each of the plurality of text messages based on the application result, and generate the keyword based on the intent of each of the plurality of text messages.

In various embodiments of the present invention, the memory (130) may store instructions that, when executed, cause the processor (120) to obtain a plurality of first text messages during a first period and to obtain a plurality of second text messages during a second period.

In various embodiments of the present invention, the memory (130) may store instructions that, when executed, cause the processor (120) to generate a first keyword corresponding to the plurality of first text messages and to generate a second keyword corresponding to the plurality of second text messages.

In various embodiments of the present invention, the memory (130) may store instructions that, when executed, cause the processor (120) to generate the second keyword using the analysis results of the plurality of second text messages and at least one of the first keyword and the plurality of first text messages.

In various embodiments of the present invention, the memory (130) may store instructions that, when executed, cause the processor (120) to obtain additional information and generate the keywords using the analysis results of the plurality of text messages and the additional information.

In various embodiments of the present invention, the memory (130) may store instructions that, when executed, cause the processor (120) to obtain additional information associated with the analysis results of the plurality of text messages or to obtain additional information independent from the plurality of text messages.

In various embodiments of the present invention, the electronic device (101) may further include a microphone (not shown) for acquiring a plurality of user voices, and the memory (130) may store instructions that, when executed, cause the processor (120) to convert each of the plurality of user voices acquired from the microphone to acquire the plurality of text messages.

In various embodiments of the present invention, the display (160) may display an execution screen of a chat application running on the electronic device. The memory (130) may store instructions for controlling the processor (120) to display, when running, a plurality of text messages input to the electronic device (101) or received from another electronic device, on the execution screen of the chat application, receiving an analysis request for the plurality of text messages, controlling the communication module (170) to transmit keywords corresponding to the plurality of text messages when the analysis request is received, receiving an analysis result for the keywords, and controlling the display of the analysis result for the received keywords on the chat application window.

In various embodiments of the present invention, the memory (130) may store instructions that, when executed, cause the processor (120) to obtain a plurality of text messages, analyze each of the plurality of text messages, obtain keywords corresponding to the plurality of text messages, and perform operations corresponding to the keywords.

FIG. 2 is a block diagram of an electronic device (201) according to various embodiments. The electronic device (201) may include, for example, all or part of the electronic device (101) illustrated in FIG. 1. The electronic device (201) may include one or more processors (e.g., an application processor (AP)) (210), a communication module (220), a subscriber identification module (224), a memory (230), a sensor module (240), an input device (250), a display (260), an interface (270), an audio module (280), a camera module (291), a power management module (295), a battery (296), an indicator (297), and a motor (298).

The processor (210) may control a plurality of hardware or software components connected to the processor (210) by, for example, driving an operating system or an application program, and may perform various data processing and calculations. The processor (210) may be implemented as, for example, a system on chip (SoC). According to one embodiment, the processor (210) may further include a GPU (graphic processing unit) and/or an image signal processor. The processor (210) may also include at least some of the components illustrated in FIG. 2 (e.g., a cellular module (221)). The processor (210) may load and process commands or data received from at least one of the other components (e.g., a nonvolatile memory) into the volatile memory, and store various data in the nonvolatile memory.

The communication module (220) may have the same or similar configuration as the communication module (170) of FIG. 1. The communication module (220) may include, for example, a cellular module (221), a WiFi module (223), a Bluetooth module (225), a GNSS module (227) (e.g., a GPS module, a Glonass module, a Beidou module, or a Galileo module), an NFC module (228), and an RF (radio frequency) module (229).

The cellular module (221) may provide, for example, voice calls, video calls, text services, or Internet services through a communication network. According to one embodiment, the cellular module (221) may perform differentiation and authentication of the electronic device (201) within the communication network using a subscriber identification module (e.g., SIM card) (224). According to one embodiment, the cellular module (221) may perform at least some of the functions that the processor (210) may provide. According to one embodiment, the cellular module (221) may include a communication processor (CP).

Each of the WiFi module (223), the Bluetooth module (225), the GNSS module (227), or the NFC module (228) may include, for example, a processor for processing data transmitted and received through the corresponding module. According to some embodiments, at least some (e.g., two or more) of the cellular module (221), the WiFi module (223), the Bluetooth module (225), the GNSS module (227), or the NFC module (228) may be included in one integrated circuit (IC) or IC package.

The RF module (229) can, for example, transmit and receive a communication signal (e.g., an RF signal). The RF module (229) can include, for example, a transceiver, a power amp module (PAM), a frequency filter, a low noise amplifier (LNA), or an antenna. According to another embodiment, at least one of the cellular module (221), the WiFi module (223), the Bluetooth module (225), the GNSS module (227), or the NFC module (228) can transmit and receive an RF signal through a separate RF module.

The subscriber identification module (224) may include, for example, a card including a subscriber identification module and/or an embedded SIM, and may include unique identification information (e.g., an integrated circuit card identifier (ICCID)) or subscriber information (e.g., an international mobile subscriber identity (IMSI)).

The memory (230) (e.g., the memory (130)) may include, for example, built-in memory (232) or external memory (234). The built-in memory (232) may include, for example, at least one of a volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), a non-volatile memory (e.g., one time programmable ROM (OTPROM), a programmable ROM (PROM), an erasable and programmable ROM (EPROM), an electrically erasable and programmable ROM (EEPROM), a mask ROM, a flash ROM, a flash memory (e.g., NAND flash or NOR flash), a hard drive, or a solid state drive (SSD)).

The external memory (234) may further include a flash drive, for example, a compact flash (CF), a secure digital (SD), a micro secure digital (Micro-SD), a mini secure digital (Mini-SD), an extreme digital (xD), a multi-media card (MMC), or a memory stick. The external memory (234) may be functionally and/or physically connected to the electronic device (201) through various interfaces.

The sensor module (240) may, for example, measure a physical quantity or detect an operating state of an electronic device (201) and convert the measured or detected information into an electrical signal. The sensor module (240) may include, for example, at least one of a gesture sensor (240A), a gyro sensor (240B), a pressure sensor (240C), a magnetic sensor (240D), an acceleration sensor (240E), a grip sensor (240F), a proximity sensor (240G), a color sensor (240H) (e.g., an RGB (red, green, blue) sensor), a biometric sensor (240I), a temperature/humidity sensor (240J), an illuminance sensor (240K), or a UV (ultra violet) sensor (240M). Additionally or alternatively, the sensor module (240) may include, for example, an E-nose sensor, an electromyography sensor, an electroencephalogram sensor, an ECG sensor, an infrared (IR) sensor, an iris sensor, and/or a fingerprint sensor. The sensor module (240) may further include a control circuit for controlling at least one sensor included therein. In some embodiments, the electronic device (201) further includes a processor configured to control the sensor module (240), either as part of or separately from the processor (210), such that the sensor module (240) may be controlled while the processor (210) is in a sleep state.

The input device (250) may include, for example, a touch panel (252), a (digital) pen sensor (254), a key (256), or an ultrasonic input device (258). The touch panel (252) may use, for example, at least one of a capacitive method, a pressure-sensitive method, an infrared method, or an ultrasonic method. In addition, the touch panel (252) may further include a control circuit. The touch panel (252) may further include a tactile layer to provide a tactile response to a user.

The (digital) pen sensor (254) may be, for example, part of a touch panel or may include a separate recognition sheet. The key (256) may include, for example, a physical button, an optical key, or a keypad. The ultrasonic input device (258) may detect ultrasonic waves generated from an input tool through a microphone (e.g., microphone (288)) and confirm data corresponding to the detected ultrasonic waves.

The display (260) (e.g., the display (160)) may include a panel (262), a holographic device (264), or a projector (266). The panel (262) may include a configuration identical to or similar to the display (160) of FIG. 1. The panel (262) may be implemented to be, for example, flexible, transparent, or wearable. The panel (262) may also be configured as a single module with the touch panel (252). The holographic device (264) may use interference of light to display a three-dimensional image in the air. The projector (266) may project light onto a screen to display an image. The screen may be located, for example, inside or outside the electronic device (201). According to one embodiment, the display (260) may further include a control circuit for controlling the panel (262), the holographic device (264), or the projector (266).

The interface (270) may include, for example, a high-definition multimedia interface (HDMI) (272), a universal serial bus (USB) (274), an optical interface (276), or a D-sub (D-subminiature) (278). The interface (270) may be included, for example, in the communication module (170) illustrated in FIG. 1. Additionally and alternatively, the interface (270) may include, for example, a mobile high-definition link (MHL) interface, a secure digital (SD) card/multi-media card (MMC) interface, or an infrared data association (IrDA) standard interface.

The audio module (280) can, for example, convert sound and electrical signals bidirectionally. At least some components of the audio module (280) can be included in the input/output interface (150) illustrated in FIG. 1, for example. The audio module (280) can process sound information input or output through, for example, a speaker (282), a receiver (284), an earphone (286), or a microphone (288).

The camera module (291) is, for example, a device capable of capturing still images and moving images, and according to one embodiment, may include one or more image sensors (e.g., a front sensor or a rear sensor), a lens, an image signal processor (ISP), or a flash (e.g., an LED or xenon lamp, etc.).

The power management module (295) can manage power of the electronic device (201), for example. According to one embodiment, the power management module (295) can include a power management integrated circuit, a charger integrated circuit, or a battery or fuel gauge. The power management integrated circuit can have a wired and/or wireless charging method. The wireless charging method includes, for example, a magnetic resonance method, a magnetic induction method, or an electromagnetic wave method, and can further include an additional circuit for wireless charging, for example, a coil loop, a resonant circuit, or a rectifier. The battery gauge can measure, for example, the remaining capacity of the battery (296), voltage, current, or temperature during charging. The battery (296) can include, for example, a rechargeable battery and/or a solar battery.

The indicator (297) may indicate a specific state of the electronic device (201) or a part thereof (e.g., the processor (210)), for example, a booting state, a message state, or a charging state. The motor (298) may convert an electrical signal into a mechanical vibration and may generate vibration, a haptic effect, or the like. Although not shown, the electronic device (201) may include a processing unit (e.g., a GPU) for supporting mobile TV. The processing unit for supporting mobile TV may process media data according to standards such as, for example, DMB (digital multimedia broadcasting), DVB (digital video broadcasting), or mediaFloTM.

FIG. 3 is a block diagram of a program module according to various embodiments. According to one embodiment, a program module (310) (e.g., a program (140)) may include an operating system (OS) that controls resources related to an electronic device (e.g., an electronic device (101)) and/or various applications (e.g., application programs (147)) that run on the operating system. The operating system may be, for example, Android, iOS, Windows, Symbian, Tizen, or Bada.

The program module (310) may include a kernel (320), middleware (330), an application programming interface (API) (360), and/or an application (370). At least a portion of the program module (310) may be preloaded on the electronic device or may be downloaded from an external electronic device (e.g., an electronic device (102, 104), a server (106), etc.).

The kernel (320) (e.g., kernel (141)) may include, for example, a system resource manager (321) and/or a device driver (323). The system resource manager (321) may perform control, allocation, or recovery of system resources. According to one embodiment, the system resource manager (321) may include a process management unit, a memory management unit, or a file system management unit. The device driver (323) may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WiFi driver, an audio driver, or an IPC (inter-process communication) driver.

Middleware (330) may, for example, provide functions commonly required by applications (370) or provide various functions to applications (370) through APIs (360) so that applications (370) can efficiently use limited system resources within an electronic device. According to one embodiment, the middleware (330) (e.g., middleware (143)) may include at least one of a runtime library (335), an application manager (341), a window manager (342), a multimedia manager (343), a resource manager (344), a power manager (345), a database manager (346), a package manager (347), a connectivity manager (348), a notification manager (349), a location manager (350), a graphics manager (351), or a security manager (352).

The runtime library (335) may include, for example, library modules used by a compiler to add new functionality through a programming language while the application (370) is running. The runtime library (335) may perform functions such as input/output management, memory management, or arithmetic functions.

The application manager (341) can manage, for example, the life cycle of at least one of the applications (370). The window manager (342) can manage GUI resources used on the screen. The multimedia manager (343) can identify formats required for playing various media files and perform encoding or decoding of the media files using a codec suitable for the format. The resource manager (344) can manage resources such as source code, memory, or storage space of at least one of the applications (370).

The power manager (345) may operate, for example, with a basic input/output system (BIOS), etc., to manage a battery or power, and provide power information necessary for the operation of the electronic device. The database manager (346) may create, search, or change a database to be used by at least one of the applications (370). The package manager (347) may manage the installation or update of an application distributed in the form of a package file.

The connection manager (348) can manage wireless connections such as, for example, WiFi or Bluetooth. The notification manager (349) can display or notify events such as arrival messages, appointments, and proximity notifications in a non-intrusive manner for the user. The location manager (350) can manage location information of the electronic device. The graphics manager (351) can manage graphic effects to be provided to the user or a user interface related thereto. The security manager (352) can provide various security functions required for system security or user authentication. According to one embodiment, when the electronic device (e.g., the electronic device (101)) includes a telephone function, the middleware (330) can further include a telephony manager for managing a voice or video call function of the electronic device.

The middleware (330) may include a middleware module that forms a combination of various functions of the aforementioned components. The middleware (330) may provide modules specialized for each type of operating system to provide differentiated functions. In addition, the middleware (330) may dynamically delete some of the existing components or add new components.

API (360) (e.g., API (145)) is, for example, a set of API programming functions, and may be provided in different configurations depending on the operating system. For example, in the case of Android or iOS, one set of APIs may be provided per platform, and in the case of Tizen, two or more sets of APIs may be provided per platform.

An application (370) (e.g., an application program (147)) may include one or more applications that may perform functions such as, for example, a home (371), a dialer (372), an SMS/MMS (373), an instant message (IM) (374), a browser (375), a camera (376), an alarm (377), a contact (378), a voice dialer (379), an email (380), a calendar (381), a media player (382), an album (383), or a clock (384), health care (e.g., measuring the amount of exercise or blood sugar, etc.), or providing environmental information (e.g., providing information on barometric pressure, humidity, or temperature, etc.).

According to one embodiment, the application (370) may include an application (hereinafter, for convenience of description, an “information exchange application”) that supports information exchange between an electronic device (e.g., electronic device (101)) and an external electronic device (e.g., electronic devices (102, 104)). The information exchange application may include, for example, a notification relay application for transmitting specific information to an external electronic device, or a device management application for managing an external electronic device.

For example, the notification delivery application may include a function for delivering notification information generated from another application of the electronic device (e.g., an SMS/MMS application, an email application, a health management application, or an environmental information application, etc.) to an external electronic device (e.g., the electronic device (102, 104)). In addition, the notification delivery application may receive notification information from the external electronic device and provide it to the user, for example.

A device management application may, for example, manage (e.g., install, delete, or update) at least one function (e.g., turning on/off the external electronic device itself (or some components thereof) or adjusting the brightness (or resolution) of a display) of an external electronic device (e.g., an electronic device (102, 104)) that communicates with the electronic device, an application running on the external electronic device, or a service provided by the external electronic device (e.g., a calling service or a messaging service).

According to one embodiment, the application (370) may include an application (e.g., a healthcare application of a mobile medical device, etc.) specified according to an attribute (e.g., an electronic device (102, 104)) of an external electronic device. According to one embodiment, the application (370) may include an application received from an external electronic device (e.g., a server (106) or an electronic device (102, 104)). According to one embodiment, the application (370) may include a preloaded application or a third party application downloadable from a server. The names of the components of the program module (310) according to the illustrated embodiment may vary depending on the type of operating system.

According to various embodiments, at least a portion of the program module (310) may be implemented as software, firmware, hardware, or a combination of at least two or more of these. At least a portion of the program module (310) may be implemented (e.g., executed) by, for example, a processor (e.g., processor (210)). At least a portion of the program module (310) may include, for example, a module, a program, a routine, a set of instructions, or a process for performing one or more functions.

FIG. 4 is a flowchart illustrating a method for controlling an electronic device according to various embodiments of the present invention. The embodiment of FIG. 4 will be described in more detail with reference to FIGS. 5a and 5b. FIGS. 5a and 5b illustrate conceptual diagrams of an electronic device according to various embodiments of the present invention.

In operation 410, the electronic device (101) may obtain a plurality of text messages. Here, the text message may mean a text including at least one of letters, numbers, and symbols. In one embodiment, the text messages may be distinguished by a data format. For example, using a chat application, user A and user B may exchange text messages with each other. User A may input a text to be transmitted into a chat window, and when the text is sufficiently input into the chat window, may input a preset transmission command. The chat application may transmit a text message including the input text in response to the transmission command to another electronic device, and may display a text message received from the other electronic device. In another embodiment, the text messages may be distinguished based on the results of natural language processing. For example, based on the results of text analysis, the electronic device (101) may identify a phrase corresponding to the end of a sentence, and may distinguish text messages using the phrase corresponding to the end of the sentence. In this case, a set of texts distinguished as one sentence may be distinguished as one text message. In another embodiment, text messages may be divided by time. For example, the electronic device (101) may divide a set of texts that are continuously input without a pause into one text message. In this case, when texts are continuously input and exceed a preset pause, the electronic device (101) may obtain a set of texts that were input before the pause exceeds one text message. Accordingly, the text message may include one or more sentences. As described above, the criteria for distinguishing text messages may be implemented in various ways.

In various embodiments of the present invention, the electronic device (101) may obtain a plurality of texts that are input or received from another electronic device. The electronic device (101) may obtain a plurality of texts that are processed in an application such as a chat application, for example. Alternatively, the electronic device (101) may obtain a plurality of texts by performing TTS (text-to-speech) processing on a plurality of user voices obtained from the outside through a microphone, etc.

For example, as in FIG. 5A, the electronic device (101) can display a chat application execution screen (510) on the display (160). The electronic device (101) can execute the chat application and display the chat application execution screen (510) in response thereto. The electronic device (101) can display text messages (511, 513, 515) received from another electronic device (not shown) and can display text messages (512, 514) input from the user. Those skilled in the art will readily understand that there is no limitation on the chat application as long as it is an application that can send and receive text messages between the two electronic devices. The electronic device (101) can display a graphical user interface that distinguishes the history of text messages sent and received by each chat participant, as in FIG. 5A. As in FIG. 5A, the electronic device (101) can obtain a plurality of text messages including a text message from the user and a text message received from another electronic device.

In operation 420, the electronic device (101) can obtain a keyword using the analysis results of a plurality of text messages. The electronic device (101) can analyze each text message, and obtain a keyword using the analysis results of each text message. In various embodiments of the present invention, the electronic device (101) can generate a keyword by matching the analysis results of each of the plurality of text messages to a template. Alternatively, the electronic device (101) can generate a keyword by applying a machine learning or deep learning algorithm that analyzes user intent from the analysis results of each of the plurality of text messages. The keyword generation process according to various embodiments will be described in more detail with reference to FIGS. 8A to 8C. In the embodiment of FIG. 5A, the electronic device (101) can generate a keyword of “this Sunday, movie.” For example, the electronic device (101) can obtain a text corresponding to the time “this Sunday” based on the natural language analysis result of the text message (511) “what are you doing this Sunday.” More specifically, the electronic device (101) can identify that "this Sunday" in the text message (511) is a text corresponding to a time based on the natural language analysis result, and can identify that "what are you doing?" is a text corresponding to a verb based on the natural language analysis result. The natural language analysis can determine the role of each component constituting the text message within a sentence, and the electronic device (101) can analyze each component of a plurality of text messages based on the natural language analysis result.

In addition, based on the natural language analysis result of the text message (513) "Then do you want to watch a movie?", a text corresponding to the object "movie" can be obtained. The electronic device (101) can obtain the keyword "this Sunday, movie" using the analysis result of the text messages (511, 513). The electronic device (101) can also store in advance an algorithm to classify a text corresponding to a time and a text corresponding to an object into keywords, and can obtain a keyword based on the result of applying the algorithm. The electronic device (101) can also obtain objects such as "appointment" and "things I want to see" from other text messages (512, 514, 515), and can include the objects in the keywords or filter them out. The electronic device (101) can also store in advance a database of objects whose meanings are somewhat unclear and exclude them from the keyword generation process. Alternatively, the electronic device (101) may analyze text messages (511 to 515) using a machine learning or deep learning algorithm to generate keywords based on the acquired user intent. The electronic device (101) may analyze the text message (512) to analyze the user intent as “appointment” and may analyze the text messages (511, 513) to analyze the user intent as “going to the movies this Sunday.” For example, the electronic device (101) may analyze the text message (511) to analyze the user intent to inquire about the other party’s schedule this Sunday, and may analyze the text message (513) that inquires again after such an inquiry to indicate a task to be performed at that time using a machine learning or deep learning algorithm. As described above, the electronic device (101) may analyze keywords in various ways, and those skilled in the art will readily understand that there is no limitation to the type of method as long as it can analyze keywords using a plurality of text messages.

In operation 430, the electronic device (101) may transmit a query including the acquired keyword. For example, as in FIG. 5A, the electronic device (101) may display a graphical user interface (516) that may request a keyword analysis result, and may transmit a query including the keyword to the server (106) in response to a designation of the graphical user interface (516).

In operation 440, the server (106) can analyze keywords included in the query. The server (106) may be any electronic device that stores an algorithm or program capable of analyzing keywords. In various embodiments of the present invention, the server (106) may forward keywords to other electronic devices, which will be described in more detail below. For example, the server (106) may analyze the keyword "this Sunday, movies" obtained from the electronic device (101) to obtain a movie schedule corresponding to this Sunday.

In operation 450, the server (106) may transmit a response including the keyword analysis result to the electronic device (101). In operation 460, the electronic device (101) may operate using the keyword analysis result. For example, as in FIG. 5b, the electronic device (101) may display a graphical user interface (520) including the keyword analysis result of the movie schedule corresponding to this Sunday received from the server (106).

For example, since a conventional electronic device provides only an analysis result for one text message, it provides an analysis result for “this Sunday” for the text message (511), which results in inaccurate information. In addition, since a conventional electronic device provides an analysis result for “movie” for one text message (513), which results in inaccurate information. In contrast, an electronic device (101) according to various embodiments of the present invention can operate according to keyword analysis results based on a plurality of text messages, which results in providing information that is more in line with the user’s intention.

In various embodiments of the present invention, the server (106) may receive multiple text messages, rather than keywords obtained as a result of analyzing multiple text messages. The server (106) may analyze the received multiple text messages to generate keywords, and may transmit the generated keyword analysis results to the electronic device (101). The process of generating keywords in the server (106) may be the same as the process of generating keywords in the electronic device (101).

In various embodiments of the present invention, the electronic device (101) may perform keyword analysis on its own without requesting keyword analysis from another electronic device. In another embodiment, the electronic device (101) may directly execute a command corresponding to a keyword.

FIG. 6 illustrates a conceptual diagram for explaining text message acquisition according to various embodiments of the present invention.

As illustrated in FIG. 6, the electronic device (101) may obtain multiple user voices (611, 612) spoken by multiple users (601, 602). The electronic device (101) may include, for example, a microphone, and may convert the user voices (611, 612) into electrical signals through the microphone. The electronic device (101) may obtain multiple text messages corresponding to the user voices (611, 612) by performing TTS processing on the user voices (611, 612). The electronic device (101) may process the result of converting the continuously acquired user voices without a preset pause into one text message. In addition, the electronic device (101) may process the user voices for each user by using a voiceprint. For example, even when two users (601, 602) utter user voices simultaneously, the electronic device (101) can separate and process the user voices (611, 612) uttered by the users (601, 602) respectively using voice fingerprints. For example, the users (601, 602) can utter user voices (611, 612) having contents such as “What are you doing this Sunday?”, “I don’t have any plans”, “Then do you want to watch a movie?”, “Yeah. What do you want to see?”, “Well, what are you doing these days?” as in FIG. 5a. The electronic device (101) can obtain text messages such as in FIG. 5a by performing TTS processing on the user voices (611, 612). When a request for a keyword analysis result is detected, the electronic device (101) can transmit a query including a keyword using the analysis results of a plurality of text messages, and can obtain a keyword analysis result as a response to the query. Accordingly, the electronic device (101) of FIG. 6 may display a graphical user interface (520) including keyword analysis results, such as those in FIG. 5b, for example.

As described above, the electronic device (101) according to various embodiments of the present invention can obtain multiple text messages in various ways.

FIGS. 7A and 7B illustrate flowcharts for explaining a method of controlling an electronic device according to various embodiments of the present invention.

First, referring to FIG. 7a, in operation 710, the electronic device (101) can obtain a plurality of text messages. As described above, the electronic device (101) can obtain a text message including text or can obtain text by TTS processing a user's voice.

In operation 720, the electronic device (101) may perform natural language analysis on each of a plurality of text messages. FIG. 8A illustrates a conceptual diagram for explaining natural language analysis of an electronic device according to various embodiments of the present invention. The electronic device (101) may obtain a plurality of text messages (810, 820, 830, 840, 850). The electronic device (101) may perform natural language analysis on the text message (810) to determine that "this week" (811) in the text message (810) is a text corresponding to a time, "Sunday" (812) is a text corresponding to a time, "에" (813) is a text corresponding to a particle, and "뭐해" (814) is a text corresponding to a verb. The electronic device (101) can also perform natural language analysis on other text messages (820, 830, 840, 850) to determine properties of included components (821, 822, 823, 824, 831, 832, 833, 841, 842, 843, 844, 845, 851, 852, 853).

In operation 730, the electronic device (101) can generate a keyword using the natural language analysis result and the template. In various embodiments of the present invention, the electronic device (101) can store a template (860) such as FIG. 8B. The template (860) can include at least one item (861), and information (862) can be mapped to at least one item (861). For example, the electronic device (101) can store a template (860) including a time item (863), a date item (864), a place item (866), and an item of interest (867). The electronic device (101) can generate a keyword by storing components corresponding to items of the template (860) among the natural language analysis results as information (862). For example, the electronic device (101) can map and store components (811, 812) corresponding to time as information (865) in response to a time item (863) or a date item (864). The electronic device (101) can map and store components (832) corresponding to an object as information (868) in response to an item of interest (867). The electronic device (101) can generate a keyword using information (862) mapped to an item (861) of a template, and for example, in the embodiment of FIG. 8B, can generate a keyword such as “11.15. Movie.” The electronic device (101) can also replace text such as “this Sunday” with text such as “11.15.” and store it.

As described above, the electronic device (101) according to various embodiments of the present invention can generate a keyword based on comparison with a template (860).

FIG. 7b illustrates a flowchart for explaining a keyword generation process based on learning according to various embodiments of the present invention. Since operations 710 and 720 have been described above, their descriptions will be omitted here. In operation 731, the electronic device (101) may apply a machine learning or deep learning algorithm to a natural language analysis result to generate a keyword. For example, as in FIG. 8c, the electronic device (101) may apply a machine learning or deep learning algorithm to a pre-analyzed user intention pattern, and may also apply a machine learning or deep learning algorithm to a plurality of acquired text messages. Accordingly, the electronic device (101) may map information (872) by conversation topic (871). The electronic device (101) may identify the user intention by abstraction level (873, 874) and store it as information. Here, it is assumed that the higher the abstraction level, the clearer the user intention. For example, the electronic device (101) can determine that the user intent is in the movie decision (875) through analysis of the text message (840). More specifically, the electronic device (101) can determine the user intent for each text message (810, 820, 830, 840, 850). The electronic device (101) can generate a keyword using a more specifically determined user intent among the user intents identified for each text message. For example, the electronic device (101) can determine that “this Sunday” is a specific user intent in the text message (810), and can determine that “watching a movie” is a specific user intent in the text message (830). The electronic device (101) can perform the judgment of the text corresponding to the more specific user intent through machine learning or deep learning. The electronic device (101) can generate the keyword “this Sunday, watching a movie” as a keyword using the result of applying machine learning or deep learning to a plurality of texts.

FIG. 9 is a flowchart illustrating a method for controlling an electronic device according to various embodiments of the present invention. The embodiment of FIG. 9 will be described in more detail with reference to FIGS. 10a to 10d.

In operation 910, the electronic device (101) can obtain a plurality of text messages during a first period. In operation 915, the electronic device (101) can obtain a first keyword using analysis results of the plurality of text messages during the first period. In operation 920, the electronic device (101) can transmit a query including the first keyword. In operation 925, the electronic device (101) can receive an analysis result of the first keyword and operate using the analysis result of the first keyword. FIG. 10A is a conceptual diagram of an electronic device (101) according to various embodiments of the present invention, and assumes, for example, displaying a graphical user interface after FIG. 5A. The electronic device (101) can display a graphical user interface (1011) including a current popular movie ranking as an analysis result of the first keyword, "this Sunday, movies." More specifically, the electronic device (101) can transmit a query including the first keyword, “this Sunday, movies,” and receive and display information on the current popular movie rankings in response to the query.

In operation 930, the electronic device (101) can obtain a plurality of text messages during a second period. Here, the first period and the second period can be distinguished from the operation based on a keyword analysis request or a keyword analysis result. For example, as in FIG. 10A, the electronic device (101) can obtain a plurality of text messages (1012, 1013) after displaying a graphical user interface (1011) corresponding to the keyword analysis result. The electronic device (101) can display the plurality of text messages (1012, 1013) on the chat application execution screen (1010).

In operation 935, the electronic device (101) can obtain a second keyword using the analysis results of a plurality of text messages during the second period. For example, the electronic device (101) can obtain the second keyword based on a template. The electronic device (101) can obtain the second keyword independently from the plurality of text messages during the second period, but the electronic device (101) according to various embodiments of the present invention can also obtain the second keyword based on the plurality of text messages during the first period and the plurality of text messages during the second period. Alternatively, the electronic device (101) can obtain the second keyword based on the first keyword and the plurality of text messages during the second period. FIG. 10b illustrates a conceptual diagram for explaining keyword generation according to various embodiments of the present invention. The electronic device (101) can generate the second keyword based on information (1062) for each item (1061) of the template (1060). For example, the electronic device (101) can obtain information (1066) on November 15th of the date item (1065) and information (1070) on a movie of the interest item (1069) based on the text message during the first period. Meanwhile, the electronic device (101) can obtain information (1064) on the morning of the time item (1063), information (1068) on Gangnam of the place item (1067), and information (1070) on a phone ring and reservation of the interest item (1069) based on the text message during the second period. The method by which the electronic device (101) obtains information based on the text message during the second period may be the same as the method of obtaining information during the first period, and since this has been described above, a description thereof will be omitted herein. In the embodiment of FIG. 10b, the electronic device (101) may generate the second keyword, “November 15, am, Gangnam, movie, phone ring, reservation.” In another embodiment, the electronic device (101) may generate the keywords, “am, Gangnam, phone ring, reservation,” based on the text message analysis result for the second period, and then combine the keywords with the first keyword, “11.15., movie,” for the first period, to generate the second keyword, “November 15, am, Gangnam, movie, phone ring, reservation.”

In operation 940, the electronic device (101) may transmit a query including a second keyword. In operation 945, the electronic device (101) may receive an analysis result of the second keyword and operate using the analysis result of the second keyword. The electronic device (101) may transmit a query including the second keyword, for example, "November 15, morning, Gangnam, movie, phone ring, reservation", and receive an analysis result corresponding thereto. The electronic device (101) may display a graphical user interface (1071) including the received analysis result, for example, as shown in FIG. 10c. For example, the graphical user interface (1071) may include a hyperlink to a reservation screen (1072) of a movie ticket reservation site.

The electronic device (101) may obtain a plurality of text messages (1072, 1073) during a third period after the second period, and may display the obtained plurality of text messages (1072, 1073). The electronic device (101) may analyze the text messages (1072, 1073) during the third period to generate a third keyword. For example, the electronic device (101) may generate a keyword as shown in FIG. 10d as a result of the third keyword analysis. Referring to FIG. 10d, the text messages (1072, 1073) during the third period and the text messages during the first and second periods may be used to generate a third keyword of "November 15, morning, Gangnam, movie, phone ring, B1, B2, reservation" of the target item of interest (1069). When the electronic device (101) detects the designation of the graphical user interface (1074) corresponding to the request for analysis of the third keyword, the electronic device (101) can transmit a query including the third keyword. The server (not shown) can process the third keyword, perform reservation of the Gangnam branch movie phone bell B1, B2 on the morning of November 15, and transmit the result of the reservation as a response to the electronic device (101). The electronic device (101) can display the received response, i.e., a message (1075) indicating that the reservation is complete.

As described above, the electronic device (101) according to various embodiments of the present invention can generate multiple keywords corresponding to each of the multiple periods by analyzing multiple text messages acquired during each of multiple periods rather than a single period. When the electronic device (101) generates a keyword corresponding to one period, it can also refer to text messages or keywords corresponding to other periods rather than the corresponding period.

FIG. 11 illustrates a flowchart for explaining a method of controlling an electronic device according to various embodiments of the present invention.

In operation 1110, the electronic device (101) may display a chat application execution screen. In operation 1120, the electronic device (101) may display a plurality of texts assigned to the chat application. For example, the chat application execution screen may be configured to display a text message input into the electronic device (101) and a text message received from another electronic device on one screen. The chat application may be configured to place a text message input into the electronic device (101) on one side and a text message received from another electronic device on the other side, thereby allowing a user to easily distinguish between a text message input by the user and a text message input by the other party.

In operation 1130, the electronic device (101) may display an analysis request icon for a plurality of texts. In operation 1140, the electronic device (101) may detect designation of an analysis request icon for a plurality of texts. After displaying the analysis request icon for the text, the electronic device (101) may perform an analysis request for the text when the icon is designated. In another embodiment, when a text requesting analysis for the text is input, the electronic device (101) may perform an analysis request for the text while displaying the input text.

In operation 1150, the electronic device (101) can perform an analysis on a plurality of texts to generate keywords. In operation 1160, the electronic device (101) can transmit keywords. In operation 1170, the electronic device (101) can receive a keyword analysis result. In operation 1180, the electronic device (101) can display the keyword analysis result on a chat application execution screen.

FIGS. 12a and 12b illustrate flowcharts for explaining a method of controlling an electronic device according to various embodiments of the present invention.

In operation 1210, the electronic device (101) can obtain a plurality of text messages. In operation 1215, the electronic device (101) can obtain a keyword using the analysis results of the plurality of text messages. Since operations 1210 and 1215 have been described in detail, further description thereof is omitted herein.

In operation 1220, the electronic device (101) may transmit a query including the acquired keyword and recipient information. FIG. 13 is a conceptual diagram of an electronic device according to various embodiments of the present invention. As illustrated in FIG. 13, the electronic device (101) may receive information about a recipient for performing analysis on a plurality of text messages (1311 to 1315), and display the input information (1316). For example, a user may want to have “A Theater” perform analysis on a plurality of text messages (1311 to 1315), and thus may input a text message including recipient information as information (1316). The electronic device (101) may display the input information (1316) on a chat application screen (1310) for the user’s confirmation.

In operation 1225, the server (106) can verify recipient information. In operation 1230, the server (106) can transmit a query including a keyword to the recipient server (1200) corresponding to the recipient information. The server (106) according to various embodiments of the present invention can store a database for recipient information in advance and forward a query including a keyword using the database. The server (106) can store a database that maps semantic recipient information and the identifier of the recipient from the electronic device (101), and thus can map various forms of recipient information to a specific recipient server. For example, even if the recipient information input by the user is input and received in various forms such as “A” or “A Movie Theater” instead of “A Theater,” the server (106) can determine the recipient information as “A Theater” and forward the query to the recipient server (1200) of “A Theater.”

In operation 1235, the receiver server (1200) may analyze keywords included in the query. In operation 1240, the receiver server (1200) may transmit a response including the keyword analysis result to the server (106). In various embodiments of the present invention, the server (106) may transmit the query and identification information of the electronic device (101) together to the receiver server (1200), and in this case, the receiver server (1200) may transmit the keyword analysis result directly to the electronic device (101) without the mediation of the server (106).

In operation 1245, the server (106) may generate a UI corresponding to the keyword analysis result. In operation 1250, the server (106) may transmit a response including the UI to the electronic device (101). In various embodiments of the present invention, the server (106) may also transmit the keyword analysis result directly to the electronic device (101).

In operation 1255, the electronic device (101) can display a UI included in the response. In operation 1260, the electronic device (101) can obtain a user input through the UI. In operation 1265, the electronic device (101) can transmit a command corresponding to the user input to the receiver server (1200) through the relay of the server (106) or directly. In operation 1270, the receiver server (1200) can operate in response to the received command.

FIG. 14 illustrates a conceptual diagram for explaining a receiver server according to various embodiments of the present invention.

In one embodiment, the electronic device (101) may transmit recipient information and keywords (1401) to the server (106). The server (106) may store a store list database (1410), which is an example of a recipient information database. The store list database (1410) may store recipient information, for example, a text corresponding to the recipient, by mapping it to an identifier of a store. For example, the server (106) may store a store list database such as Table 1.

Text Identifier A, A theater, A movie, A cinema A theater B, B Hospital, B Dermatology, B Skin B Dermatology Hospital C, C shoes, D clothing store, D t-shirt, E sunglasses F Small Business Association

As shown in Table 1, the server (106) can store text and identifiers such as semantics by mapping them. Accordingly, when the recipient information of, for example, “Movie A” is received from the electronic device (101) along with a keyword, the server (106) can transmit a query including the keyword to the recipient server of Theater A. Meanwhile, small business owners may have difficulty in operating individual servers, and thus, a small business owner integrated server may be operated by a union of small business owners.

In various embodiments of the present invention, the small business integration server (1420) may include a reservation management server (1421), a customer account server (1422), a store account server (1423), and a store-specific information database (1424). The reservation management server (1421) may perform a reservation when reservation information is included in a query. The customer account server (1422) may manage customer-specific accounts. The store account server (1423) may manage store manager-specific accounts. The store-specific information database (1424) may store individual information of registered stores.

In various embodiments of the present invention, the company server (1430) may be implemented as an individual recipient server. The company server (1430) may include a reservation management server (1431), a customer account server (1432), and a store information database (1433).

The small business integrated server (1420) or the company server (1430) can analyze or process keywords included in the query. Alternatively, the small business integrated server (1420) or the company server (1430) can transmit the analysis result or the processing result to the electronic device (101).

FIG. 15 illustrates a flowchart for explaining a method of controlling an electronic device according to various embodiments of the present invention.

In operation 1510, the electronic device (101) can obtain a plurality of text messages. In operation 1520, the electronic device (101) can perform natural language analysis on each of the plurality of text messages. In operation 1530, the electronic device (101) can obtain additional information. Here, the additional information may refer to all information that can be obtained through a path other than the path for obtaining the text messages. For example, the electronic device (101) may include information from an application other than the application that obtains the text messages.

In operation 1540, the electronic device (101) can generate keywords using the natural language analysis results, additional information, and templates. In operation 1550, the electronic device (101) can transmit a query including the acquired keywords. In operation 1560, the electronic device (101) can receive the keyword analysis results. In operation 1570, the electronic device (101) can operate using the keyword analysis results.

Below, keyword generation using various additional information will be described in more detail with reference to FIGS. 16a to 16c.

FIGS. 16A to 16C illustrate flowcharts for explaining keyword generation using additional information according to various embodiments of the present invention. FIGS. 16A to 16C will be described in more detail with reference to FIGS. 17A to 17D. FIGS. 17A to 17D illustrate conceptual diagrams for explaining keyword generation using additional information according to various embodiments of the present invention.

Referring to FIG. 16A, in operation 1610, the electronic device (101) may obtain a plurality of text messages. In operation 1620, the electronic device (101) may perform natural language analysis on each of the plurality of text messages. For example, as in FIG. 17A, the electronic device (101) may execute a chat application and display a chat application execution screen (1710) on the display (160). The electronic device (101) may display the obtained plurality of text messages (1711 to 1714). In various embodiments of the present invention, a text message analysis request may be input as a text message (1714). The text of "@" of the text message (1714) may be preset to indicate recipient information.

In operation 1630, the electronic device (101) can obtain user schedule information as additional information. For example, the electronic device (101) can obtain user schedule information from a schedule management application. The electronic device (101) can use the user schedule information received from the schedule management application to check the date and time when the user does not have a schedule. For example, the electronic device (101) can obtain information that the date and time when the user does not have a schedule are 10:00 to 11:00 AM on November 20, November 21, and November 22.

Alternatively, as in FIG. 16b, in operation 1631, the electronic device (101) may obtain user location information as additional information. For example, the electronic device (101) may obtain user location information from a GPS management application. For example, the electronic device (101) may confirm that the user location is Gangnam-gu, Seoul. Alternatively, the electronic device (101) may obtain user location history and confirm that the user location is Gangnam-gu, Seoul on a day of the week when the user does not have a schedule.

In operation 1640, the electronic device (101) may generate a keyword using the natural language analysis result, the user schedule information, and the template. Or, in operation 1641 in FIG. 16b, the electronic device (101) may generate a keyword using the natural language analysis result, the user location information, and the template. For example, as in FIG. 17b, the electronic device (101) may obtain “acne removal, acne treatment” from the target item of interest of the item (1721) in the template (1720) as a result of the text message analysis. The electronic device (101) may obtain information (1722) about the time, date, and location of the item (1721) using additional information.

In operation 1650, the electronic device (101) can transmit a query including the acquired keyword. In operation 1660, the electronic device (101) can receive a keyword analysis result. In operation 1670, the electronic device (101) can operate using the keyword analysis result. For example, the electronic device (101) can receive and display a keyword analysis result (1715) including an available schedule for B dermatology, as in FIG. 17c. The keyword analysis result (1715) may include, for example, a hyperlink (1716) for making a reservation.

Referring to FIG. 16c, in operation 1610, the electronic device (101) can obtain a plurality of text messages. In operation 1620, the electronic device (101) can perform natural language analysis on each of the plurality of text messages.

In operation 1632, the electronic device (101) can obtain a history associated with the natural language analysis result. For example, the electronic device (101) assumes that the keyword "11.15, movie" is obtained as the natural language analysis result, as in FIG. 8b. The electronic device (101) can obtain, as a history associated with the keyword "11.15", a history that the user has free time between 11:00 AM and 3:00 PM on Sundays and is mainly in Gangnam-gu, Seoul. In addition, as a history associated with the keyword "movie", a movie ticket reservation history that the user mainly watched action movies can be obtained.

In operation 1642, the electronic device (101) can generate keywords using the natural language analysis results, acquired history, and templates. For example, as in FIG. 17d, the electronic device (101) can obtain information (1761) of the history from 11:00 AM to 3:00 PM, information (1762) of Gangnam-gu, Seoul, and information (1763) of an action movie (1763) for each of the time item (863), the date item (864), the location item (866), and the item of interest (867). Accordingly, the electronic device (101) can generate keywords such as "11.15. 11:00 AM to 3:00 PM, Gangnam-gu, Seoul, movie, action movie." In operation 1650, the electronic device (101) can transmit a query including the acquired keywords. In operation 1660, the electronic device (101) can receive a keyword analysis result. In operation 1670, the electronic device (101) can operate using the keyword analysis result.

As described above, the electronic device (101) according to various embodiments of the present invention may generate keywords by using not only text analysis results, but also various additional information such as user schedule information, user location information, or history associated with the text analysis results.

FIG. 18 illustrates a conceptual diagram for explaining the operation of an electronic device in an IoT (internet of things) environment according to various embodiments of the present invention.

As illustrated in FIG. 18, the electronic device (101) can communicate with another electronic device (1820). In an IoT environment, each of the electronic device (101) and the other electronic device (1820) can be assigned an IP address according to various formats such as IPv4 or IPv6, and can transmit and receive data using various forms of short-range communication (e.g., Bluetooth, Bluetooth low energy, Zig-bee, NFC (near field communication), infrared communication) and the assigned IP address. Alternatively, the electronic device (101) can transmit and receive data with the other electronic device (1820) based on various communication methods without using an IP address.

In various embodiments of the present invention, the electronic device (101) may include a microphone capable of acquiring external voices, a short-range communication module capable of performing short-range communication with another electronic device (1820), and a cellular module. The electronic device (101) may acquire user voices (1811, 1812) spoken by persons (1801, 1802) through a microphone, etc.

The electronic device (101) can obtain multiple text messages corresponding to the user voices (1811, 1812) by TTS processing the user voices (1811, 1812). The electronic device (101) can process the result of converting the continuously obtained user voices without a preset pause as a single text message. In addition, the electronic device (101) can process the user voices for each user by using voice fingerprints. For example, even when two users (1801, 1802) utter user voices simultaneously, the electronic device (101) can separate and process the user voices (611, 612) uttered by the users (1801, 1802) respectively by using voice fingerprints. For example, users (1801, 1802) can utter user voices (1811, 1812) having contents such as "What are you doing this Sunday?", "I don't have any plans", "Then do you want to see a movie?", "Yeah. What do you want to see?", "Well, what are you doing these days?" as in FIG. 5a. The electronic device (101) can obtain text messages such as in FIG. 5a by TTS processing the user voices (1811, 1812). When a request for keyword analysis results is detected, the electronic device (101) can transmit a query including keywords using analysis results of multiple text messages through the cellular module, and can obtain keyword analysis results as a response to the query.

The electronic device (101) can transmit (1825) the keyword analysis result to another electronic device (1820) via a short-range communication module. The other electronic device (1820) can display the keyword analysis result (1830) received from the electronic device (101).

In another embodiment, the electronic device (101) may directly perform keyword analysis and transmit (1825) the directly performed keyword analysis results to another electronic device (1820).

As described above, the electronic device (101) may also operate as if transmitting the received keyword analysis results to another electronic device (1820).

FIG. 19 illustrates a flowchart for explaining a method of controlling an electronic device according to various embodiments of the present invention.

In operation 1910, the electronic device (101) can obtain a plurality of voices during a first period. In operation 1920, the electronic device (101) can convert the obtained plurality of voices to obtain a plurality of text messages. In operation 1930, the electronic device (101) can obtain keywords using the analysis results of the plurality of text messages.

In operation 1940, the electronic device (101) can transmit a query including a keyword. In operation 1950, the electronic device (101) can obtain an analysis result of the query. In operation 1960, the electronic device (101) can output the analysis result or transmit it to another electronic device capable of outputting the result.

FIG. 20 is a flowchart illustrating a method of controlling an electronic device according to various embodiments of the present invention. The embodiment of FIG. 20 will be described in more detail with reference to FIGS. 21a and 21b. FIGS. 21a and 21b illustrate conceptual diagrams illustrating a process of processing a user voice from a single user according to various embodiments of the present invention.

In operation 2010, the electronic device (101) can acquire voices of multiple users during a first period. For example, the electronic device (101) can acquire user voices (2101, 2102, 2103) at each of a first time point (t1), a second time point (t2), and a third time point (t3) within the first period, as shown in FIG. 21. The user voices (2101, 2102, 2103) can be uttered by a single user (2100). Meanwhile, the electronic device (101) in FIG. 21 can be implemented as a wristwatch-type wearable device.

In operation 2020, the electronic device (101) may convert each of the acquired plurality of voices to acquire a plurality of text messages. If a preset text (for example, @) is included among the plurality of text messages, the electronic device (101) may determine the corresponding text message as a text message analysis request. If the text message analysis request is detected, in operation 2030, the electronic device (101) may acquire a keyword using the analysis results of the plurality of text messages. In operation 2040, the electronic device (101) may transmit a query including a keyword, and may receive and display the keyword analysis result. For example, as in FIG. 21b, the electronic device (101) may display the keyword analysis result (2110) on the display (160). Meanwhile, when implemented as a wristwatch-type wearable device, the electronic device (101) may perform query transmission and analysis result reception directly with a server (not shown) through a cellular module, or may perform query transmission and analysis result reception through a relay of another electronic device (e.g., a smartphone) through short-range communication.

FIG. 22 illustrates a flowchart describing a method of controlling an electronic device according to various embodiments of the present invention.

In operation 2210, the electronic device (101) can obtain at least one user voice. In operation 2220, the electronic device (101) can analyze the at least one user voice. In operation 2230, the electronic device (101) can output a voice using the analysis result of the user voice. For example, the electronic device (101) can store a conversation algorithm in advance and can output a text corresponding to a text message of the user voice either vocally or visually.

For example, as in FIG. 23, a user's voice (2301) uttered by a user (2300) at a first time point (t1) may be processed by TTS to obtain the text "What should I do on Sunday?" The electronic device (101) may be implemented in a form such as a robot, for example. The electronic device (101) may include a microphone and a speaker. The electronic device (101) may store in advance a conversation algorithm that may output an appropriate response to a text input by the user, and as a result of applying the conversation algorithm to the text "What should I do on Sunday?", the response "I have time in the morning" may be obtained. The electronic device (101) may TTS process the response "I have time in the morning" and output it as a voice (2302) or may output it in a visual form through a display (not shown). The electronic device (101) may output the voice (2302) by referring to the user's schedule information, for example.

The electronic device (101) may also output a response (2304) by applying a conversation algorithm to the user voice (2303) detected at the second time point (t2). The electronic device (101) may obtain a plurality of text messages at each of the first time point (t1) and the second time point (t2). Meanwhile, the electronic device (101) may obtain a voice (2305) including a text message analysis request and recipient information from the user at the third time point (t3).

In operation 2240, the electronic device (101) can convert the user's voice and the output voice into text. The electronic device (101) can obtain not only the text message received from the user, but also the text message output by itself. In operation 2250, the electronic device (101) can obtain a keyword by using the converted plurality of texts. The electronic device (101) can generate a keyword by using not only the text message received from the user, but also the text message output by itself. As the electronic device (101) uses the text message (2302) output by itself, the electronic device (101) can obtain the keyword of "Sunday, morning, movie" instead of the keyword of "Sunday, movie".

In operation 2260, the electronic device (101) can transmit a query including a keyword. In operation 2270, the electronic device (101) can receive a query analysis result. In operation 2280, the electronic device (101) can operate using the query analysis result. For example, as in FIG. 23, the electronic device (101) can output a voice (2306) including the query analysis result.

FIG. 24 illustrates a flowchart for explaining a method of controlling an electronic device according to various embodiments of the present invention.

In operation 2410, the electronic device (101) can obtain a plurality of text messages. In operation 2420, the electronic device (101) can analyze each of the plurality of text messages to obtain keywords corresponding to the plurality of text messages. Since the process of the electronic device (101) obtaining keywords corresponding to the plurality of text messages has been described in detail, further description thereof is omitted herein.

In operation 2430, the electronic device (101) may perform an operation corresponding to the keyword. For example, the electronic device (101) may transmit a query including the keyword in response to the keyword. Alternatively, the electronic device (101) may set a preset operation to input the keyword into a web browsing application and display a keyword processing result from the web browsing application. The electronic device (101) may pre-store a command corresponding to the keyword, and may perform the command or transmit the command to another electronic device. That is, the electronic device (101) according to various embodiments of the present invention may directly perform an operation corresponding to the keyword in addition to receiving an analysis result for a keyword corresponding to a plurality of text messages.

FIGS. 25A to 25C illustrate examples of calling and communicating with an in-home IoT device in an electronic device according to various embodiments of the present invention. For convenience of explanation, the IoT device is described as an example of a refrigerator, but is not limited thereto.

Referring to FIG. 25a, an electronic device (101), an IoT device (2525), a first server (2521), and a second server (2523) are illustrated.

The IoT device (2525) may be, for example, a refrigerator installed in a home. The first server (2521) may be, for example, a shopping mall server, but is not limited thereto. The second server (2523) may be, for example, a server that manages IoT devices in a home, but is not limited thereto.

The electronic device (101) can display an execution screen of a chat application running on the electronic device on the display unit. The electronic device (101) can display a plurality of text messages received from another electronic device through the communication unit and a plurality of text messages input through the input unit of the electronic device on the execution screen. For example, when user A runs a chat application on the electronic device (101), messages (2505, 2506, 2507) exchanged between user A and user B can be displayed on the screen (2503). User A can input text messages (2505, 2507) through the input unit of the electronic device. User B can input text messages (2506) through another electronic device, and the other electronic device can transmit the input text messages to the electronic device. The electronic device (101) can display the received text messages (2506) on the screen (2503).

The electronic device (101) can determine an external device that can provide information to user A based on a plurality of messages displayed on the screen.

The electronic device (101) can obtain a plurality of text messages (2505, 2506, 2507) through a chat application. The electronic device (101) can extract keywords from the plurality of text messages (2505, 2506, 2507) and receive information from an external device based on the extracted keywords. The electronic device (101) can transmit and receive data to and from the external device to receive information from the external device. The method by which the electronic device (101) extracts keywords from text messages and the method of arranging and displaying text messages on a screen have been described with reference to FIGS. 4 to 10, so a detailed description thereof will be omitted.

The external device may be a first server (2521), a second server (2523), or a refrigerator (2525).

For example, if user A asks user B, “What do you want to eat for dinner?” (2505) and user B responds, “Pizza” (2506), the electronic device (101) can determine that the two people are having a conversation related to food from the words “dinner,” “what do you want to eat,” and “pizza,” and can search for a food-related device among the IoT devices installed in the home.

The electronic device can receive information from a determined external device. The food-related device can be, for example, a 'refrigerator' or a 'microwave oven (MWO: Micro Wave Oven)'. When a user inputs a message saying, "Are there any ingredients in the refrigerator?", the electronic device (101) can extract keywords such as 'refrigerator' and 'ingredients' from the message and determine the status of food ingredients stored in the refrigerator. That is, the electronic device (101) can search for an external device to transmit and receive data based on words (keywords) extracted from a plurality of messages (2505, 2506, 2507), and transmit or receive data to the searched external device. Here, the data can be a command for controlling the external device or data to be provided to the external device.

The electronic device (101) may request the status of ingredients from the refrigerator (2525) based on the text message (2507) and display a message (2508) related thereto on the screen. The electronic device (101) may receive the 'status of food ingredients' from the refrigerator (2525) and display the received status of food ingredients on the screen (2503) where the application is executed. At this time, a plurality of text messages (2505, 2506, 2507) and information (2508) received from the refrigerator may be arranged in chronological order and displayed on the execution screen.

The electronic device (101) can display a UI element (2509) within a text message (2508) to provide information on the status of food ingredients in the refrigerator (2525). The UI element (2509) can be a button. The UI element can receive user input.

When a user selects a button (2509), the status of food ingredients in the refrigerator may be displayed on the screen. The status of food ingredients may be displayed within a text message (2508) or in a separate pop-up window, but is not limited thereto. For example, the status of food ingredients may be provided through voice guidance.

According to an embodiment, the electronic device (101) can receive the status of food ingredients in the refrigerator (2525) through the second server (2523). The second server (2523) can be a server that manages IoT devices in the home, manages data on the status and current status of IoT devices in the form of a database, and can transmit data on IoT devices in the home to other devices including the electronic device (101).

Referring to FIG. 25b, the electronic device (101) can display food ingredient status (2531) on the screen according to a user input of selecting a button (2509) illustrated in FIG. 25a. The food ingredient status (2531) screen can display food ingredient images (2532, 2534, 2536, 2538) and the names and expiration dates of the food ingredients.

Food ingredient images (2532, 2534, 2536, 2538) can be acquired through a camera mounted on a refrigerator or through a first server (shopping mall server) (2521). The names and expiration dates of the food ingredients can be acquired through the first server (2521).

The electronic device (101) can determine the status of additional materials to be purchased based on text messages and provide the information to the user.

Referring to FIG. 25c, the electronic device can display the status of ingredients (2551) that need to be newly purchased on the screen. The electronic device (101) can extract the keyword 'pizza' from a text message (2506 of FIG. 25a) and search for a recipe for 'pizza' through the first server. The electronic device (101) can compare the food ingredients required to make 'pizza' from the search result with the status of food ingredients in the refrigerator, and generate a status of newly purchased ingredients (2551).

The status of newly purchased ingredients (2551) may include food ingredient images (2552, 2554, 2556) and the names and prices of the food ingredients. The electronic device (101) may transmit information about the food ingredients included in the newly purchased ingredients (2551) to the first server (shopping mall server) (2521) through the user's confirmation. That is, the electronic device (101) may proceed with an order for the newly purchased ingredients through the user's confirmation.

Depending on the embodiment, the electronic device (101) may automatically order food ingredients by referring to the status of newly purchased ingredients (2551) without a user confirmation process.

In various embodiments of the present invention, a method for controlling an electronic device may include: obtaining a plurality of text messages; analyzing each of the plurality of text messages to obtain a keyword corresponding to the plurality of text messages; transmitting a query including the keyword; and receiving a result of the keyword analysis to perform an operation corresponding to the received result of the keyword analysis.

In various embodiments of the present invention, a method for controlling an electronic device further includes an operation of obtaining recipient information related to a recipient performing keyword analysis, wherein the operation of transmitting the query transmits the query including the keyword and the recipient information, and the keyword analysis result can be performed by an electronic device corresponding to the recipient information.

In various embodiments of the present invention, the operation of obtaining the keyword may include the operation of performing natural language processing on each of the plurality of text messages; and the operation of generating the keyword using the natural language processing result for each of the plurality of text messages.

In various embodiments of the present invention, the operation of generating the keyword using the natural language processing result for each of the plurality of text messages may include the operation of comparing the natural language processing result with a preset template; and the operation of generating the keyword based on the comparison result.

In various embodiments of the present invention, the operation of generating the keyword using the natural language processing result for each of the plurality of text messages may include the operation of applying a machine learning or deep learning algorithm to the natural language processing result; the operation of determining the intent of each of the plurality of text messages based on the application result; and the operation of generating the keyword based on the intent of each of the plurality of text messages.

In various embodiments of the present invention, the act of obtaining the plurality of text messages may include the act of obtaining the plurality of first text messages during a first period; and the act of obtaining the plurality of second text messages during a second period.

In various embodiments of the present invention, the operation of obtaining the keyword may include the operation of generating a first keyword corresponding to the plurality of first text messages; and the operation of generating a second keyword corresponding to the plurality of second text messages.

In various embodiments of the present invention, the operation of generating the second keyword may generate the second keyword by using the analysis results of the plurality of second text messages and at least one of the first keyword and the plurality of first text messages.

In various embodiments of the present invention, a method for controlling an electronic device further includes an operation of obtaining additional information, and the operation of generating the keyword can generate the keyword by using analysis results of the plurality of text messages and the additional information.

In various embodiments of the present invention, the act of obtaining the additional information may obtain additional information associated with the analysis results of the plurality of text messages or obtain additional information independent from the plurality of text messages.

In various embodiments of the present invention, the operation of obtaining the plurality of text messages may include the operation of obtaining the plurality of user voices; and the operation of converting each of the plurality of user voices to obtain the plurality of text messages.

In various embodiments of the present invention, a method for controlling an electronic device may include: an operation of displaying an execution screen of a chat application running on the electronic device; an operation of displaying a plurality of text messages input to the electronic device or received from another electronic device on the execution screen of the chat application; an operation of receiving an analysis request for the plurality of text messages; an operation of transmitting keywords corresponding to the plurality of text messages when the analysis request is received; and an operation of receiving an analysis result for the keywords and displaying the analysis result for the received keywords on a window of the chat application.

In various embodiments of the present invention, a method for controlling an electronic device may include: obtaining a plurality of text messages; analyzing each of the plurality of text messages to obtain a keyword corresponding to the plurality of text messages; and performing an operation corresponding to the keyword.

Each of the above-described components of the electronic device may be composed of one or more parts (components), and the names of the corresponding components may vary depending on the type of the electronic device. In various embodiments, the electronic device may be composed of at least one of the above-described components, and some of the components may be omitted or may further include other additional components. In addition, some of the components of the electronic device according to various embodiments may be combined to form a single entity, thereby performing the same functions of the corresponding components prior to being combined.

The term “module” as used herein may mean a unit comprising one or more combinations of, for example, hardware, software, or firmware. The term “module” may be used interchangeably with, for example, terms such as unit, logic, logical block, component, or circuit. A “module” may be the smallest unit of a component or a part thereof that is integrally formed. A “module” may also be the smallest unit or a part thereof that performs one or more functions. A “module” may be implemented mechanically or electronically. For example, a “module” may include at least one of an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs), or a programmable-logic device that performs certain operations, known or to be developed in the future.

At least a part of the device (e.g., modules or functions thereof) or the method (e.g., operations) according to various embodiments may be implemented as instructions stored in a computer-readable storage medium, for example, in the form of a program module. When the instructions are executed by a processor (e.g., processor (120)), the one or more processors may perform a function corresponding to the instructions. The computer-readable storage medium may be, for example, the memory (130).

The computer-readable recording medium may include a hard disk, a floppy disk, a magnetic media (e.g., a magnetic tape), an optical media (e.g., a compact disc read only memory (CD-ROM), a digital versatile disc (DVD), a magneto-optical media (e.g., a floptical disk)), a hardware device (e.g., a read only memory (ROM), a random access memory (RAM), or a flash memory), etc. In addition, the program instructions may include not only machine language codes generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc. The above-described hardware devices may be configured to operate as one or more software modules to perform operations of various embodiments, and vice versa.

Modules or program modules according to various embodiments may include at least one or more of the above-described components, some of which may be omitted, or may further include other additional components. Operations performed by modules, program modules, or other components according to various embodiments may be executed sequentially, in parallel, iteratively, or in a heuristic manner. In addition, some operations may be executed in a different order, omitted, or other operations may be added.

According to various embodiments of the present invention, a storage medium storing commands may be provided, wherein the commands, when executed by at least one processor, are configured to cause the at least one processor to perform at least one operation, wherein the at least one operation may include: obtaining a plurality of text messages; analyzing each of the plurality of text messages to obtain a keyword corresponding to the plurality of text messages; transmitting a query including the keyword; and receiving a result of the keyword analysis and performing an operation corresponding to the received result of the keyword analysis.

And the embodiments disclosed in this document are presented for the purpose of explanation and understanding of the disclosed technical contents, and do not limit the scope of the present disclosure. Therefore, the scope of the present disclosure should be interpreted to include all modifications or various other embodiments based on the technical idea of the present disclosure.

Claims (29)

In a method for controlling an electronic device,
An action to obtain multiple text messages;
An operation of analyzing each of the plurality of text messages to obtain a first keyword and a second keyword corresponding to the plurality of text messages;
An action of identifying an in-home device related to the first keyword among a plurality of in-home devices; An action of transmitting a query for searching for materials stored in the in-home device to a first server;
In response to the above query, an action of receiving information about materials stored in the in-house device from the first server;
An operation of identifying information about materials to be purchased by comparing the materials required for the second keyword with materials stored in the home device; and
A method of controlling an electronic device, comprising the action of transmitting information about materials to be purchased to a second server. delete In paragraph 1,
The operation of obtaining the first and second keywords is as follows:
An operation of natural language processing each of the above multiple text messages; and
An operation of generating the first keyword and the second keyword by using the natural language processing results for each of the plurality of text messages.
A method for controlling an electronic device including: In the third paragraph,
The operation of generating the first keyword and the second keyword by using the natural language processing results for each of the plurality of text messages is as follows:
An operation of comparing the preset template with the natural language processing result; and
An operation of generating the first keyword and the second keyword based on the above comparison results.
A method for controlling an electronic device including: In the third paragraph,
The operation of generating the first keyword and the second keyword by using the natural language processing results for each of the plurality of text messages is as follows:
An action of applying a machine learning or deep learning algorithm to the above natural language processing results;
An operation of determining the intent of each of the plurality of text messages based on the above application results; and
An operation of generating the first keyword and the second keyword based on the intent of each of the plurality of text messages.
A method for controlling an electronic device including: In paragraph 1,
The action of obtaining the above multiple text messages is:
An action of obtaining a plurality of first text messages during a first period; and
The act of obtaining multiple second text messages during a second period.
A method for controlling an electronic device including: In paragraph 6,
The operation of obtaining the first and second keywords is as follows:
An operation of generating a first keyword corresponding to said plurality of first text messages; and
An action of generating a second keyword corresponding to said plurality of second text messages.
A method for controlling an electronic device including: In paragraph 7,
The action of generating the above second keyword is:
A control method of an electronic device for generating the second keyword by using the analysis results of the plurality of second text messages and at least one of the first keyword and the plurality of first text messages. delete delete In paragraph 1,
The action of obtaining the above multiple text messages is:
An operation for acquiring multiple user voices; and
An operation of converting each of the plurality of user voices to obtain the plurality of text messages.
A method for controlling an electronic device including: In electronic devices,
communication circuit;
a processor electrically connected to said communication circuit; and
Memory electrically connected to the above processor
Including,
The above memory, when executed by the processor, causes the electronic device to:
Obtain multiple text messages,
By analyzing each of the plurality of text messages, a first keyword and a second keyword corresponding to the plurality of text messages are obtained,
Identifying an in-home device related to the first keyword among multiple in-home devices,
A query for searching for materials stored in the above home device is transmitted to the first server using the above communication circuit,
In response to the above query, information about materials stored in the in-house device is received from the first server,
By comparing the materials required for the above second keyword with the materials stored in the home device, information on materials to be purchased is identified,
An electronic device storing instructions to transmit information about the materials to be purchased to a second server using the communication circuit. delete In Article 12,
The above memory, when executed, the processor,
Natural language processing of each of the above multiple text messages,
An electronic device storing instructions for generating the first keyword and the second keyword by using the natural language processing results for each of the plurality of text messages. In Article 14,
The above memory, when executed, the processor,
Compare the preset template with the above natural language processing results,
An electronic device storing instructions for generating the first keyword and the second keyword based on the results of the comparison. In Article 14,
The above memory, when executed, the processor,
Applying machine learning or deep learning algorithms to the above natural language processing results,
Based on the above application results, the intent of each of the plurality of text messages is determined,
An electronic device storing instructions for generating the first keyword and the second keyword based on the intent of each of the plurality of text messages. In Article 12,
The above memory, when executed, the processor,
Obtain multiple first text messages during the first period,
An electronic device storing instructions for obtaining a plurality of second text messages during a second period. delete delete delete A computer-readable storage medium storing instructions, wherein the instructions, when executed by at least one processor, cause an electronic device to perform at least one operation, wherein the at least one operation comprises:
An action to obtain multiple text messages;
An operation of analyzing each of the plurality of text messages to obtain a first keyword and a second keyword corresponding to the plurality of text messages;
An action of identifying an in-home device related to the first keyword among a plurality of in-home devices; An action of transmitting a query for searching for materials stored in the in-home device to a first server;
In response to the above query, an action of receiving information about materials stored in the in-house device from the first server;
An operation of identifying information about materials to be purchased by comparing the materials required for the second keyword with materials stored in the home device; and
A computer-readable storage medium comprising an action for transmitting information about materials to be purchased to a second server. delete delete delete delete delete delete delete delete

Images