KR102563818B1 - the Electronic Device Controlling the Internet-of-Thing Device and the Method for Controlling the Internet-of-Thing Device - Google Patents

Abstract

An electronic device according to various embodiments includes an EM sensing circuit for receiving an electromagnetic (EM) signal of at least one IoT device, a communication circuit capable of communicating with an external device, and storing a database related to the at least one IoT device. A memory, the EM sensing circuit, the communication circuit, and a processor operatively connected to the memory, wherein the processor forms a communication channel with an external network device through the communication circuit, and through the communication channel , Check whether the EM service is available for the at least one IoT device connected to the network device, and if the EM service is available, authorize control of the at least one IoT device from the network device or an external server Acquiring, receiving analysis information related to recognition of the device list controllable by the authority or the EM signal from the network device or the external server, and using the EM sensing circuit, the device list or the analysis information Based on this, the at least one IoT device may be recognized, and a function corresponding to the scope of authority may be executed using the recognized at least one IoT device. In addition to this, various embodiments identified through the specification are possible.

Description

The Electronic Device Controlling the Internet-of-Thing Device and the Method for Controlling the Internet-of-Thing Device

Various embodiments disclosed in this document relate to an electronic device for controlling an IoT device and a method for controlling the IoT device.

Devices such as TVs, refrigerators, or speakers may emit their own electromagnetic (EM) signals. The EM signal may have a unique waveform depending on the type of device or model name. Using the EM signal, it may be possible to identify the device that generated the EM signal. For example, products included in the same product group manufactured by the same manufacturer may generate the same EM signal for each model. An electronic device that recognizes the device can recognize the model name of each electronic device using an EM signal generated by each device, and can control the corresponding device based on the recognized information.

When an electronic device uses an EM signal to recognize a nearby internet-of-thing (IoT) device, the device corresponding to the EM signal is pre-registered in the IoT server operated based on the user account. We can provide related services. When a user moves to another place (e.g., a hotel or pension), nearby IoT devices may be registered with other users' accounts, in which case the electronic device does not control the nearby IoT devices through EM signals. I can't.

An electronic device according to an embodiment disclosed in this document includes an EM sensing circuit for receiving an electromagnetic (EM) signal of at least one IoT device, a communication circuit capable of communicating with an external device, and the at least one IoT device. A memory for storing a database related to the EM sensing circuit, the communication circuit, and a processor operatively connected to the memory, wherein the processor forms a communication channel with an external network device through the communication circuit, Through the communication channel, it is checked whether the EM service is available for the at least one IoT device connected to the network device, and if the EM service is available, the at least one IoT device is stored from the network device or an external server. Obtain control authority, receive a list of devices controllable by the authority or analysis information related to recognition of the EM signal from the network device or the external server, and use the EM sensing circuit to obtain the device list Alternatively, the at least one IoT device may be recognized based on the analysis information, and a function corresponding to the scope of authority may be executed using the recognized at least one IoT device.

An electronic device according to various embodiments disclosed in this document may recognize an IoT device by using an EM signal in a new location by a user and control the IoT device based on a different communication method based on the recognized information. In this case, the electronic device can quickly control nearby IoT devices without a separate registration process.

An electronic device according to various embodiments disclosed in this document may authenticate a user through a network device and grant an authority for controlling an IoT device within a preset range or a range permitted by an administrator of the network device.

An electronic device according to various embodiments disclosed in this document may receive analysis information corresponding to a granted authority, so that recognition and control of a nearby IoT device using an EM signal can be quickly processed. In addition to this, various effects identified directly or indirectly through this document may be provided.

1 illustrates an IoT management system according to various embodiments.
2 is a block diagram of a control electronic device according to various embodiments.
3 is a configuration diagram illustrating a procedure for identifying nearby IoT devices using a control electronic device according to various embodiments of the present disclosure.
4 is a configuration diagram of an EM sensing circuit according to various embodiments.
5 is a flowchart illustrating a control method of an IoT device according to various embodiments.
6 is a signal flow diagram related to an IoT control method according to various embodiments.
7 illustrates a control method of an IoT device using email according to various embodiments.
8 illustrates a device recognizing method based on a device list according to various embodiments.
9 illustrates a device recognition method using an optimization model according to various embodiments.
10 is a block diagram of an electronic device in a network environment according to various embodiments.
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar elements.

Hereinafter, an electronic device according to various embodiments will be described with reference to the accompanying drawings. In this document, the term user may refer to a person using an electronic device or a device using an electronic device (eg, an artificial intelligence electronic device).

1 illustrates an IoT management system according to various embodiments.

Referring to FIG. 1, the IoT system 100 includes an IoT server 101, a network device 102, a control electronic device 103, at least one IoT device 104, a master device 105, and a network 106. can include The IoT server 101 , the network device 102 , the control electronic device 103 , at least one IoT device 104 , and the master device 105 may transmit and receive data to each other through the network 106 .

The IoT server 101 may store various information required to manage at least one or more IoT devices 104 . The IoT server 101 performs an operation required to manage at least one IoT device 104 according to a request signal from the network device 102, the control electronic device 103, or at least one IoT device 104, An operation result may be provided to the device that transmitted the request signal. For example, the IoT server 101 may be an IoT cloud server (eg, Samsung Connect server).

According to an embodiment, the IoT server 101 may store user account information and information about EM signals generated from each of the one or more IoT devices 104 as a database 141a. The IoT server 101 receives information related to recognition of the EM signal (eg, sampling) based on information transmitted from the control electronic device 103 or the network device 102 or information provided from an external device managed by the manufacturer. data or analysis engine) and information about control of at least one IoT device 104 may be stored. For example, the IoT server 101 is a profile (eg, model name or communication connection method) of each at least one IoT device 104 registered through an EM signal according to the user's account, at least one IoT device (104 ), and/or access point (AP) information to which the IoT device 104 is connected (eg, the network device 102) may be stored.

According to various embodiments, the IoT server 101 may provide an EM service based on a registered user account. In the EM service, the control electronic device 103 recognizes at least one or more nearby IoT devices 104 through EM signals, and functions designated through the recognized IoT device 104 (eg, music playback through a speaker device) , or video playback through a TV) may be a service that provides a control environment to execute. The IoT server 101 may connect and store at least one or more IoT devices 104 in advance based on a user account. When a device corresponding to an EM signal is pre-registered in the IoT server 101 operated based on a user account, the user can use the EM service.

According to various embodiments, the IoT server 101 may store a list (hereinafter, a device list) of one or more IoT devices 104 connected to the network device 102 . For example, the device list may be collected through the control electronic device 103 .

The control electronic device 103 may receive an EM signal of one or more IoT devices 104 included in a network space covered by the network device 102 and analyze the received EM signal. The control electronic device 103 may transmit the analyzed information to the IoT server 101 . The IoT server 101 may link and store the device list and the received information. For example, the IoT server 101 includes identification information (eg, model name) of each IoT device 104 connected to the network device 102 and EM signal characteristics of each device or analysis information (eg, sampling method) of the EM signal , analysis engine or discrimination model) can be linked and stored.

The network device 102 may be a device that links a network of peripheral devices and external devices (eg, the IoT server 101) through short-range wireless communication or wired communication in a designated space. Short-range wireless communication, for example, Wi-Fi (wireless fidelity), Wi-Fi Direct, Li-Fi (light fidelity), Bluetooth, BLE (Bluetooth low energy), Zigbee, NFC (near field communication), MST ( It may include magnetic secure transmission (RF), radio frequency (RF), or body area network (BAN). Wired communication may include, for example, local area network (LAN), powerline communication, or plain old telephone service (POTS). For example, network device 102 may be an AP device for Wi-Fi communication. As another example, network device 102 may be a router for an Internet connection.

The control electronic device 103 may be a device that controls one or more IoT devices 104 according to set authority. The control electronic device 103 may display a user interface for controlling one or more IoT devices 104 through a display. The control electronic device 103 may transmit a control signal for controlling the at least one IoT device 104 to the at least one IoT device 104 in response to a user input. The control signal may be transmitted through direct communication between the control electronic device 103 and at least one IoT device 104, or may be transmitted through the network device 102 or the IoT server 101. For example, the control electronic device 103 may be a device of a smart phone or a tablet PC.

According to various embodiments, the control electronic device 103 may recognize at least one IoT device 104 using a unique EM signal generated from each of the at least one IoT device 104 . At least one or more IoT devices 104 may generate EM signals each having a unique frequency. When the control electronic device 103 approaches at least one or more IoT devices 104 within a specified distance (eg, about 5 cm), the control electronic device 103 may collect EM signals through an antenna and a sensing circuit.

According to various embodiments, the control electronic device 103 may acquire authority for controlling at least one IoT device 104 from another control device based on user account information. For example, another control electronic device (hereinafter referred to as a master device 105 ) registered with the account of the first user performs an EM operation on at least one IoT device 104 disposed in a space covered by the network device 102 . It may be a device capable of registering a signal and controlling at least one or more IoT devices 104 without restriction of authority. The IoT server 101 includes user account information of the master device 105, identification information of the network device 102, a list of at least one or more IoT devices 104 registered, and related information (eg, model name or communication connection method). can be stored in the database.

After the control electronic device 103 registered with the account of the second user acquires the control authority for at least one IoT device 104 disposed in the space covered by the network device 102, the IoT device according to the authority It can be a guest device that can control (104). The control electronic device 103 obtains the control authority from the IoT server 101 or the master device 105 in a state in which a communication channel is formed with the network device 102 to control at least one IoT device 104. can The control electronic device 103 may control one or more IoT devices 104 within a range permitted by the control authority. When the communication channel between the control electronic device 103 and the network device 102 is terminated, the control electronic device 103 may lose the control authority.

According to various embodiments, the control electronic device 103 or the network device 102 may transmit location information of the control electronic device 103 or the network device 102 to the IoT server 101 . The IoT server 101 may allow the control authority when the location information matches information stored in the database.

In one embodiment, the control authority may be defined together with user account information of the master device 105 registered in the IoT server 101 or may be defined through settings through a user interface displayed on the master device 105. .

Hereinafter, a case in which the control electronic device 103 is a device that receives authority for controlling the IoT device 104 and performs control is discussed, but is not limited thereto.

According to various embodiments, the master device 105, before the control electronic device 103 forms a communication channel with the network device 102, based on the EM signal generated from at least one IoT device 104, At least one or more IoT devices 104 may be registered with the EM service. The master device 105 may transmit an analysis result of an EM signal sensed by at least some of the at least one or more IoT devices 104 to the IoT server 101 . According to one embodiment, when there are a plurality of IoT servers 101, the master device 105 may determine the IoT server 101 to deliver the analysis result of the EM signal.

According to an embodiment, the control electronic device 103 or the master device 105 may determine the IoT server 101 to deliver the analysis result of the EM signal based on the information of the running application. For example, when the Samsung Pay application is running in the master device 105, the master device 105 may transmit the received EM signal analysis result to the Samsung Pay server.

According to another embodiment, the control electronic device 103 or the master device 105 analyzes the EM signal based on location information of the control electronic device 103 or the master device 105 and information acquired from a peripheral device. You can decide which server to forward the results to. For example, when the master device 105 is connected to an AP used at home, information can be transmitted to the Samsung Connect server, and information can be transmitted to the Samsung Pay server when the master device 105 is located in a shopping mall as determined based on GPS signals. can

At least one IoT device 104 may be connected to the network device 102 through wireless or wired communication. At least one IoT device 104 may be controlled by the control electronic device 103 or the master device 105 that has obtained control authority. According to various embodiments, at least one IoT device 104 may each generate a unique EM signal. At least one IoT device 104 may include various electronic components (sub components) therein, and may generate EM signals of various frequencies by electromagnetic interference (EMI) generated from the electronic components. there is.

2 is a block diagram of a control electronic device according to various embodiments. Figure 2 is illustrative and not limited thereto.

Referring to FIG. 2 , the control electronic device 103 may include a processor 120, a display 160, a memory 170, a communication circuit 190, and an EM sensing circuit 200, respectively. According to various embodiments, the master device 105 of FIG. 1 may have the same or similar configuration as the control electronic device 103 .

Processor 120 may be operationally connected to display 160 , communication circuitry 190 , and EM sensing circuitry 200 . The processor 120 may perform calculations necessary for the operation of the control electronic device 103 .

According to various embodiments, the processor 120 transmits information (hereinafter, device recognition information) generated based on the EM signal detected by the EM sensing circuit 200 to the IoT server 101 through the communication circuit 190 can be controlled to

The display 160 may display content according to the operation of the control electronic device 103 . According to various embodiments, the display 160 may display a user interface required for controlling at least one IoT device 201 or 202 .

The memory 170 may store various information necessary for the operation of the control electronic device 103 . In one embodiment, the memory 170 may store a device list of one or more IoT devices 104, EM signal characteristics, or analysis information (eg, a sampling method, an analysis engine, or a discrimination model) of an EM signal.

The communication circuit 190 may transmit information possessed by the control electronic device 103 to a server (eg, the IoT server 101) through the network 106. The communication circuit 190 may transmit the EM signal and related information received by the EM sensing circuit 200 to the IoT server 101 and receive a result.

The EM sensing circuit 200 may detect an electromagnetic (EM) signal generated from at least one IoT device (eg, the first IoT device 201 and the second IoT device 202). According to an embodiment, the EM sensing circuit 200 may generate device identification information based on the EM signal. For example, the device recognition information may include information about the waveform of the EM signal and information about the profile (eg, model name, or communication connection method) of at least one IoT device 201 or 202 that emits the EM signal. there is.

For example, the EM sensing circuit 200 receives the first EM signal EM1 from the first IoT device 201 and uses the amplitude and phase of the waveform of the first EM signal EM1 to generate the first EM signal. Device recognition information about (EM1) can be created. The EM sensing circuit 200 may provide device recognition information about the first EM signal EM1 to the processor 120 . The EM sensing circuit 200 receives the second EM signal EM2 from the second IoT device 202 and uses the amplitude and phase of the waveform of the second EM signal EM2 to generate the second EM signal EM2. Device recognition information can be generated. The EM sensing circuit 200 may provide device recognition information about the second EM signal EM2 to the processor 120 .

For another example, the EM sensing circuit 200 may detect an EM signal and generate detection information. The EM sensing circuit 200 may provide detection information to the processor 120 . The processor 120 may generate device identification information using the detection information. For example, the device recognition information may include information about the waveform of the EM signal and information about the profile (eg, model name, or communication connection method) of at least one IoT device 201 or 202 that emits the EM signal. there is.

According to an embodiment, the processor 120 may transmit device recognition information to the IoT server 101 . The processor 120 may receive information analyzed by the IoT server 101 . For example, the processor 120 transmits information about the profile (eg, model name or communication connection method) of the IoT devices 201 and 202, the operating state of the IoT devices 201 and 202, and information about the command execution function. can receive According to another embodiment, the processor 120 analyzes the device recognition information inside the control electronic device 103 to obtain information about the profile (eg, model name or communication connection method) of the IoT devices 201 and 202 , Information on the operating state and command execution function of the IoT devices 201 and 202 may be analyzed.

3 is a configuration diagram illustrating a procedure for identifying nearby IoT devices using a control electronic device according to various embodiments of the present disclosure. Figure 3 is illustrative and not limited thereto.

Referring to FIG. 3 , IoT devices 201 , 202 , 203 , or 204 may be disposed around the control electronic device 103 . For example, these IoT devices 201, 202, 203, or 204 may include a TV, refrigerator, Bluetooth speaker, or printer. According to one embodiment, the IoT devices 201, 202, 203, or 204 may include various electronic components (sub components) therein. The IoT devices 201, 202, 203, or 204 may generate various frequency signals by electromagnetic interference (EMI) generated from internal electronic components. For example, the IoT devices 201, 202, 203, or 204 may generate EM signals (eg, f1, f2, f3, or f4) each having a unique frequency. In one embodiment, the EM signal may be a signal within a frequency range of 0 to 1 MHz.

According to various embodiments, when the control electronic device 103 approaches any one of the IoT devices 201, 202, 203, or 204, the control electronic device 103 operates the EM sensing circuit 200. Through this, EM signals (eg, f1, f2, f3, or f4) can be detected.

According to various embodiments, the processor 120 of the control electronic device 103 uses a machine learning (ML) method to determine the profile (eg, model name, or communication information) of the IoT devices 201, 202, 203, or 204. connection method), etc.

According to various embodiments, the control electronic device 103 may link and store the type and model name of IoT devices according to characteristics of EM signals of various IoT devices 201, 202, 203, or 204 in an internal memory.

According to various embodiments, the processor 120 may execute a specific application based on identification information of the IoT devices 201 , 202 , 203 , or 204 . For example, when the first IoT device 201 is identified as a TV, the processor 120 may automatically execute an application related to a remote control and automatically connect to the TV (communication connection method activation). . When the user brings the control electronic device 103 close to the first IoT device 201, the control electronic device 103 may enter a stand-by state capable of controlling the TV, which is an IoT device.

According to an embodiment, the EM sensing circuit 200 may provide only detection information having the strongest reception strength among EM signals generated from the IoT devices 201 , 202 , 203 , or 204 to the processor 120 . For example, when the control electronic device 103 sets the nearest TV among the IoT devices 201, 202, 203, or 204 in the living room as a target device and senses it, the control electronic device 103 sets the TV generated by the TV By detecting the strongest EM signal strength, only the EM signal generated by the TV can be sensed.

According to an embodiment, the EM sensing circuit 200 transmits only EM signals generated from IoT devices 201, 202, 203, or 204 located within a predetermined distance from the control electronic device 103 among the sensed EM signals to the processor ( 120) can be provided. The control electronic device 103 may check whether the IoT devices 201 , 202 , 203 , or 204 are nearby devices of the control electronic device 103 using short-range communication such as BLE, WiFi, or NAN. For example, the control electronic device 103 can prevent the TV in the room from being sensed by checking location information of the TV in the living room. Accordingly, it is possible to improve sensing and analysis efficiency by preventing an EM signal unnecessary for sensing and analysis from being input. Also, the control electronic device 103 may improve accuracy of sensing a target device among the IoT devices 201 , 202 , 203 , or 204 .

4 is a configuration diagram of an EM sensing circuit according to various embodiments.

Referring to FIG. 4 , the control electronic device 103 includes an antenna 410 and an EM sensing circuit 200 for detecting an EM signal expressed in an IoT device (eg, the first IoT device 201 of FIG. 2 ). can include According to various embodiments, the master device 105 may have the same or similar configuration as the control electronic device 103 . According to an embodiment, the processor 120 of the control electronic device 103 uses the detection information provided from the EM sensing circuit 200 to detect a nearby IoT device (eg, the first IoT device 201 of FIG. 2 ). can identify.

According to various embodiments, the EM sensing circuit 200 includes a transimpedance amplifier (TIA) 210 (eg, a transimpedance amplifier), a band pass filter (BPF) 220 (band pass filter), and a variable gain amplifier (VGA). 230 (eg, a variable gain amplifier), an analog digital converter (ADC) 240 and a micro controller unit (MCU) 250.

According to an embodiment, the antenna 410 may collect EM signals generated from nearby IoT devices (eg, the first IoT device 201 of FIG. 2 ). TIA 210 may amplify the EM signal received from antenna 410 . According to one embodiment, the BPF 220 may filter the signal amplified and received from the TIA 210 around a specific frequency of interest defining a characteristic pattern. According to one embodiment, the VGA 230 may output a signal at a constant level over a preset gain range in order to improve noise characteristics and external interference signal rejection characteristics of the filtered signal. According to one embodiment, the ADC 240 may convert an analog signal provided from the VGA 230 into a digital signal and then provide the converted digital signal to the MCU 250.

According to an embodiment, the MCU 250 may compare the EM signal with a frequency table stored in a memory (eg, the memory 170 of FIG. 2 ). The MCU 250 may identify an IoT device (eg, the first IoT device 201 of FIG. 2 ) based on the comparison and provide the identified device recognition information to the processor 120 .

According to another embodiment, the MCU 250 may provide the EM signal (detection information) to the processor 120 without separate analysis. The processor 120 may compare the EM signal with a frequency table stored in memory. The processor 120 may identify an IoT device (eg, the first IoT device 201 of FIG. 2 ) based on the comparison. According to an embodiment, the processor 120 of the control electronic device 103 may identify the target device using detection information provided from the EM sensing circuit 200 . According to another embodiment, the processor 120 may transmit detection information generated by the target device to an IoT server (eg, the IoT server 101 of FIG. 1 ) and analyze it through the IoT server 101 .

5 is a flowchart illustrating a control method of an IoT device according to various embodiments.

Referring to FIG. 5 , in operation 510, the control electronic device 103 may establish a communication channel with the network device 102 through short-range wireless communication or wired communication. Short-range wireless communication, for example, Wi-Fi (wireless fidelity), Wi-Fi Direct, Li-Fi (light fidelity), Bluetooth, BLE (Bluetooth low energy), Zigbee, NFC (near field communication), MST ( It may include magnetic secure transmission (RF), radio frequency (RF), or body area network (BAN). Wired communication may include, for example, local area network (LAN), powerline communication, or plain old telephone service (POTS).

For example, network device 102 may be an AP device for Wi-Fi communication. As another example, network device 102 may be a router for an Internet connection.

In operation 520, the control electronics device 103 communicates with the network device 102 to send an EM message to at least one IoT device connected to the network device 102 (eg, the first IoT device 201 of FIG. 2). You can check the availability of the service. In the EM service, the control electronic device 103 recognizes a nearby IoT device (eg, the first IoT device 201 in FIG. 2) based on the EM signal, and the recognized IoT device (eg, the first IoT device in FIG. It may be a service that controls the device 201 to execute a designated function.

For example, the control electronic device 103 may transmit a request signal for supporting the EM service to the network device 102 . The network device 102 may check the authentication information included in the request signal and, if the authentication information is valid, transmit a response signal indicating that the EM service is supported.

For another example, the network device 102 may generate a broadcast signal or a beacon signal notifying that the EM service is available. The control electronic device 103 may transmit a request signal for starting an EM service to the network device 102 in response to a broadcast signal or a beacon signal generated by the network device 102 . The network device 102 may check the authentication information included in the request signal and, if the authentication information is valid, transmit a response signal indicating that the EM service is supported.

In operation 530, if the EM service is available, the control electronic device 103 provides authority for control of the IoT device (eg, the first IoT device 201 of FIG. 2) from the network device 102 or the IoT server 101. can be obtained.

According to various embodiments, the control electronic device 103 may use pre-set user account information (eg, ID and password) (hereinafter, guest account information). The control electronic device 103 transmits user account information to the network device 102 and acquires authority for controlling the IoT device (eg, the first IoT device 201 of FIG. 2 ) through a designated authentication process. can In one embodiment, guest account information may be set by the network device 102 or the master device 105 in FIG. 1 .

According to various embodiments, in operation 535, a list of devices controllable by the authority or analysis information related to recognition of the EM signal may be received. The device list may include identification information (eg, model name) of an IoT device (eg, the first IoT device 201 of FIG. 2 ) controllable by authority. The device list may additionally store installation information, setting information, installation location, or communication method of the IoT device (eg, the first IoT device 201 of FIG. 2 ).

Analysis information related to the recognition of the EM signal may include characteristics of the EM signal or an analysis model of the EM signal (eg, a sampling method, an analysis engine, or an analysis program).

According to an embodiment, the analysis information may include information about resources used for analysis of the EM signal. The control electronic device 103 may obtain information about a resource for providing EM service based on the acquired authority. Information about resources may include logic for selecting a classifier optimized for a specific IoT device or processing a received EM signal, or information about an application related to a specific IoT device.

According to various embodiments, the analysis information may be stored and managed in the IoT server 101 or the network device 102. For example, the analysis information calculated by the master device 105 may be transmitted to the IoT server 101, and the IoT server 101 stores the analysis information in the internal memory or transmits it to the network device 102 can be saved.

In operation 540, the control electronic device 103 may recognize an IoT device (eg, the first IoT device 201 of FIG. 2 ) based on the device list or analysis information using the EM sensing circuit 200. . For example, when the user places the control electronic device 103 and the IoT device (eg, the first IoT device 201 of FIG. 2) adjacent to each other (eg, within about 5 cm), the control electronic device 103 The EM sensing circuit 200 may detect an EM signal generated from an IoT device (eg, the first IoT device 201 of FIG. 2 ).

The control electronic device 103 may process an EM signal generated from an IoT device (eg, the first IoT device 201 of FIG. 2 ) based on the received device list or analysis information to increase recognition speed and accuracy. . For example, the control electronic device 103 may increase the recognition speed by processing only EM signals corresponding to devices included in the device list. For another example, the control electronic device 103 may recognize an IoT device (eg, the first IoT device 201 of FIG. 2 ) by executing a discrimination model included in the analysis information. The control electronic device 103 may select a classifier according to the discrimination model and may select logic for processing the EM signal.

In operation 550, the control electronic device 103 may execute a function corresponding to the range of the acquired authority using the recognized IoT device (eg, the first IoT device 201 of FIG. 2 ).

For example, when the IoT device (eg, the first IoT device 201 of FIG. 2) is a TV, when the user approaches the control electronic device 103 to a distance that can recognize the EM signal of the TV, control A designated communication (eg, WiFi Direct, mirroring) is connected between the electronic device 103 and the TV, and the video being played on the control electronic device 103 can be continuously played on the TV. The control electronic device 103 may change to a screen off state when a video being reproduced is continuously reproduced on the TV.

For another example, when an IoT device (eg, the first IoT device 201 of FIG. 2 ) is a speaker, when the user approaches the control electronic device 103 to a distance at which the EM signal of the speaker can be recognized, A designated communication (eg, BT communication) is connected between the control electronic device 103 and the speaker, and music being played in the control electronic device 103 may be continuously played in the speaker.

For another example, when the IoT device (eg, the first IoT device 201 of FIG. 2 ) is a refrigerator, the user approaches the control electronic device 103 to a distance at which the EM signal of the refrigerator can be recognized. , designated communication (eg, WiFi Direct, or mirroring) is connected between the control electronic device 103 and the refrigerator, and information about food ingredients retrieved by the control electronic device 103 may be displayed on the display of the refrigerator. According to various embodiments, the control electronic device 103 includes a list of internally stored IoT devices (eg, the first IoT device 201 of FIG. 2 ) and an IoT device recognized after acquiring the authority (eg, the first IoT device 201 of FIG. 2 ). For overlapping devices in the list of 1 IoT device 201, a control signal may be provided to a newly recognized device.

According to various embodiments, when the control electronic device 103 is out of coverage allowed by the network device 102, the acquired authority may be returned.

6 is a signal flow diagram of a method for controlling an IoT device according to various embodiments.

Referring to FIG. 6 , in operation 610, the control electronic device 103 may establish a communication channel with the network device 102 through short-range wireless communication or wired communication. For example, network device 102 may be an AP device for Wi-Fi communication.

In operation 615 , the control electronic device 103 may transmit a request signal confirming whether the EM service is supported to the network device 102 . The request signal may include authentication information for a user using the control electronic device 103 .

In operation 620, the network device 102 may transmit a response signal indicating that EM service support is possible.

The network device 102 may check the authentication information and, if the authentication information is valid, transmit a response signal indicating that the EM service is supported. According to one embodiment, the authentication information may be registered in the network device 102 through the master device 105 .

In operation 630 , the control electronic device 103 may receive pre-set guest account information (eg, ID and password) to obtain permission for an EM service in a network space covered by the network device 102 . For example, the control electronic device 103 may receive guest account information from a user.

In operation 635 , the control electronic device 103 may transmit guest account information to the network device 102 . According to various embodiments, the authority for the EM service acquired by the control electronic device 103 through subsequent operations may vary according to guest account information.

In operation 640, the network device 102 may perform an authentication process based on the guest account information. The network device 102 may authenticate guest account information based on previously stored information or authenticate guest account information through the IoT server 101 .

In operation 645, if the authentication information is valid, the network device 102 may transmit an authentication signal indicating that the EM service is available to the control electronic device 103.

In operation 650, the control electronic device 103 may compare guest account information with account information set in the control electronic device 103 in relation to the EM service (hereinafter, set account information).

In operation 670, the control electronic device 103 may request permission for the EM service from the IoT server 101 when the guest account information and the set account information do not match. For example, if the guest account information and the setting account information do not match, the user of the control electronic device 103 does not normally use the space (eg, a hotel, a pension, or a relative's house) in an IoT device (eg, a road). It may be a state in which the first IoT device 201 of 2 is desired to be controlled.

According to various embodiments, in operation 675, the IoT server 101 may check with the master device 105 whether permission setting is allowed for the control electronic device 103. For example, the IoT server 101 may check the master device 105 to request permission based on the permission request 670 requested by the control electronic device 103 .

According to various embodiments, in operation 680, the IoT server 101 may receive a permission setting response from the master device 105.

In operation 685, the IoT server 101 may set access rights for an IoT device (eg, the first IoT device 201 of FIG. 2) when receiving a response for permission approval from the master device 105. . According to an embodiment, the IoT server 101 may provide the control electronic device 103 with a list of devices controllable by the access authority or analysis information (eg, resource information) related to recognition of an EM signal.

According to various embodiments, the IoT server 101 may transmit a device list or analysis information (eg, resource information) to the network device 102 . The network device 102 provides a device list or analysis information (eg, resource information) to the control electronic device 103 through a designated authentication process (eg, location check of the control electronic device 103 or user account verification). can do.

In operation 690, the control electronic device 103 may provide an EM service. The control electronic device 103 may start the EM service without a separate permission request when the guest account information and the set account information match. For example, when the guest account information and the setting account information match, the IoT device (eg, home or office) in a space normally used by the user of the control electronic device 103 or a space where authority is registered (eg, at home or office) : This may be a state in which the first IoT device 201 of FIG. 2 is desired to be controlled.

The control electronic device 103 may provide an EM service based on the acquired access right and analysis information (including resource information) when the guest account information and the set account information do not match. When the obtained authority restricts the control of the IoT device (eg, the first IoT device 201 of FIG. 2 ), the EM service may be provided within the limited authority range. For example, if control of the TV and the speaker is permitted among the TV, speaker, air conditioner, and boiler, the control electronic device 103 may control the TV and the speaker through the EM service. On the other hand, the control electronic device 103 cannot control the air conditioner and the boiler through the EM service.

7 illustrates a control method of an IoT device using an email address according to various embodiments. 7 shows an IoT control method using an email address as an example, but is not limited thereto. For example, an IoT device may be controlled using account information or a phone number.

Referring to FIG. 7 , in operation 710, the control electronic device 103 may establish a communication channel with the network device 102 through short-range wireless communication or wired communication. For example, network device 102 may be an AP device for Wi-Fi communication.

In operation 720, the control electronic device 103 may receive a previously set email address (or account information, phone number) to obtain permission for the EM service in the network space covered by the network device 102. For example, the control electronic device 103 may receive an email address from a user or use information stored in a memory (eg, memory 170) of the control electronic device 103. The control electronic device 103 may establish a communication channel using the network device 102 and designated network account information (eg, ID and password). When a communication channel is formed, the control electronic device 103 may display a user interface through which an email address (or account information, phone number) can be input. The control electronic device 103 may receive an email address (or account information, phone number) for using the EM service through the user interface.

In operation 725 , the control electronic device 103 may transmit the received e-mail address (or account information or phone number) to the network device 102 .

In operation 730, the network device 102 may transmit an invitation request signal including the received e-mail address (or account information, phone number) to the IoT server 101.

In operation 740, the IoT server 101 sends an invitation to the EM service to the received email address (or a push message based on account information, an application notification, or a text message based on a phone number) in response to the invitation request signal. can transmit.

In operation 750, the control electronic device 103 may check whether the user accepts the invitation through e-mail (or push message or text message).

In operation 755, the control electronic device 103 may request permission from the IoT server 101 when the user accepts the invitation via e-mail (or push message or text message).

According to various embodiments, in operation 760, the IoT server 101 may check whether permission setting is allowed to the master device 105.

According to various embodiments, in operation 765, the IoT server 101 may receive a response regarding authority setting.

In operation 770, the IoT server 101 may set access rights for the IoT device when receiving a response regarding permission approval from the master device 105. According to an embodiment, the IoT server 101 may provide the control electronic device 103 with a list of devices controllable by the access authority or analysis information (eg, resource information) related to recognition of an EM signal.

According to various embodiments, the IoT server 101 provides the control electronic device 103 or the network device 102 with a list of controllable devices based on location information and analysis information (eg, resource information) related to recognition of an EM signal. can provide

In one embodiment, the control electronic device 103 may transmit location information to the IoT server 101 using communication through the network device 102 or separate communication (eg, cellular communication). The IoT server 101 may provide the control electronic device 103 with a device list corresponding to the received location information and analysis information (eg, resource information) related to recognizing the EM signal.

In operation 780, the control electronic device 103 may provide EM service. For example, the control electronic device 103 may control a nearby IoT device (eg, the first IoT device 201 of FIG. 2 ) based on the received analysis information.

8 illustrates a device recognizing method based on a device list according to various embodiments.

Referring to FIG. 8 , in a first state 801, the control electronic device 103 uses an EM signal 811 when obtaining permission for an EM service in a network space covered by a network device 102. Control of an IoT device (eg, the first IoT device 201 of FIG. 2 ) may be performed. For example, the processor 120 of the control electronic device 103 may analyze the EM signal based on previously stored EM information 801a. The EM information 801a may include analysis information on other IoT devices as well as IoT devices around the control electronic device 103 . When receiving the EM signal 811, the processor 120 compares the stored EM information 801a with the received EM signal 811 for all searchable devices (eg, first to Nth devices), fit can be calculated.

In the second state 802, the control electronic device 103 receives a device list 810 from the IoT server 101 about at least one IoT device 104 included in the network space covered by the network device 102. can receive The device list 810 may be previously stored in the IoT server 101 through the master device 105 . According to an embodiment, the master device 105 may recognize an EM signal of at least one IoT device 104 included in a network space covered by the network device 102 and analyze the EM signal. The master device 105 transmits the analyzed information to the IoT server 101, and the IoT server 101 may create and store a device list 810 based on the received information.

In the second state 802 , the control electronic device 103 may use the device list 810 to reduce resource consumption required to process the EM signal 821 and improve device recognition performance. For example, the processor 120 of the control electronic device 103 may configure the updated EM information 802a based on the device list 810 . The updated EM information 802a may include analysis information specific to an IoT device around the control electronic device 103 . When the EM signal 821 is received, the processor 120 selects devices (eg, first to third devices) included in the device list 810 among all searchable devices (eg, first to Nth devices). , the degree of fitness may be calculated by comparing the updated EM information 802a and the received EM signal 821 . The processor 120 may select a classifier (or discriminant model) optimized for a specific IoT device through the device list 810 or select appropriate logic for processing the received EM signal 821 . According to one embodiment, EM information 802a may be stored in memory 170 and referenced by processor 120 .

According to various embodiments, the processor 120 may recognize an IoT device (eg, the first IoT device 201 of FIG. 2 ) through a Gaussian mixture model (GMM) discrimination model. The GMM discrimination model may be configured by combining individual models for each IoT device (eg, the first IoT device 201 of FIG. 2 ). For example, discrimination models for each of the N IoT devices exist independently, and the entire discrimination model may be configured as a combination of these models.

For example, the control electronic device 103 is connected to the network equipment 102 (eg, AP) in a specific space, and the device list 810 of IoT devices capable of supporting the EM service connected to the network equipment 102 can receive When device 1, device 2, and device 3 are registered in the device list 810, among the GMM discrimination models stored in the control electronic device 103, device 1, device 2, and device 3 included in the device list 810 IoT devices can be recognized by optimizing the GMM discrimination model corresponding to each.

9 illustrates a device recognition method based on a device discrimination model according to various embodiments.

Referring to FIG. 9 , when the control electronic device 103 obtains permission for an EM service in a network space covered by a network device 102, the control electronic device 103 uses an EM signal 911 to control at least one IoT device 104. control can be performed.

The control electronic device 103 is a device list 910 related to at least one IoT device 104 included in the network space covered by the network device 102 from the IoT server 101 or the network device 102 and the device A discrimination model 920 may be received. The device list 910 and the device discrimination model 920 may be previously stored in the IoT server 101 or the network device 102 through the master device 105 . According to one embodiment, the master device 105 recognizes the EM signal 911 of at least one IoT device 104 included in the network space covered by the network device 102, and sends the EM signal 911 can be analyzed. The master device 105 transmits analysis information (eg, information 920 on a device discrimination model) to the IoT server 101, and the IoT server 101, based on the received information, lists the devices 910 and A device discrimination model 920 may be created and stored. Alternatively, the IoT server 101 may transmit the device list 910 and the device discrimination model 920 to the network device 102 to be stored.

According to various embodiments, the control electronic device 103 may reduce resource consumption required for processing the EM signal 911 and improve device recognition performance by using the device list 910 and the device discrimination model 920. there is.

For example, the processor 120 of the control electronic device 103 may configure the updated EM information 901a based on the device list 910 and the device determination model 920 . The updated EM information 901a may include analysis information specific to an IoT device around the control electronic device 103 . When there is a device discrimination model 920, compared to the case where there is only a device list 810 as shown in FIG. , the power may be lowered. In addition, device recognition performance can be improved.

According to one embodiment, the EM information 901a may be stored in the memory 170 and referenced by the processor 120 .

According to one embodiment, the discriminant model 920 may be a GMM discriminant model. The GMM discrimination model may be configured by combining individual models for each of the at least one or more IoT devices 104 . For example, discriminant models for each of the N IoT devices exist independently, and a GMM discriminant model for all N devices may be configured by combining them.

According to another embodiment, the discrimination model 920 may be a discrimination model based on deep learning, such as deep neural networks (DNNs) or convolutional neural networks (CNNs). Unlike the GMM discrimination model, a discrimination model based on deep learning may be configured as one discrimination model that calculates the fitness of all N devices at once. A discrimination model based on deep learning may be stored in the IoT server 101 or the network device 102 through the master device 105 . When the control electronic device 103 downloads a deep learning-based discrimination model from the IoT server 101 or the network device 102, the fitness calculation logic of the latter part of the discrimination model can be calculated by applying only to the corresponding devices. there is.

According to various embodiments, the control electronic device 103 checks the device list 910 of at least one new IoT device 104 for which permission has been acquired, and the application associated with each device (eg, a device-specific application, an integrated application) ) can be downloaded or run.

10 is a block diagram of an electronic device 1001 within a network environment 1000 according to various embodiments. Electronic devices according to various embodiments disclosed in this document may be devices of various types. Electronic devices include, for example, portable communication devices (eg, smart phones), computer devices (eg, personal digital assistants (PDAs), tablet PCs), laptop PCs (desktop PCs, workstations, or servers), The wearable device may include at least one of a portable multimedia device (eg, an e-book reader or an MP3 player), a portable medical device (eg, a heart rate, blood glucose, blood pressure, or body temperature monitor), a camera, or a wearable device. (e.g. watches, rings, bracelets, anklets, necklaces, eyeglasses, contact lenses, or head-mounted-devices (HMDs), textile or clothing integrals (e.g. electronic garments), body-worn (e.g. : a skin pad or a tattoo), or a bio-implantable circuit In some embodiments, an electronic device may include, for example, a television, a digital video disk (DVD) player, an audio device, and an audio accessory device. (e.g. speakers, headphones, or headsets), refrigerators, air conditioners, vacuum cleaners, ovens, microwave ovens, washing machines, air purifiers, set-top boxes, home automation control panels, security control panels, game consoles, electronic dictionaries, electronic keys, camcorders , or at least one of the electronic picture frames.

In another embodiment, the electronic device may include a navigation device, a global navigation satellite system (GNSS), an event data recorder (EDR) (eg, a black box for a vehicle/ship/aircraft), and an automobile infotainment device. (e.g. head-up displays for vehicles), industrial or home robots, drones, automated teller machines (ATMs), point of sales (POS) devices, metering devices (e.g. water, electricity, or gas metering devices), or at least one of IoT devices (eg, a light bulb, a sprinkler device, a fire alarm, a thermostat, or a street light). The electronic device according to the embodiment of this document is not limited to the above-mentioned devices, and also, for example, as in the case of a smart phone equipped with a function of measuring personal biometric information (eg, heart rate or blood sugar), a plurality of electronic devices. Functions of the devices may be provided in combination. In this document, the term user may refer to a person using an electronic device or a device using an electronic device (eg, an artificial intelligence electronic device).

Referring to FIG. 10 , in a network environment 1000, an electronic device 1001 (eg, the control electronic device 103 of FIG. 1 ) via a first network (eg, short-distance wireless communication) 1098, an electronic device 1002 ) (eg, at least one IoT device 104 of FIG. 1) communicates with, or through a second network (eg, network 106 of FIG. 1) 1099 (eg, the master device of FIG. 1) (105)) 1004 or a server (eg, IoT server 101 of FIG. 1) 1008. According to an embodiment, the electronic device 1001 may communicate with the electronic device 1004 through the server 1008.

According to an embodiment, the electronic device 1001 includes a bus 1010, a processor 1020 (eg, the processor 120 of FIG. 2 ), a memory 1030 (eg, the memory 170 of FIG. 2 ), Input device 1050 (e.g. microphone or mouse), display device (e.g. display 160 of FIG. 2) 1060, audio module 1070, sensor module 1076, interface 1077, haptic module ( 1079), a camera module 1080, a power management module 1088, and a battery 1089, a communication module 1090 (eg, communication circuit 190 of FIG. 2), and a subscriber identification module 1096. can In some embodiments, the electronic device 1001 may omit at least one of the components (eg, the display device 1060 or the camera module 1080) or may additionally include other components.

The bus 1010 may include circuitry that connects the components 1020-1090 to each other and transfers signals (eg, control messages or data) between the components.

The processor 1020 may be one of a central processing unit (CPU), an application processor (AP), a graphics processing unit (GPU), an image signal processor (ISP) of a camera, or a communication processor (CP). or more. According to an embodiment, the processor 1020 may be implemented as a system on chip (SoC) or system in package (SiP). The processor 1020 may control at least one other component (eg, hardware or software component) of the electronic device 1001 connected to the processor 1020 by driving an operating system or an application program, and , various data processing and calculations can be performed. The processor 1020 loads and processes commands or data received from at least one of the other components (eg, the communication module 1090) into the volatile memory 1032, and stores the resulting data in the non-volatile memory 1034. can

The memory 1030 may include a volatile memory 1032 or a non-volatile memory 1034 . The volatile memory 1032 may be composed of, for example, random access memory (RAM) (eg, DRAM, SRAM, or SDRAM). The non-volatile memory 1034 includes, for example, programmable read-only memory (PROM), one time PROM (OTPROM), erasable PROM (EPROM), electrically EPROM (EEPROM), mask ROM, flash ROM, flash memory, HDD (hard disk drive), or SSD (solid state drive). In addition, the non-volatile memory 1034, depending on the connection type with the electronic device 1001, is a built-in memory 1036 disposed therein, or a stand-alone external device that can be connected and used only when necessary. memory 1038. The external memory 1038 is a flash drive, for example, compact flash (CF), secure digital (SD), Micro-SD, Mini-SD, extreme digital (xD), multi-media card (MMC) , or a memory stick. The external memory 1038 may be functionally or physically connected to the electronic device 1001 through wire (eg, cable or universal serial bus (USB)) or wirelessly (eg, Bluetooth).

The memory 1030 may store, for example, at least one other software component of the electronic device 1001, for example, a command or data related to the program 1040. The program 1040 may include, for example, a kernel 1041 , a library 1043 , an application framework 1045 , or an application program (interchangeably “application”) 1047 .

The input device 1050 may include a microphone, mouse, or keyboard. According to an embodiment, the keyboard may be connected as a physical keyboard or displayed as a virtual keyboard through the display device 1060 .

The display device 1060 may include a display, a hologram device, or a projector and a control circuit for controlling the device. The display may include, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a microelectromechanical systems (MEMS) display, or an electronic paper display. . The display, according to one embodiment, may be implemented to be flexible, transparent, or wearable. The display may include touch circuitry capable of detecting a user's touch, gesture, proximity, or hovering input, or a pressure sensor capable of measuring the strength of a touch (interchangeably a "force sensor"). can The touch circuit or pressure sensor may be integrally implemented with the display or may be implemented as one or more sensors separate from the display. A hologram device can show a 3D image in the air by using the interference of light. The projector may display an image by projecting light onto a screen. The screen may be located inside or outside the electronic device 1001, for example.

The audio module 1070 may convert, for example, a sound and an electrical signal in both directions. According to an embodiment, the audio module 1070 acquires sound through an input device 1050 (eg, a microphone), or an output device (not shown) included in the electronic device 1001 (eg, a speaker or receiver), or an external electronic device connected to the electronic device 1001 (e.g. electronic device 1002 (e.g. wireless speaker or wireless headphone) or electronic device 1006 (e.g. wired speaker or wired headphone)). can output

The sensor module 1076 measures or detects, for example, an internal operating state (eg, power or temperature) or an external environmental state (eg, altitude, humidity, or brightness) of the electronic device 1001, Electrical signals or data values corresponding to the measured or sensed state information may be generated. The sensor module 1076 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, and a color sensor (eg, a red, green, blue (RGB) sensor). , infrared (IR) sensors, biometric sensors such as iris sensors, fingerprint sensors, or heartbeat rate monitoring (HRM) sensors, olfactory (electronic nose) sensors, electromyography (EMG) sensors, electroencephalogram (EEG) sensors, electrocardiogram (ECG) sensor), temperature sensor, humidity sensor, illuminance sensor, or UV (ultra violet) sensor. The sensor module 1076 may further include a control circuit for controlling one or more sensors included therein. In some embodiments, the electronic device 1001 may control the sensor module 1076 using the processor 1020 or a processor (eg, a sensor hub) separate from the processor 1020 . In the case of using a separate processor (eg, sensor hub), the electronic device 1001 does not wake up the processor 1020 while the processor 1020 is in a sleep state, and the sensor module is operated by the separate processor. At least part of the operation or state of 1076 may be controlled.

The interface 1077, according to an embodiment, is a high definition multimedia interface (HDMI), USB, optical interface, recommended standard 232 (RS-232), D-subminiature (D-sub), mobile (MHL) high-definition link) interface, SD card/multi-media card (MMC) interface, or audio interface. The connection terminal 1078 may physically connect the electronic device 1001 and the electronic device 1006 . According to one embodiment, the connection terminal 1078 may include, for example, a USB connector, an SD card/MMC connector, or an audio connector (eg, a headphone connector).

The haptic module 1079 may convert electrical signals into mechanical stimuli (eg, vibration or movement) or electrical stimuli. For example, the haptic module 1079 may provide a stimulus related to a tactile or kinesthetic sense to the user. The haptic module 1079 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 1080 may capture still images and moving images, for example. The camera module 1080, according to one embodiment, may include one or more lenses (eg, a wide-angle lens and a telephoto lens, or a front lens and a rear lens), an image sensor, an image signal processor, or a flash (eg, a light emitting diode or a xenon lamp). (xenon lamp), etc.).

The power management module 1088 is a module for managing power of the electronic device 1001 and may be configured as at least a part of a power management integrated circuit (PMIC).

The battery 1089 may be recharged by an external power source including, for example, a primary battery, a secondary battery, or a fuel cell to supply power to at least one component of the electronic device 1001.

The communication module 1090 establishes a communication channel between the electronic device 1001 and an external device (eg, the first external electronic device 1002, the second external electronic device 1004, or the server 1008). And it can support the performance of wired or wireless communication through the established communication channel. According to an embodiment, the communication module 1090 includes a wireless communication module 1092 or a wired communication module 1094, and the first network 1098 (eg, Bluetooth or IrDA) using a corresponding communication module among them. It is possible to communicate with an external device through a short-range communication network such as an infrared data association) or a second network 1099 (eg, a long-distance communication network such as a cellular network).

The wireless communication module 1092 may support cellular communication, short range wireless communication, or GNSS communication, for example. Cellular communication, for example, long-term evolution (LTE), LTE Advance (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), universal mobile telecommunications system (UMTS), wireless broadband (WiBro) ), or GSM (Global System for Mobile Communications). Short-range wireless communication, for example, Wi-Fi (wireless fidelity), Wi-Fi Direct, Li-Fi (light fidelity), Bluetooth, BLE (Bluetooth low energy), Zigbee, NFC (near field communication), MST ( It may include magnetic secure transmission (RF), radio frequency (RF), or body area network (BAN). GNSS may include, for example, Global Positioning System (GPS), Global Navigation Satellite System (Glonass), Beidou Navigation Satellite System (hereinafter “Beidou”) or Galileo (the European global satellite-based navigation system). In this document, "GPS" may be used interchangeably with "GNSS".

According to an embodiment, when cellular communication is supported, the wireless communication module 1092 identifies and authenticates the electronic device 1001 within a communication network using the subscriber identity module 1096, for example. can do. According to an embodiment, the wireless communication module 1092 may include a CP separate from the processor 1010 (eg, an AP). In this case, CP may, for example, act on behalf of processor 1020 while processor 1020 is in an inactive (eg, sleep) state, or with processor 1020 while processor 1020 is in an active state. Together, at least some of the functions related to at least one of the components 1010 to 1096 of the electronic device 1001 may be performed. According to an embodiment, the wireless communication module 1092 may include a plurality of communication modules supporting only a corresponding communication method among a cellular communication module, a short-range wireless communication module, and a GNSS communication module.

The wired communication module 1094 may include, for example, local area network (LAN), power line communication, or plain old telephone service (POTS).

The first network 1098 uses, for example, Wi-Fi direct or Bluetooth capable of transmitting or receiving commands or data through direct wireless connection between the electronic device 1001 and the first external electronic device 1002. can include The second network 1099 may be, for example, a telecommunication network capable of transmitting or receiving commands or data between the electronic device 1001 and the second external electronic device 1004 (eg, a local area network (LAN) or computer networks such as wide area networks (WANs), the Internet, or telephone networks).

According to various embodiments, the command or the data may be transmitted or received between the electronic device 1001 and the second external electronic device 1004 through the server 1008 connected to the second network. Each of the first and second external electronic devices 1002 and 1004 may be the same as or different from the electronic device 1001 . According to various embodiments, all or part of operations executed in the electronic device 1001 may be executed in one or more electronic devices (eg, the electronic devices 1002 and 1004, or the server 1008). According to an example, when the electronic device 1001 needs to perform a certain function or service automatically or upon request, the electronic device 1001 instead of or in addition to executing the function or service by itself, at least related thereto Some functions may be requested from other devices (eg, electronic devices 1002 and 1004, or server 1008). A function or additional function may be executed, and the result thereof may be transmitted to the electronic device 1001. The electronic device 1001 may provide the requested function or service by directly or additionally processing the received result. For example, cloud computing, distributed computing, or client-server computing technologies may be used.

An electronic device (eg, the control electronic device 103 of FIG. 1 ) according to various embodiments receives an electromagnetic (EM) signal of at least one IoT device (eg, one or more IoT devices 104 of FIG. 1 ). EM sensing circuit (eg, EM sensing circuit 200 of FIG. 2), a communication circuit capable of communicating with an external device (eg, communication circuit 190 of FIG. 2), and the at least one IoT device A memory for storing a database (eg, memory 170 of FIG. 2 ), the EM sensing circuitry, the communication circuitry, and a processor operatively coupled to the memory (eg, processor 120 of FIG. 2 ), The processor forms a communication channel with an external network device (eg, the network device 102 of FIG. 1) through the communication circuit, and connects to the at least one IoT device connected to the network device through the communication channel. Check whether the EM service is available for the EM service, and if the EM service is available, obtain an authority for controlling the at least one IoT device from the network device or an external server (eg, IoT server 101 in FIG. 1) and receiving a list of devices controllable by the authority or analysis information related to recognition of the EM signal from the network device or the external server, and using the EM sensing circuit, based on the list of devices or the analysis information It can be configured to recognize the at least one IoT device and to execute a function corresponding to the scope of authority using the at least one recognized IoT device.

According to various embodiments, the EM service may be a service that controls the at least one IoT device recognized through the EM signal to execute a specified function.

According to various embodiments, the processor may transmit a request signal including authentication information to the network device through the communication channel. When receiving a response signal corresponding to the request signal through the communication channel, the processor may determine that the EM service is available.

According to various embodiments, the electronic device may further include a display displaying content, and the processor may display a user interface for inputting user account information to obtain the authority on the display. The processor may obtain an authority for controlling the at least one IoT device based on the user account information input to the user interface. When the input user account information does not match user account information related to the EM service stored in the memory, the processor may request permission for controlling the at least one IoT device from the server.

According to various embodiments, the processor may transmit location information of the electronic device or connection information with the network device to the server through the communication circuit. The processor may receive the device list or the analysis information based on the location information or the connection information from the server through the communication circuit.

According to various embodiments, the electronic device may further include a display displaying content, and the processor may display a user interface for inputting user's e-mail information on the display. The processor may perform authentication with the server based on the user's e-mail, and acquire the authority based on the authentication result.

A control method of an IoT device according to various embodiments is performed in an electronic device (eg, the control electronic device 101 of FIG. 1 ) through a communication circuit (eg, the communication circuit 190 of FIG. 2 ) of the electronic device. , Forming a communication channel with an external network device (eg, the network device 102 of FIG. 1), through the communication channel, the at least one IoT device connected to the network device (eg, at least one IoT device in FIG. 1) For the above IoT device 104), the operation of checking whether the EM service is available, if the EM service is available, the network device (eg, network device 102 in FIG. 1) or an external server (eg, FIG. Obtaining authority for controlling the at least one IoT device from the IoT server 101 of 1), the network device (eg, the network device 102 of FIG. 1) or the external server (eg, FIG. 1 An operation of receiving a list of devices controllable by the authority or analysis information related to recognition of an EM signal from the IoT server 101), using the EM sensing circuit of the electronic device (EM sensing circuit 200 in FIG. 2) and recognizing the at least one IoT device based on the device list or the analysis information, and executing a function corresponding to the scope of authority using the recognized at least one IoT device. can do.

According to various embodiments, the EM service may be a service that controls the at least one IoT device recognized through the EM signal to execute a specified function.

According to various embodiments, the operation of checking whether the control is possible may include an operation of transmitting a request signal including authentication information to the network device through the communication channel.

According to various embodiments, the operation of checking whether the control is possible may include an operation of determining that the EM service is available when a response signal corresponding to the request signal is received through the communication channel.

According to various embodiments, the operation of acquiring the control authority may include displaying a user interface for inputting user account information to obtain the authority on the display of the electronic device. The operation of acquiring the authority for control may include an operation of acquiring the authority for controlling the at least one IoT device based on the user account information input to the user interface. The operation of acquiring the control authority is performed by giving the server the authority to control the at least one IoT device when the input user account information does not match the user account information related to the EM service stored in the memory. It can contain requested actions.

According to various embodiments, the control method may further include an operation of deleting the authority information when the communication channel is terminated.

A network device (eg, the network device 102 of FIG. 1 ) according to various embodiments includes a communication circuit capable of communicating with an external device, a memory, and a processor operatively connected to the communication circuit and the memory. and the processor forms a communication channel with a first electronic device (eg, the control electronic device 103 of FIG. 1) through the communication circuit, and through the communication circuit, at least one communication channel from the first electronic device Receives a signal requesting control of an IoT device (eg, at least one IoT device 104 of FIG. 1), and through the communication circuit, an external server (eg, IoT server 101 of FIG. 1) transmits the signal, receives information related to the authority from the external server through the communication circuit, and transmits the information to the first electronic device through the communication circuit.

Various embodiments of this document and terms used therein are not intended to limit the technology described in this document to a specific embodiment, and should be understood to include various modifications, equivalents, and/or substitutes of the embodiments. In connection with the description of the drawings, like reference numerals may be used for like elements. Singular expressions may include plural expressions unless the context clearly dictates otherwise. In this document, expressions such as "A or B", "at least one of A and/or B", "A, B or C" or "at least one of A, B and/or C" refer to all of the items listed together. Possible combinations may be included. Expressions such as "first," "second," "first," or "second," may modify the corresponding components regardless of order or importance, and are used to distinguish one component from another. It is used only and does not limit the corresponding components. When a (e.g., first) element is referred to as being "(functionally or communicatively) coupled to" or "connected to" another (e.g., second) element, that element refers to the other (e.g., second) element. It may be directly connected to the component or connected through another component (eg, a third component).

In this document, "adapted to or configured to" means "adapted to or configured to" depending on the situation, for example, hardware or software "adapted to," "having the ability to," "changed to," ""made to," "capable of," or "designed to" can be used interchangeably. In some contexts, the expression "device configured to" can mean that the device is "capable of" in conjunction with other devices or components. For example, the phrase “a processor set up (or configured) to perform A, B, and C” may include a dedicated processor (eg, embedded processor), or memory device (eg, memory 1030) to perform those operations. It may refer to a general-purpose processor (eg, CPU or AP) capable of performing corresponding operations by executing one or more stored programs.

The term "module" used in this document includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic blocks, parts, or circuits, for example. can A “module” may be an integrally constructed component or a minimal unit or part thereof that performs one or more functions. A "module" may be implemented mechanically or electronically, for example, a known or future developed application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs), or A programmable logic device may be included.

At least some of the devices (eg, modules or functions thereof) or methods (eg, operations) according to various embodiments include instructions stored in a computer-readable storage medium (eg, the memory 1030) in the form of program modules. can be implemented as When the command is executed by a processor (eg, the processor 1020), the processor may perform a function corresponding to the command. Computer-readable recording media include hard disks, floppy disks, magnetic media (e.g. magnetic tape), optical recording media (e.g. CD-ROM, DVD, magneto-optical media (e.g. floptical disks), built-in memory, etc.) The instruction may include code generated by a compiler or code executable by an interpreter.

Each component (eg, module or program module) according to various embodiments may be composed of a single object or a plurality of entities, and some sub-components among the aforementioned corresponding sub-components may be omitted, or other sub-components may be used. can include more. Alternatively or additionally, some components (eg, modules or program modules) may be integrated into one entity and perform the same or similar functions performed by each corresponding component prior to integration. Operations performed by modules, program modules, or other components according to various embodiments are executed sequentially, in parallel, repetitively, or heuristically, or at least some operations are executed in a different order, omitted, or other operations. this may be added.

Claims (20)

In electronic devices,
An EM sensing circuit for receiving an electromagnetic (EM) signal of at least one IoT device;
a communication circuit capable of communicating with an external device;
a memory for storing a database of the at least one IoT device; and
a processor in operative connection with the EM sensing circuitry, the communication circuitry, and the memory;
The processor
Forming a communication channel with an external network device through the communication circuit;
Checking whether an EM service is available for the at least one IoT device connected to the network device through the communication channel;
When the EM service is available, obtaining authority for control of the at least one IoT device from the network device or an external server;
Receiving a list of devices controllable by the authority or analysis information related to recognition of the EM signal from the network device or the external server;
Using the EM sensing circuit, recognizing the at least one IoT device based on the device list or the analysis information;
An electronic device configured to execute a function corresponding to the scope of authority using the at least one recognized IoT device. The electronic device of claim 1, wherein the EM service controls the at least one IoT device recognized through the EM signal to execute a specified function. The method of claim 1, wherein the processor
An electronic device that transmits a request signal including authentication information to the network device through the communication channel. The method of claim 3, wherein the processor
The electronic device determining that the EM service is available when receiving a response signal corresponding to the request signal through the communication channel. According to claim 1,
Further comprising a display for displaying content,
The processor
An electronic device displaying a user interface for inputting user account information in order to acquire the authority on the display. ◈Claim 6 was abandoned when the registration fee was paid.◈ According to claim 5,
The processor
An electronic device that acquires authority for controlling the at least one IoT device based on the user account information input to the user interface. ◈Claim 7 was abandoned when the registration fee was paid.◈ According to claim 6,
The processor
If the input user account information does not match the user account information related to the EM service stored in the memory, the electronic device requests the server for permission to control the at least one IoT device. The method of claim 1, wherein the processor
An electronic device that transmits location information of the electronic device or connection information with the network device to the server through the communication circuit. The method of claim 8, wherein the processor
An electronic device that receives the device list based on the location information or the connection information or the analysis information from the server through the communication circuit. According to claim 1,
Further comprising a display for displaying content,
The processor
An electronic device that displays a user interface for inputting user's e-mail information on the display. According to claim 10,
The processor
An electronic device that performs authentication with the server based on the user's e-mail, and acquires the authority based on the authentication result. delete In the control method of the IoT device performed in the electronic device,
forming a communication channel with an external network device through a communication circuit of the electronic device;
checking whether an EM service is available for at least one IoT device connected to the network device through the communication channel;
obtaining an authority for controlling the at least one IoT device from the network device or an external server when the EM service is available;
Receiving analysis information related to a list of devices controllable by the authority or recognition of an EM signal from the network device or the external server;
Recognizing the at least one IoT device based on the device list or the analysis information by using an EM sensing circuit of the electronic device; and
A control method comprising: executing a function corresponding to the scope of authority by using the at least one recognized IoT device. ◈Claim 14 was abandoned when the registration fee was paid.◈ The method of claim 13, wherein the EM service,
A control method that is a service that controls the at least one IoT device recognized through the EM signal to execute a designated function. ◈Claim 15 was abandoned when the registration fee was paid.◈ The method of claim 13, wherein the operation of checking whether the EM service is available,
and transmitting a request signal including authentication information to the network device through the communication channel. ◈Claim 16 was abandoned when the registration fee was paid.◈ The method of claim 15, wherein the operation of checking whether the EM service is available,
and determining that the EM service is available when receiving a response signal corresponding to the request signal through the communication channel. ◈Claim 17 was abandoned when the registration fee was paid.◈ 14. The method of claim 13, wherein the operation of acquiring the authority for the control
and displaying a user interface for inputting user account information on a display of the electronic device to acquire the authority. ◈Claim 18 was abandoned when the registration fee was paid.◈ 18. The method of claim 17, wherein the operation of acquiring the authority for the control
and obtaining an authority for controlling the at least one IoT device based on the user account information input to the user interface. ◈Claim 19 was abandoned when the registration fee was paid.◈ 19. The method of claim 18, wherein the operation of acquiring the authority for the control
When the input user account information does not match the user account information related to the EM service stored in the memory of the electronic device, requesting the server for permission to control the at least one IoT device; including control method. ◈Claim 20 was abandoned when the registration fee was paid.◈ According to claim 13,
When the communication channel is terminated, the operation of deleting the information on the authority; the control method further comprising.

Images