KR101549027B1 - Mobile device and method for controlling the mobile device - Google Patents

Abstract

A mobile terminal is disclosed. A mobile terminal according to an embodiment of the present invention includes a communication module for initiating a communication connection with a plurality of reference devices for a location service, a display module for displaying a device list to be controlled, And a controller for controlling the display module to output a graphic image for controlling the corresponding first device in accordance with the position and direction of the mobile terminal.

Description

TECHNICAL FIELD [0001] The present invention relates to a control method for a mobile terminal and a mobile terminal,

The present invention relates to a mobile terminal and a control system capable of measuring a position of an electronic device or a specific area and controlling a system including the same. In particular, the present invention can be applied to effectively controlling at least one device located in a room, for example.

A terminal can be divided into a mobile terminal (mobile / portable terminal) and a stationary terminal according to whether the terminal can be moved. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

Various new attempts have been made in terms of hardware or software to implement the complex functions of such multimedia devices. For example, a user interface environment is provided for a user to easily and conveniently search for or select a function.

In addition, mobile terminals are regarded as personal items for expressing their individuality, and various design forms are required. The design form also includes structural changes and improvements for the user to use the mobile terminal more conveniently. One such structural change and improvement can be considered for the operating unit.

Further, there is a demand for a mobile terminal capable of locating and controlling the position of an electronic device in a room.

It is an object of the present invention to provide a mobile terminal and a control system capable of measuring a position of an electronic device or a specific area in a room and controlling a system including the same.

It is another object of the present invention to specifically define a protocol for registering the legacy device in advance when the mobile terminal to be controlled is a legacy device. The legacy device may be interpreted in a conventional sense to one of ordinary skill in the art, or may be said to be, for example, an analog device or a device without communication capability.

It is another object of the present invention to define a process for automatically changing the communication means of the mobile terminal to control the mobile terminal to be controlled in accordance with the pointing direction of the mobile terminal.

According to another aspect of the present invention, there is provided a method of controlling a mobile terminal, including: initiating a communication connection with a plurality of reference devices for a location service; displaying a device list to be controlled; Selecting a specific device among the devices displayed in the list, storing the location information of the selected specific device in an internal or external memory, and storing the location information of the corresponding first device And outputting a graphic image for control of the device.

According to another aspect of the present invention, there is provided a mobile terminal including a communication module for initiating a communication connection with a plurality of reference devices for a location service, a display module for displaying a device list to be controlled, A controller for controlling the display module to output a graphic image for controlling the corresponding first device according to a position and a direction of the mobile terminal, .

The effects of the mobile terminal and the control system according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, it is possible to accurately measure the position of an electronic device or a specific area in a room.

In addition, according to at least one embodiment of the present invention, an indoor electronic device can be remotely controlled and a mobile terminal accessing a specific area can be remotely controlled.

Further, according to at least one of the embodiments of the present invention, when the mobile terminal to be controlled is a legacy device, it is possible to register the legacy device in advance. The legacy device may be interpreted in a conventional sense to one of ordinary skill in the art, or may be said to be, for example, an analog device or a device without communication capability.

According to at least one of the embodiments of the present invention, a technical effect of providing a process of automatically changing the communication means of the mobile terminal in order to control the mobile terminal to be controlled according to the pointing direction of the mobile terminal Is expected.

1 is a diagram showing an example of a control system according to the present invention.
2 is a diagram showing another example of the control system according to the present invention.
3 is a diagram illustrating an example of a mobile terminal according to the present invention.
4 is a view showing another example of a mobile terminal according to the present invention.
5 is a view showing an example of a reference device according to the present invention.
6 is a diagram showing an example of an electronic apparatus according to the present invention.
7 to 9 are views showing an example of a system control method according to the present invention.
10 and 11 are views showing another example of a system control method according to the present invention.
12 to 14 are diagrams showing another example of a system control method according to the present invention.
15 to 17 are views showing another example of a system control method according to the present invention.
18 is a diagram showing another example of a system control method according to the present invention.
19 and 20 are views showing another example of the system control method according to the present invention.
21 to 24 are diagrams showing other examples of the system control method according to the present invention.
25 and 26 are diagrams showing other examples of the system control method according to the present invention.
27 and 28 are diagrams showing other examples of the system control method according to the present invention.
29 schematically illustrates components of a mobile terminal according to an embodiment of the present invention.
30 shows a system including a mobile terminal and a legacy device according to an embodiment of the present invention.
FIG. 31 illustrates a system including a mobile terminal, a legacy device, and a smart device according to an embodiment of the present invention.
FIG. 32 illustrates in detail components of a mobile terminal according to an embodiment of the present invention.
33 is a flowchart showing an operation procedure between a mobile terminal and a server according to an embodiment of the present invention.
FIG. 34 is a flowchart showing a control method of a mobile terminal according to an embodiment of the present invention.
FIG. 35 shows an example of a registration procedure for a legacy device using a mobile terminal according to an embodiment of the present invention.
36 shows another example of a registration procedure for a legacy device using a mobile terminal according to an embodiment of the present invention.
37 shows another example of a registration procedure for a legacy device using a mobile terminal according to an embodiment of the present invention.
FIG. 38 shows a graphic image for solving a situation where a mobile terminal can not control a legacy device according to an embodiment of the present invention.
39 is a block diagram of a mobile terminal according to an embodiment of the present invention. A process for sequentially controlling the first device and the second device is schematically illustrated.
40 is a block diagram of a mobile terminal according to an embodiment of the present invention, with reference to FIG. A process for sequentially controlling the first device and the second device is shown in detail.
41 is a block diagram of a mobile terminal according to an embodiment of the present invention. A third device, and a fourth device in sequence.
FIG. 42 is a block diagram of a mobile terminal according to an embodiment of the present invention, with reference to FIG. The third device, and the fourth device in order.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

1 is a diagram showing an example of a control system according to the present invention.

As shown in FIG. 1, the control system of the present invention may include a mobile terminal 10, a plurality of reference devices 30, and one or more electronic devices 50. Here, the mobile terminal 10 measures its position through wireless communication with the reference devices 30, detects the direction of the mobile terminal 10 toward the electronic device 50, And the electronic device 50 are measured. The mobile terminal 10 can measure the position of the electronic device 50 using its position and direction and the distance between the electronic device 50 and the electronic device 50. The mobile terminal 10 can also generate and store a map indicating the location of the electronic devices 50 based on the measured location and use it to select and control the desired electronic device 50 .

The mobile terminal 10 described in the present specification can be used as a portable terminal such as a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP) slate PCs, tablet PCs, ultrabooks, wearable devices such as smartwatches, smart glass, HMDs (head mounted displays)), And may be configured in any one of a remote control mode and a remote control mode.

The reference devices 30 are devices used to measure the position of the mobile terminal 10 or the electronic device 50. At least three or more of the reference devices 30 are disposed at different positions in order to measure positions in a triangulation manner . For example, at least three reference devices 30 are required to measure the plane (2D) position of the mobile terminal 10 or the electronic device 50, and the mobile terminal 10 or the electronic device 50, At least four reference devices 30 are required to measure the spatial position (3D) When the reference devices 30 are used to measure the position of the mobile terminal 10 in the room, the reference devices 30 are preferably located indoors, but the position of the reference devices 30 is not limited to this, It is also possible.

The electronic device 50 may be a home electronic device such as a TV, a computer, a refrigerator, a washing machine, an air conditioner, a lighting device, or the like, as well as other mobile terminals capable of moving and communicating. In particular, when the electronic device 50 has an Indoor Positioning System (IPS) function, it may measure its position through communication with the reference devices 30. [

2 is a diagram showing another example of the control system according to the present invention.

2, the control system of the present invention may include a mobile terminal 10, a plurality of reference devices 30, one or more electronic devices 50, and a server 70. Here, the mobile terminal 10 measures its position through wireless communication with the reference devices 30, detects the direction of the mobile terminal 10 toward the electronic device 50, Is measured. The mobile terminal 10 can measure the position of the electronic device 50 using its position and direction and the distance between the electronic device 50 and the electronic device 50. The mobile terminal 10 may also generate a map indicating the location of the electronic devices 50 based on the measured location and may use it to select and control the desired electronic device 50.

The reference devices 30 are devices used to measure the position of the mobile terminal 10 or the electronic device 50. At least three or more of the reference devices 30 are disposed at different positions in order to measure positions in a triangulation manner . When the reference devices 30 are used to measure the position of the mobile terminal 10 in the room, the reference devices 30 are preferably located indoors, but the position of the reference devices 30 is not limited to this, It is also possible.

The electronic device 50 may be a home electronic device such as a TV, a computer, a refrigerator, a washing machine, an air conditioner, a lighting device, or the like, as well as other mobile terminals capable of moving and communicating. In particular, when the electronic device 50 has an Indoor Positioning System (IPS) function, it may measure its position through communication with the reference devices 30. [

The server 70 can measure the position of the electronic device 50 using the position and direction of the mobile terminal 10 and the distance between the mobile terminal 10 and the electronic device 50. [ In addition, the server 70 may generate and store a map indicating the location of the electronic devices 50 based on the measured location, and may use the map to map the desired electronic device 50 can be selected and controlled. Here, the server 70 may constitute a home gateway or a cloud (CLOUD), but it is not limited thereto and may mean a communicating arithmetic / storage device.

3 is a diagram illustrating an example of a mobile terminal according to the present invention.

3, the mobile terminal 10 includes a communication unit 11, an input unit 12, a sensing unit 14, a display unit 15, a memory 17, and a control unit 18 do. The components shown in FIG. 3 are not essential for implementing the mobile terminal 10, so that the mobile terminal described herein may have more or fewer components than those listed above.

The communication unit 11 may include at least one of a wireless Internet module, a local area communication module, and a location information module.

Here, the wireless Internet module refers to a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 10. The wireless Internet module is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies. Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), and Long Term Evolution-Advanced (LTE-A) And transmits and receives data according to at least one wireless Internet technology in a range including internet technologies not listed above.

The short-range communication module is for short range communication, and includes Bluetooth (registered trademark), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Communication, Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short distance communication module may be provided between the mobile terminal 10 and the reference devices 30 or between the mobile terminal 10 and the electromagnetic device 50 or between the mobile terminal 10 and the mobile terminal 10 through a wireless local area network And the network where the server 70 is located. The short-range wireless communication network may be a short-range wireless personal area network. In particular, the mobile terminal 10 can determine its own position through communication with the reference devices 30 using the local communication module.

The location information module is a module for obtaining the location (or current location) of the mobile terminal 10, and representative examples thereof include a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, the mobile terminal 10 can acquire the position of the mobile terminal 10 by using a signal sent from the GPS satellite by using the GPS module. As another example, when the mobile terminal 10 utilizes a Wi-Fi module, the mobile terminal 10 can acquire the position of the mobile terminal 10 based on information of a wireless access point (AP) Can be obtained. If necessary, the location information module may replace or additionally perform the function of any one of the other modules of the communication unit 11 to obtain data relating to the location of the mobile terminal.

The input unit 12 may include a user input unit for receiving information from a user, for example, a touch key, a mechanical key, and the like.

The sensing unit 14 may include one or more sensors for sensing at least one of information in the mobile terminal 10, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 14 may be an acceleration sensor, a magnetic sensor, a G-sensor, a gyroscope sensor, a motion sensor, an infrared sensor An infrared sensor, an ultrasonic sensor, and an optical sensor. At least one of the acceleration sensor, the magnetic sensor, the gravity sensor, the gyroscope sensor and the motion sensor may be oriented in the direction (azimuth, inclination, elevation) of the mobile terminal 10, And at least one of the infrared sensor, the ultrasonic sensor and the optical sensor may be used for measuring the distance between the mobile terminal 10 and the electronic device 50. [ For example, the ultrasonic sensor senses ultrasonic waves reflected from the electronic device 50 and returns to the controller 18, and the controller 18 can calculate the distance to the wave generating source (electronic device) through the sensed ultrasonic waves. The distance of the wave generating source can be calculated using the time difference between the output ultrasonic wave and the reflected ultrasonic wave.

The display unit 15 may implement a touch screen. Such a touch screen may function as a user input 12 that provides an input interface between the mobile terminal 10 and a user and may provide an output interface between the mobile terminal 10 and the user. In addition, the display unit 15 displays (outputs) the information processed by the mobile terminal 10. For example, the display unit 15 may display execution screen information of an application program driven by the mobile terminal 10, or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

The memory 17 stores a plurality of application programs (application programs or applications) driven by the mobile terminal 10, data and instructions for the operation of the mobile terminal 10, (ID) of the electronic device, and a map including the location information and the identification information of the one or more electronic devices 50. [ The memory 17 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card type micro type, card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (PROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk.

The control unit 18 typically controls the overall operation of the mobile terminal 10. The control unit 18 may process or process signals, data, information, and the like input or output through the above-mentioned components, or may drive an application program stored in the memory 17 to provide or process appropriate information or functions to the user. In addition, the control unit 18 may control at least some of the components in order to drive an application program stored in the memory 17. [ Furthermore, the control unit 18 may operate at least two or more of the components included in the mobile terminal 10 in combination with each other for driving the application program.

The control unit 18 determines the position of the mobile terminal 10 measured through communication between the communication unit 11 and the reference devices 30 and the position of the mobile terminal 10 measured by the sensing unit 14 The distance between the mobile terminal 10 and the electronic device 50 is used to measure the actual position of the electronic device 50. [ The control unit 18 may provide a user interface for setting a maximum allowable value of the distance between the mobile terminal 10 and the electronic device 50 used for measuring the position of the electronic device 50. [

The control unit 18 can transmit the positional information of the measured electronic device 50 to the memory 17 or the server 70 together with the identification information of the electronic device 50, The map can be generated using the identification information and stored in the memory 17. [

As described above, when the user executes the position tracking application and adjusts the direction of the mobile terminal 10 after the map is generated, the control unit 18 determines whether the direction of the mobile terminal 10 to be controlled is the measurement of the electronic device 50 It is determined whether or not it is facing the position. For this, the controller 18 determines whether the mobile terminal 10 is pointing to the position of the electronic device 50 registered in the map in consideration of the current position and the current direction of the mobile terminal 10. If the direction of the mobile terminal 10 faces the position of the electronic device 50, the control unit 18 can select and control the electronic device 50.

When the user inputs a touch input (e.g., a drag) to the display unit 15 so that the user faces the measured position of the electronic device 50, The user can select and control the electronic device 50 in consideration of the current position and the direction of the touch input.

The control unit 18 may display on the display unit 15 the identification information of one or more electronic devices 50 located on a virtual straight line that coincides with the direction of the mobile terminal 10 or the direction of the touch input . At this time, the control unit 18 may arrange the identification information on the display unit 15 in order according to the distance between the mobile terminal 10 and the corresponding electronic device 50. [ The user can easily select the desired electronic device 50 by using the identification information thus displayed. The control unit 18 may also provide a display unit 15 with a user interface for setting a virtual straight line length.

4 is a block diagram illustrating another example of a mobile terminal according to the present invention. The components of the mobile terminal 10 of FIG. 3 described above are also included in the mobile terminal 100 of FIG. 4, and the functions of the components are the same.

The mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, ), And the like. The components shown in FIG. 4 are not essential for implementing the mobile terminal 100, so that the mobile terminal 100 described herein can have more or fewer components than the components listed above have.

The wireless communication unit 110 may be connected between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and another mobile terminal 100 or between the mobile terminal 100 and the external server 100. [ Lt; RTI ID = 0.0 > wireless < / RTI > In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115 .

The input unit 120 includes a camera 121 or an image input unit for inputting a video signal, a microphone 122 for inputting an audio signal, an audio input unit, a user input unit 123 for receiving information from a user A touch key, a mechanical key, and the like). The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

The sensing unit 140 may include at least one sensor for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, A G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, An optical sensor (e.g., a camera 121, a microphone 122, a battery gage, an environmental sensor (e.g., a barometer, a hygrometer, a thermometer, (E.g., a sensor, a gas sensor, etc.), a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.) Lt; RTI ID = 0.0 > Combined can be used.

The output unit 150 includes at least one of a display unit 151, an acoustic output unit 152, a haptic tip module 153, and a light output unit 154 to generate an output related to visual, auditory, can do. The display unit 151 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user and may provide an output interface between the mobile terminal 100 and a user.

The interface unit 160 serves as a path to various types of external devices connected to the mobile terminal 100. The interface unit 160 is connected to a device having a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, And may include at least one of a port, an audio I / O port, a video I / O port, and an earphone port. In the mobile terminal 100, corresponding to the connection of the external device to the interface unit 160, it is possible to perform appropriate control related to the connected external device.

The memory 170 may store a plurality of application programs or applications running on the mobile terminal 100, data for operation of the mobile terminal 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. At least some of these application programs may exist on the mobile terminal 100 from the time of shipment for the basic functions of the mobile terminal 100 (e.g., call incoming, outgoing, message reception, and origination functions) . Meanwhile, the application program may be stored in the memory 170, installed on the mobile terminal 100, and may be operated by the control unit 180 to perform the operation (or function) of the mobile terminal.

In addition to the operations related to the application program, the control unit 180 typically controls the overall operation of the mobile terminal 100. The control unit 180 may process or process signals, data, information, and the like input or output through the above-mentioned components, or may drive an application program stored in the memory 170 to provide or process appropriate information or functions to the user.

In addition, the controller 180 may control at least some of the components illustrated in FIG. 4 in order to drive an application program stored in the memory 170. FIG. In addition, the controller 180 may operate at least two of the components included in the mobile terminal 100 in combination with each other for driving the application program.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power to the components included in the mobile terminal 100. The power supply unit 190 includes a battery, which may be an internal battery or a replaceable battery.

At least some of the components may operate in cooperation with one another to implement a method of operation, control, or control of a mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170. [

Hereinafter, the components listed above will be described in more detail with reference to FIG. 4 before explaining various embodiments implemented through the mobile terminal 100 as described above.

First, referring to the wireless communication unit 110, the broadcast receiving module 111 of the wireless communication unit 110 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The mobile communication module 112 may be a mobile communication module or a mobile communication module such as a mobile communication module or a mobile communication module that uses technology standards or a communication method (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution And an external terminal, or a server on a mobile communication network established according to a long term evolution (AR), a long term evolution (AR), or the like.

The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive a wireless signal in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) 113 transmit and receive data according to at least one wireless Internet technology, including Internet technologies not listed above.

The wireless Internet module 113 for performing a wireless Internet connection through the mobile communication network can be used for wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE or LTE- May be understood as a kind of the mobile communication module 112.

The short-range communication module 114 is for short-range communication, and includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB) (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short-range communication module 114 is connected to the mobile terminal 100 and the wireless communication system through the wireless area networks, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 ) And the other mobile terminal 100 (or the external server). The short-range wireless communication network may be a short-range wireless personal area network. In particular, the mobile terminal 100 may determine its location through communication with the reference devices 30 using the short-range communication module 114. [

Here, the other mobile terminal 100 may be a wearable device (e.g., a smartwatch, a smart glass, etc.) capable of interchanging data with the mobile terminal 100 according to the present invention (smart glass), HMD (head mounted display)). The short range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 around the mobile terminal 100. [ If the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the control unit 180 may transmit at least a part of the data processed by the mobile terminal 100 to the short- 114 to the wearable device. Therefore, the user of the wearable device can use the data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a telephone is received in the mobile terminal 100, the user performs a telephone conversation via the wearable device, or when a message is received in the mobile terminal 100, It is possible to check the message.

The position information module 115 is a module for obtaining the position (or current position) of the mobile terminal, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, it can acquire the position of the mobile terminal by using a signal transmitted from the GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, it can acquire the position of the mobile terminal based on information of a wireless access point (AP) that transmits or receives the wireless signal with the Wi-Fi module. Optionally, the location information module 115 may perform any of the other functions of the wireless communication unit 110 to obtain data relating to the location of the mobile terminal, in addition or alternatively. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

The input unit 120 is for inputting image information (or a signal), audio information (or a signal), or information input from a user. The input unit 120 may input image information The mobile terminal 100 may include one or a plurality of cameras 121. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [ A plurality of cameras 121 provided in the mobile terminal 100 may be arranged to have a matrix structure and various angles or foci may be provided to the mobile terminal 100 through the camera 121 having the matrix structure A plurality of pieces of image information can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or a running application program) being executed in the mobile terminal 100. Meanwhile, the microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The user input unit 123 is for receiving information from a user and when the information is inputted through the user input unit 123, the control unit 180 can control the operation of the mobile terminal 100 to correspond to the input information . The user input unit 123 may include a mechanical input means (or a mechanical key such as a button located on the front, rear or side of the mobile terminal 100, a dome switch, a jog wheel, Jog switches, etc.) and touch-type input means. For example, the touch-type input means may comprise a virtual key, a soft key or a visual key displayed on the touch screen through software processing, And a touch key disposed on the touch panel. Meanwhile, the virtual key or the visual key can be displayed on a touch screen having various forms, for example, a graphic, a text, an icon, a video, As shown in FIG.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a corresponding sensing signal. The control unit 180 may control the driving or operation of the mobile terminal 100 or may perform data processing, function or operation related to the application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface, or the presence of an object in the vicinity of the detection surface, without mechanical contact by using electromagnetic force or infrared rays. The proximity sensor 141 may be disposed in the inner area of the mobile terminal or in proximity to the touch screen, which is covered by the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is electrostatic, the proximity sensor 141 can be configured to detect the proximity of the object with a change of the electric field along the proximity of the object having conductivity. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the act of recognizing that the object is located on the touch screen in proximity with no object touching the touch screen is referred to as "proximity touch & The act of actually touching an object on the screen is called a "contact touch. &Quot; The position at which the object is closely touched on the touch screen means a position where the object corresponds to the touch screen vertically when the object is touched. The proximity sensor 141 can detect a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, have. Meanwhile, the control unit 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further provides visual information corresponding to the processed data It can be output on the touch screen. Furthermore, the control unit 180 can control the mobile terminal 100 such that different operations or data (or information) are processed according to whether the touch to the same point on the touch screen is a proximity touch or a touch touch .

The touch sensor senses a touch (or touch input) applied to the touch screen (or the display unit 151) by using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, do.

For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the touch screen or a capacitance generated in a specific portion to an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, a capacitance at the time of touch, and the like where a touch object touching the touch screen is touched on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like. Here, the touch controller may be a separate component from the control unit 180, and may be the control unit 180 itself.

On the other hand, the control unit 180 may perform different controls or perform the same control according to the type of the touch object, which touches the touch screen (or a touch key provided on the touch screen). Depending on the kind of the touch target object, whether to perform different controls or to perform the same control may be determined according to the current operating state of the mobile terminal 100 or an application program being executed.

On the other hand, the touch sensors and the proximity sensors discussed above can be used independently or in combination to provide a short touch (touch), a long touch, a multi touch, a drag touch ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, and the like. Touch can be sensed.

The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. Meanwhile, the controller 180 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera 121 includes at least one of a camera sensor (for example, a CCD, a CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to sense a touch of the sensing object with respect to the three-dimensional stereoscopic image. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

In addition, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image. In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system) can be applied.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 153 may be vibration. The intensity and pattern of the vibration generated in the haptic module 153 can be controlled by the user's selection or setting of the control unit. For example, the haptic module 153 may synthesize and output different vibrations or sequentially output the vibrations.

In addition to the vibration, the haptic module 153 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 153 can transmit the tactile effect through the direct contact, and the tactile effect can be felt by the user through the muscles of the finger or arm. The haptic module 153 may include two or more haptic modules 153 according to the configuration of the mobile terminal 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the mobile terminal 100. Examples of events that occur in the mobile terminal 100 may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output from the light output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors to the front or rear surface. The signal output may be terminated by the mobile terminal detecting the event confirmation of the user.

The interface unit 160 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 160 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data in the mobile terminal 100 to an external device. For example, a port for connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, an audio I / O port, a video I / O port, an earphone port, and the like may be included in the interface unit 160.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM) A universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the interface unit 160. [

The interface unit 160 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, And various command signals may be transmitted to the mobile terminal 100. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 170 may store data related to vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 170 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read memory, a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs the storage function of the memory 170 on the Internet.

Meanwhile, as described above, the control unit 180 controls the operations related to the application program and the general operation of the mobile terminal 100. [ For example, when the state of the mobile terminal meets a set condition, the control unit 180 can execute or release a lock state for restricting input of a user's control command to applications.

In addition, the control unit 180 performs control and processing related to voice communication, data communication, video call, or the like, or performs pattern recognition processing to recognize handwriting input or drawing input performed on the touch screen as characters and images, respectively . Further, the controller 180 may control any one or a plurality of the above-described components in order to implement various embodiments described below on the mobile terminal 100 according to the present invention.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 includes a battery, the battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of an interface 160 through which an external charger for supplying power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 may use at least one of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission apparatus and a magnetic resonance coupling method based on an electromagnetic resonance phenomenon Power can be delivered.

5 is a diagram showing an example of a reference device 30 related to the present invention.

As shown in FIG. 5, the reference device 30 of the present invention includes a communication unit 31 and a control unit 38. It should be appreciated that the components shown in FIG. 5 are essential for implementing the present invention, and that the reference device 30 described herein may have more components than those listed above. In addition, the reference device 30 of the present invention may be configured to be coupled to a device such as a lighting device, a fire detector device, a household appliance device, or the like.

The communication unit 31 includes a short-range communication module. The short-range communication module is for short-range communication. The short-range communication module includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA) Can utilize at least one of UWB (Ultra Wideband), ZigBee, Near Field Communication (NFC), Wireless-Fidelity (WiFi), Wi-Fi Direct and Wireless USB have. The short-range communication module is provided between the reference device 30 and the mobile terminal 10 through the wireless area networks, between the reference device 30 and the electronic device 50, between the reference devices 30, Or a wireless communication between the reference device 30 and the network where the server 70 is located.

The control unit 38 controls communication between the communication unit 31 and the mobile terminal 10 and between the communication unit 31 and the electronic device 50 and between the communication unit 31 and the server 70. [

6 is a diagram showing an example of an electronic device 50 related to the present invention.

As shown in Fig. 6, the electronic device 50 of the present invention includes a communication unit 51 and a control unit 58. Fig. It is apparent that the components shown in FIG. 6 are essential for implementing the present invention, and that the electronic device 50 described in this specification can have more components than those listed above.

The communication unit 51 may include at least one of a local area communication module, a wired communication module, and a location information module.

The short-range communication module is for short range communication, and includes Bluetooth (registered trademark), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Communication, Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short-range communication module is a module for connecting between the electronic device 50 and the reference devices 30, between the electronic device 50 and the mobile terminal 10, or between the electronic device 50 and the mobile terminal 10 via the wireless area networks. And the network where the server 70 is located. The short-range wireless communication network may be a short-range wireless personal area network. In particular, the electronic device 50 can determine its position through communication with the reference devices 30 using the short-range communication module.

The position information module is a module for obtaining the position (or current position) of the electronic device 50, and representative examples thereof include a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the electronic device 50 utilizes a GPS module, it can acquire the position of the electronic device 50 using a signal transmitted from the GPS satellite. As another example, when the electronic device 50 utilizes the Wi-Fi module, based on the information of the wireless AP (wireless access point) transmitting or receiving the wireless signal with the Wi-Fi module, Can be obtained. Optionally, the location information module may replace or additionally perform any one of the other modules of the communication unit 51 to obtain data regarding the location of the electronic device.

The control unit 58 typically controls the overall operation of the electronic device 50. The control unit 58 may control the communication unit 51 to process input or output signals, data, information, or the like, or to communicate with the mobile terminal 10 or the reference devices 30. [

The control unit 58 compares the position information of the electronic device 50 provided by the mobile terminal 10 or the server 70 with the position of the electronic device 50 measured by the mobile device 10 or the server 70, And may respond to the terminal 10 or the server 70.

Hereinafter, embodiments related to a control method that can be implemented in a control system configured as above will be described with reference to the accompanying drawings. It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

Figs. 7 to 9 are diagrams for explaining a method of registering one or more electronic devices 50 and generating a map of the electronic device 50. Fig.

7, in a state where the mobile terminal 10 executes a remote control application used to register the position of the electronic device 50 and to control the electronic device 50, The mobile terminal 10 is moved to the vicinity of the electronic device 50 located in the room by a distance smaller than a predetermined maximum allowable distance between the mobile terminal 10 and the electronic device 50 It is desirable to approach. 8, the control unit 18 controls the maximum allowable distance between the mobile terminal 10 and the electronic device 50. The predetermined maximum allowable distance between the mobile terminal 10 and the electronic device 50 may be set / changed by the user. A user interface for setting / changing the distance can be provided.

It is preferable that at least one of the azimuth, tilt, and elevation of the mobile terminal 10 is controlled so that the mobile terminal 10 faces the electronic device 50 to be registered. As shown in FIG. 8, It is also possible that the upper end of the mobile terminal 10 faces the electronic device 50 or another part of the mobile terminal 10 faces the electronic device 50. [

When the mobile terminal 10 approaches the electronic device 50, the control unit 18 displays on the display unit 15 a list indicating previously registered electronic devices and other electronic devices capable of communication / control . At this time, the electronic devices can be recognized by the mobile terminal 10 and displayed on the list through PIN number, NFC, QR code, Received Signal Indication Proximity, or the like.

When the user selects any one of the electronic devices included in the list, the control unit 18 determines the position of the mobile terminal 10 through the short-range wireless communication between the reference devices 30 and the communication unit 11 And the sensing unit 14 senses the direction of the mobile terminal 10 toward the electronic device 50 and measures the distance between the mobile terminal 10 and the electronic device 50. [ Here, in order to measure the position of the mobile terminal 10 by the triangulation method, the controller 18 calculates the distance between the at least three reference devices 30, the speed and the frequency value of the radio wave for short- The distance between the devices 30 and the mobile terminal 10 can be measured and the position of the mobile terminal 10 can be measured using these values. It is also possible to measure the position of the mobile terminal 10 using another triangulation method. There are various methods for measuring the distance between the mobile terminal 10 and the electronic device 50. For example, the distance between the mobile terminal 10 and the electronic device 50 may be measured by using an ultrasonic sensor included in the sensing unit 14, (50) can be measured.

The control unit 18 measures the actual position of the electronic device 50 using the position and direction of the mobile terminal 10 and the distance between the mobile terminal 10 and the electronic device 50. [ Since the direction of the mobile terminal 10 toward the electronic device 50 at the current position of the mobile terminal 10 and the distance between the mobile terminal 10 and the electronic device 50 are measured as described above, It is possible to measure the position of the device 50 in a three-dimensional position. In other words, the position of the electronic device 50 can be expressed by coordinates (coordinates on a two-dimensional plane) and height (high and low) in the room. Instead of the mobile terminal 10, the server 70 may measure the actual position of the electronic device 50 using the position and orientation of the mobile terminal 10 and the distance between the mobile terminal 10 and the electronic device 50 It is also possible to do.

The control unit 18 generates position information of the electronic device 50 and transmits identification information (ID and the like) of the electronic device 50 to the memory 17 or the server 70 together with the generated position information . The location information and the identification information of the electronic device 50 transmitted in this manner are transmitted to the memory 17 or the server 70.

9, the above process is repeatedly performed to transmit and store the location information and the identification information for each electronic device in the room to the memory 17 or the server 70, and the control unit 18 or the server 70, Can generate the electronic device control map using the stored location information and the identification information.

7 to 9 illustrate the indoor electronic device 50 registration method, but outdoor electronic devices can also be registered in the same manner.

10 and 11 are views for explaining an example of a control method of a control system according to the present invention.

11, in a state where the mobile terminal 10, the plurality of reference devices 30, and the electronic device 50 are indoors and the remote control application included in the mobile terminal 10 is executed, If the direction of the mobile terminal 10 is adjusted so as to face the electronic device 50 desired by the user or a touch input (drag or flicking) is inputted to the display unit 15, the control unit 18 controls the mobile terminal 10 It is determined whether or not the direction indicated by the touch input coincides with the position of the electronic device 50 registered in the map. The control unit 18 determines the current position of the mobile terminal 10 through wireless communication with the reference devices 30 and determines the direction of the mobile terminal 10 or the touch input at the current position of the mobile terminal 10 It is determined whether or not the direction indicated by the mobile terminal 10 or the touch input coincides with the position of the registered electronic device 50. On the other hand, when the map is stored in the server 70, the server 70 determines whether or not the direction indicated by the mobile terminal 10 or the touch input matches the position of the registered electronic device 50 in place of the mobile terminal 10 It can be judged.

If the direction indicated by the mobile terminal 10 or the touch input coincides with the registered position of the electronic device 50, the control unit 18 selects the electronic device 50 and controls the electronic device 50 And displays the user interface for the user on the display unit 15. For example, if the electronic device 50 selected as shown in FIG. 11 is a creative, the control unit 18 may display a user interface for controlling a channel or a volume of the television on the display unit 15. [ The control unit 18 outputs a command for controlling the electronic device 50 according to a user's request and directly controls the electronic device 50 or controls the server 70 in accordance with a command of the mobile terminal 10. [ The electronic device 50 may be controlled by the control unit 50. [

10 and 11 illustrate the control method of the electronic device 50 in the room, however, if the reference devices 30 and the electronic device 50 are located outdoors, the outdoor electronic device can be controlled in the same manner.

12 to 14 are diagrams for explaining another example of the control method of the control system according to the present invention.

12, when the mobile terminal 10, the plurality of reference devices 30, the one or more electronic devices 50 are in the room and the remote control application included in the mobile terminal 10 is executed, The control unit 18 adjusts the direction of the mobile terminal 10 so that the user faces the desired electronic device 50 or inputs a touch input (drag or flicking) to the display unit 15 as shown in FIG. 14, It is determined whether the electronic device 50 that matches the direction indicated by the terminal 10 or the touch input is registered in the map. The control unit 18 determines the current position of the mobile terminal 10 through wireless communication with the reference devices 30 and determines the direction of the mobile terminal 10 or the touch input at the current position of the mobile terminal 10 It is confirmed whether the electronic device 50 located on the virtual straight line coinciding with the direction indicated by the mobile terminal 10 or the touch input is registered. Here, when the map is stored in the server 70, the server 70 can determine whether or not the electronic device 50 located on a virtual straight line is registered instead of the mobile terminal 10. In this case, the server 70 can transmit the identification information of the electronic device located on the imaginary straight line to the mobile terminal 10. [

In addition, the length of the virtual straight line can be changed / set by the user. For this, the controller 18 can provide a user interface for setting the length of the virtual straight line.

If at least one registered electronic device 50 is located on a virtual straight line, the control unit 18 displays a list of the electronic devices 50 on the display unit 15 as shown in FIG. In this case, the list may include identification information (ID) of the electronic device 50. The control unit 18 sequentially displays the identification information according to the distance between the mobile terminal 10 and the electronic device 50, (15).

Then, when the user selects any one of the electronic devices using the identification information included in the list, the control unit 18 displays a user interface for controlling the selected electronic device 50 on the display unit 15 can do. For example, if the electronic device 50 selected as shown in FIG. 13 is active, the control unit 18 may display a user interface for controlling the channel or volume of the television on the display unit 15. The control unit 18 outputs a command for controlling the electronic device 50 according to a user's request and directly controls the electronic device 50 or controls the server 70 in accordance with a command of the mobile terminal 10. [ The electronic device 50 may be controlled by the control unit 50. [

12 to 14 illustrate a method of controlling the electronic device 50 in the room. However, if the reference devices 30 and the electronic device 50 are located outdoors, the outdoor electronic device can be controlled in the same manner.

15 to 17 are diagrams for explaining another example of the control method of the control system according to the present invention.

15, in a state where the mobile terminal 10, the plurality of reference devices 30, the one or more electronic devices 50 are in the room and the remote control application included in the mobile terminal 10 is executed, And it is possible to scan the controllable electronic device 50 while changing the direction of the mobile terminal 10 as shown in Fig. Here, the width of the scan beam in FIG. 15 may be changed / set for the user. For this purpose, the controller 18 may provide a user interface for changing / setting the width of the scan beam. The scan beam may be set not only in a radial form but also in a cylindrical form, or may be set in other forms.

Next, the control unit 18 determines whether the electronic device 50 that matches the direction of the scan beam is registered in the map. The control unit 18 determines the current position of the mobile terminal 10 through wireless communication with the reference devices 30 and determines the direction and the range of the scan beam at the current position of the mobile terminal 10, It is confirmed whether the electronic device 50 located within the range of the beam is registered. If at least one registered electronic device 50 is located within the range of the scan beam, the control unit 18 displays a list of the electronic devices 50 on the display unit 15. [ In this case, the list may include identification information (ID) of the electronic device 50. The control unit 18 sequentially displays the identification information according to the distance between the mobile terminal 10 and the electronic device 50, (15).

Then, when the user selects any one of the electronic devices using the identification information included in the list, the control unit 18 displays a user interface for controlling the selected electronic device 50 on the display unit 15 can do. For example, if the selected electronic device 50 is a creative, the control unit 18 can display a user interface for controlling the channel or volume of the television on the display unit 15. [ The control unit 18 outputs a command for controlling the electronic device 50 according to a user's request and directly controls the electronic device 50 or controls the server 70 in accordance with a command of the mobile terminal 10. [ The electronic device 50 may be controlled by the control unit 50. [

15 to 17 illustrate a method of controlling the indoor electronic device 50. However, if the reference devices 30 and the electronic device 50 are located outdoors, the outdoor electronic device can be controlled in the same manner.

18 is a view for explaining another example of the control method of the control system according to the present invention.

As shown in FIG. 18, the control system includes a mobile terminal 10, a plurality of reference devices 30, one or more electronic devices 50, and a DLNA source (Digital Living Network Alliance Source) in a room. Here, the mobile terminal 10 may be used as a DLNA control device, and the electronic device 50 may be used as a DMR (Digital Media Renderer). The DLNA source is a network technology standard for media transmission and control between terminals in the home. It uses Internet protocols such as HTTP, RTP / RSTP, etc. to share contents such as images, music and videos under WiFi, Ethernet and Bluetooth network environment. It provides a protocol that can be used. The DLNA source may comprise a data storage device that connects to the network, such as a NAS (Network Attached Storage) or a DMS (Digital Media Server).

7 to 9, the control unit 18 may register the electronic devices 50 as a DMR or a DMS, and may control the DMR and the DMS using any one of the control methods of FIGS. have.

19 and 20 are diagrams for explaining another example of the control method of the control system according to the present invention.

20, in the state where the mobile terminal 10, the plurality of reference devices 30, and the electronic device 50 are indoors and the remote control application included in the mobile terminal 10 is executed, The controller 18 adjusts the direction of the mobile terminal 10 or inputs the touch input (drag or flicking) to the display unit 15 so that the user faces the desired electronic device 50, From the memory (170) or the server (70) or measures the current position of the electronic device (50). The controller 18 uses the position and the direction of the mobile terminal 10 and the distance between the mobile terminal 10 and the electronic device 50 to measure the current position of the corresponding electronic device 50. [

The control unit 18 generates position information using the registered position or the measured current position of the electronic device 50 and transmits the generated position information to the corresponding electronic device 50. At this time, the control unit 18 can transmit the identification information of the electronic device 50 together with the position information.

Then, the electronic device 50 compares the position information transmitted from the control unit 18 with the measured position of the user through the wireless communication between the reference devices 30, and transmits the comparison result to the mobile terminal 10 Reply. Here, since the electronic device 50 has the IPS function, it is possible to measure its position through communication with the reference devices 30.

If the transmitted location information and the measured location are the same, the electronic device 50 responds to the mobile terminal 10 and executes a pairing procedure so that it can be controlled by the mobile terminal 10. On the other hand, if the transmitted location information differs from the measured location, the electronic device 50 does not respond to the mobile terminal 10.

21 is a view for explaining another example of the control method of the control system according to the present invention.

The control unit 18 can register a specific position in the indoor space and designate at least one of functions and applications of the electronic device 50 or the mobile terminal 10 in this specific position in the same manner as in Figs. have. The functions of the electronic device 50 or the mobile terminal 10 designated by the position of the indoor space can be registered in the map stored in the memory 17 or the server 70. [ For example, as shown in FIG. 21, a specific position around the TV may be designated as a movie mode execution position, or a sleep mode may be designated at a specific position around the illumination. In addition, a specific application (e.g., a calendar application) of the mobile terminal 10 may be designated to a calendar in the room. Here, the size of the specific location registered in the map can be changed / set by the user. For this, the controller 18 can provide a user interface for changing / setting the size of the designated specific location.

When the user directs the direction of the mobile terminal 10 toward the specific position of the indoor space or inputs a touch input (drag or flicking) to the display unit 15, the control unit 18 controls the mobile terminal 10 or And executes at least one of functions and applications of the electronic device 50 or the mobile terminal 10 specified at a specific location indicated by the touch input. Here, the controller 18 measures the current position of the mobile terminal 10 in the above-described manner to determine the specific position indicated by the mobile terminal 10 or the touch input, Determines the direction of the terminal 10 or the touch input, and then determines the specific position indicated by the mobile terminal 10 or the touch input.

If the mobile terminal 10 or the touch input is directed to a specific position around the TV, the control unit 18 can control the television to execute the movie mode. In addition, if the mobile terminal 10 or the touch input is pointing to a calendar in the room, the control unit 18 may execute the calendar application of the mobile terminal 10. [

22 is a view for explaining another example of the control method of the control system according to the present invention.

As shown in FIG. 22, the control system includes a mobile terminal 10, a plurality of reference devices 30, and one or more electronic devices 50 in the room. Here, the mobile terminal 10 may have a function of miracast that is connected to an electronic device based on Wifi-Direct. In addition, the electronic device 50 may have an IPS function. In this case, the mobile terminal 10 and the electronic device 50 can perform P2P pairing.

23 is a view for explaining another example of the control method of the control system according to the present invention.

The control unit 18 can register a specific position in a room in the same manner as in FIGS. 7 to 9 and designate an item frequently lost by the user at the specific position. For example, as shown in FIG. 23, after the position of the frequently lost object 53 is measured, it can be registered in the map stored in the memory 17 or the server 70.

Thereafter, when the frequently-lost object 53 is input to the mobile terminal 10, the control unit 18 informs the user of the specific position designated by the object 53. [

24 is a view for explaining another example of the control method of the control system according to the present invention.

The control unit 18 can register the position of each article in the shop in the same manner as in FIGS. The positions of the articles and the information about the articles can be registered in the map stored in the memory 17 or the server 70. [ Here, the information on the article includes information such as an article name, a price, a manufacturer, a manufacturing date, a sale / inventory quantity, and the like.

Thereafter, when the user adjusts the direction of the mobile terminal 10 so as to face the position of the article, the controller 18 displays information on the article on the display unit 15. In addition, it is also possible to display information on a plurality of articles at the same time by setting the scan beam of the mobile terminal 10 to be wide.

25 and 26 are diagrams for explaining a method of registering a position of a specific area in a room and generating a map relating to the specific area.

First, in a state where the application used to register the position of a specific area (e.g., the first and second areas) and to control the mobile terminal 10 is executed on the mobile terminal 10, (For example, a host or a manager) moves the mobile terminal 10 to a specific area located in the room (for example, a conference room). Here, the user may designate a desired area in the space as a specific area and approach the mobile terminal 10 to a distance smaller than a predetermined maximum allowable distance between the mobile terminal 10 and the specific area. 26, the control unit 18 sets the maximum allowable distance between the mobile terminal 10 and the specific area by the user. For this purpose, the controller 18 sets the maximum allowable distance on the display unit 15 / Offset < / RTI > In addition, the control unit 18 can set a virtual NFC tag in a specific area, designate a desired data or message in an NFC tag, and can change / set the size of a specific area according to a user's request. For this, the controller 18 may provide a user interface for setting a Tag and a user interface for changing / setting a size of a specific area.

At least one of the azimuth, inclination and height of the mobile terminal 10 is preferably adjusted so that the mobile terminal 10 faces a specific area to be registered. When the top of the mobile terminal 10 faces a specific area Or another part of the mobile terminal 10 may be directed to a specific area.

The control unit 18 measures the position of the mobile terminal 10 through the short distance wireless communication between the reference devices 30 and the communication unit 11 and measures the position of the mobile terminal 10 toward the specific area using the sensing unit 14. [ (10) and measures the distance between the mobile terminal (10) and a specific area. Here, in order to measure the position of the mobile terminal 10 by the triangulation method, the controller 18 calculates the distance between the at least three reference devices 30, the speed and the frequency value of the radio wave for short- The distance between the devices 30 and the mobile terminal 10 can be measured and the position of the mobile terminal 10 can be measured using these values. It is also possible to measure the position of the mobile terminal 10 using another triangulation method. For example, the distance between the mobile terminal 10 and a specific region may be measured using an ultrasonic sensor included in the sensing unit 14, Can be measured.

Next, the controller 18 measures the position and direction of the mobile terminal 10 and the actual position of the specific region using the distance between the mobile terminal 10 and the specific region. Since the distance between the mobile terminal 10 and the specific area is measured in the direction of the mobile terminal 10 toward the specific area at the current position of the mobile terminal 10, the controller 18 determines the position of the specific area in three dimensions It is possible to measure by position. That is, the position of a specific region can be expressed by coordinates (coordinates on a two-dimensional plane) and a height (high and low) in a room. It is also possible for the server 70 to measure the actual position of the specific region by using the position and direction of the mobile terminal 10 and the distance between the mobile terminal 10 and the specific region instead of the mobile terminal 10.

Then, the control unit 18 generates positional information of the specific area, and transmits identification information (ID, etc.) of the specific area to the memory 17 or the server 70 together with the generated positional information. The location information and the identification information of the specific area thus transmitted are transmitted to the memory 17 or the server 70.

This process is repeated to transmit and store the location information and the identification information for each specific area (the first and second areas) in the room to the memory 17 or the server 70, and the control unit 18 or the server 70 May generate a map for a specific area using the stored location information and the identification information.

FIGS. 27 and 28 are diagrams for explaining an example of a system control method using the registered specific areas of FIGS. 25 and 26. FIG.

27, when the mobile terminal 10 of another user (for example, a guest) moves to the first area or passes through the first area, the mobile terminal 10 of the guest moves to the reference devices 30, And transmits position information indicating the measured position to the mobile terminal 10 or the server 70 of the host.

Then, the mobile terminal 10 or the server 70 of the host determines whether the mobile terminal 10 of the guest has moved to the second area based on the transmitted location information. If the mobile terminal 10 of the guest has not moved to the second area, the mobile terminal 10 or the server 70 of the host can determine the distance or proximity between the mobile terminal 10 and the second area of the guest ) Of the guest, and information for guiding the direction or route of the guest from the mobile terminal 10 to the second area.

When the mobile terminal 10 of the guest moves to the second area, the mobile terminal 10 or the server 70 of the host transmits data or a message specified in the virtual NFC tag of the second area, for example, The guest terminal 10 can control the guest's mobile terminal 10 to transmit data or a message asking the user to the mobile terminal 10 of the guest and display the transmitted data or message on the mobile terminal 10 of the guest. Here, the mobile terminal 10 or the server 70 of the host can store data or messages designated in each specific area.

Then, if the guest indicates the presence or absence by pressing the "Enter" button of his / her mobile terminal 10, the mobile terminal 10 or the server 70 of the host can determine whether or not the guest is present. As described above, by using the system shown in FIG. 27 to FIG. 28, it is possible to automatically confirm whether or not a guest is present and to perform an unattended guidance.

29, two additional embodiments will be described later. First, if the mobile terminal to be controlled is a legacy device, a protocol for registering the legacy device in advance will be defined in detail.

Second, the process of automatically changing the communication means of the mobile terminal and switching to the device-related graphic image to be controlled is controlled in detail to control the mobile terminal to be controlled according to the pointing direction of the mobile terminal I will.

According to the related art, there is an inconvenience that a user controlled by a conventional remote controller such as Infrared or RF has to select and control the device with a plurality of devices.

According to an embodiment of the present invention to be described later, a legacy device controlled by a conventional remote controller such as Infrared or RF is referred to as an Indoor Positioning System (IPS) A mobile terminal equipped with a 6-axis, 9-axis sensor (ex: a 3-axis acceleration sensor, a 3-axis gyroscope sensor and a 3-axis geomagnetic sensor as the case may be) is used for a user such as pointing or flicking There is a technical effect that an intuitive device selection method can be provided.

That is, a smart device that can be connected to at least one network of a zigbee, a wifi, a bluetooth, and a z-wave, as well as a legacy device controlled by Infrared or RF legacy devices can also be controlled.

29 schematically illustrates components of a mobile terminal according to an embodiment of the present invention. With reference to the previous figures, those skilled in the art can supplement Fig. Further, it is within the scope of the present invention to delete, change, or add other modules as shown in FIG. Furthermore, the mobile terminal described in the present specification may be implemented not only by a conventional mobile phone, tablet PC, but also by a separate IPS controller.

29, the mobile terminal 2900 according to an exemplary embodiment of the present invention includes a communication module 2910, a display module 2920, an interface module 2930, a controller 2940, a memory 2950, A sensing module 2960, and the like.

The communication module 2910 is designed to initiate a communication connection with a number of reference devices for location services. The reference device corresponds to a node of an anchor or a known position used in, for example, an Indoor Positioning System. That is, the reference device may determine the location of the mobile terminal or another device through communication with the mobile terminal, and may provide the mobile terminal with location information of the mobile terminal or another device.

The display module 2920 displays a device list to be controlled, and the interface module 2930 is designed to select a specific device among the devices displayed in the list. The controller 2940 outputs a graphic image for controlling the corresponding first device according to the position and direction of the mobile terminal 2900.

According to another embodiment of the present invention, the memory 2950 stores the location information of the selected specific device, and the sensing module 2960 stores at least one of the location or direction of the mobile terminal 2900 Lt; / RTI >

According to another embodiment of the present invention, when at least one of the position or the direction of the mobile terminal 2900 is detected as being changed by the sensing module 2960, Controls the display module 2920 to stop outputting the graphic image for control of the first device and output a graphic image for control of the second device corresponding to the changed position or direction. With reference to FIG. 39 to FIG. 42, a detailed description will be given later.

29, a mobile terminal 2900 according to another embodiment of the present invention may be configured such that, when a specific area of a graphic image for controlling the first device is selected, And a second transmission module for transmitting a second wireless signal to the second device when a specific area of the graphic image for controlling the second device is selected. The first wireless signal and the second wireless signal are based on different communication methods. For example, the first wireless signal is based on an IR infrared signal, and the second wireless signal is based on an RF infrared signal.

According to yet another embodiment of the present invention, the controller 2940 outputs an option for selecting another device not displayed in the list, and the memory 2950 stores the information necessary for controlling the other device And is designed to download additional information. Further, the controller 2940 is designed to calculate the distance between the mobile terminal and the selected specific device, and calculate the location information of the selected specific device based on the position information of the mobile terminal and the calculated distance do.

According to another embodiment of the present invention, the memory 2950 may connect the identification of the selected specific device, the position information of the selected specific device, and the allowable distance to control the specific device All are saved.

30 shows a system including a mobile terminal and a legacy device according to an embodiment of the present invention.

As shown in FIG. 30, the mobile terminal 3000 according to an embodiment of the present invention is connected to the reference device 3010 through IPS communication. As the IPS communication, UWB, Wi-Fi, Bluetooth and the like can be used. Accordingly, the mobile terminal 3000 can perform position calculation through IPS communication with the reference device 3010, and calculate positional information of the legacy device 3020. 35, the mobile terminal points to the legacy device, It is possible to estimate the position. This is because the mobile terminal 3000 can determine its position through communication with the reference device 3010. [ Therefore, the legacy device 3020 does not need to have a separate communication function, and a device which can be controlled by an IR infrared signal is sufficient.

FIG. 31 illustrates a system including a mobile terminal, a legacy device, and a smart device according to an embodiment of the present invention. Fig. 31 assumes a system with smart device 3140 added, unlike before in Fig. The smart device 3140 may not include the IPS function. Of course, as shown in FIG. 31, when the smart device 3140 includes the IPS function, it can determine its position through the IPS communication connection with the reference device 3110.

30, the mobile terminal 3100 can determine its position through communication with the reference device 3110, and further calculate the position of the legacy device 3120. [

It is also a feature of the present invention that the server 3130 stores location information of the mobile terminal 3100 and location information of the legacy device 3120. The server 3130 can be implemented as a reference device of a home gateway, a cloud server, or an IPS, for example.

FIG. 32 illustrates in detail components of a mobile terminal according to an embodiment of the present invention. Fig. 32 shows the mobile terminal shown in Fig. 29 in more detail.

32, a mobile terminal 3200 according to an embodiment of the present invention includes an application 3210, a user interface 3220, an IPS 3230, a motion sensor 3240, a device management 3250, Object management 3260, legacy control 3270, and smart device control 3280, among others. Each of the modules shown in Fig. 32 can be designed by hardware or software.

The application 3210 refers to computer software designed to control each module or to execute a specific task (TASK). The user interface 3220 can be configured with a touch module or the like that receives a command from a user.

The IPS 3230 performs communication with a reference device (IPS anchor device) through communication means such as UWB, Bluetooth, WiFi, and so on, and thereby performs a function of determining its own position. The motion sensor 3240 uses a six-axis sensor or a nine-axis sensor to determine the angle of the mobile terminal 3200 from the ground, the pointing direction, and the like. For example, a geomagnetic sensor, a gravity sensor, a gyroscope sensor, an acceleration sensor, and an altitude sensor are adopted.

The device management 3250 stores commands necessary for controlling a controllable indoor device. The indoor device corresponds to, for example, a TV, an air conditioner, a lamp, or the like.

The object management 3260 stores commands necessary to control a sleep mode, a movie mode, a calendar mode, and the like. For example, when the mobile terminal according to the embodiment of the present invention is pointing in a certain direction in a state where a virtual object is set to the sleep mode, the lamp and the TV are automatically designed to be turned off. That is, the virtual object refers to a case where the mobile terminal is pointed in a specific direction at a specific position rather than an actual device.

The legacy control 3270 has communication means for controlling the legacy device. For example, if the legacy device is IR controlled, the legacy control 3270 sends an IR signal to the legacy device. On the other hand, when the legacy device is controlled by RF, the legacy control 3270 transmits an RF signal to the legacy device.

The smart device control 3280 includes communication means for controlling a smart device, not a legacy device. For example, if the smart device is controlled by Wi-Fi, the smart device control 3280 transmits a Wi-Fi signal to the smart device. Meanwhile, when the smart device is controlled by Bluetooth, the smart device control 3280 transmits the Bluetooth signal to the corresponding smart device.

33 is a flowchart showing an operation procedure between a mobile terminal and a server according to an embodiment of the present invention. Hereinafter, with reference to FIG. 38, a process of registering information on the legacy device in advance to control the legacy device to be controlled based on the position using the mobile terminal will be described.

First, the mobile terminal executes a location-based application (S3310). The function of step S3310 may be designed to be performed by the application 3210 of FIG.

The mobile terminal moves to the vicinity of the legacy device to be registered (S3320). The registration is a preliminary procedure for controlling the legacy device with the mobile terminal.

The mobile terminal displays a list identifying at least one legacy device stored in the memory or communicating with an external server, and determines whether the legacy device is present in the list (S3330).

If the determination result (S3330) does not exist, the mobile terminal requests the information about the legacy device to the server, and the server transmits the software for the legacy device (S3335). The software is used to control the legacy device. Of course, instead of the server, a smart phone, a PC, a cloud, a storage device, or the like may be adopted.

If the determination result (S3330) is present, the distance between the mobile terminal and the legacy device is set and registered using the mobile terminal (S3340). However, if the mobile terminal includes a distance measurement module such as an ultrasonic sensor, a Time Of Flight (TOF) / Time Of Arrival (TOA) sensor, and a camera, it is also possible to omit step S3340, .

Since the mobile terminal knows its location through communication with the reference device, the mobile terminal calculates the location of the legacy device using its location information and the set distance information (S3350). That is, it can be calculated using the position information of the mobile terminal, the geomagnetism, the gyroscope, the gravity, the acceleration, the data measured by the altitude sensor, and the separation distance between the mobile terminal and the control target legacy device. Furthermore, by using the data measured by the above-described sensors, positional information of a legacy device located in a vertical direction such as a lamp can be calculated. When four or more triangular surveying anchor devices (or reference devices) are arranged for three dimensions , It is also possible to record the three-dimensional position of the legacy device to be controlled.

In step S3360, the mobile terminal maps the ID, position information, and control allowable distance of the legacy device to the memory.

Although steps S3350 and S3360 are performed in the mobile terminal as shown in FIG. 33, it is also within the scope of the present invention to design it to be performed in the home gateway and the cloud server.

FIG. 34 is a flowchart showing a control method of a mobile terminal according to an embodiment of the present invention. It is also within the scope of the present invention to implement another embodiment of the present invention by deleting or changing some steps shown in FIG.

A mobile terminal according to an embodiment of the present invention starts communication connection with a plurality of reference devices for a location service (S2101). For example, it is a procedure necessary for calculating the position of the mobile terminal in the IPS. Further, the device list to be controlled is displayed (S2102).

A specific device among the devices displayed in the list is selected (S2103), and the location information of the selected specific device is stored in the internal or external memory (S2104). Then, a graphic image for controlling the corresponding first device is output according to the position and direction of the mobile terminal (S2105).

According to another embodiment of the present invention, when at least one of the position or the direction of the mobile terminal changes, the output of the graphic image for controlling the first device is stopped and the output of the graphic image corresponding to the changed position or direction And outputs a graphic image for controlling the second device. Further, when a specific area of the graphic image for controlling the first device is selected, the first wireless signal is transmitted to the first device, and when a specific area of the graphic image for the control of the second device is selected, And transmits a second wireless signal to the second device. The first radio signal and the second radio signal are based on the same or different communication methods. For example, the first radio signal is based on a radio-frequency (RF) communication method, IR (Infra-Red) communication method. Hereinafter, a description will be given later with reference to FIG. 39 to FIG.

According to another embodiment of the present invention, although not shown in Fig. 34, the step of outputting an option for selecting another device not displayed in the list and the additional information necessary for controlling the other device, To the mobile terminal. Hereinafter, description will be made below with reference to FIGS. 35 and 36. FIG.

FIG. 35 shows an example of a registration procedure for a legacy device using a mobile terminal according to an embodiment of the present invention. The legacy device 3510 shown in FIG. 35 assumes a case where data communication is impossible, and therefore can not calculate position information on which the indoor legacy device 3510 is located by itself.

Meanwhile, it is assumed that the mobile terminal 3500 shown in FIG. 35 can calculate its own position information through communication with the reference devices as described in the previous drawings. Therefore, as shown in FIG. 35, a pre-registration procedure for calculating the location information of the legacy device is required.

In the vicinity of the legacy device 3510 to be controlled indoors, the mobile terminal 3500 executes an application for registering the indoor location service. As shown in Fig. 35, the mobile terminal 3500 displays a legacy device related list 3501 already stored in the memory. Therefore, the user can select the product type of the legacy device 3510 that he wants to control later. However, the list 3501 shown in FIG. 35 may not include the type of the corresponding product. In such a case, the mobile terminal is designed to automatically search for a new product type by connecting to a server or the Internet.

36 shows another example of a registration procedure for a legacy device using a mobile terminal according to an embodiment of the present invention. Fig. 36 will be described on the assumption that the mobile terminal selects TV as a legacy device in Fig.

Since different IR code values can be defined for each maker (product manufacturer) of each TV, in order to control the legacy device 3610, which is a TV later, it is necessary to determine the maker of the TV to be controlled.

Therefore, as shown in FIG. 36, the mobile terminal 3600 displays a list 3601 that identifies the maker of the TV. At this time, the user refers to the list 3601 and selects a maker of the TV to be controlled. Of course, it is also possible that the mobile terminal 3600 directly photographs the legacy device 3610, and then analyzes the photographed image data to estimate the type and maker of the legacy device. For example, a method of estimating from the image data of the logo attached to the front surface of the legacy device 3610 may be adopted.

However, the maker may not be included in the list 3601 shown in Fig. In such a case, the mobile terminal is designed to automatically retrieve information about a new maker by accessing a server or the Internet.

37 shows another example of a registration procedure for a legacy device using a mobile terminal according to an embodiment of the present invention. After completion of the registration procedure of Figs. 35 and 36, the registration procedure of Fig. 37 is finally required. As described above, it is assumed that the legacy device can not judge the position information by itself.

As shown in FIG. 37, the mobile terminal 3700 displays a message 3701 for inputting a distance to the legacy device 3710. As described above, the mobile terminal 3700 knows its location information through communication with the IPS reference device. Accordingly, the mobile terminal 3700 can determine the location of the legacy device 3710 through its location information and distance information with the legacy device 3710. [ Of course, it is also a feature of the present invention that the mobile terminal 3700 additionally uses the direction information of the mobile terminal using the motion sensor or the like. Therefore, finally, the legacy device identification information (ID), location information, and the like are stored in the memory or the server of the mobile terminal 3700. Further, a command and a graphic image for controlling the legacy device corresponding to the identification information (ID) are also stored in the memory or the server of the mobile terminal 3700. Therefore, if it is determined that the mobile terminal 3700 and the legacy device 3710 are within a predetermined distance range, the mobile terminal 3700 automatically displays a graphic image for controlling the legacy device 3710. In this regard, it will be described later with reference to FIG. 39 to FIG.

FIG. 38 shows a graphic image for solving a situation where a mobile terminal can not control a legacy device according to an embodiment of the present invention. For example, in the case of a legacy device controlled by an IR signal, the distance at which the IR signal can be recognized is limited. Therefore, when the distance between the legacy device and the mobile terminal exceeds the distance range in which the IR signal can be recognized, a solution for solving the problem is needed. In this regard, the following description will be made with reference to FIG.

When the mobile terminal 3800 is pointing in the direction of the legacy device 3810, the mobile terminal 3800 can know that the legacy device 3810 exists in the pointing direction as described above. Further, the legacy device 3810 ) Can also be confirmed. In addition, when the corresponding legacy device 3810 is controlled by the IR signal, the maximum range to be controlled by the IR signal is also preset. For example, assume that the legacy device has a maximum distance of 4 meters that it can receive an IR control signal.

However, as shown in FIG. 38, the distance between the mobile terminal 3800 and the legacy device 3810 is actually about 5 meters apart. Therefore, even if the mobile terminal 3800 transmits an IR signal to the legacy device 3810, the legacy device 3810 can not recognize it. There is a high possibility that the user recognizes it as an error of the mobile terminal 3800 or the legacy device 3810. In order to solve such a problem, when the legacy device 3810 is located beyond the predetermined IR signal recognition range from the mobile terminal 3800, the mobile terminal 3800 displays a message 3801 for correcting the detected IR signal .

39 is a block diagram of a mobile terminal according to an embodiment of the present invention. A process for sequentially controlling the first device and the second device is schematically illustrated. 40 is a block diagram of a mobile terminal according to an embodiment of the present invention, with reference to FIG. A process for sequentially controlling the first device and the second device is shown in detail. 39 and 40, a mobile terminal according to an embodiment of the present invention includes: A process for sequentially controlling the first device and the second device will be described. The devices 3910, 3920, 4050, and 4060 shown in FIGS. 39 and 40 are not necessarily limited to legacy devices, and may correspond to smart devices capable of data communication.

For example, as shown in FIG. 39, when the mobile terminal 3900 according to an embodiment of the present invention firstly points toward the TV (first device) 3910, the Blu- ray player (second device) 3920 ) Direction.

40A corresponds to the case of pointing in the TV direction in Fig. 39, and Fig. 40B corresponds to the case in which the pointing in the direction of the Blu-ray player in Fig.

As shown in FIG. 40 (a), when the mobile terminal 4000 points to the direction in which the TV 4050 is located, a graphic image 4010 capable of controlling the TV is displayed. When a specific function in the graphic image 4010 is selected, the mobile terminal 4000 transmits the corresponding command through the RF signal. That is, the TV 4050 corresponds to a device capable of receiving an RF signal from a remote controller.

On the other hand, when the direction of the pointing of the mobile terminal is changed, the graphic image (UI) outputted by the mobile terminal is also automatically converted.

As shown in FIG. 40 (b), when the mobile terminal points to the direction in which the Blu-ray player 4060 is located, a graphic image 4020 capable of controlling the Blu-ray player is displayed. When a specific function in the graphic image 4020 is selected, the mobile terminal transmits the corresponding command through the IR signal. That is, the Blu-ray player 4060 corresponds to a device capable of receiving an IR signal from a remote controller. That is, since the mobile terminal already knows the position of the device to be controlled, the graphic image (UI) necessary for controlling each device, and the communication path (IR or RF) necessary for controlling each device, As shown in the figure, a different graphic image is output according to the pointing direction of the mobile terminal, and a command (for example, channel up / down for a TV, start / stop / Backward).

41 is a block diagram of a mobile terminal according to an embodiment of the present invention. A third device, and a fourth device in sequence. FIG. 42 is a block diagram of a mobile terminal according to an embodiment of the present invention, with reference to FIG. The third device, and the fourth device in order. 41 and 42, a mobile terminal according to an embodiment of the present invention includes: A process for sequentially controlling the third device and the fourth device will be described. The devices 4110, 4120, 4250 and 4260 shown in FIGS. 41 and 42 are not necessarily limited to legacy devices, and may correspond to smart devices capable of data communication.

For example, as shown in FIG. 41, the mobile terminal 4100 according to an embodiment of the present invention first points toward the air conditioner (third device) 4110, As shown in FIG.

Fig. 41 (a) corresponds to the case of pointing in the TV direction in Fig. 39, and Fig. 40 (b) corresponds to the case of pointing in the direction of the blu-ray player in Fig.

As shown in FIG. 42 (a), when the mobile terminal 4200 is pointing in the direction in which the air conditioner 4250 is located, a graphic image 4210 capable of controlling the air conditioner is displayed. When a specific function in the graphic image 4210 is selected, the mobile terminal 4200 transmits the corresponding command through the IR signal. That is, the air conditioner 4250 corresponds to a device capable of receiving an IR signal from a remote controller. Assuming that the process of FIG. 42 (a) is continuously executed after the process of FIG. 40 (b), the mobile terminal need not change the communication means for controlling each device. However, as described above, when the process of FIG. 40 (a) is continuously executed after the process of FIG. 40 (a), the mobile terminal must change the communication means for controlling each device (RF- > IR).

On the other hand, when the direction of the pointing of the mobile terminal is changed, the graphic image (UI) outputted by the mobile terminal is also automatically converted.

As shown in Figure 42 (b), when the mobile terminal points to the direction in which the lamp 4260 is located, it displays a graphic image 4220 that can control the lamp. When a specific function in the graphic image 4220 is selected, the mobile terminal transmits the command through another wireless signal. 42 (b), the mobile terminal 4220 transmits a command for controlling the electric lamp to the gateway 4261 installed in the house, and when the electric power is not supplied to the gateway 4261, (4261) passes the command to the electric lamp (4260). That is, it can be assumed that the gateway 4261 and the electric lamp 4260 are wired. That is, since the mobile terminal already knows the location of the device to be controlled, the graphic image (UI) necessary for controlling each device, and the communication path (IR or gateway) necessary for controlling each device, As shown in the drawing, a different graphic image is output according to the pointing direction of the mobile terminal, and a command (for example, temperature up / down for an air conditioner or power on / off for a lamp) is transmitted through a communication path suitable for each device send.

Meanwhile, the mobile terminal described in the present specification includes both an IPS (Indoor Positioning System) and a 9-axis sensor. More specifically, the 9-axis sensor includes, for example, a 3-axis gyroscope, a 3-axis acceleration sensor, and a 3-axis magnetic field sensor.

The present invention described above can be implemented as computer readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). Also, the computer may include a control unit 180 of the terminal. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

2900: Mobile terminal
2910: Communication module
2920: Display Module
2930: Interface module
2940: Controller
2950: Memory
2960: Sensing module
3010, 3110: Reference device
3020, 3120: Legacy device
3130: Server
3140: Smart Devices

Claims (17)

A method of controlling a mobile terminal,
Initiating a communication connection with a plurality of reference devices for a location service;
Displaying a device list to be controlled;
Selecting a specific one of the devices displayed in the list;
Storing location information of the selected specific device in an internal or external memory; And
Outputting a graphic image for controlling the corresponding first device according to the position and direction of the mobile terminal
And transmitting the control information to the mobile terminal. The method according to claim 1,
If at least one of the position or direction of the mobile terminal changes,
Stopping output of a graphic image for control of the first device; And
Outputting a graphic image for control of a second device corresponding to the changed position or direction
Further comprising the steps of: 3. The method of claim 2,
Transmitting a first wireless signal to the first device when a specific area of the graphic image for control of the first device is selected; And
Transmitting a second wireless signal to the second device when a specific area of the graphic image for controlling the second device is selected, the first wireless signal and the second wireless signal being based on different communication methods -
Further comprising the steps of: The method according to claim 1,
Outputting an option for selecting another device not displayed in the list;
Downloading additional information necessary for controlling the other device to the memory
Further comprising the steps of: The method according to claim 1,
Wherein the storing step comprises:
Calculating a distance between the mobile terminal and the selected specific device;
Calculating location information of the selected specific device based on the location information of the mobile terminal and the calculated distance;
Further comprising the steps of: The method according to claim 1,
Wherein the storing step comprises:
The identification of the selected specific device, the location information of the selected specific device, and the allowable distance for controlling the specific device are all connected and stored. The method according to claim 1,
The reference device,
A method of controlling a mobile terminal corresponding to a node in an anchor or a known position used in an Indoor Positioning System. The method of claim 3,
Wherein the first radio signal is based on a radio-frequency (RF) communication method, and the second radio signal is based on an Infra-Red (IR) communication method. In the mobile terminal,
A communication module for initiating a communication connection with a plurality of reference devices for a location service;
A display module for displaying a device list to be controlled;
An interface module for selecting a specific device among the devices displayed in the list;
A controller for controlling the display module to output a graphic image for controlling the corresponding first device according to a position and a direction of the mobile terminal,
. 10. The method of claim 9,
A memory for storing location information of the selected specific device,
Further comprising: 10. The method of claim 9,
A sensing module for sensing at least one of a position and a direction of the mobile terminal;
The mobile terminal further comprising: 12. The method of claim 11,
If at least one of the position or direction of the mobile terminal is detected as being changed by the sensing module,
The controller comprising:
Controls the display module to stop outputting the graphic image for controlling the first device and to output a graphic image for controlling the second device corresponding to the changed position or direction. 13. The method of claim 12,
A first transmission module for transmitting a first wireless signal to the first device when a specific area of the graphic image for controlling the first device is selected; And
A second transmission module for transmitting a second wireless signal to the second device when a specific area of the graphic image for controlling the second device is selected, wherein the first wireless signal and the second wireless signal are different communication methods Based on -
The mobile terminal further comprising: 11. The method of claim 10,
The controller outputs an option for selecting another device not displayed in the list,
And the memory downloads additional information necessary for controlling the other device. 10. The method of claim 9,
The controller comprising:
Calculate a distance between the mobile terminal and the selected specific device, and
And calculates position information of the selected specific device based on the position information of the mobile terminal and the calculated distance. 11. The method of claim 10,
The memory comprising:
The identification of the selected specific device, the location information of the selected specific device, and the allowable distance for controlling the specific device. 10. The method of claim 9,
The reference device,
A mobile terminal corresponding to a node of an anchor or a known position used in an Indoor Positioning System.

Images