RU2673464C1 - Method for recognition and control of household appliances via mobile phone and mobile phone for its implementation - Google Patents

Abstract

FIELD: satisfaction of vital needs of people; control systems.SUBSTANCE: invention relates to the field of devices and methods for remote control of household appliances, in particular, via a user's mobile phone. At first, the direction of the position and / or movement of the mobile phone in space is determined based on the data from sensors located on the surface of the phone, and the appropriate mode of operation is activated. At the same time, in the “Remote Control” mode, the end camera is directed to the controlled device, and its image is captured and the information about the types of various devices stored, recorded and / or saved in the database of the microprocessor's memory block or reference information received via the Internet connection to the corresponding server of the system is identified and the control menu and images of the control buttons of the recognized controlled device are displayed on the touch screen. Then, a control signal is transmitted to the controlled device via a suitable communication channel for this device by selecting menu functions, also, a notification and confirmation of the execution of mobile phone control commands is received from the controlled device as a feedback via wireless communication channel with display on the screen of the user's mobile phone.EFFECT: technical result is to enable the mobile phone to recognize the controlled devices in the direction of position and / or movement in the space of the mobile phone and the received data from the sensors, as well as the choice of the mode of operation of the mobile phone, which improves the accuracy of the coincidence of the user's intentions and the transmitted control commands.9 cl, 13 dwg

Description

Technical field

The invention relates to multifunctional mobile phones, allowing the user to control devices of a “smart” home — household appliances: televisions, music centers, lighting, air conditioning and ventilation, etc., in the most convenient and natural way in an intuitive way.

State of the art

Currently, most modern electronic devices intended for use at home have special remote controls that allow you to control the most important functions of these devices from a distance. The most important control functions of various electronic devices can vary significantly. Therefore, each such electronic device is equipped with its own special control panel. Typically, such remote controls have many mechanical specialized control buttons.

The disadvantage of using most of these remote controls is the inconvenience due to the need to simultaneously use different remote controls located in different places and the excessive complexity for the user due to the need to remember the functional purpose of many specialized buttons on different remote controls.

The prior art remote control for household appliances and computer systems and a control method (see patent RU 2127019 for an invention, publ. 27.02.1999).

The remote control contains a transmitter-receiver, a microprocessor with a data bus, memory and operating system, a graphic display, a button, a keyboard system and a manipulator.

The disadvantages of the known technical solutions are:

- complexity and inconvenience in management for the user (a large number of preparatory actions, the mandatory need to navigate the menu to perform basic actions);

- the impossibility of recognition in the direction of position and / or movement in space.

The prior art method for remote control of a remote control and remote control for its implementation (see application US 2014/0327782 for an invention, publ. 06.11.2014).

The remote control includes a camera to automatically detect the device to which the remote control is directed by the user. The image received from the camera is compared with images in a database of known or previously described devices for further control of a universal remote control. If the image received from the camera matches the image in the database, the universal remote control loads a special keyboard layout to control this particular device from the database. The remote control can operate in three modes: through a regular infrared port, in the "IR-Blaster" mode and through a connection via a common Wi-Fi network. The setup does not take much time. Management is based on the application database. The user selects his model from the list and makes a connection. Then, the control signal (command) is encoded and transmitted by the IR LED. Before transmitting the main signal, the transmitting and receiving devices are synchronized, and the correspondence of the remote control code is also checked on the receiving side. The transmission itself will be carried out for the entire time while the control button is pressed. The microcontroller generates a control signal after pressing the corresponding key. Devices are controlled by infrared using a pre-installed special application.

The disadvantages of the known technical solutions are:

- complexity and inconvenience in management for the user (a large number of preparatory actions, the mandatory need to navigate the menu to perform basic actions);

- the impossibility of recognition in the direction of position and / or movement in space.

The prior art mobile device (see application US 2015/0036875 for an invention, publ. 05.02.2015).

A mobile device remotely monitors devices by identifying them through the camera and launching an application offline associated with a specific device. Also, when identical devices are determined, the mobile device can be configured to use individual identifiers and / or positioning data associated with the managed device for the purpose of their separation and control. The invention can be taught to recognize devices that need to be controlled.

The disadvantages of the known technical solutions are:

- the impossibility of recognition in the direction of position and / or movement in space.

The prior art combined mobile phone and a remote control terminal (see patent RU 2214065 for an invention, publ. 10.10.2003).

A system providing mobile telephone communication and remote control of a plurality of remotely actuated peripheral devices comprises a mobile telephone comprising a transceiver for generating wireless communication lines, a mobile telephone module for providing mobile telephone functionality via a transceiver, a control command module for generating control commands into a plurality remote-driven peripherals in response to user input Catering, a local communication module for forming a wireless communication line between a plurality of peripheral devices and a control command module, a user interface and a local communication network.

The disadvantages of the known technical solutions are:

- the impossibility of recognition in the direction of position and / or movement in space;

- the complexity and inconvenience of management for the user (a large number of preparatory actions, the mandatory need to navigate the menu to perform basic actions).

Disclosure of invention

The objective of the invention is:

- the creation of the most convenient, simple and intuitive (not requiring special training) remote way of user interaction with home (household) appliances using a mobile phone through additional functionality - recognition of household appliances in the direction of position and / or movement in space.

Thus, a mobile phone is able to provide ordinary telephone functions, act as a remote control device for a variety of peripheral devices, and also take pictures, while a person can use a multifunctional mobile phone to perform many functionalities.

The technical result of the claimed invention is:

- expanding the functionality of the mobile phone by recognizing the managed devices in the direction of the position and / or movement in the space of the mobile phone and the received data from the sensors, as a result of which the mobile phone can operate in the “telephone” mode, the “remote control” mode or the “camera” mode.

The technical result of the claimed invention is achieved in that a method for recognizing and controlling household appliances with a mobile phone includes:

- collecting data from mobile phone sensors located on the screen, the back side of the second screen and side surfaces, to determine the direction of the position and / or movement of the mobile phone in space;

- instant activation of the mobile phone in the appropriate mode of operation on the basis of the received data from the sensors: in the "telephone" mode, the "remote control (RC)" mode or the "camera" mode corresponding to a certain direction of position and / or movement in space and data from sensors;

while in the "remote control" mode, the mobile phone is configured to:

- direction and capture by the end camera of the image of the controlled device and recognition in the field of view of the available controlled devices in the direction of the position of the end of the phone and / or the movement in the space of the mobile phone, taking into account data received from the sensors of the mobile phone, information about the types of various devices stored, recorded and / or stored in the database of the microprocessor memory unit or reference information via the Internet connection to the corresponding system server;

- saving images of an accessible managed device in the database of the memory block;

- retrieving the recognized image of the managed device from the database of the memory unit as the selected image of the managed device with displaying the control menu and images of the control buttons of the recognized managed device on the touch screen;

- determining a suitable and convenient control signal transmission channel depending on the device being controlled;

- transmitting the appropriate control signals via the selected communication channel to the recognized controlled device by pressing the corresponding control button on the end of the phone and / or the button and / or image on the touch of the phone screen and / or touch surface of the phone;

- receiving feedback and confirmations of the execution of mobile phone control commands from a managed device with feedback on the user's mobile phone screen via a wireless communication channel;

A mobile phone with the function of recognition and control of household appliances contains:

- transceiver with antenna;

- a block of wireless communications;

- a block of sensors on the screens and side surfaces;

- user display on the front and back panels of the phone;

- control buttons on the end of the phone and on the touch surface of the phone;

- a memory block with a database;

- end camera;

- microcontroller;

- in this case, the microcontroller is connected by a first input-output with input-output of a user display on the front and rear panels of the telephone, a second input-output with input-output of a transceiver device with an antenna, a third input-output with inputs and outputs of a wireless communication unit, and a fourth input -exit with the input-output of the sensor unit, the fifth input-output with the input-output of the camera located on the end of the phone, the sixth input-output with the input-output of the memory unit with the database;

- the block of wireless communications is configured to interconnect via wireless communication channels with managed devices;

- the sensor unit is interconnected via wireless communication channels with controlled devices;

while the microcontroller according to a given algorithm (program) is configured to:

- monitoring and controlling the operation of all devices and blocks of a mobile phone;

- information processing, determination by signals from sensors of the corresponding controlled device, taking into account information from the memory unit with the database and / or reference information via the Internet, connecting to the corresponding server of the system;

- determining a convenient and suitable wireless communication channel (transmission channel);

- saving or retrieving information on the types of various managed devices from the database of the memory block;

- instant activation of the mobile phone in the appropriate operating modes based on the received data from the sensors: to the "telephone" mode, the "remote control" mode or the "camera" mode corresponding to a certain direction of position and / or movement in space and information from the sensors; from buttons and / or images on the touch part of user displays on the back or front panels of the phone, and / or from the touch surface of the phone and / or from the control buttons on the end of the phone and / or transceiver with antenna.

In a preferred embodiment, for example, a gyroscope, accelerometer, magnetometer, proximity sensor and / or sensor sensors are used as mobile phone sensors.

In a preferred embodiment, the control signal is transmitted via the infrared port located at the end of the phone, via a Bluetoouth wireless data network or via Wi-Fi via a local network or Internet connection.

In a preferred embodiment, the controlled devices are, for example, a TV, a music center and / or air conditioning, and notifications and confirmation of the execution of mobile phone control commands from the managed device are received in the form of messages and / or vibrations and / or light indications on the user's mobile phone screen.

Brief Description of the Drawings

The characteristics and essence of the claimed invention is illustrated in the following detailed description, illustrated by drawings (see figures 1-13), where the same reference numbers show the following.

In FIG. 1 shows the traditional aiming of the remote control on the TV.

In FIG. Figure 2 shows a telephone aimed at the TV in the same way as a conventional remote control.

In FIG. Figure 3 shows the layout of the controls on the phone, option 1 - the key action button matches the "Home" button of the phone, the power button is the same as on Android devices.

In FIG. Figure 4 shows the layout of the controls on the phone, option 2 - the key action button is located on the front touch screen (below the screen), the power button is like on Android devices.

In FIG. Figure 5 shows the layout of the controls on the phone, option 3 - the key action button is located on the rear panel (on the second screen), the power button is like on Android devices.

In figures 3-5, the same reference numbers show the following:

1 - end camera;

2 - end IR port;

3 - power button;

4 - volume button;

5 - key action button;

6 - flash;

7 - camera (normal).

In FIG. 6 shows an example of a telephone position of a telephone.

In FIG. 7 shows an example of the position of the phone "remote control", a variant of the key action button on the front screen of the phone.

In FIG. Figure 8 shows an example of the position of the phone "remote control", a variant of the key action button combined with the "Home" button of the phone.

In FIG. Figure 9 shows an example of the position of the "Remote Control" telephone, a variant of the key action button on the back of the telephone.

In FIG. 10 shows an example of the position of the phone "remote control" when controlling the volume of the device.

In FIG. 11 shows an example of the position of the camera phone (with two hands).

In FIG. Figure 12 shows an example of the position of the phone "camera" (with one hand) and "camera selfie" (with one hand).

In FIG. 13 is a structural diagram of a mobile phone, where:

8 - user display;

9 - microcontroller;

10 - a memory block with a database;

11 - transceiver with antenna;

12 - wireless communications;

13 - sensor block;

14 - end camera;

15 - managed devices.

The implementation of the invention and examples of implementation

One of the natural gestures when controlling various devices using the remote control is to direct the remote control to the device itself. This is one of the basic intuitive principles, let's call it the "wave of a magic wand." At the same time, in traditional remote control (for TV, etc.), the IR beam of the remote control is aimed towards the controlled device (see Fig. 1).

The most convenient way to control household appliances and the elements of a smart home will be from the mobile phone with the exact same gesture, directing the mobile phone with its end toward the device that needs to be controlled - the same “wave of a magic wand” (see Fig. 2). At the same time, the advantage is that a mobile phone, unlike various remote controls that are located in different places at home, is usually always at hand.

Determining the mode of operation of the phone by the position in space is as follows.

To determine the required mode of operation of a mobile phone (telephone, photo, remote control (on / off), remote control), it is necessary to use recognition of the direction of the position and / or movement of the mobile telephone in space (in the user's hand (s)). This information can be obtained, for example, from the following set of sensors in a mobile phone: touch screen, touch back surface of the phone (second screen) and edges of the phone, gyroscope, etc. The direction of the position and / or movement of the mobile phone in the hand (s) allows high the likelihood of determining the desired further action with him.

Depending on the direction of the position and / or movement in space (the angle of inclination), various phone operating modes are activated, for example, the mobile phone itself, the camera for shooting with the main camera, the camera for shooting with the camera on the front side, remote control mode (see Fig. 6- 12).

Pre-configuration of the mobile phone is as follows.

Recognition of devices to be controlled can take place without prior configuration. By the appearance of the device via the Internet connection to the corresponding server of the system, the type of device and the system of control commands and communication protocols can be determined. After the first determination, the result can be stored (for example, in a storage device or memory block) and subsequently recognition can be carried out locally on the phone without accessing the system server.

For quick and accurate system operation, a preset can be performed. Presetting can be done through the mobile application. Devices that are supposed to be controlled can be shown to the system from different directions and compared with how to manage them.

Thus, the phone will be trained in the presence of all the devices necessary for control, their location and methods of communication with them, as well as the typical user locations relative to these devices.

Management of external devices (household appliances) is carried out in several stages:

1. Definition of entry into the "magic wand" mode.

2. Definition of the control object.

3. Definition of the desired action by the user.

4. Determination of a convenient control signal transmission channel.

5. Transmission of the control signal.

6. Notification of the user about the results.

Stage 1. Determination of entry into the "magic wand" mode.

When you take the phone in your hand in the position characteristic of the remote control, the “Magic Wand” mode is activated, which serves to control various devices.

The functions of the control elements (buttons, sensors) should also depend on the direction of the position and / or movement of the phone in space. For example, when determining the “remote control” position, the volume buttons (pos., Figs. 3-5) control the volume in the case of controlling a TV or music center, in the case of controlling a lamp - the brightness of the lamp.

Stage 2. Recognition of the control object.

Combined use of several methods is supposed. This will speed up the recognition process and increase its reliability.

Search by a narrow infrared signal.

At the moment when the position of the hand with the phone is fixed, that is, after pointing to the controlled device, a modulated infrared signal is sent with the request. If the managed device is equipped with an infrared port and supports such a protocol, then having determined that the infrared beam is pointing to it, it will inform the telephone about it by some known agreed protocol.

Recognition of controlled devices by the end camera.

When targeting the phone in the “remote control” position to the controlled device, recognition is activated through the camera (pos. 1, Figs. 3-5) located at the end of the phone. The image from the end camera (pos. 1, Figs. 3-5) is compared with both locally stored types of devices and a request can be made to a remote device database, and a determination is made taking into account the direction of the position and / or movement of the mobile phone in space (room). If necessary, if there is a lack of lighting, the IR illumination is turned on by the infrared port (pos. 2, Figs. 3-5) of the telephone.

Phone operation with familiar devices (repeated search).

The combination of a camera, gyroscope, accelerometer, compass, and other sensors can accelerate the re-recognition of controlled devices. After positioning on the camera, the direction in which the control object is located becomes clear. If a person remains in place (this is determined by a gyroscope and other means of positioning), then re-pointing in the same direction no longer requires turning on the camera and recognition, but allows you to immediately execute a specific command.

An important intuitive feature is the implementation of the control principle through the display on the subject, and not on its switch. Light bulbs, lamps, chandeliers have a greater individuality (visual visibility), which makes it easier to understand what kind of object it is and where it is located, which will allow directing the phone in the remote control mode not to the switch, but directly to the lamp. You can adjust the volume by showing not only the receiver, but, for example, any of the speakers.

Stage 3. Determination of the desired action by the user.

User actions are divided into: key, which are performed when the user presses one of the physical or touch buttons of the phone (key action buttons, pos. 5, Figs. 3-5) or touch surfaces, including ribs, and general, which require the user's work with a menu on the touch screen.

Key action buttons can be either “normal” or touch buttons. These buttons can be combined with traditional phone control buttons (unlock button, power button, volume buttons), or they can be independent.

Key actions.

In most cases, for various devices there is a small number of the most popular and intuitive actions. It is these actions that are implemented when you click on the key buttons (item 5, Fig. 3-5).

For example, when using the “Note” button of the telephone (key button, pos. 5, Figs. 3-5) located on the bottom of the front side of the phone, volume buttons (pos. 4, Figs. 3-5) located on the side the surface of the phone on the left, and the power button of the phone (item 3, Fig. 3-5) located on the side surface of the phone on the right, the control of various devices can be as follows:

For the TV.

- if the TV is turned off:

telephone "Home" button (key action button, pos. 5, Figs. 3-5) - turning on the TV;

- if the TV is on:

telephone "Home" button (pos. 5, Figs. 3-5) - turn off the TV;

phone volume buttons (pos. 4, Figs. 3-5) - adjusts the volume of the TV;

telephone volume buttons (pos. 4, Figs. 3-5) in combination with the pressed telephone power button (pos. 3, Figs. 3-5) - switching channels;

phone power button (pos. 3, Fig. 3-5) - turn off the volume (mute).

For the music center.

In case the music center is turned off:

phone's "Home" button (pos. 5, Figs. 3-5) - turning on the music center.

In the case of the included music center:

telephone "Home" button (item 5, Figs. 3-5) - turn off the music center; phone volume buttons (pos. 4, Figs. 3-5) - volume control of the music center;

telephone volume buttons (pos. 4, Figs. 3-5) in combination with the pressed phone power button (pos. 3, Figs. 3-5) - switching channels of radio stations, tracks, etc .; power button (pos. 3, Figs. 3-5) - turn off the volume (mute). To control the light. In case of light off:

telephone "Home" button (pos. 5, Figs. 3-5) - light on;

phone volume buttons (pos. 4, Figs. 3-5) - turn on and gradually increase / decrease the brightness of the light. In the case of the light on:

telephone "Home" button (pos. 5, Figs. 3-5) - turn off the light; phone volume buttons (pos. 4, Figs. 3-5) - smooth increase / decrease in light brightness.

The functions of the buttons (pos. 3-5, Figs. 3-5) and button sequences can be edited through the mobile application.

To control such key actions, the mobile phone must have a special button or touch sensor (it is preferable, because in this case you can also read finger gestures), clicking on which performs a predefined device-specific action. This key action button (pos. 5, Figs. 3-5) can be located:

Combined with the "Home" button of the phone on the front side (for example, as in Apple, Samsung devices) - see fig. 3;

To be located on the touch screen on the front side, to be either a highlighted area of the touch screen, or separately, an independent button or a touch element under the screen - see Fig. four;

Located on the back (on the second screen on the back) - see FIG. 5;

The edges of the phone must also be touch sensitive and can be “buttons” of the key action of 9 poses. 5, FIG. 3-5).

You can use button combinations - perform related actions. Related actions.

The functions of some buttons should depend on the previous event. For example, in the case of the TV’s turn-on action, the volume buttons (pos. 4, Figs. 3-5) on the phone will control the volume of the TV, and not the phone, if the targeting of the phone remains on the same device - a TV or the phone is aimed at the same TV repeatedly.

Step 4. Determination of a convenient control signal transmission channel.

Device control can be performed on various command transmission channels, for example:

- An infrared port located at the end of the phone (pos. 2, Figs. 3-5);

- Wireless data network wifi, bluetooth, etc .;

- Communication with the home and / or Internet server of the device;

- Ultrasonic signal speaker phone.

Depending on the device to which the command needs to be transmitted, a suitable communication channel is selected, including taking into account the fastest response.

Step 5. Transmission of the control signal.

The control signal is transmitted through the selected communication channel with the managed device, which is defined.

Step 6. Notify the user of the results.

To provide feedback with the user about establishing contact with controlled and potentially controllable devices (whether the object was recognized, whether the command is clear, or if the signal passed), it is necessary to notify the user. This can be done in several ways to confirm communication with the managed device, including built-in unobtrusive short events: vibration, sound, light indication or image on the screen (display). For example:

- The phone is taken in hand in a position corresponding to the remote control or volume - the green LED starts to flash often, a slight short vibration;

- The camera recognized the object or the object is detected in the direction - the green LED is on continuously, the average short vibration;

- Pressing the button is fixed and transmitted - a green single flash of the LED and a single vibration signal.

A mobile phone with a function for recognizing and controlling household appliances (see Fig. 13) contains: a transceiver with an antenna (11), wireless communications (12). The composition of wireless communications (12) includes, for example, an infrared port, which is located at the end of the phone, Bluethooth, Wi-Fi, etc. The sensor unit (13) of a mobile phone can include, for example, a gyroscope, accelerometer, magnetometer, sensor proximity, touch sensors on screens and side surfaces, etc. The user display (8) is located both on the front and on the back of the phone. At the end of the phone and / or the touch surface and / or the edges of the phone are control buttons. The microcontroller (9) is made on the basis of the processor with the ability to control and manage the operation of all devices and blocks of the mobile phone according to a given program, process information, determine controlled devices by signals from the sensor block (13) taking into account information from the memory block with the database (10) . In the absence of information in the memory unit (10) about the managed objects, reference information is extracted via the Internet connection to the corresponding server of the system, through applications. In the memory block (10), information about managed devices is retrieved or stored in the absence of data from the database. The microcontroller (9) is interconnected with the user display (8) on the front and rear panels, with a transceiver (11), with wireless communications (12), a sensor unit (13), a camera (14) located on the end of the phone and with a memory unit (10) with a database. A mobile phone can recognize and control household appliances, for example, a telephone, a music center, air conditioning, and other “smart home” devices via wireless communication channels such as the infrared port on the side of the phone, Bluetoouth, Wi-Fi, etc. Using block sensors (13) is collecting all the necessary information. After determining the direction of the position and / or movement of the mobile phone in space based on information from sensors (13), the phone instantly activates in the appropriate operating modes: “telephone” mode, “remote control” mode and / or “camera” mode . In the “remote control” mode, the end camera (14) captures the image of the controlled device and recognizes it in the field of view of the available controlled devices (15) in the direction of the end face of the phone and / or movement in the space of the mobile phone, taking into account data received from sensors, information about types of various devices stored, recorded and / or stored in the database of the microprocessor memory unit or reference information via an Internet connection to the corresponding system server. The image of the recognized accessible controlled device (15) is stored in the database of the memory unit (10), extracted in the direction of the position and / or movement in the space of the mobile phone from the database of the memory unit (10), and displayed on the touch screen with the control menu and button images management. Depending on the type of controlled device (15), a suitable and convenient channel for transmitting the control signal (command) is determined, for example, via the infrared port located at the end of the phone, the Bluetoouth wireless data network and / or via the Wi-Fi network through the local network or Internet connection. The control signal with the appropriate commands is transmitted via the selected wireless communication channel (transmission) to the recognized controlled device (15) by pressing (touching) the corresponding control button on the end of the phone and / or the button and / or image on the touch of the phone screen and / or touch the surface of the phone, for example, the edges of the phone. By feedback, a signal is received from the controlled device (15) and notifies the user about the execution of the corresponding control commands, for example, in the form of a message and / or vibration and / or light indication with an indication on the display (8) of the user's mobile phone.

The claimed invention allows you to combine in one mobile phone, which already exists and is actively used, controls all the devices of the "smart" home. All that is needed is a refinement of the mobile phone within the framework of existing technologies. To implement the claimed invention at the moment there are all the necessary technical capabilities and tools: mobile phones, microcontrollers, memory units, sensors, wireless communications, cameras and transceivers with an antenna.

The analysis of the prior art made it possible to establish: analogues with a set of essential features that are identical to the essential features of the claimed invention are absent, which indicates compliance of the claimed technical solution with the condition of patentability "novelty".

The search results for known technical solutions in order to identify significant features that match the distinctive features of the claimed invention, have shown that they do not follow explicitly from the prior art, and the influence of distinctive essential features on the technical result and task indicated by the authors has not been established. Therefore, the claimed invention meets the condition of patentability "inventive step".

Despite the fact that the claimed invention is shown and described with reference to certain preferred embodiments, it will be understood by those skilled in the art that various changes in form and content can be made therein without departing from the spirit and scope of the claimed invention, which are defined the attached claims taking into account the description and drawings.

Claims (35)

1. A method for recognizing and controlling household appliances with a mobile phone, including: - collecting data from mobile phone sensors located on the screen, the back side of the second screen and side surfaces, to determine the direction of the position and / or movement of the mobile phone in space; - instant activation of a mobile phone in the appropriate mode of operation based on the data received from the sensors: in the "telephone" mode, the "remote control (RC)" mode or the "camera" mode corresponding to a certain direction of position and / or movement in space, and data from sensors; while in the "remote control" mode, the mobile phone is configured to: - direction and capture by the end camera of the image of the controlled device and recognition in the field of view of the available controlled devices in the direction of the position of the end of the phone and / or the movement in the space of the mobile phone, taking into account data received from the sensors of the mobile phone, information about the types of various devices stored, recorded and / or stored in the database of the microprocessor memory unit, or reference information via the Internet connection to the corresponding system server; - saving images of an accessible managed device in the database of the memory block; - retrieving the recognized image of the managed device from the database of the memory unit as the selected image of the managed device with displaying the control menu and images of the control buttons of the recognized managed device on the touch screen; - determining a suitable and convenient control signal transmission channel depending on the device being controlled; - transmitting the appropriate control signals via the selected communication channel to the recognized controlled device by pressing the corresponding control button on the end of the phone and / or the button and / or image on the touch of the phone screen and / or touch surface of the phone; - receiving feedback and confirmations of the execution of mobile phone control commands from a managed device with feedback on the user's mobile phone screen via a wireless communication channel; 2. The method according to claim 1, wherein, for example, a gyroscope, accelerometer, magnetometer, proximity sensor and / or sensor sensors are used as mobile phone sensors. 3. The method according to p. 1, in which the control signal is transmitted via the infrared port located at the end of the phone, via a Bluetoouth wireless data network or via Wi-Fi via a local network or Internet connection. 4. The method according to p. 1, in which the controlled devices are, for example, a TV, stereo system and / or air conditioning. 5. The method according to claim 1, in which notifications and confirmation of the execution of mobile phone control commands from the managed device are received in the form of messages and / or vibrations, and / or light indications on the user's mobile phone screen. 6. A mobile phone with the function of recognition and control of household appliances contains: - transceiver with antenna; - a block of wireless communications; - a block of sensors on the screens and side surfaces; - user display on the front and back panels of the phone; - control buttons on the end of the phone and on the touch surface of the phone; - a memory block with a database; - end camera; - microcontroller; - while the microcontroller is connected to the first input-output with the input-output of the user display on the front and rear panels of the phone, the second input-output with the input-output of the transceiver with an antenna, the third input-output with the inputs and outputs of the wireless communication unit, the fourth input-output with the input-output of the sensor unit, the fifth input-output with the input-output of the camera located on the end of the phone, the sixth input-output with the input-output of a memory unit with a database; - the block of wireless communications is configured to interconnect via wireless communication channels with managed devices; - the sensor unit is interconnected via wireless communication channels with controlled devices; while the microcontroller according to a given algorithm (program) is configured to: - monitoring and controlling the operation of all devices and blocks of a mobile phone; - information processing, determination by signals from sensors of the corresponding controlled device, taking into account information from the memory unit with the database and / or reference information via the Internet, connecting to the corresponding server of the system; - determining a convenient and suitable wireless communication channel (transmission channel); - saving or retrieving information on the types of various managed devices from the database of the memory block; - instant activation of the mobile phone in the appropriate operating modes based on the received data from the sensors: to the "telephone" mode, the "remote control" mode or the "camera" mode corresponding to a certain direction of position and / or movement in space and information from the sensors; from buttons and / or images on the touch part of user displays on the back or front panels of the phone and / or from the touch surface of the phone and / or from the control buttons on the end of the phone and / or transceiver with antenna. 7. The mobile phone according to claim 6, in which the infrared port located at the end of the phone, Bluethooth and / or Wi-Fi is used as a wireless means. 8. The mobile phone according to claim 6, in which, for example, a gyroscope, accelerometer, magnetometer, proximity sensor and / or sensor sensors are used as sensors. 9. The mobile phone according to claim 6, in which the controlled devices are, for example, a television, stereo system and / or air conditioning.

Images