KR102305314B1 - User terminal device and methods for controlling the user terminal device - Google Patents

Abstract

A user terminal device is disclosed. The present user terminal device is bent and fixed to configure the front and side surfaces of the user terminal device, and is divided into a main region disposed on the front side of the user terminal device and a sub region extending from the main region in a lateral direction and including a bent portion. A display unit, a touch sensing unit for detecting a user's touch in at least one of the main area and the sub area, and a plurality of UI elements that can be individually displayed in the sub area are displayed in the main area when a preset event occurs, and a controller for controlling the flexible display unit to display the selected UI element on the sub-region when one of the plurality of UI elements displayed on the region is selected.

Description

User terminal device and its control method

The present invention relates to a user terminal device and a control method thereof, and more particularly, to a user terminal device receiving a user interaction input using a flexible display unit including a main area and a sub area extending to the side of the main area, and controlling the same it's about how

With the development of electronic technology, various types of user terminal devices are being developed and distributed. In recent years, as the size of the user terminal device is minimized, its functions are more diversified, and the demand thereof is increasing.

The user terminal device may provide various contents such as multimedia contents or an application screen according to a user's request. A user may select a function that he/she wants to use by using a button or a touch screen provided in the user terminal device. The user terminal device may selectively execute a program according to an interaction with the user, and display the execution result.

On the other hand, as the functions that can be provided by the user terminal device are gradually diversified, various needs are also generated for a method of displaying content and a method of user interaction. That is, as the types and functions of content greatly increase, the conventional interaction method of simply selecting a button or touching a touch screen may be insufficient.

Accordingly, there is a need for a user interaction technology that allows a user to use a user terminal device in a more convenient manner.

The present invention has been made in accordance with the above-described needs, and an object of the present invention is to provide a user terminal device capable of supporting various user interactions using a flexible display unit including a main area and a sub-region extending to the side of the main area, and controlling the same to provide a method.

A user terminal device according to an embodiment of the present invention for achieving the above object is bent and fixed to configure the front and side surfaces of the user terminal device, and the main area and the main area disposed on the front side of the user terminal device A flexible display unit divided into sub-regions extending in the lateral direction and including a bent portion, a touch sensing unit sensing a user touch in at least one of the main region and the sub-region, and a preset event occurs, the A plurality of UI elements that can be individually displayed in a sub-area are displayed in the main area, and when one of a plurality of UI elements displayed on the main area is selected, the flexible display unit is configured to display the selected UI element in the sub-area. Includes a control unit to control.

In this case, the preset event may be a touch gesture moving from the sub area to the main area.

In this case, the controller may control the flexible display unit to display a variable number of UI elements displayed on the main area in response to the length of the touch gesture.

In this case, when the touch gesture is released, the controller may control the flexible display unit to display a UI element at a preset position on the sub-region.

Meanwhile, when a multi-touch gesture extending from the sub-region to the main region is detected, the controller is configured to display a screen for editing UI elements displayable in the sub-region on the main region. can control

Meanwhile, when a preset touch gesture for at least one of a plurality of UI elements displayed in the main area is detected, the controller is configured to display a UI element in which the preset touch gesture is detected in the sub-region. can be excluded from

In this case, the preset touch gesture may be a touch gesture that separates one of a plurality of UI elements displayed on the main area from another UI element.

Meanwhile, when a flick gesture is detected on the sub-region, the controller may control the flexible display unit to change and display a UI element being displayed on the sub-region into another previously registered UI element.

On the other hand, the sub-region is divided into a plurality of sub-regions, and when a touch gesture moving from one of the plurality of sub-regions to the main region is detected, the sub-menus for the sub-regions are displayed in the main region. The flexible display unit may be controlled to display.

Meanwhile, in the method of controlling a user terminal device according to an embodiment of the present invention, the user terminal device is bent and fixed to configure the front and side surfaces of the user terminal device, and includes a main area disposed on the front of the user terminal device and A flexible display unit divided into sub-regions extending from the main region in the lateral direction and including a bent portion and a touch sensing unit sensing a user's touch in at least one of the main region and the sub-region, The control method includes, when a preset event occurs, displaying a plurality of UI elements individually displayable in the sub-region on the main region, and when one of a plurality of UI elements displayed on the main region is selected, the selected UI and displaying an element in the sub-region.

In this case, the preset event may be a touch gesture moving from the sub area to the main area.

In this case, the displaying of the plurality of UI elements on the main area may include varying the number of UI elements displayed on the main area with respect to the length of the touch gesture.

In this case, the displaying of the UI element on the sub-region may include displaying the UI element at a preset position on the sub-region when the touch gesture is released.

Meanwhile, in the control method according to the present embodiment, when a multi-touch gesture extending from the sub area to the main area is detected, a screen for editing UI elements displayable in the sub area is displayed on the main area. The step of displaying may be further included.

Meanwhile, in the control method according to the present embodiment, when a preset touch gesture for at least one of a plurality of UI elements displayed on the main area is detected, the UI element in which the preset touch gesture is detected can be displayed in the sub area. The step of excluding from the previously registered UI elements may be further included.

In this case, the preset touch gesture may be a touch gesture that separates one of a plurality of UI elements displayed on the main area from another UI element.

Meanwhile, the control method according to the present embodiment may further include, when a flick gesture is detected on the sub-region, changing the UI element being displayed on the sub-region to another previously registered UI element and displaying it. can

Meanwhile, the sub-region is divided into a plurality of sub-regions, and in the control method according to the present embodiment, when a touch gesture moving from one of the plurality of sub-regions to the main region is detected, a sub-menu for the sub-region The method may further include displaying them on the main area.

On the other hand, in the computer-readable recording medium according to an embodiment of the present invention, the recording medium is bent and fixed to configure the front and side surfaces of the user terminal device, and includes a main area disposed on the front of the user terminal device and the and a program for executing a control method of a user terminal device having a flexible display unit divided into sub-regions extending from a main region in the lateral direction and including a bent portion, wherein the control method of the user terminal device includes: When a set event occurs, displaying a plurality of UI elements individually displayable in the sub-area on the main area, and when one of a plurality of UI elements displayed on the main area is selected, setting the selected UI element to the sub-area Including the step of indicating.

According to various embodiments of the present invention as described above, the user can be provided with various user experiences by using the flexible display unit including the main area and the sub area. Accordingly, user convenience and satisfaction may be improved.

1 is a block diagram showing the configuration of a user terminal device according to an embodiment of the present invention;
2 to 10 are views showing various configuration examples of the flexible display unit;
11 is a block diagram illustrating a configuration of a user terminal device according to various embodiments of the present disclosure;
12 is a diagram illustrating an example of a software configuration of a user terminal device according to an embodiment of the present invention;
13 to 22 are views showing examples of screens displayed on a user terminal device according to various embodiments of the present disclosure;
23 is a flowchart illustrating a method of controlling a user terminal device according to an embodiment of the present invention.

Since the present embodiments can apply various transformations and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope of the specific embodiments, and it should be understood to include all transformations, equivalents and substitutions included in the spirit and scope of the disclosed technology. In describing the embodiments, if it is determined that a detailed description of a related known technology may obscure the subject matter, the detailed description thereof will be omitted.

Terms such as first, second, etc. may be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the scope of rights. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as "comprises" or "consisting of" are intended to designate that the features, numbers, steps, operations, components, parts, or combinations thereof described in the specification exist, and are intended to indicate that one or more other It is to be understood that this does not preclude the possibility of addition or presence of features or numbers, steps, operations, components, parts, or combinations thereof.

In an embodiment, a 'module' or 'unit' performs at least one function or operation, and may be implemented as hardware or software, or a combination of hardware and software. In addition, a plurality of 'modules' or a plurality of 'units' are integrated into at least one module and implemented with at least one processor (not shown) except for 'modules' or 'units' that need to be implemented with specific hardware. can be

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating an example of a basic configuration of a user terminal device for explaining various embodiments of the present disclosure. Specifically, the user terminal device 1000 of FIG. 1 may be implemented as various types of devices, such as a TV, a PC, a laptop PC, a mobile phone, a tablet PC, a PDA, an MP3 player, a kiosk, an electronic picture frame, a table display device, etc. . When implemented as a portable type device such as a mobile phone, tablet PC, PDA, MP3 player, or laptop PC, it may be referred to as a mobile device, but in this specification, it will be collectively referred to as a user terminal device.

Referring to FIG. 1 , a user terminal device 1000 includes a flexible display unit 100 , a touch sensing unit 200 , and a control unit 300 .

The flexible display unit 100 is divided into a main area and at least one sub area. Here, the main region and the sub region may be defined in various meanings. For example, a region having a relatively large size among the two regions may be defined as a main region, and a region having a smaller size may be defined as a sub region. Alternatively, a region located on the same plane as a plane on which a home button or a front speaker for returning to the home screen is disposed may be defined as a main region, and a region positioned on the side may be defined as a sub region. Alternatively, the main area may be defined as an area that can directly control the UI in the area, and the sub area may mean an area that can control the UI of the main area.

The area of the sub region may be smaller than that of the main region. Also, the at least one sub-region may form a different surface from the main region. For example, if the main region is disposed on the front surface of the user terminal device 1000 , at least one sub-region is a right side surface among the surfaces constituting the exterior of the user terminal device 1000 , They may be disposed on different surfaces such as a left side surface and a back surface. A surface (flat or curved) including the main region and a surface (flat or curved) including at least one sub-region may be fixed to form an obtuse angle. The shape, position, and number of sub-regions may be variously implemented according to embodiments. This will be described in detail together with the drawings in a part to be described later. On the other hand, when the sub-region is located on a side surface among surfaces forming the exterior of the user terminal device 1000 , the sub-region may be referred to as an edge region.

The touch sensing unit 200 may detect a user's touch in at least one of the main area and the sub area. The touch sensing unit 200 may include at least one of a touch panel and a pen recognition panel. The touch panel may detect a user's finger gesture input and output a touch event value corresponding to the sensed touch signal. The touch panel may be mounted under both the main area and the sub area of the flexible display unit 100 . A method for the touch panel to sense a user's finger gesture input may include a capacitive type and a pressure sensitive type. The capacitive method is a method of calculating touch coordinates by sensing micro-electricity caused by the user's body. The decompression type is a method of calculating touch coordinates by sensing that current flows by contacting the upper and lower plates of the touched point, including two electrode plates built into the touch panel.

The pen recognition panel detects a user's pen gesture input according to the user's operation of a touch pen (eg, a stylus pen or a digitizer pen), and outputs a pen proximity event value or a pen touch event value can do. The pen recognition panel may be mounted under at least one of the main area and the plurality of sub areas of the flexible display unit 100 . The pen recognition panel, for example, may be implemented using an EMR method, and may sense a touch or proximity input according to a change in the intensity of an electromagnetic field due to proximity of a pen or a touch. In detail, the pen recognition panel includes an electromagnetic induction coil sensor (not shown) having a grid structure and an electronic signal processing unit (not shown) that sequentially provides an AC signal having a predetermined frequency to each loop coil of the electromagnetic induction coil sensor can be configured. When a pen having a built-in resonance circuit is present in the vicinity of the loop coil of the pen recognition panel, a magnetic field transmitted from the loop coil generates a current based on mutual electromagnetic induction in the resonance circuit in the pen. Based on this current, an induced magnetic field is generated from the coil constituting the resonance circuit in the pen, and the pen recognition panel detects this induced magnetic field in the loop coil in the signal receiving state, so that the approach or touch position of the pen is can be detected.

The controller 300 may control the display of the main area and at least one sub area of the flexible display unit 100 . For example, the controller 300 may display a UI element that can be displayed in the sub area on the main area. The types, display methods, layouts, etc. of UI elements displayed in the sub area and the main area may be variously changed according to embodiments. This will be described in detail in a section to be described later.

2 is a diagram illustrating an example of an external configuration of a user terminal device including a flexible display unit divided into one sub area and a main area.

According to FIG. 2 , the flexible display unit 100 is divided into a main area 1010 disposed on the front surface of the user terminal device 1000 and a sub area 1020 disposed on the right side of the user terminal device 1000 . can be In FIG. 2 , the main area 1010 and the sub area 1020 are divided based on the boundary area 1050 . Considering that the flexible display unit 100 is in a bent state, the boundary area 1050 may also be expressed as a bending line.

3 is a diagram illustrating a cross-sectional configuration of the user terminal device of FIG. 2 . Referring to FIG. 3 , the main area 1010 and the sub area 1020 of the flexible display unit 100 are respectively disposed on the front and side surfaces of the user terminal device 1000 .

4 and 5 are diagrams illustrating an example of an external configuration and a cross-sectional configuration of a user terminal device including a flexible display unit divided into two sub-regions and a main region.

Referring to FIG. 4 , the main area 1010 is disposed on the front side, and sub areas 1020 and 1030 are disposed on the right side and the left side, respectively. The main area 1010 and each of the sub areas 1020 and 1030 are divided by boundary areas 1050 - 1 and 1050 - 2 .

FIG. 5 shows a cross-sectional configuration of the user terminal device 1000 of FIG. 4 . Referring to FIG. 5 , each of the sub-regions 1020 and 1030 may be disposed while forming an obtuse angle with the main region 1010 so as to be viewed from the front direction.

6 and 7 are diagrams illustrating another example of a user terminal device including a flexible display unit divided into two sub-regions and a main region. Referring to FIG. 6 , the two sub-regions 1020 and 1030 are disposed on both sides of the main region 1010 , and may be fixed at viewing angles in the right and left directions instead of the front direction. That is, according to FIG. 7 , each of the sub-regions 1020 and 1030 may be bent close to 90 degrees from the plane including the main region 1010 .

Meanwhile, according to another embodiment of the present invention, the sub-region may be disposed on a side opposite to the main region 1010 .

8 and 9 show another example of a user terminal device including a flexible display unit divided into two sub-regions and a main region. 8 and 9 , the flexible display unit 100 is divided into a main area 1010 formed on the front surface, a first sub area 1020 formed on the side surface, and a second sub area 1040 formed on the rear surface. In FIG. 9 , the second sub-region 1040 may not cover the entire rear surface, but may be formed only on a partial area of the rear surface. The controller 300 controls the main region 1010 , the first sub region 1020 , and the second sub region 1040 based on the first boundary region 1050 - 1 and the third boundary region 1050 - 3 . By dividing, different contents can be displayed for each area.

Meanwhile, in FIGS. 3 to 9 , the sub-regions 1020 , 1030 , and 1040 are bent in a round shape, but the sub-regions 1020 , 1030 , and 1040 may also have a planar shape. In this case, the plane including the main region 1010 and the plane including the sub regions 1020 , 1030 , and 1040 may contact each other along the boundary line. That is, the boundary regions 1050 - 1 , 1050 - 2 , and 1050 - 3 may have a line shape.

Meanwhile, the user terminal device 1000 may have a triangular cross-section. In this case, the surface including the main area 1010 and the surface including the sub area 1020 are connected to each other to form an obtuse angle θ in the boundary area 1050 . In addition, the cross-sectional configuration may be configured in various shapes such as trapezoid, pentagon, and the like.

In addition, although the flexible display unit 100 is shown in a horizontally bent state with respect to the front surface of the user terminal device, the present invention is not limited thereto. That is, the flexible display unit 100 may be bent in the vertical direction with respect to the front surface of the user terminal device 1000 .

10 illustrates a state in which the flexible display unit 100 is bent in the vertical direction. Specifically, the flexible display unit 100 may be divided into a main area 1010 disposed on the front side of the user terminal device 1000 and a sub area 1020 disposed on the lower side of the user terminal device 1000 . A speaker unit 390 may be disposed above the main area 1010 .

Meanwhile, in FIG. 1 , the configuration of the user terminal device including the flexible display unit 100 , the touch sensing unit 200 , and the control unit 300 is illustrated. However, according to an embodiment, the user terminal device 1000 includes various components. may further include. For example, the user terminal device 1000 may further include a memory in which various applications are stored. The controller 300 may execute an application stored in the memory according to the sensed user gesture, and display content provided by the application in at least one of the main area and the sub area.

In addition, the user terminal device 1000 may be configured in various forms.

11 is a block diagram illustrating an example of a detailed configuration of the user terminal device 1000 implemented as a mobile phone. According to FIG. 11 , the user terminal device 1000 includes a flexible display unit 100 , a touch sensing unit 200 , a control unit 300 , a storage unit 310 , a GPS chip 320 , a communication unit 330 , and a video processor ( 340 ), an audio processor 350 , a button 360 , a microphone unit 370 , an imaging unit 380 , a speaker unit 390 , and a motion sensing unit 400 .

As described above, the flexible display unit 100 may be divided into a main area and at least one sub area. The flexible display unit 100 may be implemented in various types of displays, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a plasma display panel (PDP), and the like. In the flexible display unit 100 , a driving circuit, a backlight unit, etc. that may be implemented in the form of an a-si TFT, a low temperature poly silicon (LTPS) TFT, or an organic TFT (OTFT) may also be included.

The touch sensing unit 200 may include a touch sensor for sensing a user's touch gesture. The touch sensor may be implemented as various types of sensors such as capacitive type, pressure sensitive type, and piezoelectric type. The capacitive type is a method of calculating touch coordinates by sensing micro-electricity excited by the user's body when a part of the user's body is touched on the touch screen surface using a dielectric coated on the touch screen surface. The decompression type includes two electrode plates embedded in the touch screen, and when the user touches the screen, the touch coordinates are calculated by detecting that the upper and lower plates of the touched point come into contact and current flows. In addition, when the user terminal device 1000 also supports the pen input function, the bent touch screen 100 may detect a user gesture using an input means such as a pen in addition to the user's finger. When the input means is a stylus pen having a coil therein, the user terminal device 1000 may include a magnetic field detection sensor capable of detecting a magnetic field changed by the coil inside the stylus pen. Accordingly, it is possible to sense not only the touch gesture but also the proximity gesture, that is, hovering.

The storage unit 310 may store various programs and data necessary for the operation of the user terminal device 1000 . Specifically, the storage unit 310 may store programs and data for configuring various screens to be displayed in the main area and the sub area.

The control unit 300 displays UI elements in each of the main area and the sub area of the flexible display unit 100 by using the program and data stored in the storage unit 310 . Also, the controller 300 may display continuous UI elements over the main area and the sub area.

The control unit 300 includes a RAM 210 , a ROM 220 , a CPU 230 , a graphic processing unit (GPU) 240 , and a bus 250 . The RAM 210 , the ROM 220 , the CPU 230 , a graphic processing unit (GPU) 240 , and the like may be connected to each other through the bus 250 .

The CPU 230 accesses the storage unit 310 and performs booting using the O/S stored in the storage unit 310 . Then, various operations are performed using various programs, contents, data, etc. stored in the storage unit 310 .

The ROM 220 stores an instruction set for system booting, and the like. When a turn-on command is input and power is supplied, the CPU 230 copies the O/S stored in the storage unit 310 to the RAM 210 according to the command stored in the ROM 220, and executes the O/S to the system boot up When booting is completed, the CPU 230 copies various programs stored in the storage unit 310 to the RAM 210 , and executes the programs copied to the RAM 210 to perform various operations. When the booting of the user terminal device 1000 is completed, the GPU 240 displays the UI element in the active area among the main area and the sub area. Specifically, the GPU 240 may generate a screen including various objects such as icons, images, and texts by using a calculator (not shown) and a renderer (not shown). The calculation unit calculates property values such as coordinate values, shape, size, color, etc. of each object to be displayed according to the layout of the screen. The rendering unit generates screens of various layouts including objects based on the attribute values calculated by the calculation unit. The screen generated by the rendering unit is provided to the bent touch screen 100 and displayed in the main area and the sub area, respectively.

The GPS chip 320 is a component for receiving a GPS signal from a Global Positioning System (GPS) satellite and calculating the current location of the user terminal device 1000 . The controller 300 may calculate the user's location by using the GPS chip 320 when using a navigation program or when the user's current location is required.

The communication unit 330 is configured to communicate with various types of external devices according to various types of communication methods. The communication unit 330 includes a Wi-Fi chip 331 , a Bluetooth chip 332 , a wireless communication chip 333 , and an NFC chip 334 . The control unit 300 performs communication with various external devices using the communication unit 330 .

The Wi-Fi chip 331 and the Bluetooth chip 332 perform communication using a WiFi method and a Bluetooth method, respectively. In the case of using the Wi-Fi chip 331 or the Bluetooth chip 332 , various types of connection information such as an SSID and a session key are first transmitted and received, and then various types of information can be transmitted and received after communication connection using the same. The wireless communication chip 333 refers to a chip that performs communication according to various communication standards such as IEEE, ZigBee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), and Long Term Evoloution (LTE). The NFC chip 334 refers to a chip operating in an NFC (Near Field Communication) method using a 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz, and 2.45 GHz.

The video processor 340 is a component for processing the content received through the communication unit 330 or video data included in the content stored in the storage unit 310 . The video processor 340 may perform various image processing, such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion, on video data.

The audio processor 350 is a component for processing the content received through the communication unit 330 or audio data included in the content stored in the storage unit 310 . In the audio processor 350 , various processes such as decoding, amplification, and noise filtering on audio data may be performed.

When a playback program for multimedia content is executed, the controller 300 drives the video processor 340 and the audio processor 350 to play the corresponding content.

The flexible display unit 100 may display the image frame generated by the video processor 340 in at least one of the main area and the sub area.

Also, the speaker unit 390 outputs audio data generated by the audio processor 350 .

The button 360 may be various types of buttons such as a mechanical button, a touch pad, a wheel, etc. formed in an arbitrary area such as the front, side, or rear of the main body of the user terminal device 1000 .

The microphone unit 370 is configured to receive a user's voice or other sound and convert it into audio data. The control unit 300 may use the user's voice input through the microphone unit 370 in a call process, or convert it into audio data and store it in the storage unit 310 .

The imaging unit 380 is configured to capture a still image or a moving image according to a user's control. The imaging unit 380 may be implemented in plurality, such as a front camera and a rear camera. As described above, the imaging unit 380 may be used as a means for acquiring an image of the user in an embodiment for tracking the user's gaze.

When the imaging unit 380 and the microphone unit 370 are provided, the control unit 300 performs a control operation according to a user voice input through the microphone unit 370 or a user motion recognized by the imaging unit 380 . may be That is, the user terminal device 1000 may operate in a motion control mode or a voice control mode. When operating in the motion control mode, the controller 300 activates the imaging unit 380 to capture an image of the user, tracks the user's motion change, and performs a control operation corresponding thereto. When operating in the voice control mode, the controller 300 may also operate in a voice recognition mode in which a user voice input through the microphone unit 370 is analyzed and a control operation is performed according to the analyzed user voice.

In the user terminal device 1000 in which the motion control mode or the voice control mode is supported, the voice recognition technology or the motion recognition technology may be used in the various embodiments described above. For example, when the user takes a motion as if selecting an object displayed on the home screen or pronounces a voice command corresponding to the object, it is determined that the object is selected and a control operation matched to the object can be performed. .

The motion detection unit 400 is a component for detecting the movement of the main body of the user terminal device 1000 . That is, the user terminal device 1000 may be rotated or tilted in various directions. The motion detection unit 400 may detect motion characteristics such as a rotation direction, an angle, and a tilt by using at least one of various sensors such as a geomagnetic sensor, a gyro sensor, and an acceleration sensor.

In addition, although not shown in FIG. 11 , according to an embodiment, a USB port to which a USB connector can be connected in the user terminal device 1000 or various external inputs for connecting to various external terminals such as a headset, a mouse, and a LAN Of course, it may further include a port, a DMB chip for receiving and processing a Digital Multimedia Broadcasting (DMB) signal, various sensors, and the like.

Meanwhile, as described above, various programs may be stored in the storage unit 310 . 12 is a diagram for explaining the structure of software stored in the user terminal device 1000 . According to FIG. 12 , software including an OS 1210 , a kernel 1220 , middleware 1230 , an application 1240 , and the like may be stored in the storage unit 310 .

An operating system (OS) 1210 controls and manages the overall operation of hardware. That is, the OS 1210 is a layer in charge of basic functions such as hardware management, memory, and security.

The kernel 1220 serves as a path for transmitting various signals including a touch signal detected by the bent touch screen 100 to the middleware 1220 .

The middleware 1220 includes various software modules that control the operation of the user terminal device 1000 . 12 , the middleware 1230 includes an X11 module 1230-1, an APP manager 1230-2, a connection manager 1230-3, a security module 1230-4, a system manager 1230-5, It includes a multimedia framework 1230-6, a UI framework 1230-7, a window manager 1230-8, and a handwriting recognition module 1230-9.

The X11 module 1230-1 is a module for receiving various event signals from various hardware provided in the user terminal device 1000 . Here, the event may be variously set, such as an event in which a user gesture is detected, an event in which a system alarm occurs, an event in which a specific program is executed or terminated, and the like.

The APP manager 1230 - 2 is a module for managing execution states of various applications 1240 installed in the storage 310 . When an application execution event is detected from the X11 module 1230-1, the APP manager 1230-2 calls and executes an application corresponding to the event.

The connection manager 1230 - 3 is a module for supporting a wired or wireless network connection. The connection manager 1230 - 3 may include various detailed modules such as a DNET module and a UPnP module.

The security module 1230 - 4 is a module supporting hardware certification, request permission, secure storage, and the like.

The system manager 1230 - 5 monitors the status of each component in the user terminal device 1000 and provides the monitoring result to other modules. For example, when the remaining battery level is insufficient, an error occurs, or the communication connection state is cut off, the system manager 1230-5 transmits the monitoring result to the main UI framework 1230-7 or the sub UI frame. It can be provided to the walk 1230-9 to output a notification message or a notification sound.

The multimedia framework 1230 - 6 is a module for playing multimedia content stored in the user terminal device 1000 or provided from an external source. The multimedia framework 1230 - 6 may include a player module, a camcorder module, a sound processing module, and the like. Accordingly, it is possible to perform an operation of reproducing various multimedia contents to generate a screen and sound.

The main UI framework 1230 - 7 is a module for providing various UIs to be displayed in the main area of the bent touch screen 100 , and the sub UI framework 1230 - 9 provides various UIs to be displayed in the sub area. module to provide. The main UI framework 1230-7 and the sub UI framework 1230-9 include an image compositor module constituting various objects, a coordinate compositor that calculates coordinates at which objects are to be displayed, and coordinates obtained by calculating the configured objects. It may include a 2D/3D UI toolkit that provides a rendering module for rendering to the UI, a tool for composing a 2D or 3D UI, and the like.

The window manager 1230 - 8 may detect a touch event or other input event using the user's body or a pen. When such an event is detected, the window manager 1230-8 transmits an event signal to the main UI framework 1230-7 or the sub UI framework 1230-9 to perform an operation corresponding to the event.

In addition, when the user touches and drags the screen, a writing module for drawing a line according to the drag trajectory, or a pitch angle, a roll angle, a yaw angle, etc. Various program modules such as an angle calculation module for calculating may be stored.

The application module 1240 includes applications 1240-1 to 1240-n for supporting various functions. For example, it may include a program module for providing various services such as a navigation program module, a game module, an e-book module, a calendar module, an alarm management module, and the like. These applications may be installed by default, or the user may install and use them arbitrarily in the course of use. When an object is selected, the CPU 230 may execute an application corresponding to the selected object using the application module 1240 .

Since the software structure shown in FIG. 12 is only an example, it is not necessarily limited thereto. Accordingly, it goes without saying that some may be omitted, modified, or added as necessary. For example, the storage unit 310 includes a sensing module for analyzing signals sensed by various sensors, a messaging module such as a messenger program, a short message service (SMS) & multimedia message service (MMS) program, an e-mail program, and phone information. Various programs such as a Call Info Aggregator program module, a VoIP module, and a web browser module may be additionally provided.

Meanwhile, as described above, the user terminal device 1000 may be implemented as various types of devices such as a mobile phone, a tablet PC, a laptop PC, a PDA, an MP3 player, an electronic picture frame device, a TV, a PC, and a kiosk. Accordingly, the configuration described with reference to FIGS. 11 and 12 may be variously modified according to the type of the user terminal device 1000 .

As described above, the user terminal device 1000 may be implemented in various forms and configurations. The controller 300 of the user terminal device 1000 may support various user interactions according to embodiments.

Hereinafter, a user interaction method according to various embodiments of the present invention will be described in detail.

According to an embodiment of the present invention, when a preset event occurs, the controller 300 may perform an operation corresponding to the preset event. The preset event may be understood as sensing a user manipulation. For example, there may be events related to various user manipulations, such as an event in which a preset touch gesture is detected, an event in which a preset motion of the user terminal device 1000 is detected, and the like.

Touch gestures include, for example, a gesture of touching one point and moving to another point while maintaining the touch state (drag, drag), a gesture of rubbing after touching a point (rubbing), and pressing and holding a point for more than a threshold time. There are various gestures such as a gesture (long pressing), a gesture that quickly flicks in one direction after touching a point (flick), and a gesture of lightly touching with a fingertip (tapping).

When a preset event is detected, the control unit 300 may control the flexible display unit 100 to display a plurality of UI elements that can be individually displayed in the sub area on the main area. Alternatively, the controller 300 may display some of the plurality of UI elements in the sub area and some in the main area instead of displaying the UI elements only in the main area.

A UI element that can be displayed in a sub-region has a display layout of the sub-region. The layout refers to information in which the size, shape, arrangement position, arrangement order, and the like of an area for displaying various types of information are determined. Hereinafter, for convenience of explanation, the term 'UI element' is used as the same meaning as 'UI element displayable in a sub area'.

There are various UI elements that the user terminal device 1000 can provide. For example, a UI element for adjusting the volume of the user terminal device 1000, a UI element for adjusting the screen brightness, a UI element for collecting favorite icons, a UI element including information on stocks of interest, music or video playback Numerous UI elements, such as UI elements for Among them, the user can register and use only desired UI elements. Information about registration and non-registration states of UI elements is stored in the storage unit 310 .

When a preset event is detected, the controller 300 may display these registered UI elements in the main area. 13 to 15 are diagrams for explaining this embodiment.

Meanwhile, for convenience of explanation, it is assumed that there is one sub-region for the following various embodiments, and the main region of the flexible display unit 100 is 1010 and the sub-region of the flexible display unit 100 is denoted by reference numeral 1020. used in unification.

Referring to FIG. 13 , when a touch gesture moving from the sub area 1020 to the main area 1010 is detected, the controller 300 displays the UI element A and the UI element B in the main area 1010 or from the beginning. The UI element A displayed on the sub area 1020 may be displayed in the sub area 1020 as it is, and the UI element B may be displayed in the main area 1010 . And when the subsequent touch gesture is detected, the controller 300 further displays the additional UI element C and the UI element D on the main area 1010 . In this case, the touch gesture may be a touch gesture that extends from the initial touch point to the final touch point at a lower position than the initial touch point, for example, as if drawing an arc.

FIG. 14 is a diagram for explaining that a plurality of UI elements are displayed in the main area 1010 using a touch gesture different from that of FIG. 13 .

Referring to FIG. 14 , according to a touch gesture moving in a straight line from the sub area 1020 to the main area 1010 , the controller 300 displays the UI elements A and B in the main area 1010 or first The UI element A displayed on the sub area 1020 may be displayed in the sub area 1020 as it is, and the UI element B may be displayed in the main area 1010 . And when the subsequent touch gesture is detected, the controller 300 further displays the additional UI element C and the UI element D.

As described with reference to FIGS. 13 and 14 , the controller 300 may display a variable number of UI elements displayed on the main area 1010 in response to the length of the touch gesture. Meanwhile, the order in which UI elements appear in the main area may be changed according to settings. For example, when a touch gesture extending from the sub area 1020 to the main area 1010 is detected, the controller 300 may display the UI element being displayed in the sub area 1020 as the head and other UI elements to follow. Alternatively, the UI element being displayed in the sub area 1020 may be placed last, and other UI elements may be sequentially displayed toward the main area 1010 . For example, it may be displayed in the order of D-C-B-A as shown in FIG. 13 , or may be displayed in the order of A-B-C-D as shown in FIG. 14 .

Meanwhile, touch gestures may be more diverse than those described with reference to FIGS. 13 and 14 . In addition, the above-described operation may be performed not only when a touch gesture is sensed but also when a movement of the user terminal device 1000 is sensed. That is, according to another embodiment of the present invention, when a preset movement of the user terminal device 1000 is detected, a plurality of UI elements displayable in the sub area may be displayed in the main area. 15 is a diagram for explaining this embodiment.

Referring to FIG. 15 , when a motion in which the user terminal device 1000 is accelerated in a preset direction is detected by the motion detecting unit 400 (as if unfolding a fan), the controller 300 moves in the direction in which the acceleration is detected. UI element A, UI element B, UI element C, and UI element D can be displayed in the main area 1010 in an unfolded form, or UI element A that has been displayed in the sub area 1020 from the beginning remains as it is in the sub area 1020 ), the remaining UI elements may be displayed in the main area 1010 .

Alternatively, when an acceleration motion of the terminal device 1000 is detected while a region on the sub-region 1020 is being touched, the controller 300 expands in the direction in which the acceleration is detected, UI element A, UI element B , UI element C and UI element D can be displayed in the main area 1010 , or UI element A, which was initially displayed in the sub area 1020 , remains in the sub area 1020 , and the remaining UI elements are displayed in the main area 1010 . ) can be displayed. That is, a combination of a touch gesture and a movement gesture may be used.

Meanwhile, in a state in which the plurality of UI elements are displayed as described above, when a movement of the user terminal device 1000 in a direction opposite to the direction in which the UI elements are unfolded is sensed, the controller 300 displays it on the main area 1010 . You can make the old UI elements disappear.

According to the embodiments described with reference to FIGS. 13 to 15 , since the user can check a plurality of previously registered UI elements at once, user convenience can be improved.

In addition, the user may check a plurality of UI elements displayed on the main area 1010 , and select any one of them to be displayed on the sub area 1020 . As a method of selecting a UI element, for example, a user may select any one of a plurality of UI elements displayed on the main area 1010 by touching it. Alternatively, the user may change any one of the plurality of UI elements displayed on the main area 1010 to a movable state by long pressing, and then move the UI element by dragging the UI element to the sub area 1020 . In addition, the user may select any one of the plurality of UI elements in various ways.

According to an embodiment, the user may select the UI element by moving the UI element to be selected to a specific location. An embodiment related thereto is shown in FIGS. 16 to 17 .

Referring to FIG. 16 , the controller 300 may increase and display the number of UI elements displayed on the main area 1010 according to a touch gesture, and in the same manner, according to the touch gesture, the controller 300 controls the main area The number of UI elements displayed in 1010 may be reduced and displayed. Specifically, when the touch gesture is directed from the sub area 1020 to the main area 1010 , the number of UI elements is increased, and when the touch gesture is directed from the main area 1010 to the sub area 1020 , the number of UI elements is decreased.

That is, the controller 300 can display the number of UI elements displayed on the main area 1010 variably according to the length of the touch gesture. In this case, as shown in FIG. 16 , when the touch gesture is released (when the touch gesture is no longer detected, for example, when the user releases the user's hand from the flexible display unit), the touch gesture is displayed in the sub-region 1020 at the time it is released. The old UI element C can be selected. The selected UI element C is displayed in the sub area 1020 , and the remaining UI elements A and B disappear.

In FIG. 16 , it has been described that the UI element located in the sub region 1020 is selected when the touch gesture is released. However, according to another embodiment, after the UI element is positioned at a preset position on the main region 1010 , touch When the gesture is released, the UI element can be selected. This embodiment will be described with reference to FIG. 17 .

Referring to FIG. 17 , a graphic object 17 indicating an area in which a UI element should be positioned for UI element selection, for example, may be displayed on the main area 1010 . In FIG. 17 , the graphic object 17 is illustrated as a shadow, and the UI element B is located in the graphic object 17 . In this state, when the user releases the touch gesture, the UI element B is selected and displayed on the sub area 1020 , and the remaining UI elements A, C, D, E, and F disappear. If the user wants to select the UI element C while the UI element B is positioned on the graphic object 17 , if the user moves to the right by a certain distance without releasing the hand from the flexible display unit 100 , the UI element C becomes the graphic object 17 , and when the hand is released from that state, the UI element C will be selected and displayed on the sub-region 1020 .

Meanwhile, although embodiments in which a plurality of UI elements are displayed in the main area 1010 have been described above, according to another embodiment, there is also a method of checking a plurality of UI elements one by one on the sub-area. According to this embodiment, when a flick gesture is detected on the sub-region 1020 , the controller 300 may change the UI element being displayed on the sub-region 1020 to another previously registered UI element and display it. have. This embodiment will be described with reference to FIG. 18 .

Referring to FIG. 18 , when a flick gesture is detected while UI element A is displayed on the sub area 1020 , the controller 300 displays a UI element B different from the UI element A in the sub area 1020 . can make it happen For example, as shown in FIG. 18 , the existing UI element A disappears in the upward direction in which the flick gesture is taken, and another UI element B appears. According to the present embodiment, the user may repeat a flick gesture on the sub-region 1020 until a desired UI element appears. If the user feels that the repetitive operation is tiring, the user may list and check a plurality of UI elements at once according to the above-described embodiment.

Meanwhile, there are various UI elements that the user terminal device 1000 can provide. For example, a UI element for adjusting the volume of the user terminal device 1000, a UI element for adjusting the screen brightness, a UI element for collecting favorite icons, a UI element including information on stocks of interest, music or video playback Numerous UI elements, such as UI elements for Some of these UI elements may be unnecessary to the user. Therefore, according to an embodiment of the present invention, a user can register and use only a desired UI element.

For example, if there are ten UI elements supported by the user terminal device 1000 , the user may select and register only four UI elements among them. And when a preset event is detected, the controller 300 may display the four previously registered UI elements on the main area 1010 according to the above-described embodiments.

Hereinafter, a method for editing a previously registered UI element will be described with reference to FIGS. 19 to 20 .

According to an embodiment of the present invention, when a preset touch gesture for at least one of a plurality of UI elements displayed in the main area 1010 is detected, the controller 300 sets the UI element in which the preset touch gesture is detected to a sub-region. It can be excluded from the pre-registered UI elements that can be displayed in . In this case, the preset touch gesture may be a touch gesture that separates one of a plurality of UI elements displayed on the main area 1010 from another UI element. For example, as shown in FIG. 19 , the UI element C may be pushed upward to be spaced apart from other UI elements A, B, D, and E. As a result, since the UI element C is excluded from the previously registered UI elements, only UI elements A, B, D, and E are displayed on the main area 1010 later.

In addition, an operation for changing the order of UI elements as well as an operation for removing UI elements may be performed. For example, when UI element C is long pressed while UI elements A, B, C, D, and E are displayed, the controller 300 changes the UI element C to a movable state, and the UI according to the user's touch gesture Element C may be positioned between UI elements D and E. Accordingly, what was displayed in the order of A-B-C-D-E may be changed to the order of A-B-D-C-E.

On the other hand, UI elements that have been deregistered can be re-registered as well. To this end, the user terminal device 1000 may provide a screen for editing UI elements.

According to an embodiment, when a multi-touch is detected from the sub area 1020 to the main area 1010 , the controller 300 controls a screen for editing UI elements displayable in the sub area 1020 . may be displayed in the main area 1010 . Multi-touch is a technology for recognizing that two or more points that are separated from each other are simultaneously touched.

For example, as shown in FIG. 20 , when a multi-touch gesture moving toward the main area 1010 by touching two or more points of the sub area 1020 is detected, the control unit 300 displays the editing screen 20 in the main area ( 1010) can be indicated. On the edit screen 20, as shown in FIG. 20, all UI elements provided by the user terminal device 1000 are displayed, the radio button of the registered UI element is checked, and The radio button is unchecked. That is, in FIG. 20 , UI elements A and B are in a deregistered state, and UI elements C, D, and E are in a registered state. If the Done button is selected here, the settings are saved. As a result, when a preset event occurs (for example, when a touch gesture moving from the sub-area 1020 to the main area 1010 is detected), the controller 300 controls only the registered UI elements C, D, and E. It is displayed in the area 1010 .

Also, it is possible to change the order of UI elements on the edit screen 20 . For example, it is possible to change the order of UI elements by long-pressing them on the editing screen 20 .

Meanwhile, the user terminal device 1000 may be implemented to perform another display operation instead of displaying the edit screen by such a multi-touch gesture. For example, when a multi-touch gesture leading to the main area 1010 is detected on the sub area 1020 , the control unit 300 applies an extended UI element in which the UI element displayed in the sub area 1020 is expanded to the main area 1020 . can be displayed This embodiment will be described with reference to FIG. 21 .

Referring to FIG. 21 , for example, when a multi-touch gesture directed from the sub region 1020 to the main region 1010 is detected while a UI element related to music playback is displayed on the sub region 1020 , the controller 300 controls the A sub-menu for UI elements related to music reproduction may be displayed on the main area 1010 . For example, as shown in FIG. 21 , an EQ (Equalizer) menu screen 21 for changing the frequency characteristics of music may be displayed. According to the present embodiment, the user can receive not only the functions provided in the sub area 1020 , but also a sub menu including functions related thereto on the main area 1010 .

Also, the controller 300 may change the size of the sub-menu according to the length of the multi-touch gesture. That is, the size of the sub menu may be determined to correspond to the length of the touch gesture from the sub region 1020 to the main region 1010 .

Meanwhile, the multi-touch gesture may be performed in a manner different from the above-described method. For example, even when a multi-touch gesture of simultaneously touching one point of the main area 1010 and one point of the sub area 1020 is sensed, the same operation as described above may be performed. In this case, the size of the sub-menu may be determined by the distance between the touch point of the main area 1010 and the touch point of the sub area 1020 .

Meanwhile, in addition to the embodiment described with reference to FIG. 21 , a sub-menu for a sub-region may be displayed on the main area 1010 in various ways.

Specifically, the sub-region 1020 is divided into a plurality of sub-regions, and when a touch gesture moving from one of the plurality of sub-regions to the main region 1010 is sensed, the controller 300 controls the sub-region 1020. Sub menus may be displayed in the main area 1010 . This embodiment will be described with reference to FIG. 22 .

Referring to FIG. 22 , the sub-region 1020 may be divided into regions a, b, and c, and when a touch gesture moving from region a to the main region 1010 is detected, the controller 300 controls the region a The sub-menu A may be displayed in the main area 1010 . Similarly, when a touch gesture moving from area b to the main area 1010 is detected, the controller 300 may display a submenu B related to area b in the main area 1010 . Similarly, when a touch gesture moving from region c to the main region 1010 is detected, the controller 300 may display a sub-menu related to region c in the main region 1010 .

For example, it is assumed that the UI element currently displayed in the sub-region 1020 provides functions related to Wi-Fi (region a), ringtone (region b), and Bluetooth (region c) settings. In this case, when region a is touched, Wi-Fi is turned on or off, when region b is touched, any one state of silence, vibration, and ringtone is changed, and when region c is touched, Bluetooth may be turned on or off.

In this case, when a touch gesture extending from area a to the main area 1010 is detected, the controller 300 may display a list of connectable Wi-Fi access points on sub-menu A related to area a, and from area b to the main area. When a touch gesture leading to 1010 is detected, the control unit 300 may display a ringtone list on sub-menu B related to area b, and when a touch gesture leading from area c to the main area 1010 is detected, the control unit ( 300) may display a list of Bluetooth-connectable peripheral devices in a sub-menu related to area c.

The above-described example is merely an embodiment, and various sub-menus may be displayed on the main area 1010 according to UI elements displayed on the sub area 1020 .

As described above, according to various embodiments of the present disclosure, the user can check a plurality of UI elements that can be displayed in the sub area in the main area that provides a larger space than the sub area, and UI elements displayed in the sub area can be extended to the main area to receive more various information and functions.

Hereinafter, a method of controlling the present user terminal device 1000 will be described in detail using a flowchart.

23 is a flowchart illustrating a method of controlling a user terminal device having a flexible display unit according to an embodiment of the present invention. According to FIG. 23 , when a preset event occurs ( S2310 ), the user terminal device 1000 may display a plurality of UI elements that can be individually displayed on the sub-region of the flexible display unit on the main region of the flexible display unit ( S2320 ). ). The preset event includes, for example, an event of touching a preset point of the sub-region or the main region, an event in which a touch gesture extending from the sub-region to the main region is sensed, and a movement in which the user terminal device 1000 accelerates in a preset direction is detected. There may be a variety of events, such as

In this state, when one of the plurality of UI elements displayed on the main area is selected ( S2330 ), the user terminal device 1000 may display the selected UI element on the sub area ( S2340 ). There are many ways to select UI elements. For example, the user may select by directly touching one of a plurality of displayed UI elements. Alternatively, the user may select by moving the UI element to be selected to a preset position of the flexible display unit and then releasing the touch gesture. In this case, according to an embodiment, the preset location may exist on the main area or on the sub area. In order to move a specific UI element to a preset position, various touch gestures may be used. For example, a touch gesture directed from the sub-region to the main region or from the main region to the sub-region may be used. In this case, the number of UI elements displayed according to the touch gesture from the sub region toward the main region increases, and the number of UI elements displayed according to the touch gesture from the main region toward the sub region decreases. When it is reduced, a graphic effect as if the UI element disappears out of the sub-region may be produced. On the other hand, the user may move the UI element on the main area directly to the sub area by long pressing.

The user terminal device 1000 displays the UI element selected as described above in the sub area. In addition, the user terminal device 1000 stops displaying unselected UI elements.

And, through the UI element displayed on the sub-region as described above, the user can control the user terminal device 1000 and receive various information. Meanwhile, in the above-described embodiment, it has been described that the user can control the user terminal device 1000 through the UI element only while the UI element is displayed in the sub area, but even when the UI element is displayed in the main area, the user The user terminal device 1000 may be controlled through the UI element displayed in the area.

On the other hand, although it is illustrated that the sizes of the UI elements are constant in the drawings, they may be different from each other. Also, the size of the UI element may be different when being displayed in the sub area and when being displayed in the main area. For example, when displayed in the main area, the size of the UI element may be enlarged and displayed. According to the present embodiment, the inconvenience caused by the UI element being displayed in a relatively small size on the sub-region, for example, the inconvenience of not seeing the UI element well for older users, may be resolved.

In addition, although operations related to UI element display described in the various embodiments described above may be performed, a detailed flowchart for each embodiment will not be illustrated and described.

As described above, the user terminal device may support various control methods. Each of the above-described embodiments may be implemented separately for each embodiment, but it goes without saying that they may be implemented in combination with each other as needed.

The method for controlling the user terminal device according to the above-described various embodiments may be stored in a non-transitory readable medium. Such a non-transitory readable medium may be mounted and used in various devices.

The non-transitory readable medium refers to a medium that stores data semi-permanently, rather than a medium that stores data for a short moment, such as a register, cache, memory, etc., and can be read by a device. Specifically, it may be a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, or the like.

For example, when a preset event occurs, displaying a plurality of UI elements individually displayable in the sub-area in the main area, and when one of the plurality of UI elements displayed on the main area is selected, the selected UI element is displayed in the sub-area The program code for performing the step may be provided stored in a non-transitory readable medium (non-transitory readable medium).

In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention as claimed in the claims Various modifications are possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or prospect of the present invention.

100: flexible display unit 200: touch sensing unit
300: control unit 1000: user terminal device

Claims (19)

In the user terminal device,
a flexible display unit that is bent and fixed to configure the front and side surfaces of the user terminal device, and is divided into a main area disposed on the front side of the user terminal device and a sub area extending from the main area in the lateral direction and including a bent portion;
a touch sensing unit configured to sense a user's touch in at least one of the main area and the sub area;
a motion detecting unit for detecting a motion of the user terminal device; and
control unit; including;
The control unit is
When a movement of the user terminal device accelerated in one direction is detected by the motion detecting unit while the sub-region is touched, a plurality of individually displayable UI elements in the sub-region are displayed in the main direction in the direction in which the acceleration is detected. controlling the flexible display unit to display on the area;
When one of a plurality of UI elements displayed on the main area is selected, the user terminal device according to claim 1, wherein the flexible display unit is controlled to display the selected UI element on the sub area. According to claim 1,
The control unit is
When a touch gesture moving from the sub-region to the main region is sensed, the flexible display unit is controlled to display a plurality of UI elements individually displayable in the sub-region on the main region. 3. The method of claim 2,
The control unit is
and controlling the flexible display unit to display a variable number of UI elements displayed on the main area corresponding to the length of the touch gesture. 4. The method of claim 3,
The control unit is
When the touch gesture is released, the user terminal device according to claim 1, wherein the flexible display unit is controlled to display a UI element located at a preset position on the sub-region. According to claim 1,
The control unit is
When a multi-touch gesture from the sub area to the main area is detected, the flexible display unit is controlled to display a screen for editing UI elements displayable in the sub area on the main area. a user terminal device. According to claim 1,
The control unit is
When a preset touch gesture for at least one of the plurality of UI elements displayed in the main area is detected, the UI element in which the preset touch gesture is detected is excluded from the previously registered UI elements that can be displayed in the sub area a user terminal device. 7. The method of claim 6,
The preset touch gesture is
A user terminal device, characterized in that it is a touch gesture for separating one of the plurality of UI elements displayed on the main area from another UI element. According to claim 1,
The control unit is
When a flick gesture is detected on the sub-region, the user terminal device according to claim 1, wherein the flexible display unit is controlled to change and display the UI element being displayed on the sub-region to another previously registered UI element. According to claim 1,
The sub-region is divided into a plurality of sub-regions,
The control unit is
When a touch gesture moving from one of the plurality of sub areas to the main area is detected, the flexible display unit is controlled to display sub menus for the sub areas on the main area. A flexible display unit that is bent and fixed to constitute the front and side surfaces of the user terminal device, and is divided into a main area disposed on the front side of the user terminal device and a sub area extending from the main area in the lateral direction to include a bent portion, A method for controlling a user terminal device comprising: a touch sensing unit sensing a user touch in at least one of the main region and the sub region; and a motion sensing unit sensing a movement of the user terminal device, the method comprising:
When a movement of the user terminal device accelerated in one direction is detected by the motion detecting unit while the sub-region is touched, a plurality of individually displayable UI elements in the sub-region are displayed in the main direction in the direction in which the acceleration is detected. marking the area; and
and displaying the selected UI element on the sub-region when one of a plurality of UI elements displayed on the main area is selected. 11. The method of claim 10,
When a touch gesture moving from the sub-region to the main region is detected, displaying a plurality of UI elements individually displayable in the sub-region on the main region; Way. 12. The method of claim 11,
Displaying the plurality of UI elements in the main area comprises:
The control method of a user terminal device, characterized in that the number of UI elements displayed on the main area is displayed by varying the length of the touch gesture. 13. The method of claim 12,
Displaying the UI element in the sub-region comprises:
When the touch gesture is released, a UI element at a preset position is displayed on the sub-region. 11. The method of claim 10,
When a multi-touch gesture from the sub area to the main area is detected, displaying a screen for editing UI elements displayable in the sub area on the main area; A method of controlling a user terminal device. 11. The method of claim 10,
When a preset touch gesture is detected for at least one of the plurality of UI elements displayed in the main area, excluding the UI element in which the preset touch gesture is detected from the previously registered UI elements displayable in the sub area; Control method of a user terminal device, characterized in that it further comprises. 16. The method of claim 15,
The preset touch gesture is
A method of controlling a user terminal device, characterized in that the touch gesture separates one of a plurality of UI elements displayed on the main area from another UI element. 11. The method of claim 10,
When a flick gesture is detected on the sub-region, changing the UI element being displayed on the sub-region to another previously registered UI element and displaying the changed; . 11. The method of claim 10,
The sub-region is divided into a plurality of sub-regions,
The control method of the user terminal device,
When a touch gesture moving from one of the plurality of sub-regions to the main region is detected, displaying sub-menus for the sub-region in the main region; . A flexible display unit that is bent and fixed to constitute the front and side surfaces of the user terminal device, and is divided into a main area disposed on the front side of the user terminal device and a sub area extending from the main area in the lateral direction to include a bent portion, and a program for executing a control method of a user terminal device having a touch sensing unit detecting a user touch in at least one of the main area and the sub area and a motion detecting unit detecting a motion of the user terminal apparatus In a computer-readable recording medium that
The control method of the user terminal device,
When a movement of the user terminal device accelerated in one direction is detected by the motion detecting unit while the sub-region is touched, a plurality of individually displayable UI elements in the sub-region are displayed in the main direction in the direction in which the acceleration is detected. marking the area; and
and displaying the selected UI element in the sub area when one of a plurality of UI elements displayed on the main area is selected.

Images