TWI668621B - Portable terminal and display method thereof - Google Patents

Abstract

The invention provides a portable terminal having a cover including a transparent area and a display method thereof. The display method includes: displaying a UI element on the exposed display region in a state where the display region is covered by a cover; and controlling the corresponding to the transparent region in response to a user input for selecting the UI element. Display area.

Description

Portable terminal and display method thereof

The method and device according to the exemplary embodiments relate to a portable terminal having a cover for protecting a display of the portable terminal and a display method thereof, and more particularly to a portable terminal and a display method thereof. Portable terminal with cover including transparent area and display method thereof.

This portable terminal can be carried with various portable terminal accessories. For example, the portable terminal may be provided with a USB storage device, a portable stand, or a cover for protecting the portable terminal, and the portable terminal may be placed on the portable stand for connection. The device is convenient for viewing (corresponding to DMB mode or TV mode).

The cover protects the portable terminal from shocks (such as dropping) that may occur frequently due to the characteristics of the portable terminal. In addition to absorbing impact, the cover can also have various colors or designs that express the personality of the user. Specifically, in the case where the cover has a transparent area, the user can confirm simple information through the transparent area of the cover while the portable terminal is still protected by the cover. For example, the user can confirm the current time or message reception through the transparent area of the cover. However, although the transparent area of the cover is a display area that a user can quickly and easily confirm, the function of using the transparent area of the cover is limited.

The aspect of the exemplary embodiment also provides various display functions of the portable terminal according to the opening and closing of the cover having the transparent area.

The aspect of the exemplary embodiment also provides that in a state where the display area of the portable terminal is covered by the cover, the portable terminal is associated with the display area exposed by the cover and the display area corresponding to the transparent area of the cover. Various display functions.

According to an aspect of the exemplary embodiment, a method for displaying information on a portable terminal is provided, the portable terminal is configured to be connected to a cover, the cover includes a transparent area and has a larger area than the portable terminal. The display area has a small width, and the method includes: displaying a user interaction on an exposed display area not covered by the cover in a state where a part of the display area is covered by the cover; UI) element, the part of the display area having the width of the cover and including the transparent area; and corresponding to the display of the UI element on the exposed display area not covered by the cover At the same time, a user input for selecting the UI element is received to control a part of the display information of the display area corresponding to the transparent area of the cover.

According to an aspect of the exemplary embodiment, a method for displaying information on a portable terminal is provided, the portable terminal is configured to be connected to a cover, the cover includes a transparent area and has a larger area than the portable terminal. The display area has a small width, and the method includes displaying on a portion of the display area corresponding to the transparent area of the cover in a state where a part of the display area is covered by the cover. A user interaction (UI) element, the portion of the display area having the width of the cover and including the transparent area; and corresponding to the display area corresponding to the transparent area of the cover While the UI element is displayed on the portion of the part, a user input for selecting the UI element is received, and an exposed display area not covered by the cover is controlled.

According to an aspect of the exemplary embodiment, a method for displaying information on a portable terminal is provided, the portable terminal is configured to be connected to a front cover, the front cover includes a transparent area, and the method includes: Displaying a user interaction on a side display area of the display of the portable terminal in a state where a front display area including the transparent area of the display of the portable terminal is covered by the front cover (UI) element; and in response to a user input selecting the UI element appearing while the UI element is displayed on the side display area, controlling the display area corresponding to the transparent area of the cover Display information.

According to an aspect of the exemplary embodiment, there is provided a portable terminal configured to be connected to a cover, the cover including a transparent area and having a width smaller than a display area of the portable terminal The portable terminal includes: a sensor to sense a user input; and a display to cover a part of the display area that is not covered by the cover in a state where the display area is covered by the cover. A UI element is displayed on the exposed display area, the part of the display area has the width of the cover and includes the transparent area; and a controller for responding to the sense while the UI element is displayed The tester sends a user input for selecting the UI element to control a part of the display information of the display area corresponding to the transparent area of the cover.

According to an aspect of the exemplary embodiment, there is provided a portable terminal configured to be connected to a front cover including a transparent area, the portable terminal including: a sensor for sensing A user input; a display, in a state where the front display area of the display of the portable terminal including the transparent area is covered by the front cover, Displaying a UI element on the side display area; and a controller for controlling, in response to the UI element being displayed on the side display area, the sensor receiving a user input for selecting the UI element, and controlling A part of the display area corresponding to the transparent area of the cover displays information.

According to an aspect of the exemplary embodiment, there is provided a portable terminal configured to be connected to a cover, the cover including a transparent area and having a width smaller than a display area of the portable terminal The portable terminal includes: a sensor for sensing user input; and a display for communicating with the cover in a state where a part of the display area is covered by the cover. A user interaction (UI) element is displayed on a portion of the display area corresponding to the transparent area, the portion of the display area has the width of the cover and includes the transparent area; and a controller for responding When the UI element is displayed, the sensor receives a user input for selecting the UI element, and controls the exposed display area not covered by the cover.

According to an aspect of the exemplary embodiment, a portable terminal is provided. The portable terminal includes: a touch-sensitive display for sensing user input and displaying information; and a controller, For: detecting that a cover is covering the touch-sensitive display of the portable terminal, the cover includes a transparent portion, and the cover has a width smaller than that of the touch-sensitive display; Until the cover is covering the touch-sensitive display, controlling the touch-sensitive display to display a user interaction (UI) element on one of the following: the touch-sensitive display is not covered by the cover An exposed portion and a portion corresponding to the transparent portion of the cover of the touch-sensitive display; and selected to be displayed on the exposed portion of the touch-sensitive display in response to the touch-sensitive display sensing The user input of the UI element controls the display of the U and U on the portion of the touch-sensitive display corresponding to the transparent portion of the cover. Information related to the I element and the use of the UI element selected to be displayed on the touch-sensitive display corresponding to the portion of the cover corresponding to the transparent portion of the touch-sensitive display The user inputs and controls to display information related to the UI element on the exposed portion of the touch-sensitive display.

Hereinafter, terms used in the description will be briefly explained, and the present invention will be explained in detail.

In the present invention, all the terms used in the description are general terms that are widely used in consideration of their functions in the present invention, but can be based on the intentions, habits, or emergence of new technologies of those skilled in the art But different. In addition, in certain cases, the inventor may select terms as appropriate, and in this case, the meaning may be explained in detail when explaining the present invention. Therefore, the terms should be defined based on the contents of the overall description of the present invention.

The present invention is not limited to the exemplary embodiments disclosed below, but may be implemented in various forms. The items defined in the description (such as detailed structures and elements) are provided to help those of ordinary skill in the art to fully understand the invention, and the invention is defined only within the scope of the accompanying patent application. In explaining the present invention, the conventionally known element structure and technology will not be described in detail, because the known element structure and technology will make the disclosure obscure due to unnecessary details.

Although the terms "first" and "second" are used to describe various elements, elements and / or sections, such elements, elements and / or sections are not limited to those terms. These terms are only used to distinguish individual elements, elements, or sections.

In the description, the singular wording may include the plural wording unless specifically stated. The terms "including" and / or "consisting of" as used in the description mean that in addition to the stated elements, steps, operations, and / or elements do not exclude one or more other elements, steps, operations, and / or The presence or addition of components.

In the embodiments of the present invention, the term "module" or "portion" as used herein means, but is not limited to, software components or hardware components or a combination of software components and hardware components for performing certain tasks. In addition, "multiple modules or parts" can be integrated into at least one module and can be implemented by at least one processor, except for "modules" or "parts" that need to be implemented by specific hardware.

In the embodiment of the present invention, the term "connected to" or "coupled to" used to specify the connection or coupling of one element with another element includes the following two cases: the element is "directly connected to or coupled to" another element And a case where an element is connected or coupled to another element via another element. In this case, the terms "directly connected to" or "directly coupled to" mean that an element is connected or coupled to another element without the intervention of any other element.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Aspects and features of the present invention and a method for achieving the aspects and features will be apparent by referring to the exemplary embodiments that will be explained in detail with reference to the accompanying drawings. However, the present invention may be implemented in various forms and is not limited to the exemplary embodiments described below. Throughout the description of the invention, the same drawing reference numerals are used for the same elements in the various drawings.

In an exemplary embodiment of the present invention, the cover may be an object or device covering a part or all of the display area of the portable terminal to protect the display. The cover can be electrically or non-electrically connected to the portable terminal. In addition, the cover can communicate with a portable terminal, as appropriate. In addition, the cover may be detachably attached to the portable terminal as a separate product, or may be integrally formed with the portable terminal to be sold with the portable terminal.

In an exemplary embodiment of the present invention, the user input may include at least one of a touch input, a bending input, a voice input, a button input, and a multimodal input, but the user input It is not limited to this.

In an exemplary embodiment of the present invention, the term "touch input" means a touch gesture made by a user on a display or cover for controlling a device. In addition, the term "touch input" may include a touch (for example, floating or hovering) in a state where the user does not contact the display, but is spaced apart from the display by more than a predetermined distance. The touch input may be a touch and hold gesture, a tap gesture that touches and then releases the touch, a double tap gesture, a pan gesture, a flick gesture, a touch drag gesture that touches and then moves in one direction, or a pinch Pinch gestures, but not limited to them.

In an exemplary embodiment of the present invention, the term "button input" means an input made by a user to control a device using a physical button provided on the device.

In an exemplary embodiment of the present invention, the term "motion input" means a motion applied to a device by a user for controlling the movement of the device. For example, the term "motion input" may include input made by a user to rotate the device, tilt the device, or move the device in up, down, left, and right directions.

In an exemplary embodiment of the present invention, the term "multimodal input" means a combination of at least two input methods. For example, the device may receive touch input and motion input from the user, or may receive touch input and speech input from the user.

Further, in the exemplary embodiment of the present invention, the term "application" means a group of computer programs designed to perform a specific task. In an exemplary embodiment of the present invention, various applications may be provided. For example, game apps, moving image reproduction apps, map apps, memo apps, calendar apps, phone book apps, broadcast apps, exercise support apps, billing apps, and photo folders are available Application, but the application is not limited to this.

In addition, in an exemplary embodiment of the present invention, the term “application identification information” may be inherent information used to distinguish an application from other applications. For example, the application identification information may be an icon, an index item, or a link information, but the application identification information is not limited to this.

In addition, in the exemplary embodiment of the present invention, the term “user interaction (UI) element” means an element that can interact with a user to achieve video feedback, auditory feedback, and olfactory feedback according to user input. The UI element may be expressed in the form of at least one of an image, a text, and a moving image, or may be a region that does not display the above information but makes feedback possible according to a user input. In addition, the UI element may be, for example, the application identification information described above.

FIG. 1 is a block diagram illustrating a detailed configuration of a portable terminal 100 according to an exemplary embodiment of the present invention.

The portable terminal 100 may be, for example, a smart phone, a notebook computer, a personal digital assistant (PDA), a media player, an MP3 player, a micro server, a GPS device, an e-book terminal, and a digital broadcasting device. Terminal, kiosk, digital photo frame, navigation, wearable device (such as a watch or Head-Mounted Display (HMD)) or other mobile computing device or non-mobile computing device.

As shown in FIG. 1, the portable terminal 100 includes a video receiver 110, a video processor 120, a display 130, a communicator 140, a storage 150, an audio processor 160, a speaker 170, and a sensor 180. 、 And controller 190.

On the other hand, FIG. 1 generally illustrates various constituent elements under the assumption that the portable terminal 100 has various functions (for example, a content providing function and a display function). Therefore, a part of the constituent elements shown in FIG. 1 may be omitted or changed, or other constituent elements may be added thereto.

The video receiver 110 receives video data through various sources. For example, the video receiver 110 may receive broadcast data from an external broadcast station, receive real-time VOD data from an external server, and receive video data from an external device.

The video processor 120 is a component that processes video data received via the video receiver 110. The video processor 120 may perform various reproduction processes, such as video data decoding, scaling, noise filtering, frame rate conversion, and resolution conversion.

The display 130 displays at least one of a processed video frame processed by the video processor 120 and various images generated by the graphics processor 194.

The implementation method of the display 130 is not limited, and for example, the display 130 may be implemented by one of the following various displays: for example, a liquid crystal display (LCD), an organic light emitting diode (Organic Light Emitting Diode) (OLED) display, Active-Matrix Organic Light-Emitting Diode (AM-OLED) display, and Plasma Display Panel (PDP). The display 130 may include additional configurations according to the actual method. For example, if the display 130 is a liquid crystal type, the display 130 may include an LCD display panel, a backlight unit that provides light to the LCD display panel, and a panel driving substrate that drives the panel. The display 110 may be combined with the touch sensor 181 of the sensor 180 to serve as a touch screen.

The display 130 may be in the form of a curved display, and may be combined with at least one of a front region, a side region, and a rear region of the portable terminal 100. The curved display may be implemented by a flexible display or a non-flexible general display. For example, curved displays can be implemented by connecting multiple flat displays to each other. Alternatively, the display 130 may be a curved display having a flat central main display area and one or more curved display areas, and the one or more curved display areas are disposed on the display 130. On one or more sides corresponding to one or more edges of the portable terminal 100.

In the case where the curved display is implemented by a flexible display, the flexible display can be bent, bent, or curled without being damaged by a substrate as thin and flexible as paper. The flexible display can be made not only using a commonly used glass substrate but also a plastic substrate. In the case of using a plastic substrate, a flexible display may be formed using a low-temperature manufacturing processor instead of an existing manufacturing processor to prevent the substrate from being damaged. In addition, by replacing the glass substrate with a plastic film, the flexible display can be flexible so that the flexible display can be folded and unfolded, and the plastic film surrounds a liquid crystal display (LCD), an organic light emitting diode (OLED) Liquid crystals in displays, active matrix organic light emitting diode (AM-OLED) displays, or plasma display panels (PDPs). The flexible display has the following advantages: the flexible display is thin, light, and impact resistant, and can be manufactured into various shapes including a flexible shape and a bendable shape.

The flexible display may have an active matrix screen having a specific screen size (for example, 3 inches, 4 inches, 4.65 inches, 5 inches, 6.5 inches, or 8.4 inches) according to the size of the portable terminal 100. And can be extended to at least one side of the portable terminal 100 (for example, at least one of a left side, a right side, an upper side, and a lower side). In addition, the flexible display can be bent to a radius of curvature that enables the flexible display to operate (eg, a radius of curvature of 5 cm, 1 cm, 7.5 mm, 5 mm, or 4 mm) and can be fastened to the portable terminal 100 The side.

The communicator 140 is a communication interface for communicating with various external devices according to various communication methods. The communicator 140 includes a Wi-Fi chip 141, a Bluetooth chip 142, a wireless communication chip 143, and a near field communication (NFC) chip 144. The controller 190 uses the communicator 140 to communicate with various external devices.

Specifically, the Wi-Fi chip 141 and the Bluetooth chip 142 perform communication using the Wi-Fi method and the Bluetooth method, respectively. In the case of using the Wi-Fi chip 141 or the Bluetooth chip 142, various connection information (such as an SSID and a session key) may be transmitted and received first to perform communication connection using the connection information, and then may be transmitted and received Various information. According to the wireless communication chip 143 means such as ^{IEEE, Zigbee, 3G (3 rd} Generation), Third Generation Partnership Project ^{(3 rd Generation Partnership Project, 3GPP} ), and Long Term Evolution (Long Term Evolution, LTE) and other communications Standard communication chip. The NFC chip 144 means using 135 kilohertz (kHz), 13.56 megahertz (MHz), 433 megahertz, 860 megahertz to 960 megahertz, and 2.45 billion hertz in these various RF-ID bands. 13.56 megahertz frequency band chip operating with NFC method.

The storage 150 may store various programs and data required for operating the portable terminal 100. The storage 150 may include a nonvolatile memory, a volatile memory, a flash memory, a hard disk drive (HDD), or a solid state drive ( Solid State Drive (SSD). The storage 150 can be accessed by the controller 190, and data can be read / written / corrected / deleted / updated via the controller 190. In the present invention, the term “memory” may include a ROM or RAM provided in the memory 150 or the controller 190, or a memory card (for example, a micro SD card or a memory stick) installed in the portable terminal 100.

Specifically, programs and data for providing various information to be displayed on the display area may be stored in the storage 150.

Hereinafter, referring to FIG. 2, software stored in the portable terminal 100 will be explained. Referring to FIG. 2, the software includes an Operating System (OS) 210, a kernel 220, a middleware 230, and an application program 240.

The OS 210 controls and manages the entire operation of the portable terminal 100. That is, the OS 210 is a layer responsible for basic functions such as hardware management, memory, and security.

The core 220 functions as a path for transmitting various signals including touch signals sensed through the display 130 to the middleware 230.

The middle software 230 includes various software modules for controlling the operation of the portable terminal 100. Referring to FIG. 2, the intermediate software 230 includes an X11 module 230-1, an APP manager 230-2, a connection manager 230-3, a security module 230-4, a system manager 230-5, a multimedia framework 230-6, and a UI. The frame 230-7, the window manager 230-8, and the handwriting recognition module 230-9.

The X11 module 230-1 is a module that receives various event signals from various hardware provided in the portable terminal 100. Here, the term "event" can be set in various ways as an event in which a user gesture is sensed, an event in which a system alarm is generated, or an event in which a specific program is executed or ended.

The APP manager 230-2 is a module that manages execution states of various application programs 240 installed in the storage 150. If the X11 module 230-1 senses an application execution event, the APP manager 230-2 calls and executes an application corresponding to the corresponding event.

The connection manager 230-3 is a module for supporting a wired network connection or a wireless network connection. The connection manager 230-3 may include various detailed modules, such as a DNET module and a UPnP module.

The security module 230-4 is a module that supports hardware authentication, permission request, and secure storage.

The system manager 230-5 monitors the status of each component in the portable terminal 100 and provides the monitoring results to other modules. For example, in a situation where the remaining battery power is insufficient, an error occurs, or the communication connection becomes disconnected, the system manager 230-5 may provide the monitoring result to the main UI framework 230-7 or the sub UI framework 230-9 to Output a notification message or notification sound.

The multimedia framework 230-6 is a module for reproducing multimedia content stored in the portable terminal 100 or provided from an external source. The multimedia frame 230-6 may include a player module, a camcorder module, and a sound processing module. Therefore, the multimedia frame 230-6 can reproduce various multimedia contents to generate a screen and sound.

The main UI frame 230-7 is a module for providing various UIs to be displayed on the main area of the display 130, and the sub UI frame 230-9 is a module for providing various UIs to be displayed on the sub areas. Each of the main UI framework 230-7 and the sub UI framework 230-9 may include: an image compositor module for configuring various UI elements; a coordinate compositor module for calculating UI element Display coordinates; rendering module for rendering configured UI elements at calculated coordinates; and 2D / 3D UI tool kit for providing tools for configuring 2D or 3D UI.

The window manager 230-8 can sense touch events and other input events using the user's body or pen. If such an event is sensed, the window manager 230-8 transmits an event signal to the main UI frame 230-7 or the sub UI frame 230-9 to perform an operation corresponding to the event.

In addition, various program modules can be stored, such as a handwriting module for drawing a line along the drag track when the user touches and drags the screen, and for calculating based on the sensor value sensed by the motion sensor 182 Angle calculation module for pitch angle, roll angle, and yaw angle.

The application module 240 includes applications 240-1 to 240-n for supporting various functions. For example, the application module 240 may include a program module for providing various services, such as a navigation program module, a game module, an electronic book module, a calendar module, and an alarm management module. These applications can be installed without a user or installed by the user as needed. If a UI element is selected, the main CPU 194 may use the application module 240 to execute an application corresponding to the selected UI element.

The software shown in FIG. 2 is merely exemplary, and the software is not limited thereto. If necessary, a part of the software can be omitted, modified or added. For example, various programs may be provided in the storage 150, such as a sensing module for analyzing signals detected by various sensors, including a messenger program, a SMS service, and multimedia. Messaging service (MMS) programs, and messaging modules for email programs, call information aggregator program modules, VoIP modules, and web browser modules.

Referring again to FIG. 1, the audio processor 160 is a constituent element for processing audio data of video content. The audio processor 160 may perform various processes, such as audio data decoding, amplification, and noise filtering. The audio data processed by the audio processor 160 may be output to the audio outputter 170.

The audio outputter 170 is configured to output not only various audio data that has been processed by the audio processor 160 (such as decoding, amplification, and noise filtering) but also various notification sounds or voice messages. Specifically, the audio outputter 170 may be implemented by a speaker. However, this is merely exemplary, and the audio outputter 170 may also be implemented by an output terminal capable of outputting audio data.

The sensor 180 senses various user interactions. The sensor 180 may detect at least one of various changes such as a change in posture, a change in illumination, and a change in acceleration, and transmit a corresponding electric signal to the controller 190. That is, the sensor 180 may sense a state change of the portable terminal 100, generate a corresponding sensing signal, and transmit the corresponding sensing signal to the controller 190. In the present invention, the sensor 180 may be composed of various sensors, and when the portable terminal 100 is driven (or based on a user's setting), at least one sensor set under the control of the sensor 180 is sensed. The detector supplies power so that the sensor can sense a change in state of the portable terminal 100.

The sensor 180 may be configured to include one or more of various sensing devices that can detect a change in the state of the portable terminal 100. For example, the sensor 180 may be configured to include, for example, at least one of the following various sensing devices: a touch sensor, an acceleration sensor, a gyroscope sensor, an illuminance sensor, a proximity sensor, Pressure sensor, noise sensor (for example, microphone), video sensor (for example, camera module), and timer.

As shown in FIG. 1, the sensor 180 may be divided into a touch sensor 181, a motion sensor 182, and a cover opening / closing sensor 183 for sensing purposes, but is not limited thereto. The sensor 180 may be divided into more uses. This does not mean a physical division, and at least one sensor may be combined to be used as the sensors 181, 182, and 183. In addition, depending on the implementation method, a part of the configuration or function of the sensor 180 may be included in the controller 190.

For example, the touch sensor 181 may use a touch sensor attached to the back of the display panel to sense a user's touch input. The controller 190 may obtain information about the touch coordinates and the touch time from the touch sensor 181, and determine the type of touch input (for example, a tap gesture, a double tap gesture, a pan gesture, a flick gesture, and a touch drag gesture). ). In addition, the controller 190 may directly determine the type of the touch input using the touch coordinates and the touch time obtained by the touch sensor 181.

The cover opening / closing sensor 183 may use, for example, at least one of a hall sensor, an illuminance sensor, and a pressure sensor to determine the opening / closing of the cover connected to the portable terminal 100. Closed. A Hall sensor is a device that changes its output voltage according to the strength of a magnetic field, and can sense the electric potential difference that occurs when the cover is opened or closed while a current is flowing through the conductor. The controller 190 may obtain a potential difference occurring when the cover is opened or closed from the cover opening / closing sensor 183, and use information related to the obtained potential difference to determine the open / closed state of the cover.

In addition, in a case where an illuminance sensor is used, the illuminance sensor can sense an electric signal generated due to a change in the illuminance of the surrounding environment according to the opening / closing of the cover. The controller 190 may determine an opened / closed state of the cover by comparing a sensing result obtained from the cover opening / closing sensor 183 with a predetermined reference value. For example, if it is assumed that the highest illuminance intensity measured by the illuminance sensor is 100, the lowest illuminance intensity is 0, and the predetermined reference illuminance intensity is 30, the controller 190 may It is determined that the cover is closed in a case where the intensity of the reference illuminance is 30 or less.

The motion sensor 182 may use at least one of an acceleration sensor, a tilt sensor, a gyro sensor, and a 3-axis magnetic sensor to sense the portable terminal. 100 (for example, a rotary motion or a tilt motion), and transmits the generated electric signal to the controller 190. For example, in the case of an acceleration sensor, as shown in FIG. 4, the motion sensor 182 may measure the acceleration of gravity with respect to the X-axis, Y-axis, and Z-axis based on the portable terminal 100. Specifically, the motion sensor 182 may measure accelerations in which kinetic acceleration and gravitational acceleration of the portable terminal 100 are added, and only measures when the portable terminal 100 is not moving. Gravitational acceleration. As an example, an explanation will be made under the following assumptions: where the front-side direction of the portable terminal 100 is the positive (+) direction of the acceleration of gravity, and where the back-side direction of the portable terminal 100 is the acceleration of gravity Negative (-) direction.

As shown in FIG. 4, if the back of the portable terminal 100 contacts a horizontal plane, the gravity acceleration measured by the motion sensor 182 may include an X-axis component measured as 0 m / sec ² and a Y- Axis component and Z-axis component measured as a specific positive value (eg +9.8 m / sec ² ). In contrast, if the front of the portable terminal 100 contacts a horizontal plane, the gravity acceleration measured by the motion sensor 182 may include an X-axis component and a Y-axis component measured as 0 m / sec ² and The Z-axis component measured as a specific negative value (for example, -9.8 m / sec ² ).

In addition, if it is assumed that the portable terminal 100 is placed on a desktop inclinedly, the gravity acceleration measured by the motion sensor 182 may include a value other than 0 m / sec ² for at least one axis, and in this case In this case, the square root of the sum of the squares of the three axis components (that is, the length of the vector sum) may be a specific value (for example, 9.8 m / sec ² ). In this case, the motion sensor 182 senses accelerations in the X-axis, Y-axis, and Z-axis directions in the coordinate system. Depending on the attachment position of the sensor, each axis and the corresponding gravitational acceleration can be changed.

In a case where the gravity acceleration transmitted by the motion sensor 182 is measured for at least one axis component, the controller 190 may use the acceleration on the axis to confirm (calculate) the posture of the portable terminal 100. The attitude can be indicated by the roll angle Φ, the pitch angle θ, and the yaw angle Ψ. In FIG. 4, the roll angle Φ may be a rotation angle about the X-axis, the pitch angle θ may be a rotation angle about the Y-axis, and the yaw angle Ψ may be a rotation angle about the Z-axis. As illustrated in FIG. 4, if the Z-axis gravity acceleration transmitted by the motion sensor 182 is +9.8 m / sec ² , the posture of the portable terminal 100 corresponds to a roll angle Φ of “0” and is The pitch angle θ of "0", and therefore the back subjected to the Z-axis gravity acceleration, is placed in the direction of gravity. Thereby, any posture of the portable terminal 100 can be sensed, and a posture detector that detects the posture of the portable terminal 100 can be additionally implemented.

The controller 190 may use, for example, an algorithm to determine the posture of the portable terminal: a posture calculation algorithm using an Euler angle, a posture calculation algorithm using an extended Kalman filter, and Acceleration prediction switching algorithm. According to the exemplary embodiments of the present invention, various methods for measuring the posture of the portable terminal can be implemented.

The controller 190 uses various programs stored in the storage 150 to control the entire operation of the portable terminal 100.

As shown in FIG. 1, the controller 190 includes a RAM 191, a ROM 192, a graphics processor 193, a main CPU 194, first to n-th interfaces 195-1 to 195-n, and a bus 196. In this case, the RAM 191, the ROM 192, the graphics processor 193, the main CPU 194, and the first to n-th interfaces 195-1 to 195-n may be connected to each other via the bus 196.

The command set for system booting is stored in ROM 192. If an ON command is input and power is supplied, the main CPU 194 copies the OS stored in the storage 150 to the RAM 191 according to the command stored in the ROM 192, and starts the system by executing the OS. When the startup is completed, the main CPU 194 copies various applications stored in the storage 150 to the RAM 191, and performs various operations by executing the applications copied to the RAM 191.

The graphics processor 193 uses an operator and a renderer to generate a screen including various objects such as items, images, and text. The calculator uses the control command received from the sensor 180 to calculate the attribute values of the object to be displayed, such as coordinate values, shapes, sizes, and colors according to the layout of the screen. The renderer generates screens of various layouts including the object based on the attribute values calculated by the operator. The screen generated by the renderer is displayed in a display area of the display 130.

The main CPU 194 accesses the memory 150 and executes startup using the OS stored in the memory 150. In addition, the main CPU 194 performs various operations using various programs, contents, and data stored in the storage 150.

The first to n-th interfaces 195-1 to 195-n are connected to various constituent elements as described above. One of the interfaces may become a network interface connected to an external device via a network.

Specifically, the controller 190 may appear via the sensor 180 in response to displaying a UI element on the exposed display area in a state where a part of the display area is covered by a cover including a transparent area to be exposed to the outside of the cover. A user input of the UI element is selected, and a display area corresponding to the transparent area provided by the display 130 is controlled.

In another embodiment, the controller 190 may appear while displaying UI elements on the display area corresponding to the transparent area in a state where a part of the display area is covered by a cover including a transparent area to be exposed to the outside of the cover. A user input of the UI element is selected via the sensor 180 to control a display area provided by the display 130 to be exposed to the outside of the cover.

In still another embodiment, the controller 190 may select the UI element via the sensor 180 in response to the UI element being displayed on the side display region while the front display region is covered by the front cover including the transparent region. The user inputs and controls the display area corresponding to the transparent area provided by the display 130.

3A to 3F are views illustrating an example of a portable terminal 100 according to an exemplary embodiment of the present invention.

As shown in FIGS. 3A to 3F, the portable terminal 100 according to an exemplary embodiment of the present invention is configured to include: a curved display 310; a main body 300, and the curved display 310 is placed on the main body 300 to be fastened to the main body. 300; and additional devices formed on the main body 300 to perform the functions of the portable terminal 100. Additional devices may include speakers 321, sensors (eg, illuminance sensor 322 and front camera module 323), connection interfaces (eg, charging port, data input / output port, and audio input / output port) 324, Microphone 325, and physical buttons.

In the exemplary embodiment of the present invention, the term “curved surface display area” means an area where data is displayed on the display 310. In addition, the term "display area" means an area where data is displayed on a curved portion of the display and a flat portion of the display. Data means all information (such as images, text, and moving images) that can be displayed on the display area, and can be displayed on various screens. The screen can consist of one or more layers. A plurality of layers may be successively overlapped with each other to form a screen, and in this case, a user may recognize various kinds of data arranged on the plurality of layers as one screen.

In addition, in the portable terminal 100 having a curved display as shown in FIGS. 3A to 3C, the display area 311 corresponding to the front of the portable terminal 100 may be referred to as a front display area 311 or a main display area 311. The display area 312 corresponding to the side of the portable terminal 100 may be referred to as a side display area 312 or an auxiliary display area 312.

In addition, in the portable terminal 100 having both a curved display and a cover as shown in FIG. 3D, in a case where the front of the portable terminal 100 is covered with a cover, the front of the portable terminal 100 is covered with a cover The display area may be referred to as a front display area 311, a main display area 311, or a cover display area 311. In contrast, the display area covered by the cover on the side of the portable terminal 100 may be referred to as a side display area 312, an auxiliary display area 312, an out-of-cover display area 312, or an exposed display area 312.

In addition, as shown in FIG. 3E, the display area 313 covered by the cover of the portable terminal 100 may be referred to as a main display area 313 or an in-cover display area 313. In contrast, the display area on the side of the portable terminal 100 that is not covered by the cover and the partial display area on the front of the portable terminal 100 may be referred to as the auxiliary display area 314, the cover-out display area 314, or exposed Display area 314.

In addition, in the portable terminal 100 having a flat display as shown in FIG. 3F, in a case where a part of the front display area of the portable terminal 100 is covered by a cover, the display area 315 covered by the cover may be called The main display area 315 or the cover display area 315. In contrast, a partial display area on the front of the portable terminal 100 and a display area not covered by a cover on the side of the portable terminal 100 may be referred to as an auxiliary display area 316, an external display area 316, or an exposed area. Display area 316.

In addition, in an exemplary embodiment of the present invention, the cover may include not only a cover covering a front display area of the portable terminal 100 but also a cover covering all or at least a part of a side display area of the portable terminal 100. . In this case, a cover covering the front display area may be referred to as a front cover, and a cover covering the side display area may be referred to as a side cover. In addition, the front cover and the side cover may be provided in the main body or separately.

In the exemplary embodiment of the present invention, the case where the portable terminal 100 is provided with a front cover means that the portable terminal 100 may be provided with not only a front cover but also a side cover.

FIG. 5 is a view illustrating that the portable terminal 100 provides notification information according to an exemplary embodiment of the present invention.

Referring to FIG. 5, the portable terminal may use the side display area 312 to provide notification information 501. The notification information 501 may mean information displayed by the portable terminal 100 in response to receiving data or information from another external device. For example, the notification information 501 may include events, such as call reception, message reception (eg, message reception based on SMS (SMS) / Multimedia Messaging Service (MMS)), mail reception, reception of information for push services, or social networking Receiving notification of network services (SNS). In addition, the notification information 501 is information generated in the portable terminal 100 and may mean information related to the current state of the portable terminal 100. For example, the notification mode 501 may include the following information: for example, the remaining battery power of the portable terminal 100, the current time, the connection status of the long-range or short-range network of the portable terminal 100, the purpose of the portable terminal 100 Ground mode status (for example, vibration mode, silent mode, or sound mode), or presence / absence status of alarm information set by the user.

According to an exemplary embodiment of the present invention, if the front display area of the portable terminal 100 is not in use (for example, an object (for example, a cover of the portable terminal 100) or a note is in the front display area) (In the state that the portable terminal 100 faces down and contacts the desktop), the portable terminal 100 can provide the notification information 501 through the side display area 312. Such a state may also include a state where the user places the portable terminal 100 face down on a table during a meeting. That is, the user can change the state of the portable terminal 100, for example, make the front display area 311 of the portable terminal 100 face down and contact the desktop. In addition, as shown in FIG. 3D, the front display area 311 of the portable terminal 100 may be covered by a separate cover or a notebook.

In the above state, the portable terminal 100 can detect the state of the portable terminal 100 and enter the side display use mode. The state of the portable terminal 100 can be detected by the following sensors: an illuminance sensor for detecting a change in the amount of light, a sensor for detecting the posture of the portable terminal 100 (for example, a geomagnetic field) (Geomagnetic sensor or acceleration sensor), Hall sensor and / or timer. Here, the above sensors may be integrated into one chip, or multiple sensors may be implemented as a single chip. For example, the portable terminal 100 may determine the current status according to the illuminance value detected by the illuminance sensor. In addition, the portable terminal 100 can determine the current state according to the posture information (for example, measurement values on the X-axis, Y-axis, and Z-axis) detected by the operation sensor. In addition, the portable terminal 100 can determine the current status according to the current time detected by the timer. In the case of using a timer, the portable terminal 100 can determine whether the current time of the portable terminal 100 corresponds to the time of the automatic notification mode (manner notification mode) set by the user, and if the current time corresponds to When the user sets the time, the portable terminal 100 can enter the mode notification mode.

As described above, if the front display area of the portable terminal 100 is blocked and the side display area usage mode is performed, the front display area can be processed in a single color (for example, black), or the front display area can be combined with The power supply of the side display area is divided to prevent the power supply of the front display area. In this case, in the side display use mode, only the screen output can be performed without the sound output and the vibration output, and this can be defined in different ways according to the user's setting.

In addition, the right-hand mode or the left-hand mode of the portable terminal 100 may be defined by an environment setting or a separate application provided by the portable terminal 100. In this case, the portable terminal 100 may operate only a side display area corresponding to the determined mode. As an example, as shown in FIG. 3B, if the right-hand mode is set in a state where the portable terminal 100 has both the right-side display area and the left-side display area, the alarm information may be output using the right-side display area, and if the left-hand mode is set , You can use the left display area to output alarm information.

6A to 6H are views illustrating various examples of a cover having a transparent region according to an exemplary embodiment of the present invention. The transparent area is an area where a user can see a display area corresponding to the transparent area. That is, the transparent area may include not only the area of the cover having holes (that is, the area of the cover in which the cover is cut away so that the material of the cover is not present) but also the cover formed of a transparent or translucent material to show Part of the display area.

Referring to FIG. 6A, the transparent area 611 of the cover is located inside the cover and may be spaced apart from the display area 612 exposed to the outside of the cover. In this case, the transparent region 611 of the cover may have a circular shape as shown in 610 of FIG. 6A, or may have a rectangular shape as shown in 610-2 of FIG. 6A. In addition, the transparent region 611 of the cover may have a polygonal shape, a rounded polygonal shape, or an oval shape, but the shape of the transparent region 611 is not limited to this.

In addition, referring to FIG. 6B, the transparent area 611 of the cover may be connected to the display area 612 exposed to the outside of the cover to open a part of the cover. In this case, the transparent region 611 of the connection type cover may have a circular shape as shown in 610-3 of FIG. 6B, or may have a rectangular shape as shown in 610-4 of FIG. 6B. In addition, the transparent region of the connection type cover may have a polygonal shape, a rounded polygonal shape, or an oval shape, but the shape of the transparent region is not limited to this. As shown in FIG. 6B, in a state where the transparent area 611 of the cover is connected to the display area 612 exposed to the outside of the cover, the display area inside the cover means the transparent area 611 of the cover. That is, although the transparent area 611 of the cover is not completely surrounded by the cover, in the case where one side of the cover is substantially recessed to be regarded as a region contained in the cover, the transparent area 611 of the cover may be referred to as a display inside the cover Area.

In addition, as shown in FIGS. 6C and 6D, the cover having the transparent region 611 may cover a part of the front display region of the curved display. In addition, as shown in FIGS. 6E and 6F, a cover having a transparent region 611 may cover a part of a front display region of a flat display. In addition, as shown in FIGS. 6G and 6H, the cover having the transparent region 611 may cover both the front display region and the side display region of the curved display. In this case, as for the cover having the transparent area 611, the cover covering the front display area may be referred to as a front cover, and the cover covering the side display area may be referred to as a side cover. In addition, the front cover and the side cover may be provided in an integrated shape or in a separate shape.

Hereinafter, various examples of displaying information in the portable terminal 100 according to an exemplary embodiment of the present invention will be explained with reference to FIGS. 7A to 25B.

The various examples of FIGS. 7A to 25B are disclosed for the portable terminal 100 mainly having a curved display, but can also be applied to the portable terminal 100 having a flat display as shown in FIG. 3F. In this case, the front display area of the curved display may correspond to the in-cover display area of FIG. 3F. The side display area of the curved display may correspond to the cover-out display area of FIG. 3E.

In an exemplary embodiment, the controller 190 may display a user interaction (UI) element (for example, application identification information) on the exposed display area in a state where a part of the display area is covered by a cover, the cover including the To the transparent area outside the cover. In addition, the controller 190 may control a display area corresponding to the transparent area in response to a user input for selecting a UI element appearing while the UI element is displayed.

In another exemplary embodiment, the controller 190 may display the UI element on the display area corresponding to the transparent area in a state where a part of the display area is covered by a cover including a transparent area to be exposed to the outside of the cover. In addition, the controller 190 may control a display area exposed to the outside of the cover in response to a user input for selecting a UI element appearing while the UI element is displayed.

First, as shown in FIGS. 7A to 7C, in a state where a plurality of UI elements are displayed on the display area 712 exposed to the outside of the cover, the sensor 180 may sense that one of the plurality of UI elements is selected User input of element 712-1. In addition, the controller 190 may control the display 130 in response to a user input for selecting the UI element 712-1, so that information related to the UI element 712-1 is displayed on the display area 711 corresponding to the transparent area of the cover.

As an example, referring to 710 of FIG. 7A, the user input for selecting the UI element 712-1 may include a tap gesture of the user, which touches the UI element 712- exposed on the display area 712 outside the cover. 1.

As another example, referring to 720 of FIG. 7A, the user input for selecting the UI element 712-1 may include a flick gesture of the user, which touches the UI on the display area 712 exposed to the outside of the cover After element 712-1, flick UI element 712-1 in the positioning direction of the cover.

As another example, referring to 730 of FIG. 7B, the user input for selecting the UI element 712-1 may include a drag gesture of the user: the drag gesture is touched on the UI of the display area 712 exposed to the outside of the cover UI element 712-1 is then dragged along the long side of UI element 712-1. In response to the user ’s drag gesture, as shown in 740 of FIG. 7B, the UI element 712-1 is moved to a position adjacent to the display area corresponding to the transparent area, and if it is not within a predetermined time (about 0.5 seconds to 1.5 seconds) Upon receiving the user input, the controller 190 may control the display 130 so that the information related to the UI element 712-1 is automatically displayed on the display area 711 corresponding to the transparent area. In this case, the position adjacent to the transparent region may be, for example, a position at a level relative to the central portion 711-1 of the transparent region on the display region exposed to the outside of the cover.

As yet another example, referring to 750 of FIG. 7C, the user input for selecting the UI element 712-1 may include a drag gesture of the user: the drag gesture is touched on the UI of the display area 712 exposed to the outside of the cover After the element 712-1, the UI element 712-1 is dragged to the display area 711 corresponding to the transparent area. In this case, since the display area 711 corresponding to the transparent area and the display area 712 exposed to the outside of the cover are connected to each other, the user can seamlessly drag the UI element 712-1. In addition, if the touch on the UI element 712-1 is released on the display area 711 corresponding to the transparent area, as shown in 760 of FIG. 7C, the controller 190 may control the display 130 so that the UI element 712-1 is related to the UI element 712-1. The information is displayed on a display area 711 corresponding to the transparent area.

Referring to 810 of FIG. 8, if the cover of the portable terminal 100 is opened, the display 130 may display application identification information on the display area 811. If the user closes the cover in the above state, as shown by 820 in FIG. 8, the controller 190 may control the display 130 so that the reconfigured application identification information is displayed on the exposed display area 812. In this case, the reconfigured application identification information on the exposed display area 812 may be a subset of the identification information of the application displayed on the front display area 811 before being covered by the cover. For example, the size of the re-arranged application identification information on the exposed display area 812 may be equal to or smaller than the size of the application identification information displayed on the front display area 811 before being covered by the cover, or as described above. The reconfigured application identification information can be different types of UI components.

Referring to 910 of FIG. 9, in a state in which an application identification information list including application identification information is displayed on the exposed display area 912, the sensor 180 can sense a user input moving along a long side of the exposed display area 912. . The user input may be, for example, a touch-drag gesture in a vertical direction. In response to user input, the controller 190 may move the application identification information included in the application list.

As a result of the movement, as shown in 920 of FIG. 9, the controller 190 may control the display 130 so that the application list containing the identification information of the movement of the position is displayed on the exposed display area 912. In this case, according to the user history, the identification information can be displayed by circular movement. As an example, if a piece of identification information disappears from one side of the exposed display area 912, the piece of identification information may be displayed on the opposite side of the exposed display area 912 again. In addition, if a piece of identification information disappears from one side of the exposed display area 912, new identification information may be displayed on an opposite side of the exposed display area 912.

Referring again to 920 in FIG. 9, an piece of application identification information 912-1 can be moved to a position adjacent to the display area 911 corresponding to the transparent area of the cover. If the sensor 180 does not receive user input within a predetermined time (about 0.5 seconds to 1 second) in this state, the controller 190 may control the display 130 so that the display area 911 corresponding to the transparent area is automatically turned off. The state switches to the on state. In addition, the controller 190 may control the display 130 so that information related to execution of an application is displayed on the display area 911 corresponding to the transparent area. The information related to the execution of an application may be, for example, at least one of an application execution screen, application summary information, and a menu screen for executing the application. For example, if one piece of application identification information is the weather icon 912-1, the information related to the execution of the application may be the execution screen of the weather application related to the weather icon.

Referring to 1010 of FIG. 10A, in a state where a list of application identification information including phone application identification information (for example, a phone application icon) is displayed on the exposed display area 1012, the sensor 180 may sense that it is used for selection. The user input of the telephone application identification information 1012-1. The user input may be a tap gesture that touches the identification information and then releases the touch. In response to user input, as shown in 1020 of FIG. 10A, the controller 190 may display a keypad, a call button, a text message switchover button, and a video message on a display area 1011 corresponding to the transparent area. At least one of a call button and a delete button. In addition, the controller 190 may control the display 130 so that information related to the phone application (for example, a UI element that can control the phone application) is displayed on the exposed display area 1012. The UI elements that can control the phone application may include, for example, at least one of a keypad UI element, a latest call history search UI element, a most popular phone number search UI element, and a contact address search UI element.

In a case where the keypad is displayed on the display area 1012 corresponding to the transparent area, the sensor 180 may sense a user input for selecting at least one of a number or a character of the keypad. In response to user input, as shown in 1030 of FIG. 10B, the controller 190 may control the display 130 so that the phone number information related to the input digits or characters is displayed on the exposed display area 1012 as a result of performing the auto-complete function. For example, in response to user input for selecting several digits, the controller 190 may search for a phone number including the selected digits, and control the display 130 so that the searched phone number is displayed on the exposed display area 1012. Next, as shown in 1040 of FIG. 10B, if the sensor 180 senses a user input for selecting a call button, the controller 190 may execute a call with the searched phone number in response to the user input connection.

Referring to 1110 of FIG. 11A, in a case where a message is received in the portable terminal 100, the controller 190 may control the display 130 so that at least a part of the received message is displayed on the exposed display area 1112. In a state where the message is displayed on the exposed display area 1112, the sensor 180 can sense a user input on the exposed display area 1112. For example, the sensor 180 may sense a user input moving along the long side of the exposed display area 1112 of the exposed area. The user input may be, for example, a touch drag gesture, down or up. If the user input is a downward touch drag gesture 1118, the controller 190 may delete the message and control the display so that the message is not displayed on the exposed display area 1112.

In contrast, if the user input is an upward touch drag gesture 1119, as shown in 1120 of FIG. 11A, the controller 190 may display information related to the message on the display area 1111 corresponding to the transparent area. The information related to the message may be, for example, a message with more information. For example, if the title of the message is displayed on the exposed display area 1112, the text of the message may be displayed on the display area 1111 corresponding to the transparent area. In addition, in a case where a part of the main body of the message is displayed on the exposed display area 1112, the entire main body of the message or a larger amount of the main body of the message than the part of the main body of the message may be displayed on the display area 1111 corresponding to the transparent area.

Here, as an example, if the information related to the message is displayed on the display area 1111 corresponding to the transparent area, the sensor 180 may sense a user input on the display area 1111 corresponding to the transparent area. The user input may be, for example, a touch-drag gesture. In response to user input, the controller 190 may control the display 130 so that other information related to the message is displayed on the display area 1111 corresponding to the transparent area. Here, other information related to the message may be the body of the message or a UI element that controls the message, and the body of the message includes content different from the content of the message being displayed.

Referring to 1120 of FIG. 11A again, while the information related to the message is displayed on the display area 1111 corresponding to the transparent area, the controller 190 may control the display 130 so that the UI element of the controllable message application is displayed on the exposed display area. 1112 on. The UI elements may include, for example, at least one of a message storing UI element, a message deleting UI element, a message origin storing UI element, a message spam registration UI element, and a keypad UI element for message preparation. While the UI element is displayed on the exposed display area 1112, the controller 190 may sense a user input for selecting the keypad UI element 1112-1 in response to the received message. In response to user input, as shown in 1130 of FIG. 11B, the controller 190 may control the display 130 so that the keypad is displayed on the display area 1111 corresponding to the transparent area.

Referring to 1130 of FIG. 11B, while the keypad is displayed on the display area 1111 corresponding to the transparent area, the sensor 180 may sense a user input for selecting at least one of the digits or characters of the keypad. In response to the user input, as shown in 1140 of FIG. 11B, the controller 190 may control the display to display the result of the input through the keypad. For example, the controller 190 may control the display 130 so that at least a part of the response message according to the input characters is displayed on the exposed display area 1112. Next, if the sensor 180 senses a user input for selecting a send button, the controller 190 may send a response message prepared using the keypad to the address of the contact who has sent the received message. .

Referring to 1210 of FIG. 12A, in a state where a list of application identification information including camera application identification information (for example, a camera application icon) is displayed on the exposed display area 1212, the sensor 180 may sense for selection User input of camera application identification information 1212-1. In response to user input, as shown in 1220 of FIG. 12A, the controller 190 may control the display 130 so that information related to the camera application is displayed on the display area 1211 corresponding to the transparent area. The information related to the camera application may be, for example, a preview screen before an image is taken. In addition, the controller 190 may control the display 130 so that UI elements that can control the camera application are displayed on the exposed display area 1212. The UI element may include, for example, at least one of: a zoom-in UI element, a zoom-out UI element, a video shooting UI element, a setting UI element or a camera application ending UI element, a flash on / off A UI element and a UI element for setting a video shooting effect. In a state where the information related to the camera application is displayed on the display area 1211 corresponding to the transparent area, the sensor 180 can sense a user input for opening the cover to expose the entire display area. In response to user input, as shown in 1230 of FIG. 12B, the controller 190 may control the display 130 so that information related to the camera application is displayed on the display area 1231 that was once covered by the cover. The information related to the camera application may be, for example, at least one of an enlarged preview screen before image capture and a UI element that can control the preview screen before image capture.

Referring to 1310 of FIG. 13A, while the preview screen is displayed on the display area 1311 corresponding to the transparent area, the sensor 180 may sense a user input for selecting a UI element 1312-1 on the exposed display area 1312, UI The component 1312-1 is used to capture an image of an object on the preview screen. If an image of the object is captured, as shown in 1320 of FIG. 13A, the controller 190 may control the display so that the captured video content (for example, an image or a moving image) is displayed on the display area 1311 corresponding to the transparent area. In this state, the sensor 180 can sense a user input on the display area 1311 corresponding to the transparent area. The user input may be, for example, a flick gesture of touching the display area 1311 corresponding to the transparent area and flicking in a direction exposing the display area 1312. In response to user input, as shown in 1330 of FIG. 13B, the controller 190 can control the display 130 so that a thumbnail 1312-2 of the image is displayed on the exposed display area 1312. As described above, the controller 190 may control the display 130 in response to a user's flick gesture on the captured video content, so that the thumbnails of the video content are sequentially displayed on one side of the exposed display area 1312.

Referring to 1340 of FIG. 13C, in a state in which thumbnails 1341 of the images are accumulated on one side of the exposed display area 1312, the sensor 180 may receive the use of one of the thumbnails 1341 of the selected image 1341者 Enter. The user input may be, for example, a touch and hold gesture that touches a thumbnail 1341-1 and then maintains the touch for more than a predetermined time. In response to user input, as shown in 1350 of FIG. 13C, the controller 190 can control the display 130 so that the video content of the selected thumbnail 1341-1 is displayed on the display area 1311 corresponding to the transparent area, and the video information can be displayed. UI elements for editing content or sending video content to a third party are displayed on the exposed display area 1312. The UI element for editing the video content may include, for example, at least one of the following: a UI element for editing the color of the video content, a UI element for adopting a filter effect of the video content, a UI elements for adding information to the content, UI elements for storing the edited video content, UI elements for deleting the video content, and for deleting / moving / modifying part of the video content when the video content is a moving image UI components.

Referring to 1410 of FIG. 14A, the controller 190 may control the display 130 such that at least one folder storing content (eg, images, audio, or moving images) is displayed on the display area 1411 corresponding to the transparent area. In addition, the controller 190 may control the display 130 so that a UI element for performing a content search is displayed on the exposed display area 1412. The UI element may include, for example, at least one of a text search UI element, a mobile image search UI element, an image search UI element, and an audio search UI element. In this state, the sensor 180 may sense a user input for selecting a folder 1411-1 on the display area 1411 corresponding to the transparent area. In response to user input, as shown in 1420 of FIG. 14A, the controller 190 may control the display 130 so that a thumbnail of the content contained in the selected folder is displayed on the exposed display area 1412. While displaying a thumbnail of the image, the sensor 180 may sense a user input for selecting a thumbnail 1412-1. In response to user input, as shown in 1430 of FIG. 14B, the controller 190 can control the display 130 so that the video content of the selected thumbnail is displayed on the display area 1411 corresponding to the transparent area, and the video content can be edited Or the UI element that sends the video content to a third party is displayed on the exposed display area 1412.

Referring to 1510 of FIG. 15, in the case of executing a gallery application, the controller 190 may control the display 130 so that the most recently stored image, the most frequently searched image, or an image specified in advance by the user is displayed on the display. On the display area 1511 corresponding to the transparent area. While the image is displayed, the sensor 180 may sense a user input for selecting the image. In response to user input, as shown in 1520 of FIG. 15, the controller 190 can control the display 130 so that UI elements that can edit the image or send the image to a third party are displayed on the exposed display area. The UI elements that can edit the image may include, for example, at least one of the following: a UI element for adjusting the size of the image, a UI element for editing the color of the image, and a UI for applying a filter effect to the image Components, UI components for adding information to the image, UI components for storing the edited image, and UI components for deleting the image.

Referring to 1610 of FIG. 16A, in a state where a list of application identification information including web application identification information 1612-1 is displayed on the exposed display area 1612, the sensor 180 can sense the web application identification information 1612 for selection User input of -1. The user input may be, for example, a touch drag gesture that touches the web application to identify the information 1612-1 and then drag the touch to a predetermined position. Here, the predetermined position is a position corresponding to a permeation region of the cover, and may be a position closest to the center of the display region 1611 corresponding to the transparent region among the exposed regions. In response to user input, as shown in 1620 of FIG. 16A, the controller 190 may display information related to the web application on the display area 1611 corresponding to the transparent area. The information related to the web application may include, for example, pieces of web identification information. The webpage identification information may include, for example, at least one of a webpage image, webpage link information, and a webpage name. In a state where the plurality of web page identification information is displayed, the sensor 180 may sense a user input for selecting one web page identification information 1611-1 of the plurality of web page identification information. The user input may be, for example, a tap gesture of touching a piece of webpage identification information 1611-1. In a state where a piece of webpage identification information 1611-1 is touched, the sensor 180 can sense a user input for opening the cover to fully expose the display area. In response to user input, as shown in 1630 of FIG. 16B, the controller 190 may control the display 130 so that a webpage corresponding to the piece of webpage identification information 1611-1 is displayed on the display area 1630 that was once covered by the cover.

Referring to 1710 of FIG. 17, in a state in which an application identification information list including music application identification information 1712-1 is displayed on the exposed display area 1712, the sensor 180 may sense the identification information 1712 for selecting a music application. User input of -1. The user input may be, for example, a touch drag gesture that touches the music application to identify the information 1712-1 and then drags the touch to a predetermined position and then releases the touch. Here, the predetermined position may be a display area 1711 corresponding to the transparent area of the cover. In response to user input, as shown in 1720 of FIG. 17, the controller 190 can automatically reproduce the music content and control the display 130 so that the UI elements of the music content can be controlled or information related to the music content (eg, images or music titles) ) Is displayed on the display area 1711 corresponding to the transparent area of the cover. Here, the reproduced music content may be, for example, a music content recently reproduced by a user or a music content designated in advance by a user. In addition, the controller 190 may control the display 130 so that other information related to music content (for example, music title, music lyrics, or composer) is also displayed on the exposed display area 1712.

Referring to 1810 of FIG. 18, in a state where a message (for example, an SNS message) is displayed on the exposed display area 1812, the sensor 180 may sense a user input for selecting the message. In this case, if the message is connected to content or content identification information, as shown in 1820 of FIG. 18, the controller 190 may control the display 130 in response to a user input so that the content connected to the message is displayed on the On the display area 1811 corresponding to the transparent area. For example, if the content connected to the message is an image, the controller 190 may control the display 130 so that the connected image is displayed on the display area 1811 corresponding to the transparent area. In this case, the controller 190 may control the display 130 so that additional information related to the content (for example, the source of the content, the title of the content, and the author of the content) or the content of the message is displayed on the exposed display area 1812.

Referring to 1910 of FIG. 19, while displaying an application list including identification information of an application (for example, a map application), the sensor 180 may sense the identification information 1912-1 for selecting an application. User input. In response to user input, as shown in 1920 in FIG. 19, the controller 190 may control the display so that video content (for example, a map image) related to an application is displayed on the display area 1911 corresponding to the transparent area. In this case, the controller 190 may control the display 130 so that the video content is not displayed on the front display area, except for the display area 1911 corresponding to the transparent area. In addition, the controller 190 may control the display 130 to disable the front display area covered by the cover, except for the display area 1911 corresponding to the transparent area. While displaying the video content, the sensor 180 may sense a user input for opening the cover. In response to user input, as shown in FIG. 20, the controller 190 may control the display so that information related to the video content is displayed on the front display area. The information related to the video content may be, for example, at least one of the following: enlarged video content, other video content connected to the video content, detailed information of the video content, in a case where the video content is a map image Map image of the neighboring area.

As another exemplary embodiment, in a case where the notification information is obtained in a state where the display area is covered by the cover, the controller 190 may control the display 130 to display the notification information on the display area exposed to the outside of the cover.

In addition, in the case where the portable terminal 100 is provided with a curved display, the controller 190 may control the display 130 to display notification information on a side display area. In this case, the portable terminal 100 may or may not be provided with a cover.

Traditionally, the notification information is displayed on a predetermined area (for example, the upper end of the display area) of the front display area of the portable terminal. According to an exemplary embodiment of the present invention, the notification information is displayed on the side display area, and thus more information can be displayed.

Referring to 2110 in FIG. 21, the controller 190 may control the display 130 so that the notification information is displayed on the side display area 2112. In this case, the notification information may be displayed in a horizontal text mode or a vertical text mode according to predetermined information or user settings. In addition, in a case where multiple pieces of notification information are provided, the pieces of notification information may be automatically aligned in a predetermined priority order, or may be aligned from top to bottom or bottom to top in the order in which they appear.

The sensor 180 may sense a user input for controlling display of notification information. The user input may be, for example, a touch drag gesture of touching the side display area 2112, dragging the touch, and then releasing the touch on the front display area 2111. In response to user input, as shown in 2120 of FIG. 21, the controller 190 may control the display 130 so that detailed information of the notification information and other notification information are displayed on the front display area 2111 together with a sliding animation effect. In addition, as shown at 2130 in FIG. 21, the controller 190 may control the display 130 so that detailed information of the notification information and other notification information are displayed on the entire front display area 2111. In this case, the detailed information of the notification information may include at least one of the following: a UI element indicating the status of the portable terminal 100 related to the notification information, a UI element that can change the status of the portable terminal, and A UI element indicating the identification information of the notification information. For example, once one UI element 2131-1 among the UI elements that can change the state of the portable terminal 100 is selected, the state of the portable terminal 100 can be changed from the non-power saving mode to the power saving mode.

As described above, in the case where the frequently used notification information is displayed using the side display area 2112, the user can easily select the notification information as needed, and the detailed information of the notification information can be easily confirmed through the front display area 2111.

Referring to FIG. 22, the controller 190 may control the display 130 so that the notification information may be displayed on the side display area 2212 in various shapes. As an example, referring to 2210 in FIG. 22, only the notification information 2213 can be displayed on the side display area 2212. As another example, referring to 2220 in FIG. 22, the notification information 2213 and the application identification information 2214 may be displayed on the side display area 2212 together. In this case, since the display area of the notification information 2213 is reduced, the notification information 2213 may be arranged to be displayed in 2 or 3 rows, or a simplified UI element may be displayed instead of the notification information 2213. As another example, referring to 2230 in FIG. 22, the notification information 2213-1 and 2213-2, the displayed screen, and / or a UI element 2215 that can control the displayed content may be displayed on the side display area 2212. The UI element may be, for example, a soft key 2215. Soft keys are keys that replace the existing physical buttons to control the screen displayed on the display area. The soft keys may include at least one of: a soft key for executing a home screen, a soft key for displaying a menu related to the displayed screen, and a soft key for returning to a previous screen of the displayed screen. In this case, the notification information 2213-1 and 2213-2 may be divided into upper and lower ends around a UI element (for example, a soft key) to be displayed.

Referring to FIG. 23, the controller 190 may control the display 130 so that soft keys are displayed on the side display area 2312. If the soft keys are displayed on the side display area 2312 as described above, the user can use the soft keys to easily and quickly control the displayed screen. According to the existing portable terminal 100 without a side display area, the soft keys are located at the lower end of the front display area of the portable terminal 100, and thus the information on the display area can be partially hidden or omitted. In addition, according to the existing portable terminal 100 having no side display area, the user operates the soft keys with one hand, which causes difficulty in use. Specifically, as the display area becomes larger, the user may encounter great difficulties when using one hand to select a soft key at the lower end of the front display area.

While the soft keys are displayed on the side display area 2312, the sensor 180 may sense a user input for selecting the soft keys to perform the soft key function. In this case, since the user can easily touch the side display area 2312 due to the physical characteristics of the side display area 2313, the sensor 180 can take into account a failure that occurs during the touch. For example, an input sensor may be used in the sensor 180, and if a soft key is pressed with more than a predetermined pressure, the sensor 180 may determine that the soft key is selected. In addition, if the soft key is touched for more than a predetermined time, the sensor 180 may determine that the soft key is selected. In addition, if a user input is sensed and after the soft key is displayed on the side display area 2312 by the user's touch and drag, the soft key is sequentially touched within a predetermined time (for example, 1 second to 3 seconds) Then, the sensor 180 may determine that the soft key is selected.

FIG. 24 shows an example of a screen displayed on the side display area 2412. Since the vertical length of the side display area 2412 is about 1.5 to 2 times longer than the horizontal length of the front display area 2412, various information traditionally displayed on different areas of the front display area of the portable terminal can be passed through the side The display area is provided together. For example, notification information and soft keys are displayed at the upper and lower ends of the front display area of a conventional portable terminal. However, according to an exemplary embodiment of the present invention, as shown in 2410 of FIG. 24, an object 2413 indicating a soft key may be displayed at the center of the side display area 2412, and multiple pieces of notification information may be displayed at the lower and upper ends of the software Office. In addition, referring to 2420 in FIG. 24, the text 2414 indicating the soft key is displayed at the center of the side display area 2412, and the notification information can be displayed at the lower and upper ends of the software.

Referring to 2510 of FIG. 25A, in a case where the notification information is displayed on the side display area 2512, the sensor 180 may sense a user input for selecting one notification information 2512-1 among a plurality of notification information. The user input may be, for example, a tap gesture to touch a piece of notification information 2512-1, or a flick gesture to flick a piece of notification information 2512-1 in the positioning direction of the front display. In response to user input, as shown in 2520 of FIG. 25A, the controller 190 may control the display 130 so that detailed information 2521 of the notification information is displayed on the front display area 2511. For example, if the notification information is an icon indicating a received message, the detailed information 2521 of the notification information may be the body of the message or the title of the message. In addition, as shown in 2530 of FIG. 25B, in a case where the front area of the portable terminal 100 is covered by a cover having a transparent area, the controller 190 may control the display 130 so that the detailed information 2521 of the notification information is displayed on the and On the display area 2531 corresponding to the transparent area.

26A to 27B are views illustrating user interaction using a palm on a side display area according to an exemplary embodiment of the present invention.

As an example, various user inputs using the side display area can be considered.

In this case, the frequency of touching the front display area of the portable terminal 100 is reduced, and thus the front display area can be less polluted.

Specifically, if the user input on the front display area using the palm is replaced by the user input on the side display, the pollution of the front display area can be reduced. In addition, since the sides of the front display area and the side display area are divided with a predetermined curvature, it is difficult for the palm on the side display area to touch the front display area.

In addition, if the touch area of the palm on the front display area is not large enough, it is difficult to distinguish between the touch of the palm and the touch of the finger, thereby causing a malfunction. If a user input using a palm is performed on the side display area, the palm can cover the entire width of the side display area, and thus the possibility of a malfunction can be reduced.

In an exemplary embodiment of the present invention, a display 130 combined with the sensor 180 may be provided on the side of the portable terminal 100, or only the sensor 180 may be provided without the display 130. In addition, a portion of the side of the portable terminal 100 may be provided with only the sensor 180, and another portion thereof may be provided with only the display 130.

As shown in 2610 of FIG. 26A, while the screen containing the video content is displayed on the front display area 2611, the sensor 180 can sense the use of dragging from the bottom to the top along the long side using the palm on the side display area Gesture. In response to a user gesture, as shown in 2620 of FIG. 26A, the controller 190 can capture a screen displayed on the front display area 2611. In addition, the controller 190 may control the display 130 such that thumbnails 2611-1 and 2612-1 of the captured image are displayed on one side of the front display area 2611 or on the side display area 2612.

As shown in 2630 of FIG. 26B, while the screen containing the video content is displayed on the front display area 2631, the sensor 180 can sense that the palm is dragged from top to bottom along the long side using the palm on the side display area 2632 User gesture. In response to a user gesture, the controller 190 can capture a screen displayed on the front display area 2631, and can control the display 130 so that the captured images are continuously displayed on the front display area 2631. In addition, the controller 190 may control the display 130 so that a UI element that can edit a captured image is displayed on the side display area 2632. The UI element may include, for example, at least one of the following: a UI element for adjusting the size of the captured image, a UI element for editing the color of the captured image, and a UI for applying a filter effect to the captured image Components, a UI component for adding information to the captured image, a UI component for storing the captured image, and a UI component for deleting the captured image without storing the captured image.

As described above, the controller 190 may control the display 130 to display the UI elements providing different functions on the side area using the palm in the dragging direction of the side area. As another example, even in a case where a finger is used instead of the palm, the controller 190 can control the display 130 so that UI elements providing different functions are displayed on the side area along the dragging direction.

As shown in 2710 of FIG. 27A, while the portable terminal 100 outputs sound at the first level, the sensor 180 may sense that the side display area 2712 is covered with the palm or is predetermined along the side display area 2712. User gesture for directional drag. In response to a user gesture, as shown in 2720 of FIG. 27A, the controller 190 may attenuate the output sound and control the display 130 to display notification information 2711-1 indicating that the sound has been attenuated. In addition, the controller 190 may lower the level of the output sound from the first level to the second level.

As shown in 2730 of FIG. 27B, while the output sound is weakened in the portable terminal 100, the sensor 180 may sense that the side display area 2712 is covered with the palm or in a predetermined direction on the side display area 2712 User gesture for drag on. In response to a user gesture, as shown in 2740 of FIG. 27B, the controller 190 can output sound at a level before the sound is attenuated. In addition, the controller 190 may output a sound at a predetermined third level.

28 to 30 are flowcharts illustrating various display methods according to the present invention.

Referring to FIG. 28, the portable terminal 100 may display a UI element on the exposed display area in a state where a part of the display area is covered by a cover including a transparent area to be exposed (S2801). Next, while the UI element is displayed on the exposed display area, the portable terminal 100 may determine whether a user input for selecting a UI element is sensed (S2803). The user input may be, for example, at least one of the following: a tap gesture that touches a UI element and then releases the touch, a flick gesture that touches the UI element and then flicks the touched UI element in the positioning direction of the cover, touches A drag gesture of the UI element and then dragging the touched UI element to the transparent area, and a drag gesture of touching the UI element and then dragging the touched UI element from the exposed display area to a position corresponding to the transparent area of the cover.

If the result of the judgment is that a user input is sensed (S2803-Y), the portable terminal can control the display area corresponding to the transparent area (S2805). For example, the portable terminal 100 may display information on the execution of an application program related to the UI element on a display area corresponding to the transparent area.

Referring to FIG. 29, the portable terminal 100 may display a UI element on a display area corresponding to the transparent area in a state where a part of the display area is covered by a cover including a transparent area to be exposed to the outside of the cover (S2901). While the UI element is displayed on the display area corresponding to the transparent area, the portable terminal 100 may determine whether a user input for selecting the UI element is sensed (S2903).

If the result of the judgment is that a user input is sensed (S2903-Y), the portable terminal 100 can control the display area exposed to the outside of the cover (S2905). For example, the portable terminal 100 may display another UI element that can control information related to the UI element on a display area exposed to the outside of the cover.

Referring to FIG. 30, the portable terminal 100 may display a UI element on a side display area in a state where the front display area is covered by a front cover including a transparent area (S3001). While the UI element is displayed on the side display area, the portable terminal 100 may determine whether a user input for selecting a UI element is sensed (S3003).

If the result of the determination is that a user input is sensed (S3003-Y), the portable terminal 100 can control a display area corresponding to the transparent area (S3005). For example, the portable terminal 100 may display information on the execution of an application program related to a UI element on a display area corresponding to the transparent area.

FIG. 31 is a block diagram illustrating a configuration of a portable terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 31, the portable terminal 100 includes a display 130, a sensor 180, and a controller 190. Since the configurations of the display 130, the sensor 180, and the controller 190 have been explained, they will not be described again.

In an exemplary embodiment, in a state where a part of the display area is covered by a cover including a transparent area to be exposed to the outside of the cover, the display 130 may display a UI element on the exposed display area. While the UI element is displayed, the sensor 180 may sense a user input for selecting the UI element. In response to a user input via the sensor 180, the controller 190 may control a display area corresponding to the transparent area provided by the display 130.

In another exemplary embodiment, in a state where a part of the display area is covered by a cover including a transparent area to be exposed to the outside of the cover, the display 130 may display a UI element on the display area corresponding to the transparent area. While the UI element is displayed, the sensor 180 may sense a user input for selecting the UI element. In response to a user input via the sensor 180, the controller 190 may control the exposure provided by the display 130 to the display area outside the cover.

In still another exemplary embodiment, in a state where the front display area is covered by a front cover including a transparent area, the display 130 may display UI elements on the side display area. While the UI element is displayed, the sensor 180 may sense a user input for selecting the UI element. In response to a user input via the sensor 180, the controller 190 may control a display area corresponding to the transparent area provided by the display 130.

The display method of the portable terminal 100 according to the above-described various exemplary embodiments may be implemented by a program to be provided to the portable terminal 100. Specifically, a non-transitory computer readable medium may be provided. The non-transitory computer readable medium stores a program including a display method of the portable terminal 100.

Non-transitory computer-readable media are not media that temporarily store data (for example, scratchpad, cache, or memory), but media that store data semi-permanently and can be read by the device. Specifically, the above programs can be stored and provided in non-transitory computer-readable media, such as CD, DVD, hard disk, Blu-ray disc, USB, memory card, and ROM. In addition, the above program can be stored and provided in the storage 150 of the portable terminal 100 (which is an example of a non-transitory computer-readable medium).

Although the invention has been shown and described with reference to certain embodiments of the invention, those skilled in the art will understand that the invention can be made without departing from the spirit and scope of the invention as defined by the scope of the accompanying patent application Changes in various forms and details.

100‧‧‧ portable terminal

110‧‧‧Video Receiver

120‧‧‧ Video Processor

130‧‧‧ Display

140‧‧‧Communicator

141‧‧‧Wi-Fi chip

142‧‧‧Bluetooth chip

143‧‧‧Wireless communication chip

144‧‧‧Near field communication chip

150‧‧‧Storage

160‧‧‧Audio Processor

170‧‧‧Speaker / Audio Output

180‧‧‧Sensor

181‧‧‧touch sensor

182‧‧‧ Motion Sensor

183‧‧‧ Cover Open / Close Sensor

190‧‧‧controller

191‧‧‧RAM

192‧‧‧ROM

193‧‧‧Graphics Processor

194‧‧‧Main CPU

195-1‧‧‧First interface

195-n‧‧‧nth interface

196‧‧‧Bus

210‧‧‧ Operating System

220‧‧‧core

230‧‧‧ Chinese software

230-1‧‧‧X11 module

230-2‧‧‧APP Manager

230-3‧‧‧Connection Manager

230-4‧‧‧Security Module

230-5‧‧‧System Manager

230-6‧‧‧Multimedia Framework

230-7‧‧‧UI Framework / Main UI Framework

230-8‧‧‧window manager

230-9‧‧‧Handwriting recognition module / sub UI framework

240‧‧‧Applications / Application Modules

240-1, 240-2, 240-n‧‧‧ apps

300‧‧‧ main body

310‧‧‧ curved display

311‧‧‧front display area / main display area / display area

312‧‧‧Side display area / auxiliary display area / display area / exposed display area

313‧‧‧Main display area / display area

314‧‧‧Auxiliary display area / display area / exposed display area

315‧‧‧Main display area / display area

316‧‧‧Auxiliary display area / display area / exposed display area

321‧‧‧Speaker

322‧‧‧illumination sensor

323‧‧‧Front camera module

324‧‧‧Interface

325‧‧‧Microphone

330‧‧‧ cover

501‧‧‧Notification Information

610-1, 610-2, 610-3, 610-4‧‧‧

611‧‧‧Transparent area

612‧‧‧display area

620-1, 620-2, 620-3, 620-4‧‧‧

630-1, 630-2, 630-3, 630-4‧‧‧

640-1, 640-2, 640-3, 640-4‧‧‧

710‧‧‧ Examples

711‧‧‧display area

711-1‧‧‧center

712‧‧‧display area

712-1‧‧‧UI Elements

720‧‧‧ Examples

730‧‧‧ Examples

740‧‧‧ Examples

810‧‧‧Example

811‧‧‧display area / front display area

812‧‧‧ exposed display area

820‧‧‧Example

910‧‧‧ Examples

911‧‧‧display area

912‧‧‧ exposed display area

912-1‧‧‧App identification information / weather icon

920‧‧‧ Examples

1010‧‧‧ Examples

1011‧‧‧display area

1012‧‧‧ exposed display area

1012-1‧‧‧Phone app identification information

1020‧‧‧ Examples

1030‧‧‧ Examples

1040‧‧‧ Examples

1110‧‧‧ Examples

1111‧‧‧display area

1112‧‧‧ exposed display area

1112-1‧‧‧Keyboard UI Elements

1118‧‧‧touch drag gesture

1119‧‧‧touch drag gesture

1120‧‧‧ Examples

1130‧‧‧ Examples

1140‧‧‧ Examples

1210‧‧‧ Examples

1211‧‧‧display area

1212‧‧‧ exposed display area

1212-1‧‧‧ Camera app identification information

1220‧‧‧ Examples

1230‧‧‧ Examples

1231‧‧‧display area

1310‧‧‧ Examples

1311‧‧‧display area

1312‧‧‧ exposed display area

1312-1‧‧‧UI Elements

1312-2‧‧‧ Thumbnail

1320‧‧‧ Examples

1330‧‧‧ Examples

1340‧‧‧ Examples

1341‧‧‧ Thumbnail

1341-1‧‧‧ Thumbnail

1350‧‧‧ Examples

1410‧‧‧ Examples

1411‧‧‧display area

1411-1‧‧‧folder

1412‧‧‧ exposed display area

1412-1‧‧‧ Thumbnail

1420‧‧‧ Examples

1430‧‧‧ Examples

1510‧‧‧ Examples

1511‧‧‧display area

1512‧‧‧ exposed display area

1520‧‧‧ Examples

1610‧‧‧ Examples

1611‧‧‧Display Area

1611-1‧‧‧Web Identity

1612‧‧‧ exposed display area

1612-1‧‧‧Web application identification information

1620‧‧‧ Examples

1630‧‧‧ Examples

1710‧‧‧ Examples

1711‧‧‧Display Area

1712‧‧‧ exposed display area

1712-1‧‧‧ Music app identification information

1720‧‧‧ Examples

1810‧‧‧ Examples

1811‧‧‧display area

1812‧‧‧ exposed display area

1820‧‧‧ Examples

1910‧‧‧ Examples

1911‧‧‧ Display Area

1912‧‧‧ exposed display area

1912-1‧‧‧Identification information

1920‧‧‧ Examples

2110‧‧‧ Examples

2111‧‧‧Front display area

2112‧‧‧Side display area

2120‧‧‧ Examples

2130‧‧‧ Examples

2131-1‧‧‧UI components

2210‧‧‧ Examples

2211‧‧‧Front display area

2212‧‧‧Side display area

2213‧‧‧Notification Information

2213-1‧‧‧Notification Information

2213-2‧‧‧Notification Information

2214‧‧‧App identification information

2215‧‧‧UI Elements / Softkeys

2220‧‧‧ Examples

2230‧‧‧ Examples

2311‧‧‧Front display area

2312‧‧‧Side display area

2411‧‧‧Front display area

2410‧‧‧ Examples

2412‧‧‧Side display area

2413‧‧‧ Object

2414‧‧‧ text

2420‧‧‧ Examples

2510‧‧‧ Examples

2511‧‧‧Front display area

2512‧‧‧Side display area ’

2512-1‧‧‧Notification Information

2520‧‧‧ Examples

2521‧‧‧Details

2530‧‧‧ Examples

2610‧‧‧ Examples

2611‧‧‧Front display area

2611-1‧‧‧ Thumbnail

2612‧‧‧Side display area

2612-1‧‧‧ Thumbnail

2620‧‧‧ Examples

2630‧‧‧ Examples

2631‧‧‧Front display area

2632‧‧‧Side display area

2640‧‧‧ Examples

2711-1‧‧‧Notification Information

2711‧‧‧Front display area

2712‧‧‧Side display area

S2801, S2803, S2805‧‧‧ steps

S2901, S2903, S2905‧‧‧ steps

S3001, S3003, S3005‧‧‧ steps

X‧‧‧X-axis

Y‧‧‧Y-axis

Z‧‧‧Z-axis

The above detailed description and other aspects of the present invention will be more apparent when reading the following detailed description in conjunction with the accompanying drawings, in which:

FIG. 1 is a block diagram illustrating a portable terminal according to an exemplary embodiment of the present invention.

FIG. 2 is a diagram illustrating software stored in a portable terminal according to an exemplary embodiment of the present invention.

3A to 3F are views illustrating a portable terminal according to an exemplary embodiment of the present invention.

FIG. 4 is a view explaining a motion of a portable terminal according to an exemplary embodiment of the present invention.

FIG. 5 is a view illustrating that a portable terminal provides notification information according to an exemplary embodiment of the present invention.

6A to 6H are views illustrating various examples of a cover having a transparent region according to an exemplary embodiment of the present invention.

7A to 25B are views illustrating information displayed on a portable terminal according to an exemplary embodiment of the present invention.

26A to 27B are views illustrating user interaction using a palm on a side display area according to an exemplary embodiment of the present invention.

28 to 30 are flowcharts illustrating a method of displaying information according to an exemplary embodiment of the present invention.

FIG. 31 is a block diagram illustrating a configuration of a portable terminal according to an exemplary embodiment of the present invention.

Claims (14)

A method for displaying information on a portable terminal. The portable terminal includes a display and is configured to be connected to a cover. The display includes a main display area and a curved display area. The curved display area includes the display area. The curved surface portion of the main display area extends, the cover includes a transparent area and has a width smaller than that of the display, and the method includes: in a state where the main display area is covered by the cover, A user interaction (UI) element is displayed on the curved display area; and in response to receiving a user input to select the UI element displayed on the curved display area while the main display area is covered by the cover Displaying information in a portion of the main display area corresponding to the transparent area of the cover. The method for displaying information on a portable terminal according to item 1 of the scope of patent application, wherein displaying the information includes: on the portion of the main display area corresponding to the transparent area of the cover Displaying execution information of execution of an application program corresponding to the UI element. The method for displaying information on a portable terminal according to item 1 of the scope of patent application, further includes: in response to receiving user input to the curved display area exposed while displaying the UI element, Displaying the UI element at another position of the curved display area exposed. The method for displaying information on a portable terminal according to item 1 of the scope of patent application, wherein the user input includes one of the following: touch the UI element and release the touched tap gesture, touch A flick gesture of the UI element and flicking the touched UI element, a drag gesture of touching the UI element and dragging the touched UI element to the transparent area, and touching the UI element and A drag gesture of dragging the touched UI element from the curved display area to a position corresponding to the portion of the main display area corresponding to the transparent area of the cover. The method for displaying information on a portable terminal according to item 1 of the scope of patent application, wherein the display includes a front portion corresponding to the front of the portable terminal and a side corresponding to the side of the portable terminal Side area. The method for displaying information on a portable terminal according to item 1 of the scope of patent application, wherein the UI element is identification information of a telephone application, and wherein displaying the information is included in the transparent area with the cover At least one of the following is displayed on the corresponding portion of the main display area: a keypad, a call button, a text message switch button, a video call button, and a delete button. The method for displaying information on a portable terminal according to item 1 of the scope of patent application, wherein the UI element is camera application identification information, and wherein displaying the information includes: transparently communicating with the cover. At least one of the following is displayed on the portion of the main display area corresponding to the area: a preview screen before image shooting, an image after image shooting, and a moving image after image shooting. A method for displaying information on a portable terminal. The portable terminal includes a display and is configured to be connected to a cover. The display includes a main display area and a curved display area. The curved display area includes the display area. The curved surface portion of the main display area extends, the cover includes a transparent area and has a width smaller than the width of the display, and the method includes: in a state where the main display area is covered by the cover, A user interaction (UI) element is displayed on a portion of the main display area corresponding to the transparent area of the cover; and in a state where the main display area is covered by the cover, the display is displayed in response to a selection being received. User input of the UI element in the part of the main display area controls the curved display area exposed. The method for displaying information on a portable terminal according to item 8 of the scope of patent application, wherein the control includes: displaying another UI element on the curved display area in response to receiving the user input, The another UI element is used to control information related to the UI element. The method for displaying information on a portable terminal according to item 8 of the scope of patent application, wherein the UI element is a keypad, and wherein the controlling includes: displaying an input result on the curved surface display area. The method for displaying information on a portable terminal according to item 8 of the scope of patent application, wherein the UI element is a folder, and wherein the controlling includes: displaying the information contained in the data on the curved display area At least one thumbnail in the folder. The method for displaying information on a portable terminal according to item 8 of the scope of patent application, wherein the UI element recognizes video content, and wherein the controlling includes: displaying on the curved display area to control the UI elements for video content. A portable terminal includes a display and configured to be connected to a cover, the display includes a main display area and a curved display area, and the curved display area includes a curved surface extending from the main display area In part, the cover includes a transparent area and has a width smaller than that of the display, and the portable terminal further includes: a sensor; and a controller for covering the main display area by the cover. In a state of displaying a user interaction (UI) element on a portion of the main display area corresponding to the transparent area of the cover; and in a state where the main display area is covered by the cover, responding Upon receiving a user input to select the UI element displayed in the portion of the main display area, the curved display area exposed is controlled. The portable terminal according to item 13 of the patent application scope, wherein the controller is further configured to control the display to be displayed on the portion of the main display area corresponding to the transparent area of the cover Execution information of execution of an application program corresponding to the UI element.