KR20200014878A - Foldable device, and method for controlling the same - Google Patents

Abstract

The present invention relates to a foldable device and a control method thereof. The foldable device according to an embodiment of the present invention can comprise: a flexible display for displaying an execution screen of an application; and a control part which displays an execution screen of a first application on a first surface of the flexible display used as a display of the foldable display while the flexible display is folded, and when the flexible display is unfolded, displays the execution screen of the first application and an execution screen of a second application related to the first application on a second surface of the flexible display used as a display of the foldable device while the flexible display is unfolded.

Description

 Foldable device and its control method {FOLDABLE DEVICE, AND METHOD FOR CONTROLLING THE SAME}

Embodiments of the present invention relate to a foldable device and a control method thereof.

As the display technology develops, various display devices, such as a flexible display device and a transparent display device, are being developed. The flexible display device can be folded and used or unfolded according to a user's use situation, and thus, the volume of the electronic device can be dramatically reduced.

The flexible display may be implemented in the form of an organic light emitting display, a liquid crystal display, or the like. For example, in the existing liquid crystal display and the organic electroluminescent display, the flexible display may be manufactured using a flexible material such as replacing the organic substrate with a plastic film. In addition, in the existing liquid crystal display and the organic electroluminescent display, a foldable display can be manufactured using a flexible material at least in a folded portion.

As flexible display devices are used, various fields of application are emerging. For example, in the field of e-books, which can replace publications such as magazines, textbooks, books, and comics, miniature PCs that can be folded or rolled up, and new portable IT products such as smart cards with real-time information. The flexible display device may be applied. On the other hand, development of an interface that can take advantage of these advantages while reflecting the characteristics of the flexible display device is required.

Embodiments of the present invention are to allow a user to conveniently view a plurality of application screens in a device having a flexible characteristic.

In addition, embodiments of the present invention, to enable a user to easily use the association function in a flexible device.

In addition, embodiments of the present invention, in the flexible device, to view the application screen required for the current situation using a simple operation of folding and unfolding the flexible device.

According to an embodiment of the present invention, a foldable device includes: a flexible display for displaying an execution screen of an application; And an execution screen of a first application is displayed on a first surface of the flexible display used as a display of the foldable device while the flexible display is folded, and when the flexible display is unfolded, the flexible display is opened. And a controller configured to display an execution screen of the first application and an execution screen of a second application related to the first application on a second surface of the flexible display used as a display of the foldable device in a state. have.

The foldable device may further include an input unit configured to receive a user selection, and the controller may further include a second application selection menu for selecting the at least one second application while the flexible display is folded. The display may be displayed together with an execution screen of one first application, and the at least one second application may be determined according to a user selection through the second application selection menu.

The foldable device may further include an input unit configured to receive a user selection, and the control unit may include an execution screen of the at least one first application when the execution screen of the at least one first application is displayed. The controller may be configured to display a second application selection menu for selecting the at least one second application, and determine the at least one second application according to a user selection through the second application selection menu.

The controller may determine the at least one second application based on a pre-stored related application list.

The controller may determine the at least one second application based on an input to the at least one first application.

The controller may determine an application related to a notification event occurring in the foldable device as the at least one second application.

The controller may determine the at least one second application based on a user's application usage history.

The controller may determine the application designated by the user as the at least one second application.

The second surface of the flexible display may be disposed opposite to the first surface of the flexible display, and the state detector may cover a portion of the second surface, and at least a portion of the second surface may be aligned with the first surface. The at least one folded state is detected to be arranged in the same direction, and the controller is configured to detect the at least one folded state on the first surface of the flexible display used as a display of the foldable device in the partially folded state. Displaying at least one execution screen of the first application of the first application; and displaying at least a portion of the region arranged in the same direction as the first surface of the second surface of the flexible display used as the display of the foldable device in the partially folded state. An execution screen of one second application may be displayed.

In addition, the control method of a foldable device including a flexible display according to an embodiment for realizing the above object, the first surface of the flexible display used as a display of the foldable device in a state in which the flexible display is folded Displaying an execution screen of the first application on the screen; And an execution screen of the first application and a first screen associated with the first application on a second surface of the flexible display used as a display of the foldable device when the flexible display is unfolded when the flexible display is unfolded. 2 may include displaying an execution screen of the application.

The control method of the foldable device including the flexible display according to an exemplary embodiment may include a second application selection menu for selecting the at least one second application while the flexible display is folded. 1 displaying with the execution screen of the application; Receiving a user selection through the second application selection menu; And determining the at least one second application according to the user selection.

The displaying of the execution screen of the first application may include displaying a second application selection menu for selecting the at least one second application together with the execution screen of the at least one first application. The method for controlling a foldable device may include: receiving a user selection through the second application selection menu; And determining the at least one second application according to the user selection.

The control method of the foldable device including the flexible display according to an embodiment may further include determining the at least one second application based on a pre-stored related application list.

The control method of the foldable device including the flexible display according to an embodiment may further include determining the at least one second application based on an input to the at least one first application. have.

The control method of the foldable device including the flexible display may further include determining an application related to a notification event occurring in the foldable device as the at least one second application.

In addition, the control method of the foldable device including the flexible display according to an embodiment may further include determining the at least one second application based on a user's application usage history.

The method for controlling a foldable device including the flexible display may further include determining an application designated by a user as the at least one second application.

In addition, the control method of a foldable device including a flexible display according to an embodiment of the present invention, covering a portion of the second surface of the flexible display, at least a portion of the second surface disposed on the opposite side of the second surface Detecting a part of a folded state that is folded to be disposed in the same direction as the first surface; And when the partially folded state is detected, displaying an execution screen of the at least one first application on a first surface of the flexible display used as a display of the foldable device in the partially folded state, and in the partially folded state And displaying an execution screen of the at least one second application on at least part of an area disposed in the same direction as the first surface of the second surface of the flexible display used as the display of the foldable device. have.

According to embodiments of the present invention, in a device having a foldable characteristic, a user may conveniently view a plurality of application screens.

In addition, according to embodiments of the present invention, in the foldable device, there is an effect that the user can easily use the associated function.

In addition, according to embodiments of the present invention, in the foldable device, there is an effect that the application screen required for the current situation can be viewed using a simple operation of folding and unfolding the foldable device.

1A illustrates an example of a device 100 folding through a hinge, according to one embodiment.
1B is a diagram illustrating an example of a device 100 that can be folded by bending in accordance with one embodiment.
2 is a diagram illustrating a structure of a device 100a according to an embodiment.
3 is a diagram illustrating the structure of a device 100b according to an embodiment.
4 is a diagram illustrating an arrangement of the first display unit 310 and the second display unit 320 according to an exemplary embodiment.
5 is a view showing a device 100 is implemented in a wobbleable structure.
6 to 11 are diagrams illustrating examples of display units that are distinguished in hardware according to an exemplary embodiment.
12 and 13 illustrate examples of display units that are distinguished by software, according to an exemplary embodiment.
14 illustrates a definition of a folded state, according to an exemplary embodiment.
15 is a view showing a folded state according to an embodiment.
16 is a view showing a folded state according to an embodiment.
17 is a view showing a folded state according to an embodiment.
18 is a view illustrating a folded state according to an embodiment.
19 is a view illustrating a folded state according to an embodiment.
20 is a diagram for describing a definition of an expanded state, according to an exemplary embodiment.
21 is a view illustrating an expanded state according to an embodiment.
22 is a view showing an expanded state according to another embodiment.
23 is a view illustrating a folding operation and an expanding operation according to an embodiment.
24 is a view illustrating a folding operation and an expanding operation according to an embodiment.
25 is a flowchart illustrating a device control method according to an exemplary embodiment.
26 is a flowchart illustrating a device control method according to an embodiment.
27 is a diagram illustrating a screen of a folded state and an unfolded state according to an exemplary embodiment.
28 is a flowchart illustrating a device control method according to an embodiment.
29A to 29B are diagrams illustrating screens of an unfolded state and a partially folded state, according to an exemplary embodiment.
30A to 30B are diagrams illustrating a screen in an expanded state and a folded state, according to an exemplary embodiment.
31A to 31B are diagrams illustrating screens of an expanded state and a folded state, according to an exemplary embodiment.
32 is a diagram illustrating a device control method according to an exemplary embodiment.
33 is a diagram illustrating a structure of an electronic device 100c according to an embodiment.
34 is a flowchart illustrating a device control method according to an embodiment.
35 is a diagram illustrating providing a second application selection menu according to one embodiment.
36 is a diagram illustrating providing a second application selection menu according to an embodiment.
37 is a diagram illustrating providing a second application selection menu according to one embodiment.
38 is a diagram illustrating providing a second application selection menu according to an embodiment.
39 is a flowchart illustrating a device control method according to an embodiment.
40 is a diagram illustrating an example of displaying a second application selection menu together with a screen of a first application in step S3906 of FIG. 39.
41 is a flowchart illustrating a device control method according to an embodiment.
42 is a diagram illustrating providing a second application selection menu according to an embodiment.
43 is a diagram illustrating providing a second application selection menu according to an embodiment.
44 illustrates a device control method according to an exemplary embodiment.
45 is a diagram illustrating a related application list, according to an exemplary embodiment.
46 is a diagram illustrating a screen of displaying a screen of a second application together with a screen of a first application based on a related application list, according to an exemplary embodiment.
47 illustrates a device control method according to an embodiment.
48 is a diagram illustrating a screen for displaying a screen of a second application by determining a second application according to an embodiment.
49 is a diagram illustrating a screen for displaying a screen of a second application by determining a second application according to an embodiment.
50 is a diagram illustrating a device control method according to an exemplary embodiment.
51 is a diagram illustrating a screen for displaying a screen of a second application by determining a second application according to an embodiment.
52 is a view illustrating a device control method according to an embodiment.
53 is a diagram illustrating a screen for displaying a screen of a second application by determining a second application according to an embodiment.
54 is a diagram illustrating a screen for displaying a screen of a second application by determining a second application according to an embodiment.
55 is a view illustrating a device control method according to an embodiment.
56 illustrates a device control method according to an embodiment.
57 is a view illustrating a device control method according to an embodiment.
58 is a diagram illustrating a screen for displaying a screen of a second application by determining a second application according to one embodiment.
59 is a view illustrating a device control method according to an embodiment.
60 is a diagram illustrating providing a window split selection menu according to an embodiment.
FIG. 61 is a diagram illustrating a screen when it is selected to display a screen of a second application through the window division selection menu.
FIG. 62 is a diagram illustrating a screen when the screen of the second application is selected not to be displayed through the window division selection menu.
63 is a diagram illustrating providing a window arrangement selection menu according to an embodiment.
64 is a diagram illustrating a screen when the screen of the first application is selected on the right through the window layout selection menu.
65 is a diagram illustrating a screen when the screen of the first application is selected to be displayed as a full screen through the window layout selection menu.
FIG. 66 is a diagram illustrating a screen when the screen of the first application is selected to be displayed on the left through a window layout selection menu.
67 is a diagram illustrating a screen layout of a first application and a screen layout of a second application, according to an exemplary embodiment.
68 is a diagram illustrating a screen layout of a first application and a screen layout of a second application, according to an exemplary embodiment.
69 is a diagram illustrating an operation of the device 100 according to an embodiment.
70 is a diagram illustrating providing information on a second application according to an embodiment.
71 is a diagram illustrating providing information on a second application according to an embodiment.
78 is a block diagram illustrating a configuration of a device 100d according to an exemplary embodiment.

Advantages and features of the present invention, and methods for achieving them will be apparent with reference to the embodiments described below in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be embodied in various different forms, and the present embodiments merely make the disclosure of the present invention complete, and those of ordinary skill in the art to which the present invention belongs. It is provided to fully inform the person having the scope of the invention, which is defined only by the scope of the claims.

Terms used herein will be briefly described, and the present invention will be described in detail.

The terms used in the present invention have been selected as widely used general terms as possible in consideration of the functions in the present invention, but this may vary according to the intention or precedent of the person skilled in the art, the emergence of new technologies, and the like. In addition, in certain cases, there is a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the invention. Therefore, the terms used in the present invention should be defined based on the meanings of the terms and the general contents of the present invention, rather than simply the names of the terms.

When any part of the specification is to "include" any component, this means that it may further include other components, except to exclude other components unless specifically stated otherwise. In addition, the term "part" as used herein refers to a hardware component such as software, FPGA or ASIC, and "part" plays certain roles. However, "part" is not meant to be limited to software or hardware. The “unit” may be configured to be in an addressable storage medium and may be configured to play one or more processors. Thus, as an example, a "part" refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, procedures, Subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functionality provided within the components and "parts" may be combined into a smaller number of components and "parts" or further separated into additional components and "parts".

In this specification, the “foldable device 100” refers to a collapsible electronic device.

In addition, “folding” may mean that both faces facing each other come into close contact with each other as the planar electronic device is deformed based on an arbitrary line (see FIGS. 1 and 2). . In this case, the planar electronic device may be deformed by bending or deformed by bending through a hinge.

For example, when the hinge is mounted on the foldable device 100, the foldable device 100 may be folded because both sides of the hinge folded as the axes are in contact with each other and become parallel or close to parallel. In addition, when the foldable device 100 is made of a flexible material, the two foldable devices face each other as they are bent based on an arbitrary line, so that the foldable device can be folded.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention.

1A illustrates an example of a device 100 folding through a hinge, according to one embodiment.

The device 100 according to the present embodiment may be implemented in the form of a foldable electronic device that can be folded using a hinge as shown in FIG. 1A.

The device 100 according to the present embodiment may be used in a folded state as shown in FIG. 1A or in an unfolded state as shown in FIG. 1B.

In addition, the electronic device 100 according to the present embodiment may switch the screen according to the folded state or the unfolded state. In the present specification, a folding shape of an electronic device may be defined as two states, a folded state and an open state. The method of defining the folded state and the unfolded state will be described later.

In addition, in the present specification, the folding operation means that the electronic device 100 is changed from the expanded state to the folded state. The unfolding operation means that the electronic device 100 is changed from the folded state to the unfolded state.

According to the embodiments, the device 100 may be implemented in various forms such as a smartphone, a tablet PC, a notebook, a wearable device, an e-book, and the like.

When the device 100 according to the embodiments of the present invention detects a folding operation or an expanding operation in a state where the execution screen 110 of the first application is displayed, the device 100 may execute the second application together with the execution screen 110 of the first application. The execution screen 120 may be displayed. The second application may be determined according to various embodiments.

In this specification, the "execution screen of the first application", the "first application screen" or the "screen of the first application" means a screen displayed on the display unit as a result of the execution of the first application. The "execution screen of the second application", the "second application screen" or the "screen of the second application" means a screen displayed on the display unit as a result of the execution of the second application. In addition, referring to FIG. 1A, an area of both sides facing each other as the device 100 is folded through the hinge is implemented to be symmetrically folded, or according to another embodiment, the device 100 may be hinged. It may be implemented to be asymmetrically folded because the area of the two sides facing each other according to the folding.

1B is a diagram illustrating an example of a device 100 that can be folded by bending in accordance with one embodiment.

As shown in FIG. 1B, the device 100 may be bent based on an arbitrary line, and as the device 100 is bent, an area in which the folding line is located may be bent at a predetermined angle or more. In addition, the device 100 may be folded as both surfaces facing each other as they are bent close to parallel.

2 is a diagram illustrating a structure of a device 100a according to an embodiment.

The device 100a according to the present exemplary embodiment includes a display unit 210, a state detector 220, and a controller 230.

The display unit 210 displays an application screen, a user interface screen, a screen indicating the state of the electronic device 100a, and the like, which are being executed by the controller 230. The controller 230 executes at least one application and controls the display unit 210 to display a screen of at least one application being executed on the display unit 210. According to the present exemplary embodiment, when a folding operation or an expanding operation of the electronic device 100a is detected while the controller 230 displays an execution screen of at least one first application, execution of the at least one first application is performed. The execution screen of the at least one second application is displayed together with the screen.

For example, as shown in FIG. 1, when the execution screen of the first application is displayed in the folded state, when the device 100a is changed to the expanded state and an expanding operation is detected, the execution screen of the first application is displayed together. The execution screen of the second application may be displayed.

According to an embodiment of the present disclosure, when the screen of the first application and the screen of the second application are displayed in the folded state and the unfolded state, the screen of the first application may be displayed as the same screen and only the size thereof may be changed.

According to another embodiment, when the screen of the first application and the screen of the second application are displayed in the folded state and the unfolded state, the arrangement of the screens may be different. For example, the position or size of a menu or the placement or size of an icon may vary in a screen of an application according to the folded state and the unfolded state.

The controller 230 may collectively control the operation of the device 100a. For example, the execution and control of an operating system of the device 100a, various data processing, and the components of the device 100a (for example, the display unit 210 and the state detector 220). An operation such as control can be performed.

The state detector 220 detects a folding operation and an expanding operation of the device 100a.

According to an embodiment, the state detector 220 may detect an operation of changing the state from the folded state to the unfolded state or an operation of changing the state of the unfolded state from the unfolded state to the folded state.

According to an embodiment, the device 100 may include a sensor unit 7780 (see FIG. 78). The sensor unit 7780 may detect a state of the device 100, a movement of the device 100, or a state around the device 100 and transmit the detected information to the controller 230.

The sensor unit 7780 may include a geomagnetic sensor, an acceleration sensor, a hall sensor, a bending sensor, a gyroscope sensor, a proximity sensor, a temperature / humidity sensor, an infrared sensor, It may include, but is not limited to, at least one of a position sensor (eg, GPS), an air pressure sensor, and an RGB sensor. Functions of the respective sensors can be intuitively deduced by those skilled in the art from the names, and thus detailed descriptions thereof will be omitted.

According to an embodiment of the present disclosure, the state detector 220 of the device 100 may detect an operation of changing to an unfolded state or a folded state of the device 100 using the sensor unit 7880. For example, the state detector 220 may detect the folding operation or the unfolding operation itself by using a Hall sensor or a magnetic sensor provided in the folding area.

According to another embodiment, the state detector 220 may detect whether the current state of the device 100a is in an unfolded state or a folded state, and if the current state is changed, detect the folding operation or unfolding operation.

According to an embodiment, the state detector 220 may measure the bending or folding angle of the device 100a. When the device 100a has a hinge structure, the folding angle may be measured in the hinge structure.

According to another exemplary embodiment, the state detector 220 may detect a folded state by placing a state detection sensor at a point close to each other by bending or folding the device 100a. The state detection sensor may include at least one or a combination of a proximity sensor, an illumination sensor, a magnetic sensor, a hall sensor, a touch sensor, a bending sensor, and an infrared sensor.

According to an exemplary embodiment, the state detector 220 may determine whether the state is folded or unfolded, and provide the determination result to the controller 230. In this case, the controller 230 may determine whether the state is in the folded state or the unfolded state according to the output of the state detector 220 without the need of separately determining the folded state or the unfolded state.

According to another exemplary embodiment, when the state detector 220 provides the controller 230 with information about the bent or folded angle or sensing information of the state detection sensor, the controller 230 may determine whether the folded state or the unfolded state is determined. Can be.

3 is a diagram illustrating a structure of an electronic device 100b according to an embodiment.

According to the present exemplary embodiment, the display unit 210 may include a first display unit 310 and a second display unit 320. In addition, the first display unit 310 and the second display unit 320 may be distinguished in hardware or in software.

According to an embodiment of the present invention, the first display unit 310 and the second display unit 320 may be distinguished from each other in hardware.

For example, the first display unit 310 and the second display unit 320 may be implemented by two hardware screens (not shown). The first display unit 310 and the second display unit 320 may be disposed on one surface of the foldable device 100b to face the same direction. In addition, the first display unit 310 may be disposed on the front surface of the foldable device, and the second display unit 320 may be disposed on the rear surface of the foldable device.

According to another exemplary embodiment of the present invention, the first display unit 310 and the second display unit 320 are physically one area, but may mean respective areas that are distinguished by software.

One display unit disposed on one surface of the foldable device 100b may be divided into at least two regions by software, and each of the regions may form the display units. For example, the hardware screen facing the front surface of the foldable device 100b may be divided into at least two areas by software, and the two separated areas may be the first display unit 310 and the second display unit 320, respectively.

In addition, for example, a partial area of the hardware screen facing the front of the foldable device 100b is the first display unit 310, and a partial area of the hardware screen facing the rear surface of the foldable device 100b is the second display unit ( 320).

In addition, when the display unit is implemented in software, the position and size of the display unit may be dynamically changed as the foldable device 100 is folded or curled.

In FIG. 3, two display units of the first display unit 310 and the second display unit 320 are illustrated, but according to various embodiments of the present disclosure, the foldable device 100b includes two or more display units. You may.

The controller 230 may control to display the screen of the first application and the screen of the second application on at least one of the first display unit 310 and the second display unit 320. According to an embodiment, the first application screen may be displayed on the first display unit 310, and the second application screen may be displayed on the second display unit 320.

4 is a diagram illustrating an arrangement of the first display unit 310 and the second display unit 320 according to an exemplary embodiment.

As shown in FIG. 4, when the front surface of the device 100b is the first surface and the rear surface is the second surface, the first display unit 310 is disposed on the first surface of the electronic device 100b and the second display unit is displayed. The 320 may be disposed on the second surface of the electronic device 100b.

The first display unit 310 and the second display unit 320 may be disposed to occupy part or all of one surface of the electronic device 100b. In some embodiments, the first display unit 310 may be integrally disposed on the first surface of the device 100b or divided into a plurality of regions. In some embodiments, the second display unit 320 may be integrally disposed on the second surface of the device 100b or divided into a plurality of regions.

5 is a view showing a device 100 is implemented in a wobbleable structure.

When the device 100 is implemented to be folded by bending, the components such as the first display unit 310, the second display unit 320, the controller 230, and the housing constituting the device 100 may have flexible characteristics. It can be implemented to have. According to an embodiment, only some components (eg, a housing, etc.) of the flexible device 100 may have a flexible characteristic, and the remaining components (eg, a battery, etc.) may be implemented to have a rigid characteristic. have.

The display unit 210 may be implemented in at least one of a foldable structure, a flexible structure, and a rigid structure. In addition, the first display unit 310 may have a foldable property, and the second display unit 320 may have a rigid property.

When the display unit 210 has a foldable property, the folding area is arranged to match the folding area of the device 100.

When the display unit 210 has a flexible property, the display unit 210 may be freely disposed on the device 100.

When the display unit 210 has a rigid property, the display unit 210 may be disposed to avoid a folding area or a bending area of the device 100.

6 to 11 are diagrams illustrating examples of display units that are distinguished in hardware according to an exemplary embodiment.

According to an exemplary embodiment, the display unit may mean a flexible display.

According to an embodiment, the device 100 including the flexible display may be deformed as it is deformed or bent through a hinge, and the device 100 may be folded by deformation. 6 to 11, the folding area 610 may indicate a portion that is deformed by folding when the device 100 is folded or bent through a hinge.

As illustrated in FIG. 6, the display unit 210a may be integrally implemented to cover the folded region 610 on the first surface of the device 100a. The display unit 210a may be implemented as a foldable display or a flexible display. According to the present exemplary embodiment, the display unit 210 may not be disposed on the second surface.

According to the present exemplary embodiment, the folding operation may be defined as an operation in which the first surface is exposed and the two regions divided by the folding region 610 of the second surface face each other. The unfolding motion may be defined as an unfolding motion in a folded state so that the first surface is exposed to the outside.

7 is a diagram illustrating the structure of the display units 210a1 and 210a2 according to an exemplary embodiment.

According to an exemplary embodiment, the display units 210a1 and 210a2 may be disposed in each of two regions divided by the folding region 610 so as not to meet the folding region 610 on the first surface of the device 100a. The display units 210a1 and 210a2 may be implemented as at least one of a foldable display device, a flexible display device, and a rigid display device.

According to the present exemplary embodiment, the folding operation may be defined as an operation in which the first surface is exposed and the two regions divided by the folding region 610 of the second surface face each other. The unfolding motion may be defined as an unfolding motion in a folded state so that the first surface is exposed to the outside.

8 is a diagram illustrating structures of the first display unit 310a and the second display unit 320a according to an exemplary embodiment.

According to an embodiment, the first display unit 310a may be integrally implemented to cover the folded region 610 on the first surface of the device 100b. The second display unit 320a may be disposed in one of the two regions divided by the folding region 610 so as not to meet the folding region 610 on the second surface of the device 100b. The first display unit 310a may be implemented as a foldable display device or a flexible display device. The second display unit 320a may be implemented as at least one of a foldable display device, a flexible display device, and a rigid display device.

9 is a diagram illustrating the structure of the first display unit 310a and the second display unit 320b according to an exemplary embodiment.

According to an embodiment, the first display unit 310a may be integrally implemented to cover the folded region 610 on the first surface of the device 100b. The second display unit 320b may be integrally implemented to cover the folded area 610 on the second surface of the device 100b. The first display unit 310a and the second display unit 320b may be implemented as a foldable display device or a flexible display device.

10 is a diagram illustrating the structure of the first display unit 310a and the second display unit 320c1 and 220c2 according to an exemplary embodiment.

According to an embodiment, the first display unit 310a may be integrally implemented to cover the folded region 610 on the first surface of the device 100b. The second display units 320c1 and 220c2 may be disposed in each of two regions divided by the folding region 610 so as not to meet the folding region 610 on the second surface of the device 100b. The first display unit 310a may be implemented as a foldable display device or a flexible display device. The second display units 320c1 and 220c2 may be implemented as at least one of a foldable display device, a flexible display device, and a rigid display device.

11 is a diagram illustrating the structure of the first display units 310b1 and 210b2 and the second display unit 320a according to another exemplary embodiment.

According to an embodiment, the first display units 310b1 and 210b2 may be disposed in each of two regions divided by the folding region 610 so as not to meet the folding region 610 on the first surface of the device 100b. The second display unit 320a may be disposed in one of two areas divided by the folding area 610 so as not to meet the folding area 610 on the second surface of the device 100b. The first display unit 310b1, 210b2 and the second display unit 320a may be implemented as at least one of a foldable display device, a flexible display device, and a rigid display device.

12 and 13 illustrate examples of display units that are distinguished by software, according to an exemplary embodiment.

As shown in FIG. 12, according to an exemplary embodiment, the first display unit 310a may be at least a portion of a hardware screen disposed on the first surface of the device 100b. The second display unit 320a may be at least a portion of a hardware screen disposed on the second surface of the device 100b.

As illustrated in FIG. 13, according to an exemplary embodiment, the first display unit 310a1 may be a partial region of a hardware screen disposed on the first surface of the device 100. The second display unit 310a2 may be a partial area of the hardware screen disposed on the first surface of the device 100 except for the first display unit 310a1.

14 illustrates a definition of a folded state, according to an exemplary embodiment.

14A, 14B, and 14C show an example in which the foldable device 100 is folded through a hinge. (D), (e), (f) of FIG. 14 show an example of folding as the foldable device 100 is bent.

The folded state and the unfolded state may be quantized with a folded form evaluation value within a predetermined range. The folded form evaluation value may vary depending on the structure of the state detector 220. The folded form evaluation value is, for example, a bent angle of the device 100, a folded angle of the device 100, a sensing value of the state detection sensor, and the like. The sensing value of the state detection sensor may be, for example, a sensing value of a proximity sensor, a sensing value of an illuminance sensor, a sensing value of a magnetic sensor, a sensing value of a hall sensor, a sensing value of a touch sensor, and the like.

In the present specification, an embodiment of evaluating the folded form at the folded angle of the device 100 will be described, but embodiments of the present invention are not limited thereto.

According to one embodiment, the folded state means a state in which the folding angle of the device 100 is included within the first range. The folded state means, for example, a state in which the folding angle of the device 100 is greater than or equal to 0 degrees and less than a degrees. As shown in FIG. 14, the folding angle refers to an angle between opposite surfaces of two regions generated by folding. The folding angle can be defined around a vertex defined by the opposing faces of the two regions caused by the folding.

According to another embodiment, the folded state refers to a case in which a sensing value indicating a proximity degree of two regions generated by folding is within a third range in a proximity sensor, a magnetic sensor, an infrared sensor, and the like.

According to an embodiment, the line on which the device 100 is folded is predefined, and the device 100 may be folded only on the predefined line. The folding line may be one or plural according to the embodiment. For example, the device 100 may be folded in various ways, such as folding in two stages or folding in three stages.

According to another embodiment, the device 100 may be folded or bent at any point. In this case, the device 100 may detect a folded or bent form using a predetermined sensor.

15 is a view showing a folded state according to an embodiment.

According to an embodiment, the folded state of the device 100 refers to a state in which the device 100 is symmetrically folded. According to one embodiment, the device 100 may be symmetrically folded by the folded region 610, as shown in FIG. 15. The device 100 can be folded through the hinge and symmetrically folded. According to another embodiment, the device 100 may be folded and symmetrically folded as it is bent.

16 is a view showing a folded state according to an embodiment.

According to the present embodiment, the folded state of the device 100 means a state in which the device 100 is folded asymmetrically. According to the present exemplary embodiment, the device 100 may be folded asymmetrically to expose the first region 1610 as shown in FIG. 16. The device 100 can be folded asymmetrically and folded through the hinge. According to another embodiment, the device 100 may be folded and asymmetrically folded as it is bent.

In the first area 1610, a key button, a partial area of the display unit 210, a touch sensor, and the like may be disposed in the first area 1610.

17 is a view showing a folded state according to an embodiment.

According to the present exemplary embodiment, the folded state of the device 100b is one of the first display unit 310 and the second display unit 320 of the device 100b in a state in which the display unit faces the user. Some of the other display units disposed on the opposite side are folded in an asymmetrical square shape to face the user. For example, as shown in FIG. 17, in a state in which the first display unit 310 is disposed to face the user, some of the second display units 320 may be folded to face the user. The device 100 may be folded through the hinge or, according to another embodiment, may be folded as it is bent.

18 is a view illustrating a folded state according to an embodiment.

According to the present exemplary embodiment, the folded state of the device 100b is one of the first display unit 310 and the second display unit 320 of the device 100b in a state in which the display unit faces the user. Some of the other display units disposed on the opposite side are folded in an asymmetrical triangular shape to face the user. For example, as illustrated in FIG. 18, in a state in which the first display unit 310 is disposed to face the user, some of the second display units 320 may be folded in a triangle shape to face the user.

The device 100 may be folded through the hinge or, according to another embodiment, may be folded as it is bent.

19 is a view illustrating a folded state according to an embodiment.

According to the present exemplary embodiment, the folded state of the device 100b is one of the first display unit 310 and the second display unit 320 of the device 100b in a state in which the display unit faces the user. Some of the other display units disposed on the opposite side are folded to be exposed in the plurality of areas. For example, as illustrated in FIG. 19, in a state where the first display unit 310 is disposed to face the user, the third region 1910 and the fourth region 1920 of the second display unit 320 are used to support the user. Can be folded to face.

The device 100 may be folded through the hinge or, according to another embodiment, may be folded as it is bent.

20 is a diagram for describing a definition of an expanded state, according to an exemplary embodiment.

*

20A, 20B, and 20C show an example in which the foldable device 100 is folded through a hinge. (D), (e), (f) of FIG. 20 show an example of folding as the foldable device 100 is bent.

According to one embodiment, the open state means a state in which the folding angle of the device 100 is included in the second range. The unfolded state means, for example, a state in which the folding angle of the device 100 is not less than a degree but not more than 180 degrees.

According to another embodiment, the unfolded state refers to a case in which a sensing value indicating proximity of two regions generated by folding is within a fourth range in a proximity sensor, a magnetic sensor, an infrared sensor, and the like.

21 is a view illustrating an expanded state according to an embodiment.

In the unfolded state according to the exemplary embodiment, as shown in FIG. 21, the folded angle of the device 100 is unfolded in a 180 degree state. According to an exemplary embodiment, as illustrated in FIG. 21, a window of the display unit 210 shown in the expanded state may be divided to display screens of a plurality of applications (S2102).

The opposite side of the display unit 210 shown in the unfolded state may be provided with various types of display units or no display unit according to embodiments. In addition, as shown in FIG. 21, the display parts on the opposite surface may be turned off (S2104).

22 is a view showing an expanded state according to another embodiment.

In the unfolded state according to the present embodiment, as shown in FIG. 22, the folded angle of the device 100 is unfolded in a 180 degree state. According to the present exemplary embodiment, as shown in FIG. 12, one application screen may be displayed on the display unit 210 shown in the unfolded state (S2202).

The opposite side of the display unit 210 shown in the unfolded state may be provided with various types of display units or no display unit according to embodiments. In addition, as shown in FIG. 22, the display parts on the opposite surface may be turned off (S2204).

23 is a view illustrating a folding operation and an expanding operation according to an embodiment.

The folding operation and the unfolding operation according to the present embodiment may be performed as shown in FIG. 23.

24 is a view illustrating a folding operation and an expanding operation according to an embodiment.

The folding operation and the unfolding operation according to the present embodiment may be performed as shown in FIG. 24.

25 is a flowchart illustrating a device control method according to an exemplary embodiment.

The device implementing the device control method according to the present embodiment may be any type of electronic device, as long as the device is implemented to be folded or folded as a hinge and has at least one display unit. For example, it is possible to perform the device control method according to the present embodiment in the device 100a shown in FIG. 2 or the device 100b shown in FIG. 3. In the present specification, the device 100a illustrated in FIG. 2 will be described with reference to an embodiment in which the device control method according to the embodiments of the present invention is implemented. However, embodiments of the present invention are not limited thereto.

The device 100a displays the screen of the first application on the display unit 210 (S2502).

When the state detector 220 or the controller 230 detects a folding operation or an expanding operation (S2504), the controller 230 simultaneously displays the screen of the first application and the screen of the second application on the display unit 210 (S2506). ).

When using a plurality of physically separated display units as shown in FIGS. 7 to 13, the operation of simultaneously displaying the screen of the first application and the screen of the second application (S2506) displays the first application screen in step S2502. The display unit other than one display unit may be used, or the display unit displaying the first application screen may be used together with the other display unit.

26 is a flowchart illustrating a device control method according to an embodiment.

In the device control method according to the present exemplary embodiment, when the spreading operation is changed from the folded state to the expanded state, the execution screen of the first application and the execution screen of the second application are displayed together.

First, the device 100 displays the execution screen of the first application in the folded state (S2602).

According to an embodiment, the controller 230 may display an execution screen of the first application on a first surface of the flexible display used as a display while the foldable device 100 is folded. When the display unit 210a is integrally provided on the first surface as shown in FIG. 6, the execution screen of the first application may be displayed on a portion of the display unit 210a. When the display units 210a1 and 210a2 are disposed in each of two areas divided by the folding area 610 so as not to meet the folding area 610 on the first surface of the device 100a as shown in FIG. 7, the execution of the first application is performed. The screen may be displayed only in one area of the two display units 210a1 and 210a2.

9 and 12, when the second display unit 320b is disposed to cover the folded area 610, the execution screen of the first application may be displayed on a portion of the second display unit 320b. Some areas of the second display unit 320b may be, for example, an area facing the user, a predefined area, or the like. As shown in FIG. 10, when the second display units 320c1 and 320c2 are disposed in each of two areas divided by the folding area 610 so as not to meet the folding area 610 on the second surface of the device 100a, the first application The execution screen may be displayed only in one area of the second display units 320c1 and 320c2. One region in which the execution screen of the first application is displayed among the second display units 320c1 and 320c2 may be, for example, an area facing the user or a predefined area.

Next, when the state detecting unit 220 detects the spreading operation (S2604), the controller 230 displays the execution screen of the first application and the execution screen of the second application together (S2606).

According to an embodiment of the present disclosure, when the foldable device 100 is folded in a folded state, the controller 230 displays an execution screen of the first application and an execution screen of the second application on the second surface of the flexible display used as the display. I can display it. The second application may be an application related to the first application. According to the present exemplary embodiment, the user may normally use the device 100 in a folded state, and when the user wants to utilize a wide screen, the user may expand and use the device 100. In addition, in the present embodiment, the device 100 displays the second application together with the first application in the unfolded state, thereby enabling a user to better utilize a wide screen and to conveniently use a plurality of applications.

27 is a diagram illustrating a screen of a folded state and an unfolded state according to an exemplary embodiment.

*

According to the present exemplary embodiment, as shown in FIG. 27, when the device 100 is changed from a folded state in which the screen of the first application is displayed to an expanded state, the display unit 210 displays the first application together with the screen of the first application. 2 The screen of the application may be displayed.

According to an embodiment, the screen of the first application is displayed on a portion of the display unit 210 of the first surface in the folded state, and the screen of the first application is displayed on the entire area of the display unit 210 of the first surface in the unfolded state. And a screen of the second application.

According to another embodiment, the screen of the first application is displayed on the display 210 of the first surface in the folded state, the screen of the first application and the screen of the second application on the display 210 of the second surface in the unfolded state Is displayed.

28 is a flowchart illustrating a device control method according to an embodiment.

According to the present exemplary embodiment, when a folding operation in which the device 100b is changed from a partially expanded state to a partially folded state is detected, the first application screen and the second application screen are displayed together. As shown in FIGS. 17, 18, and 19, a portion of the first display portion 310 and the second display portion 320 of the device 100b is disposed to face the user as illustrated in FIGS. 17, 18, and 19. In the meantime, a portion of the other display units disposed opposite to the one display unit is asymmetrically folded to face the user.

First, the device 100b displays the screen of the first application on the first display unit 310 in the unfolded state (S2802). When the state detector 220 detects a folding operation in which the device 100a is changed to a partially folded state (S2804), the controller 230 displays a screen of the first application on a portion of the first display unit 310, The screen of the second application is displayed on a portion of the second display unit 320 in operation S2806.

In FIG. 28, the first display unit 310 and the second display unit 320 may be disposed on different surfaces of the device 100b, respectively.

The partial region of the first display unit 310 may mean an area visible to the user among the entire regions of the first display unit 310 according to a partially folded state of the device 100b. That is, the partial region of the first display unit 310 may mean a region that is not covered by the second display unit 320 among the entire regions of the first display unit 310.

The partial region of the second display unit 320 may mean an area that is disposed in the same direction as the first display unit 310 and is seen by the user according to a partially folded state of the device 100b.

29A to 29B are diagrams illustrating screens of an unfolded state and a partially folded state, according to an exemplary embodiment.

According to the present exemplary embodiment, as shown in FIGS. 29A to 29B, when the screen of the first application is displayed on the first display unit 310 in the expanded state (S2902), the device 100a is partially folded in a rectangular shape. In operation S2904, the screen of the first application may be displayed on at least a portion of the first display unit 310, and the screen of the second application may be displayed on at least a portion of the second display unit 320.

The screen of the first application may be displayed only in an area of the first display unit 310 that is not covered by the folding.

As illustrated in FIG. 29A, the screen of the first application may be displayed in a state in which a portion of the screen of the first application is cut off. That is, part of the screen of the first application may be covered by the second display unit 320.

As shown in FIG. 29B, the screen of the first application is according to an exemplary embodiment of the size and ratio of the screen of the first application, in accordance with the size of an area not covered by the second display unit 320 by folding. At least one may be changed and displayed. The screen of the second application may be displayed in an area facing the same direction as the first display unit 310 by folding of the second display unit 320. The screen of the second application may be displayed by being changed in size according to the size of the screen of the first application due to the folding of the second display unit 320, or a part of the screen of the second application may be cut off.

30A to 30B are diagrams illustrating a screen in an expanded state and a folded state, according to an exemplary embodiment.

According to the present exemplary embodiment, as shown in FIGS. 30A to 30B, when the screen of the first application is displayed on the first display unit 310 in the unfolded state, the device 100b is changed to a partially folded state in a triangular form. The screen of the first application may be displayed on at least a portion of the first display unit 310, and the screen of the second application may be displayed on at least a portion of the second display unit 320.

The screen of the first application may be displayed only in an area of the first display unit 310 that is not covered by the folding.

As shown in FIG. 30A, a screen of the first application may be displayed with a part of the screen of the first application cut off. That is, part of the screen of the first application may be covered by the second display unit 320.

As shown in FIG. 30B, the screen of the first application is at least of the size and ratio of the screen of the first application, in accordance with an embodiment, in accordance with the size of an area not covered by the second display unit 320 by folding. In addition, according to an exemplary embodiment, even if an area of the first display unit 310 is not covered by the second display unit 320, an area in which nothing is displayed may be generated.

The screen of the second application may be displayed in an area facing the same direction as the first display unit 310 by folding of the second display unit 320. The screen of the second application may be displayed by changing its size in accordance with the size of an area facing the same direction as the first display unit 310 by folding of the second display unit 320.

31A to 31B are diagrams illustrating screens of an expanded state and a folded state, according to an exemplary embodiment.

According to the present exemplary embodiment, as shown in FIGS. 31A to 31B, when the screen of the first application is displayed on the first display unit 310 in the unfolded state, the device 100b is changed to a partially folded state in a plurality of areas. In this case, the screen of the first application may be displayed on at least a portion of the first display unit 310, and the screen of the second application may be displayed on at least a portion of the second display unit 320.

According to the present exemplary embodiment, the screen of the first application may be displayed only in an area of the first display unit 310 that is not covered by the folding.

As shown in FIG. 31A, a screen of the first application may be displayed in a state in which a portion of the screen of the first application is cut off. That is, part of the screen of the first application may be covered by the plurality of areas 3110 and 3120 of the second display unit 320.

As shown in FIG. 31B, the screen of the first application may be folded to fit the size of an area not covered by the plurality of areas 3110 and 3120 of the second display unit 320 by folding. 1 At least one of the size and ratio of the application screen may be changed and displayed.

The screen of the second application may be displayed on the plurality of regions 3110 and 3120 facing the same direction as the first display unit 310 by folding. In addition, different application screens may be displayed on each of the plurality of areas 3110 and 3120 of the second display unit 320. The screen of the second application may be changed in size to fit the size of the regions 3110 and 3120 facing the same direction as the first display unit 310 by folding of the second display unit 320. For example, a text message received from Kim Chul-soo may be displayed in the second area 3110, and a phone application screen may be displayed in which the icon for making a call to Kim Chul-soo is displayed in the third area 3120.

According to the embodiment illustrated in FIGS. 28 to 31B, the device 100b may be folded through a hinge or, according to another embodiment, may be folded as it is bent.

According to the exemplary embodiment shown in FIGS. 28 to 31B, when the user uses the device 100b in an unfolded state and wants to check simple contents, the user may use a display unit on the opposite side by folding a partial area of the device 100b. You can check the simple contents. For example, when a notification 2910 indicating that a text message arrives while viewing a video is displayed, the user may simply check a content of the text message by folding a part of the device 100b.

32 is a diagram illustrating a device control method according to an exemplary embodiment.

According to the present embodiment, when the folding operation or the expanding operation is detected, the device 100 determines the second application according to a predetermined criterion. Criteria for determining the second application may vary depending on the embodiment.

First, the device 100 displays a screen of the first application (S3202), and when the state detector 220 detects a folding operation or an expanding operation (S3204), the controller 230 determines the second application (S3206). . Next, the controller 230 displays the determined screen of the second application together with the screen of the first application (S3208).

The criterion for determining the second application may be determined according to, for example, a user selection, the application previously designated by the user as the second application, the determination according to the predetermined related application list, and the recently executed application as the second application. There are various embodiments, such as determining a second application and determining an application having a high frequency of use by the user. Various embodiments for determining the second application are detailed below.

33 is a diagram illustrating the structure of a device 100c according to an embodiment.

The device 100c according to the present exemplary embodiment includes a display unit 210, a state detector 220, a controller 230, and a user input unit 3310.

 The display unit 210 displays an application screen running in the controller 230, a user interface screen, a screen indicating the state of the device 100c, and the like. According to an exemplary embodiment, the display unit 210 may include a first display unit 310 disposed on the first surface and a second display unit 320 disposed on the second surface.

The controller 230 executes at least one application and controls the display unit 210 to display a screen of at least one application being executed. According to the present exemplary embodiment, when a folding operation or an expanding operation is detected while the screen of the first application is displayed, the controller 230 displays the screen of the second application together with the screen of the first application.

The controller 230 may collectively control the operation of the device 100c. For example, execution and control of an operating system of the device 100c, various data processing, and components of the device 100c (for example, the display unit 210, the state detector 220, the user input unit 3310, etc.) Control, etc.) can be performed.

The user input unit 3310 receives a user input. The user input unit 3310 may include, for example, at least one of a key, a touch sensor, a touch screen, a pen recognition panel, a bending sensor, a biosignal detection sensor, a microphone, or a combination thereof. According to an embodiment, the user input unit 3310 may be provided with a user interface screen provided through a graphical user interface (GUI).

The user input unit 3310 may receive a user input for controlling the device 100c. For example, the user input unit 3310 may receive an on / off instruction of the device 100b, an execution instruction of an application, a user input for the application, and the like. The user input unit 3310 may further include a user input for selecting whether to display a screen of the second application together with a screen of the first application when a user input for selecting a second application, a folding operation, or an unfolding operation is detected. When an operation or an expanding operation is detected, a user input for selecting a display method of the screen of the second application may be received.

According to an embodiment, the user input unit 3310 may receive a user input for selecting a second application. For example, the controller 230 may display a second application selection menu on the display unit 210 and receive a user input through the second application selection menu. The controller 230 may determine the second application based on a user input through the user input unit 3310.

According to another embodiment, when a folding operation or an expanding operation is detected, the user input unit 3310 may receive a user input for selecting whether to display a screen of a second application together with a screen of the first application. The controller 230 may display the screen of the second application together with the screen of the first application only when the user selects to display the screen of the second application.

34 is a flowchart illustrating a device control method according to an embodiment.

According to the present embodiment, a second application selection menu for selecting a second application is provided along with a screen of the first application, and the second application is determined according to a user selection.

First, the controller 230 displays a second application selection menu together with a screen of the first application (S3402). The second application selection menu is a menu for allowing a user to select a second application.

According to one embodiment, the second application selection menu is displayed on the display unit 210 in the form of a GUI.

According to another embodiment, the second application selection menu is provided to receive a user input through a touch sensor, a key button, etc. disposed in a predetermined area of the housing of the device 100c. In this case, information about the second application selection menu may be displayed in a predetermined area of the display unit 210.

Next, when the state detecting unit 220 detects a folding operation or an expanding operation (S3404), the controller 230 determines whether a user selection is received through the second application selection menu (S3406).

When the user selection is received (S3406), the controller 230 determines the application selected by the user as the second application, and displays the screen of the first application and the screen of the second application together (S3408).

If the user selection is not received (S3406), the screen of the display unit 210 is changed according to a predetermined criterion (S3410). The predetermined criterion may vary according to embodiments. According to an embodiment of the present disclosure, the predetermined criterion may be to determine an application, which is preset to be executed together with the first application, as a second application. According to another embodiment, the predetermined criterion may be to determine an application, which is previously designated by a user in a menu such as a setting, as a second application. According to another embodiment, the predetermined criterion may be to change the screen of the first application, such as changing the size of the screen of the first application or changing the layout of the screen, when the folding or spreading operation is detected. have.

According to the present embodiment, the second application may be determined by accurately reflecting the user's intention. In addition, the user automatically selects a second application to be viewed together with the screen of the first application, and automatically displays the screen of the second application together with the screen of the first application according to the folding operation or the expanding operation. There is an effect that can utilize the multi-window interface conveniently.

35 is a diagram illustrating providing a second application selection menu according to one embodiment.

According to the present exemplary embodiment, the device 100c is folded in an asymmetrical shape, displays the screen of the first application on the display unit 210 in the folded state, and displays the second application selection menu 3520 in the first area 3510. Provide through.

The second application selection menu 3520 indicates an application that can be selected by the user and is a menu in which the user can select an application. According to an embodiment, as shown in FIG. 35, the first area 3510 may be divided into a plurality of areas, and a selectable application may be matched to each area.

According to an embodiment, the screen of the first application may be displayed on the second display unit 320, and the first area 3510 may be an area on the first display unit 310. The first area 3510 may be defined as an area of at least some of the areas of the first display unit 310 that are exposed in the folded state. When the first display unit 310 is implemented as a touch screen, a second application selection menu 3520 is displayed on the first area 3510, and a user selection is received in the form of a touch input on the first display unit 310. can do.

According to another embodiment, the first area 3510 is an area disposed on the housing of the device 100c and may be, for example, an area in which a touch sensor, a proximity sensor, or the like is disposed. In the present exemplary embodiment, the information on the second application selection menu 3520 may be displayed on the first area 3510 on the housing or on at least part of the exposed area of the display unit 210 according to an embodiment. have.

According to the present embodiment, by providing a second application selection menu in a predetermined area physically separated from the display unit 210 displaying the first application by asymmetrical folding, the user intuitively enters the second application selection menu. There is an accessible effect. Furthermore, by providing a second application selection menu using an area of the lower layer exposed by asymmetrical folding, the second application selection menu can be provided without covering the screen of the first application or complicating the screen layout. There is.

36 is a diagram illustrating providing a second application selection menu according to an embodiment.

According to the present embodiment, the second application selection menu may be provided only when the user requests to provide the second application selection menu. For example, the controller 230 may display a first menu 3640 for requesting a second application selection menu together with the screen of the first application on the display 210 in a folded state (S3610). The user may request to display the second application selection menu by selecting the first menu 3640. For example, the user may request to display the second application selection menu by clicking or dragging the first menu 3640.

When the user requests to display the second application selection menu, the controller 230 displays the second application selection menu 3650 together with the screen of the first application on the display 210 (S3620). The user may select the second application through the second application selection menu 3650. The user input may be received in the form of a touch input, a key input, a pen input, a voice input, or the like.

When the user selects the second application from the second application selection menu 3650 and changes the device 100c to the open state (S3630), the controller 230 displays the second application together with the first application screen on the display 210. The application screen is displayed (S3630). As described above with reference to FIG. 34, when the user does not select the second application, when the folding operation or the expanding operation is detected, the screen of the display unit 210 may be determined and displayed according to a predetermined criterion.

In FIG. 36, a case in which the state is changed from the folded state to the expanded state has been described. As another embodiment, when the state is changed from the expanded state to the folded state, the embodiment also provides a screen of the first application and a screen of the second application. It is possible to provide a first menu 3640 that requests a second application selection menu. That is, when the expanded application provides the screen of the first application and the first menu 3640, and the user requests the second application selection menu 3650, the expanded first application screen and the second application selection menu 3650 are provided. ) Can be displayed together. In addition, when the user selects the second application, when the device 100c changes from the expanded state to the folded state, the screen of the first application and the screen of the second application selected by the user may be displayed together in the folded state.

According to the present exemplary embodiment, the second application selection menu is displayed together with the screen of the first application only when the user desires, thereby minimizing the side effects of the screen becoming complicated due to the second application selection menu or covering the screen of the first application. It can be effective.

37 is a diagram illustrating providing a second application selection menu according to one embodiment.

According to the present exemplary embodiment, the controller 230 displays the second application selection menu 3730 together with the screen of the first application on the first display unit 310 in the unfolded state (S3710). When a user input for selecting the second application is received through the second application selection menu 3730, and the device 100c is changed to a partially folded state, the controller 230 may display the first application on the first display 310. The screen is displayed, and the screen of the second application selected by the user is displayed on the surface of the second display unit 320 (S3720).

According to the present embodiment, in a state in which the user selects the second application, the screen of the second application can be viewed using a simple gesture of bending or folding only a part of the device 100c, so that the user can conveniently view the screen of the second application. This has the effect of making the screen viewable.

*

*

38 is a diagram illustrating providing a second application selection menu according to an embodiment.

According to the present embodiment, the device 100c displays information on the second application selection menu together with the first application screen, and the components 3810a and 3810b of the user input unit 3310 formed on the housing of the device 100c. Receive the user selection. For example, a user selection may be received using the touch sensors 3810a and 3810b that are components of the user input unit 3310.

According to the present embodiment, while minimizing a screen area occupied by the second application selection menu, the user input unit 3310 disposed on the housing of the device 100c may be utilized to receive a more accurate user input.

39 is a flowchart illustrating a device control method according to an embodiment.

According to the present embodiment, when a folding operation or an expanding operation is detected, a second application selection menu is displayed together with a screen of the first application, and when a user input through the second application selection menu is detected, The screen of the second application is displayed along with the screen.

First, the controller 230 displays the screen of the first application on the display 210 (S3902).

Next, when the state detecting unit 220 detects the folding operation or the expanding operation (S3904), the controller 230 displays the second application selection menu together with the screen of the first application (S3906).

When a user selection for selecting the second application is received (S3908), the controller 230 determines the application selected by the user as the second application, and displays the screen of the first application and the screen of the second application together. (S3910).

According to an embodiment, after the folding operation or the expanding operation is detected (S3904), if a user selection is not received within a predetermined time, the controller 230 may remove the second application selection menu from the screen.

According to the present embodiment, when a folding operation or an expanding operation is detected, a second application selection menu may be provided to allow a user to easily select applications to be displayed together after the folding operation or the expanding operation.

40 is a diagram illustrating an example of displaying a second application selection menu together with a screen of a first application in step S3906 of FIG. 39.

According to the present exemplary embodiment, when a folding operation or an expanding operation of the device 100c is detected as illustrated in FIG. 40, the controller 230 may display the second application selection menu along with the screen of the first application on the display 210. 4010) may be displayed.

41 is a flowchart illustrating a device control method according to an embodiment.

According to the present embodiment, when a folding operation or an expanding operation is detected, the screen of the first application, the screen of the second application, and the second application selection menu are displayed together.

First, the controller 230 displays the screen of the first application on the display 210 (S4102).

Next, when the folding operation or the expanding operation is detected by the state detector 220 (S4104), the screen of the first application, the screen of the second application, and the second application selection menu are displayed together (S4106).

The screen of the second application displayed together with the screen of the first application may be determined according to a predetermined criterion. The criterion for determining the second application may be determined according to, for example, a user selection, the application previously designated by the user as the second application, the determination according to the predetermined related application list, and the recently executed application as the second application. There are various embodiments, such as determining a second application and determining an application having a high frequency of use by the user.

When a user selection for selecting a second application is received (S4108), the controller 230 determines the application selected by the user as the second application, and displays the screen of the first application and the screen of the second application selected by the user. Displays together (S4110). According to one embodiment, the screen of the second application previously displayed is replaced with the screen of the second application selected by the user. According to another embodiment, the screen of the second application and the screen of the second application selected by the user are displayed together.

According to an embodiment, after the folding operation or the expanding operation is detected (S4104), if a user selection is not received within a predetermined time, the controller 230 may remove the second application selection menu from the screen.

According to the present embodiment, when a folding operation or an expanding operation is detected, first, a screen of the second application is displayed together with the screen of the first application, and the user can easily change the screen of the second application, so that the user can conveniently There is an effect that can view a plurality of application screens.

42 is a diagram illustrating providing a second application selection menu according to an embodiment.

According to the present exemplary embodiment, the controller 230 displays the screen of the first application on the display unit 210 in the folded state, and when changed to the expanded state, the screen of the first application and the screen of the second application are displayed on the display unit 210. , And the second application selection menu 4210 may be displayed together.

43 is a diagram illustrating providing a second application selection menu according to an embodiment.

According to the present exemplary embodiment, the controller 230 displays the screen of the first application on the display unit 210 in a folded state (S4310), and when an unfolding operation is detected, the display unit 210 displays the screen of the first application and the second screen. The screen of the application and the first menu 4350 for requesting the second application selection menu may be displayed together (S4320). When the user requests to provide the second application selection menu through the first menu 4350, the controller 230 displays the second application selection menu 4360 together with the screen of the first application and the screen of the second application. (S4330). When a user input is received through the second application selection menu 4360, the controller 230 displays a screen of the second application selected by the user together with the screen of the first application (S4340).

44 illustrates a device control method according to an exemplary embodiment.

According to the present exemplary embodiment, when a folding operation or an expanding operation is detected, the device 100a determines the second application based on a pre-stored related application list.

First, when the device 100a displays a screen of the first application (S4402), and the folding or unfolding operation is detected by the state detector 220 (S4404), the controller 230 determines that the second application is based on the related application list. Determine (S4406). The related application list is a list which is stored in advance and indicates the type of the second application matched according to the type of the first application. The related application list may be stored in, for example, a storage unit (not shown) of the device 100c.

Next, the controller 230 displays the determined screen of the second application together with the screen of the first application (S4408).

45 is a diagram illustrating a related application list, according to an exemplary embodiment.

The related application list according to the present embodiment includes information on the type of the second application matched according to the type of the first application. For example, as shown in FIG. 45, when the first application is a book, the second application is a dictionary, and when the first application is a camera, the second application may be a photo book.

According to the present embodiment, when a folding action or an unfolding action is detected by storing information about a related application that a user is likely to use together in advance, and automatically matching the first application with a second application, the user may have a related application. There is an effect that can be easily used.

46 is a diagram illustrating a screen of displaying a screen of a second application together with a screen of a first application based on a related application list, according to an exemplary embodiment.

According to the present exemplary embodiment, when the device 100c is changed to the expanded state while the social network service (SNS) application is used in the folded state, the controller 230 determines the second application as the photo album based on the related application list, and the SNS. Display the photo album screen with the screen. According to the present embodiment, there is an effect of easily uploading a picture to an SNS, such as dragging and dropping a picture from a picture book screen.

47 illustrates a device control method according to an embodiment.

According to the present exemplary embodiment, when a folding operation or an expanding operation is detected, the device 100c determines a second application based on an input to the first application. The input to the first application often reflects the current interest of the user, and according to the present embodiment, information on the interest of the user may be known.

First, the device 100c displays the screen of the first application (S4702), and when the folding or unfolding operation is detected by the state detector 220 (S4704), the controller 230 determines the second application.

The controller 230 analyzes an input for the first application in order to determine the second application (S4706). The input to the first application may include, for example, a voice of a sender or receiver of a telephone application, a message of a messenger, and the like. Next, the controller 230 determines the second application based on the analysis result of the input to the first application (S4708).

When the second application is determined, the controller 230 displays the determined screen of the second application together with the screen of the first application (S4710).

48 is a diagram illustrating a screen for displaying a screen of a second application by determining a second application according to an embodiment.

According to the present embodiment, when the first application is a telephone application, the controller 230 recognizes the contents of a call between users who are talking and determines the second application according to the contents of the call. For example, when a user of a call says, “Would you like to go to Gangnam station on weekends?”, The controller 230 recognizes that a specific name is included in the call contents and determines the second application as the map application. .

Subsequently, when the folding or unfolding operation of the device 100c is detected, the controller 230 displays the screen of the telephone application as the screen of the first application, and displays the screen of the map application as the screen of the second application. According to an embodiment of the present disclosure, when displaying a screen of a map application, the controller 230 may display a map screen on which “Gangnam Station” which is recognized in the call contents is searched.

According to this embodiment, by recognizing the call content of the user, there is an effect that the user can easily and conveniently provide information of interest to the user.

49 is a diagram illustrating a screen for displaying a screen of a second application by determining a second application according to an embodiment.

According to the present embodiment, when the first application is a messenger application or a text message application, the controller 230 may determine the second application by analyzing contents of a message sent or received by the first application. For example, when the message “The new Galaxy s5 is newly released” is transmitted or received in the first application, the controller 230 analyzes the content of the message and prepares a search application for searching the content included in the message. Can be determined by 2 applications.

Subsequently, when the folding operation or the expanding operation is detected by the device 100c, the controller 230 may display the screen of the search application as the screen of the second application together with the screen of the messenger which is the first application or the screen of the text message application. Can be. According to an embodiment of the present disclosure, the controller 230 may display a search result screen by inputting a keyword included in a message into a search window on a screen of a search application.

*

50 is a diagram illustrating a device control method according to an exemplary embodiment.

According to the present embodiment, when a notification event occurs, the device 100a determines an application related to the notification event as a second application when a folding operation or an expanding operation is detected. The user may execute an application related to the notification event by a simple operation of changing the folded form of the device 100a.

First, the device 100a displays the screen of the first application (S5002), and when the folding or unfolding operation is detected by the state detector 220 (S5004), the controller 230 determines the second application.

The controller 230 first determines whether a notification event has occurred (S5006). The notification event includes, for example, receiving a text message, receiving a phone call, receiving a mail, receiving a messenger message, receiving a notification from an SNS application, and a notification from various applications.

When a notification event occurs (S5006), the controller 230 determines an application related to the notification event as a second application (S5008). For example, when receiving a text message, the second application is a text message application. When the mail is received, the second application is a mail application. When the messenger message is received, the second application is a messenger application. When receiving a notification from the SNS application, the second application is an SNS application.

Next, the controller 230 displays the determined screen of the second application together with the screen of the first application (S5012).

If the notification event does not occur (S5006), the controller 230 changes the screen of the display unit 210 according to a predetermined criterion (S5010). The predetermined criterion may vary according to embodiments. According to an embodiment of the present disclosure, the predetermined criterion may be to determine an application, which is preset to be executed together with the first application, as a second application. According to another embodiment, the predetermined criterion may be to determine an application, which is previously designated by a user in a menu such as a setting, as a second application. According to another embodiment, the predetermined criterion may be to change the screen of the first application, such as changing the size of the screen of the first application or changing the layout of the screen, when the folding or spreading operation is detected. have.

51 is a diagram illustrating a screen for displaying a screen of a second application by determining a second application according to an embodiment.

According to the present exemplary embodiment, when the messenger message is received while the folding operation or the unfolding operation of the device 100c is detected while displaying the screen of the first application, the controller 230 displays the screen of the first application. Display with the screen. When the icon 5110 indicating the notification event is displayed while the screen of the first application is displayed, the user may perform a folding operation or an expanding operation of the device 100b to execute an application related to the notification event and check the notification event. have.

52 is a view illustrating a device control method according to an embodiment.

According to the present embodiment, when the content or the link is received, the device 100a determines the application for executing the content or the link as the second application when the folding operation or the expanding operation is detected. The user may execute an application for executing the received content or link by a simple operation of folding or unfolding the device 100a.

First, the device 100a displays the screen of the first application (S5202), and when the folding or unfolding operation is detected by the state detector 220 (S5204), the controller 230 determines the second application.

The controller 230 first determines whether content or a link has been received through the first application (S5206). The contents include, for example, photographs, videos, music, contacts, electronic business cards, and the like. The link includes, for example, an internet site link, an application execution path link, a map information link of a map application, and the like.

When receiving the content or the link (S5206), the controller 230 determines an application for executing the content or the link received through the first application as a second application (S5208). For example, when receiving a photo, the second application may include a photo album application, a photo playback application, a photo browsing browser in the first application, and the like. When receiving a video, the second application may include a video playback application, a video browsing browser in the first application, and the like. When receiving music, the second application may be a music application. When receiving a contact, the second application may be a contact application. When the electronic business card is received, the second application may be a contact application or an electronic business card management application. When the internet site link is received, the second application may be an internet browser application. When the application execution path link is received, the second application may be an application installation application. When the map information link of the map application is received, the second application may be a map application.

Next, the controller 230 displays the determined screen of the second application together with the screen of the first application (S5212).

If the controller 230 does not receive the content or the link (S5206), the controller 230 changes the screen of the display unit 210 according to a predetermined criterion (S5210). The predetermined criterion may vary according to embodiments. According to an embodiment of the present disclosure, the predetermined criterion may be to determine an application, which is preset to be executed together with the first application, as a second application. According to another embodiment, the predetermined criterion may be to determine an application, which is previously designated by a user in a menu such as a setting, as a second application. According to another embodiment, the predetermined criterion may be to change the screen of the first application, such as changing the size of the screen of the first application or changing the layout of the screen, when the folding or spreading operation is detected. have.

53 is a diagram illustrating a screen for displaying a screen of a second application by determining a second application according to an embodiment.

According to the present embodiment, when the first application is a messenger application and a message with a picture is received from the messenger application, the controller 230 detects the folding or spreading operation of the device 100c, and then, if the first application is a messenger application, Can be determined by the photo album application. In this case, when the folding operation or the expanding operation of the device 100c is detected, the screen of the photo album application is displayed together with the screen of the messenger application. In addition, the controller 230 may display a screen on which the photo album application reproduces the picture attached to the message of the messenger application.

54 is a diagram illustrating a screen for displaying a screen of a second application by determining a second application according to an embodiment.

According to the present embodiment, when the first application is a messenger application and a message with a map link is received from the messenger application, the controller 230 detects a folding operation or an expanding operation of the device 100c, and then the second application. Can be determined as a map application. In this case, when the folding operation or the expanding operation of the device 100c is detected, the screen of the map application is displayed together with the screen of the messenger application. In addition, the controller 230 may display a map of a point corresponding to a map link of the messenger application in the map application.

55 illustrates a device control method according to an embodiment.

According to the present embodiment, when the folding operation or the expanding operation is detected, the device 100a determines the second application based on the application usage history of the user.

First, when the device 100a displays the screen of the first application (S5502), and the folding or unfolding operation is detected by the state detector 220 (S5504), the control unit 230 displays the first application based on the user's application usage history. 2 Determine the application (S5506). For example, the controller 230 may determine, as the second application, an application having a high frequency of use by the user, an application which the user has recently executed, and an application running in the background. According to an embodiment of the present disclosure, when the user requests to execute a specific application through the second application selection menu, the user may learn information about the application selection history to obtain information about the user's preferred application and provide a user's preferred application. Can be determined by 2 applications.

Next, the controller 230 displays the determined screen of the second application together with the screen of the first application (S5508).

56 illustrates a device control method according to an embodiment.

According to the present exemplary embodiment, when a folding operation or an expanding operation is detected, the device 100a determines an application previously designated by the user as the second application.

First, the device 100a displays the screen of the first application (S5602), and when the folding or unfolding operation is detected by the state detector 220 (S5604), the controller 230 sets the user as a second application. The application is determined as the second application (S5606). For example, when the user expands the device from the folded state to the expanded state, it may be set to always display the screen of the Internet browser application together with the screen of the first application. The user may set the second application by using a setting application or a setting menu of the device 100a.

Next, the controller 230 displays the determined screen of the second application together with the screen of the first application (S5608).

According to the present embodiment, the user designates an application frequently used by the user as the second application, and thus the user can access the frequently used application only by a simple operation of the folding operation or the expanding operation.

57 is a view illustrating a device control method according to an embodiment.

According to the present embodiment, when the folding operation or the expanding operation is detected, the device 100a determines the second application based on the state of the user.

First, when the device 100a displays the screen of the first application (S5702), and the folding or unfolding operation is detected by the state detector 220 (S5704), the control unit 230 based on the state of the user, the second application. Determine (S5606). For example, the controller 230 may determine the second application in consideration of the current location, time, schedule, etc. of the user.

Next, the controller 230 displays the determined screen of the second application together with the screen of the first application (S5708).

58 is a diagram illustrating a screen for displaying a screen of a second application by determining a second application according to one embodiment.

According to the present embodiment, when the first application is a schedule management application, the controller 230 may determine the second application based on the current location, the current time, and the schedule of the user. For example, if a calendar application records a wedding in Seocho-dong Cathedral at 3:00 pm today, and the current time is 2:00 pm, when the user performs a folding or expanding operation while the calendar application is displayed, the current location is The map application representing the route from the wedding place to Seocho-dong Cathedral can be displayed with the schedule management application.

59 is a view illustrating a device control method according to an embodiment.

According to the present embodiment, when the folding operation or the expanding operation of the device 100c is detected, the screen of the second application may be displayed together with the screen of the first application or the screen of the second application may not be displayed according to the user input. have.

First, the device 100c displays a screen of the first application and provides a window division selection menu (S5902). According to an embodiment, the window division selection menu may be displayed on the display unit 210 and provided in the form of a GUI. According to another embodiment, the window division selection menu may be provided in a predetermined area of the housing of the device 100c, similar to the method of providing the second application selection menu 3520 in FIG. 35.

Next, when a folding operation or an expanding operation is detected by the state detector 220 (S5904), the controller 230 determines whether window division is selected (S5906).

When the window split is selected, the controller 230 displays the screen of the first application and the screen of the second application together (S5908). As described above, the second application may be determined by various criteria.

If window division is not selected (S5906), the controller 230 displays a screen of the first application (S5910). That is, when window division is not selected, the controller 230 displays the screen of the first application without displaying the screen of the second application.

60 is a diagram illustrating providing a window split selection menu according to an embodiment.

According to the present exemplary embodiment, the device 100c is folded in an asymmetrical shape, displays the screen of the first application on the display unit 210 in the folded state, and displays the window division selection menu 6020 in the fourth area 6010. Provide through.

The window split selection menu 6020 is a menu for selecting an option of whether to display the screen of the second application together with the screen of the first application (Split Window) or not (Full Window). According to an embodiment, as illustrated in FIG. 60, the fourth region 6010 may be divided into two regions to match the window segmentation options to each region.

According to an embodiment, the fourth area 6010 may be an area on the display unit 210. The fourth area 6010 may be defined as an area of at least some of the areas of the display unit 210 that are exposed in the folded state. When the display unit 210 is implemented as a touch screen, the window division selection menu 6020 is displayed on the fourth area 6010, and a user selection may be received in the form of a touch input on the display unit 210.

According to another embodiment, the fourth area 6010 is an area disposed on the housing of the device 100c and may be, for example, an area in which a touch sensor, a proximity sensor, or the like is disposed. In the present exemplary embodiment, the information on the window division selection menu 6020 may be displayed on the fourth region 6010 on the housing or on at least a portion of the exposed region of the display unit 210 according to the exemplary embodiment. .

According to the present embodiment, the user can intuitively enter the window division selection menu by providing a window division selection menu in a predetermined area physically separated from the display unit 210 on which the screen of the first application is displayed by asymmetrical folding. There is an accessible effect. Furthermore, by providing a window segmentation selection menu using an area of the lower layer exposed by asymmetrical folding, there is an effect of providing a window segmentation selection menu without covering the screen of the first application or complicating the screen layout. .

FIG. 61 is a diagram illustrating a screen when it is selected to display a screen of a second application through the window division selection menu.

According to the present embodiment, when the user selects an option for displaying the screen of the second application in the folded state, and the device 100c is changed from the folded state to the expanded state, the controller 230 may change the screen of the first application. Together, the screen of the second application is displayed.

*

62 is a diagram illustrating a screen when the screen of the second application is selected not to be displayed through the window division selection menu.

According to the present embodiment, when the user selects an option not to display the screen of the second application in the folded state and changes the device 100c from the folded state to the expanded state, the controller 230 may display the screen of the first application. Is displayed. In the unfolded state, the screen of the first application may be changed in size or the screen layout may be changed according to a predetermined criterion.

63 is a diagram illustrating providing a window arrangement selection menu according to an embodiment.

According to the present embodiment, the device 100c provides a window arrangement selection menu for selecting a layout of the first application screen and the second application when the screen of the first application and the screen of the second application are displayed together. can do. The user may select the layout of the screen of the first application and the screen of the second application through the window layout selection menu. The window arrangement selection menu may be provided through the display unit 210 or the housing of the device 100c.

According to the embodiment shown in FIG. 63, the device 100c is folded in an asymmetrical shape, displays the screen of the first application on the display unit 210 in the folded state, and displays the window arrangement selection menu 6320 in the fifth area. Provided via 6310.

The window arrangement selection menu 6320 is a menu for selecting options of arrangement of the screen of the first application and the screen of the second application. For example, the window layout selection menu 6320 may include an option of arranging the first application on the left side, on the right side, or in full screen form. According to an embodiment, as illustrated in FIG. 63, the fifth area 6310 may be divided into three areas to match the window arrangement options to each area.

According to an embodiment, the fifth area 6310 may be an area on the display unit 210. The fifth region 6310 may be defined as an area of at least a portion of the region of the display unit 210 that is exposed in the folded state. When the display unit 210 is implemented as a touch screen, a window arrangement selection menu 6320 is displayed on the fifth area 6310, and a user selection may be received in the form of a touch input on the display unit 210.

According to another embodiment, the fifth area 6310 is an area disposed on the housing of the device 100c and may be, for example, an area in which a touch sensor, a proximity sensor, or the like is disposed. In the present embodiment, the information on the window arrangement selection menu 6320 may be displayed on the fifth region 6310 on the housing or on at least a portion of the exposed region of the display unit 210 according to an embodiment. .

According to the present embodiment, the user can intuitively access the window arrangement selection menu by providing a window arrangement selection menu in a predetermined area physically separated from the display unit 210 on which the screen of the first application is displayed by asymmetrical folding. There is an effect that can be done. Furthermore, by providing a window layout selection menu using an area of the lower layer exposed by asymmetrical folding, it is possible to provide a window split selection menu without covering the screen of the first application or complicating the screen layout. .

In addition, according to the present embodiment, by determining the arrangement of the screen of the first application and the screen of the second application according to the user selection, there is an effect that the user can easily select the desired arrangement.

64 is a diagram illustrating a screen when the screen of the first application is selected on the right through the window layout selection menu.

According to the present exemplary embodiment, when the user selects an option for displaying the screen of the first application on the right side in the folded state, and the device 100c is changed from the folded state to the expanded state, the controller 230 may determine the first application. The screen is displayed on the right side, and the screen of the second application is displayed on the left side.

65 is a diagram illustrating a screen when the screen of the first application is selected to be displayed as a full screen through the window layout selection menu.

According to the present exemplary embodiment, when the user selects an option of displaying the screen of the first application in the full screen in the folded state, and changes the device 100c from the folded state to the expanded state, the controller 230 controls the first application. Is displayed on the full screen, and the screen of the second application is not displayed.

FIG. 66 is a diagram illustrating a screen when the screen of the first application is selected to be displayed on the left through a window layout selection menu.

According to the present exemplary embodiment, when the user selects an option for displaying the screen of the first application on the left side in the folded state and changes the device 100c from the folded state to the expanded state, the controller 230 may determine the first application. The screen is displayed on the left side, and the screen of the second application is displayed on the right side.

67 is a diagram illustrating a screen layout of a first application and a screen layout of a second application, according to an exemplary embodiment.

When the screen of the first application and the screen of the second application are displayed together, the screen of the first application and the screen of the second application may be arranged in various ways according to embodiments.

As illustrated in FIG. 67, when the folded form of the device 100a is changed and the screen of the first application and the screen of the second application are displayed together, the screen 6710 of the second application may display a part of the first application. It may be displayed to hide. In this case, for example, the screen of the second application may be displayed in the form of a pop-up window.

According to an embodiment, when the folded form of the device 100a is changed and the screen of the first application and the screen of the second application are displayed together, the screen of the first application is displayed as a full screen, and the screen of the second application is displayed. The screen 6710 may be displayed to cover a part of the screen of the first application. On the contrary, the screen of the second application may be displayed as a full screen, and the screen of the first application may be displayed to cover a part of the screen of the second application.

According to another embodiment, as described above, the screen of the first application and the screen of the second application may be displayed by dividing the screen with the same size.

68 is a diagram illustrating a screen layout of a first application and a screen layout of a second application, according to an exemplary embodiment.

According to an embodiment of the present disclosure, when a folding operation or an expanding operation of the device 100a is detected and the screens of the first application and the screens of the second application are displayed together, the screens of the plurality of second applications are displayed on the screens of the first application. Can be displayed together. The screens of the plurality of second applications may be screens of the same application or screens of different applications according to an embodiment.

According to an exemplary embodiment, when the folded form of the device 100a is changed and the screen of the first application and the screen of the second application are displayed together, the screen of the first application and the screen of the plurality of second applications are shown in FIG. 68. As shown in FIG. 1, the screen may be divided and disposed. The size of the screen of the first application and the screen of the second application may be the same or different depending on the embodiment.

According to an embodiment of the present disclosure, while the screen of the first application and the screen of the second application are displayed together, the size of the screen of the first application and the screen of the second application may be changed or the location may be changed according to a user input. An operation such as removing one of the plurality of screens is possible.

69 is a diagram illustrating an operation of the device 100 according to an embodiment.

According to the present exemplary embodiment, the device 100 detects the gaze of the user and turns on only the display unit of the first display unit 310 and the second display unit 320 that the user faces, and on the opposite side of the surface that the user views. The display can be turned off. For example, when the user looks at the surface on which the first display unit 310 is disposed, the second display unit 320 may be turned off. The device 100 may include a camera, a gaze detection sensor, and the like to detect the gaze of the user.

70 is a diagram illustrating providing information on a second application according to an embodiment.

According to an embodiment, when displaying the screen of the first application, information about the second application may be provided together. For example, when the second application is a contact, as shown in FIG. 70, when the device 100a is expanded, the screen of the contact application may be displayed.

71 is a diagram illustrating providing information on a second application according to an embodiment.

According to an embodiment of the present disclosure, when a notification event occurs while displaying a screen of the first application, the device 100a may be provided with information that the notification event may be confirmed by expanding or folding the device 100a. For example, when a text message is received while displaying the screen of the first application, as shown in FIG. 71, when the device 100a is opened, the text message may be confirmed.

72 is a diagram illustrating a structure of a device 100d according to an embodiment.

According to the present exemplary embodiment, the display unit 210c may be disposed on the first surface where the device 100d is hidden as the device 100d is folded, and the display unit may not be disposed on the second surface that is disposed opposite to the first surface. In addition, the device 100d may be folded in an asymmetrical shape, and a portion of the first surface may be exposed to the outside while the device 100d is folded.

According to the present exemplary embodiment, the second application selection menu 3520 may be provided on a partial area of the first surface exposed in the folded state of the device 100d.

According to one embodiment, the second application selection menu is displayed on the display unit 210 in the form of a GUI. The display unit 210c may be disposed to include the first area 7210 that is exposed when the device 100d is folded. The display unit 210c may be integrally formed with a sixth area 7210 in which the second application selection menu 3520 is displayed and a seventh area 7220 for displaying the operation screen of the device 100c according to the embodiment. It may be formed separately by such.

According to another embodiment, the second application selection menu 3520 is provided to receive a user input through a touch sensor, a key button, etc. disposed in a predetermined area of the housing of the device 100d. In this case, information about the second application selection menu 3520 may be displayed on a predetermined area of the display unit 210.

73 is a diagram illustrating an example of a second application selection menu 3520 according to an embodiment.

The second application selection menu 3520 indicates an application that can be selected by the user and is a menu in which the user can select an application. According to an embodiment, as illustrated in FIG. 73, the sixth area 7210 may be divided into a plurality of areas, and a selectable application may be matched to each area.

74 is a diagram illustrating an operation of selecting and executing a second application using the second application selection menu 3520, according to an exemplary embodiment.

According to the present embodiment, while providing the second application selection menu 3520 while the device 100d is folded, the user selects one of a plurality of applications included in the second application selection menu 3520 and selects the device. In operation S7402, the device 100d may display the screen of the second application selected by the user in a predetermined area of the display unit 210c. For example, if the device 100d is a smartphone and is in the folded state in the standby mode, when the user selects the telephone function from the second application selection menu 3520 and then switches the device 100d to the expanded state ( In operation S7402, the second application screen may be displayed in the eighth area 7210 of the display unit 210c, and the first application screen may be displayed in the ninth area 7420 (S7404). The first application screen may include, for example, a home screen that appears when the screen is turned on in the standby mode, an application list screen, and a screen of an application previously designated by the user.

75 is a diagram for describing a process of providing a second application screen, according to an exemplary embodiment.

According to an embodiment of the present disclosure, when a user makes a phone call using the device 100d, and recognizes a voice call content of the user and a word related to a specific application is recognized in the call content, the related application is selected as a second application selection menu ( 3520). Recognition of voice call content may be performed using various voice recognition algorithms. Information about an application related to the recognized word may be stored in the device 100d in advance or set by a user.

For example, as illustrated in FIG. 75, it is assumed that the user refers to the word “schedule” while talking on the phone while the device 100d is folded (S7532). When the word “schedule” and an application related thereto are designated in the device 100d, the device 100d recognizes the word “schedule” (S7532). The device 100d may arrange a selection menu 7510 on which the application related to the word “schedule” may be selected on the second application selection menu 3520 (S7534). According to an embodiment, the device 100d may arrange a selection menu 7510 corresponding to an application related to the recognized word on the touch interface using the display unit 210a, and may display a picture corresponding to the selection menu 7510 or the like. A character may be displayed on the touch interface.

The user selects the relevant application and opens the device 100d by using the selection menu 7510 of the related application additionally disposed on the second application selection menu 3520 (S7534). 7520 can be seen (S7536). According to the present embodiment, by recognizing the call contents of the user, the user can easily use the application expected to be used by the user, thereby increasing the user convenience.

76 is a diagram illustrating a structure of a device 100e according to an embodiment.

According to an embodiment, the device 100e may be implemented in the form of a rollable device. According to the present embodiment, as shown in FIG. 76, the display unit 210d may have two states, a rolled state and an unrolled state. The user may switch to the unfolded state of the device 100e by holding and pulling a predetermined portion 7610 of the device 100e in a rolled state or by pressing a predetermined button. According to an embodiment of the present disclosure, the second application selection menu 3520 may be provided in a predetermined area of the device 100e that is exposed when the device 100e is rolled up. For example, the second application selection menu 3520 may be provided in a predetermined area of the housing of the device 100e that holds the display unit 210d in a rolled state as shown in FIG. 76.

The second application selection menu 3520 may be provided in the form of a touch screen, a touch sensor, a button, and the like. The type of application selectable from the second application selection menu 3520 may be preset in the device 100e, determined according to a user selection, or changed according to an operation mode of the device 100e according to an embodiment. .

77 is a diagram for describing a process of providing a second application screen in the device 100e according to an embodiment.

According to the present exemplary embodiment, the second application selection menu 3520 is provided while the device 100e is curled, and after the user selects an application using the second application selection menu 3520 (S7702), the device ( When the display 100e is switched to the expanded state (S7704), the display unit 210d is exposed and the screen of the application selected by the user is displayed on the display unit 210d (S7706). Selecting an application (S7702) is performed before the user starts the operation of expanding the display unit 210d (S7702), or while performing the operation of expanding (S7702), or the display unit 210d It may be performed in an expanded state.

According to an embodiment of the present disclosure, when the user selects the second application from the second application selection menu 3520, the device 100e may be selected by the user together with the screen of the first application or the first application that is already running. The screen of the second application may be displayed.

78 is a block diagram illustrating a configuration of a device 100f according to an embodiment.

As shown in Fig. 78, the configuration of the device 100f is, for example, a mobile phone, a tablet PC, a PDA, an MP3 player, a kiosk, an electronic picture frame, a navigation device, a digital TV, a wrist watch or an HMD ( The present invention can be applied to various types of devices such as a wearable device such as a head-mounted display.

According to FIG. 78, the device 100f may include a display 7810, a controller 7780, a memory 7820, a GPS chip 7825, a communication unit 7830, a video processor 7835, an audio processor 7840, a user. It may include at least one of an input unit 7845, a microphone unit 7850, an imaging unit 7855, a speaker unit 7860, a motion detection unit 7855, and a sensor unit 7780.

The display unit 7810 may include a display panel 7811 and a controller (not shown) for controlling the display panel 7811. The display panel 7811 has various types of displays such as a liquid crystal display (LCD), an organic light emitting diodes (OLED) display, an active-matrix organic light-emitting diode (AM-OLED), a plasma display panel (PDP), and the like. Can be. The display panel 7811 may be implemented to be flexible, transparent, or wearable. The display unit 7810 may be combined with the touch panel 7477 of the user input unit 7845 and provided as a touch screen (not shown). For example, the touch screen (not shown) may include an integrated module in which the display panel 7811 and the touch panel 7847 are combined in a stacked structure.

The memory 7820 may include at least one of an internal memory (not shown) and an external memory (not shown).

The internal memory may be, for example, volatile memory (for example, dynamic RAM (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.), nonvolatile memory (for example, one time programmable ROM). ), PROM (Programmable ROM), EPROM (Erasable and Programmable ROM), EEPROM (Electrically Erasable and Programmable ROM), Mask ROM, Flash ROM, etc.), a hard disk drive (HDD), or a solid state drive (SSD). It may include. According to an embodiment of the present disclosure, the controller 7780 may load and process a command or data received from at least one of the nonvolatile memory or another component in the volatile memory. In addition, the controller 7780 may store data received or generated from other components in the nonvolatile memory.

For example, the external memory may include at least one of Compact Flash (CF), Secure Digital (SD), Micro Secure Digital (Micro-SD), Mini Secure Digital (Mini-SD), Extreme Digital (xD), and a Memory Stick. It may include.

The memory 7820 may store various programs and data used for the operation of the device 100f. For example, the memory 7820 may temporarily or semi-permanently store at least a part of the content to be displayed on the lock screen.

The controller 7780 may control the display 7810 so that a part of the content stored in the memory 7820 is displayed on the display 7810. In other words, the controller 7780 may display a part of the content stored in the memory 7820 on the display 7810. Alternatively, when a user gesture is made in one area of the display 7810, the controller 7780 may perform a control operation corresponding to the gesture of the user.

The controller 7780 may include at least one of a RAM 7787, a ROM 7787, a CPU 7873, a GPU (Graphic Processing Unit) 7804, and a bus 7775. The RAM 7787, the ROM 7787, the CPU 7873, the GPU 7748, and the like may be connected to each other via a bus 7775.

The CPU 7803 accesses the memory 7820 and performs booting using an operating system stored in the memory 7820. In addition, various operations are performed using various programs, contents, data, and the like stored in the memory 7820.

The ROM 7742 stores a command set for system booting and the like. For example, when the turn-on command is input and the power is supplied, the device 100f copies the OS stored in the memory 7820 to the RAM 7787 according to the command stored in the ROM 7772, and executes the OS. To boot the system. When the booting is completed, the CPU 7873 copies various programs stored in the memory 7820 to the RAM 7787, and executes the programs copied to the RAM 7787 to perform various operations. When the booting of the device 100f is completed, the GPU 7804 displays a UI screen in an area of the display 7810. In detail, the GPU 7804 may generate a screen on which an electronic document including various objects such as content, icons, menus, and the like is displayed. The GPU 7804 calculates attribute values such as coordinates, shapes, sizes, colors, and the like in which objects are displayed according to the layout of the screen. The GPU 7804 may generate screens of various layouts including objects based on the calculated attribute values. The screen generated by the GPU 7804 may be provided to the display unit 7810 to be displayed on each area of the display unit 7810.

The GPS chip 7825 may receive a GPS signal from a Global Positioning System (GPS) satellite to calculate a current position of the device 100f. The controller 7780 may calculate a user position using the GPS chip 7825 when using a navigation program or when a current position of the user is required.

The communication unit 7830 may communicate with various types of external devices according to various types of communication methods. The communication unit 7830 may include at least one of a Wi-Fi chip 7831, a Bluetooth chip 7832, a wireless communication chip 7835, and an NFC chip 7834. The controller 7780 may communicate with various external devices using the communication unit 7830.

The Wi-Fi chip 7831 and the Bluetooth chip 7832 may communicate with each other by WiFi or Bluetooth. In the case of using the Wi-Fi chip 7831 or the Bluetooth chip 7832, various connection information such as SSID and session key may be transmitted and received first, and then various communication information may be transmitted and received using the same. The wireless communication chip 7835 refers to a chip that performs communication according to various communication standards such as IEEE, Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evoloution (LTE), and the like. The NFC chip 7834 refers to a chip that operates in a near field communication (NFC) method using a 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860-960 MHz, 2.45 GHz, and the like.

The video processor 7835 may process video data included in content received through the communication unit 7830 or content stored in the memory 7820. The video processor 7835 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, and the like on the video data.

The audio processor 7840 may process audio data included in content received through the communication unit 7830 or content stored in the memory 7820. The audio processor 7840 may perform various processing such as decoding, amplification, noise filtering, and the like on the audio data.

When the playback program for the multimedia content is executed, the controller 7780 may drive the video processor 7835 and the audio processor 7840 to play the corresponding content. The speaker unit 7860 may output audio data generated by the audio processor 7840.

The user input unit 7845 may receive various commands from a user. The user input unit 7845 may include at least one of a key 7846, a touch panel 7477, and a pen recognition panel 7788.

The key 7846 may include various types of keys such as mechanical buttons, wheels, and the like formed in various areas such as a front portion, a side portion, a back portion, etc. of the main body exterior of the device 100f.

The touch panel 7847 may detect a user's touch input and output a touch event value corresponding to the detected touch signal. When the touch panel 7847 is combined with the display panel 7811 to form a touch screen (not shown), the touch screen may be implemented by various types of touch sensors such as capacitive, pressure sensitive, and piezoelectric. The electrostatic type is a method of calculating touch coordinates by detecting fine electricity generated by a user's human body when a part of the user's body is touched by the touch screen surface by using a dielectric coated on the touch screen surface. The pressure-sensitive type includes two electrode plates embedded in the touch screen, and when the user touches the screen, the touch panel calculates touch coordinates by detecting that the upper and lower plates of the touched point are in contact with current. The touch event occurring in the touch screen may be mainly generated by a human finger, but may also be generated by an object of conductive material that can apply a change in capacitance.

The pen recognition panel 7838 detects a proximity input or touch input of a pen according to the operation of a user's touch pen (eg, a stylus pen or a digitizer pen) and detects a detected pen proximity event or pen. A touch event can be output. The pen recognition panel 7788 may be implemented by, for example, an EMR method, and may detect a touch or a proximity input according to a change in the intensity of the electromagnetic field due to the proximity or touch of the pen. In detail, the pen recognition panel 7798 includes an electromagnetic induction coil sensor (not shown) having a grid structure and an electronic signal processor (not shown) that sequentially provides an AC signal having a predetermined frequency to each loop coil of the electromagnetic induction coil sensor. It may be configured to include). When there is a pen incorporating a resonant circuit in the vicinity of the loop coil of the pen recognition panel 7788, the magnetic field transmitted from the loop coil generates a current based on mutual electromagnetic induction in the resonant circuit in the pen. Based on this current, an induction magnetic field is generated from the coil constituting the resonant circuit in the pen, and the pen recognition panel 7788 detects the induction magnetic field in the loop coil in a signal receiving state so that the pen's approach position or The touch position can be detected. The pen recognition panel 7788 may be provided at a lower portion of the display panel 7811 to cover a predetermined area, for example, an area of the display panel 7811.

The microphone 7780 may convert a user voice or other sound into audio data. The controller 7780 may use a user's voice input through the microphone unit 7850 in a call operation, or convert the user voice into audio data and store it in the memory 7820.

The imaging unit 7855 may capture a still image or a moving image under the control of the user. The imaging unit 7855 may be implemented in plurality, such as a front camera and a rear camera.

When the image capturing unit 7855 and the microphone unit 7850 are provided, the controller 7780 may perform a control operation according to a user voice input through the microphone unit 7850 or a user motion recognized by the image capturing unit 7855. It may be. For example, the device 100f may operate in a motion control mode or a voice control mode. When operating in the motion control mode, the controller 7780 may activate the imaging unit 7855 to capture a user, track a user's motion change, and perform a control operation corresponding thereto. When operating in the voice control mode, the controller 7780 may operate in a voice recognition mode that analyzes a user voice input through the microphone 7780 and performs a control operation according to the analyzed user voice.

The motion detector 7265 may detect a body movement of the device 100f. The device 100f may be rotated or tilted in various directions. In this case, the motion detector 7265 may detect a movement characteristic such as a rotation direction, an angle, and an inclination by using at least one of various sensors such as a geomagnetic sensor, a gyro sensor, an acceleration sensor, and the like.

In addition, although not shown in FIG. 78, the embodiment may include a USB port to which a USB connector may be connected in the device 100f, various external input ports for connecting to various external terminals such as a headset, a mouse, a LAN, and the like. It may further include a DMB chip, various sensors, etc. to receive and process Digital Multimedia Broadcasting) signals.

The names of the components of the device 100f described above may vary. In addition, the device 100f according to the present disclosure may be configured to include at least one of the above-described components, and some components may be omitted or further include additional components.

The display unit 210 according to an embodiment of the present invention may correspond to the display unit 7810 of FIG. 78. The controller 230 according to an embodiment of the present invention may correspond to the controller 7780 of FIG. 78. The user input unit 7845 according to an embodiment of the present invention may correspond to the user input unit 7845 of FIG. 78. The state detector 220 according to an embodiment of the present invention may correspond to the sensor unit 7780 of FIG. 78.

Meanwhile, the present invention may be implemented by storing computer readable codes on a computer readable recording medium. The computer readable recording medium includes all kinds of storage devices for storing data that can be read by a computer system.

The computer readable code is configured to perform the steps of implementing the device control method according to the present invention when read and executed by the processor from the computer readable recording medium. The computer readable code may be implemented in various programming languages. And the functional program, code and code segments for implementing the embodiments of the present invention can be easily programmed by those skilled in the art.

Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

Although embodiments of the present invention have been described above with reference to the accompanying drawings, those skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing the technical spirit or essential features thereof. You will understand that there is. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive.

100, 100a, 100b, 100c, 100d, 100e, 100f: device
110: first application screen
120: second application screen
210: display unit
220: state detection unit
310: first display unit
320: second display unit
610: folding area
3310: user input unit

Claims (10)

In an electronic device,
A hinge for causing the electronic device to be folded or unfolded;
A flexible display disposed on a first surface of the electronic device such that the electronic device is folded or unfolded as the hinge is folded or unfolded about the hinge;
A rigid display disposed in an area of a second surface opposite to the first surface of the electronic device and smaller in size than the flexible display;
A sensor unit for detecting the folding or unfolding of the electronic device; And
When the occurrence of the alarm event is detected while the execution screen of the first application is provided on the rigid display while the electronic device is folded, the rigid display guides the occurrence of the alarm event together with the execution screen of the first application. Control the electronic device to provide an indicator,
If it is detected that the electronic device is unfolded while the indicator is provided together with the execution screen of the first application on the rigid display, the execution screen of the first application is displayed on the flexible display that is unfolded as the electronic device is unfolded. And a controller configured to control the electronic device to provide an execution screen of a second application related to the alarm event.
The method of claim 1,
The alarm event,
The event where a text message is received.
The second application,
An electronic device, which is a messenger application.
The method of claim 2,
The indicator,
And an icon for guiding that the text message is received.
The method of claim 2,
The execution screen of the second application,
And a chat screen with the other party who has transmitted the text message.
The method of claim 1,
The electronic device,
And the first surface is folded to face each other.
Hinge for folding or unfolding the electronic device, Flexible display disposed on the first surface of the electronic device to be folded or unfolded as the electronic device is folded or unfolded around the hinge and the first side of the electronic device A control method of an electronic device, comprising: a rigid display disposed in a region of a second surface opposite to a and smaller in size than the flexible display;
When the occurrence of the alarm event is detected while the execution screen of the first application is provided on the rigid display while the electronic device is folded, the rigid display guides the occurrence of the alarm event together with the execution screen of the first application. Providing an indicator; And
If it is detected that the electronic device is unfolded while the indicator is provided together with the execution screen of the first application on the rigid display, the execution screen of the first application is displayed on the flexible display that is unfolded as the electronic device is unfolded. And providing an execution screen of a second application related to the alarm event.
The method of claim 6,
The alarm event,
The event where a text message is received.
The second application,
Control method characterized in that the messenger application.
The method of claim 7, wherein
The indicator,
And an icon for guiding that the text message is received.
The method of claim 7, wherein
The execution screen of the second application,
And a chat screen with the other party who transmitted the text message.
The method of claim 6,
The electronic device,
And the first surface is folded to face each other.

Images