KR20240033608A - Screen capture mehod of an electronic device including flexible display and apparatus thereof - Google Patents

Abstract

An electronic device according to an embodiment may include a display module capable of changing the size of an area visible from one side. The electronic device may include a processor electrically connected to a display module. When a screen capture signal is received, the processor may change the size of the visible area based on criteria set for capture. The processor may control the size of the screen displayed through the viewable area based on the changed size of the viewable area. The processor can generate a screenshot image of the screen with controlled sizes.

Description

Screen capture method of an electronic device including a flexible display and the electronic device {SCREEN CAPTURE MEHOD OF AN ELECTRONIC DEVICE INCLUDING FLEXIBLE DISPLAY AND APPARATUS THEREOF}

The disclosure below relates to a method for capturing a screen of an electronic device including a flexible display and a corresponding electronic device.

As display technology develops, user terminal devices equipped with flexible displays are appearing. A flexible display refers to a display device that can be bent. Flexible displays replace the glass substrate covering the liquid crystal in existing LCDs and organic light-emitting diodes (OLEDs) with plastic films, giving them the flexibility to fold and unfold. Since flexible displays use a plastic substrate rather than the commonly used glass substrate, a low-temperature manufacturing processor is used instead of a conventional manufacturing processor to prevent damage to the substrate.

Flexible displays are not only thin and light, but also resistant to shock. Additionally, flexible displays have the advantage of being able to bend or bend and be produced in various shapes. In particular, flexible displays can be used in industrial fields where application is limited or impossible with existing glass substrate-based displays. The flexible display may be implemented as a rollable display. Meanwhile, as rollable displays become commercialized, new interfacing methods or information display methods using rollable displays are required.

An electronic device according to an embodiment may include a display module capable of changing the size of a viewable region from one side. The electronic device may include a processor electrically connected to the display module. When a screen capture signal is received, the processor may change the size of the visible area based on a standard set for capture. The processor may control the size of at least one execution screen output through the visible area based on the changed size of the visible area. The processor may generate a screen shot image including the size-controlled execution screen.

According to one embodiment, a method of operating an electronic device including a display module capable of changing the size of a viewable region on one side includes, when a screen capture signal is received, the displayed screen based on a standard set for capture. It can include actions that change the size of the area. A method of operating an electronic device may include controlling the size of at least one execution screen output through the viewable area based on the changed size of the viewable area. A method of operating an electronic device may include generating a screen shot image including the size-controlled execution screen.

A computer program stored in a medium according to an embodiment is combined with hardware and, when a screen capture signal is received from an electronic device including a display module capable of changing the size of a viewable region from one side, a screen capture signal is set for capture. An operation to change the size of the visible area can be performed based on a standard. A computer program stored in a medium according to an embodiment is combined with hardware to control the size of at least one execution screen output through the viewable area based on the changed size of the viewable area in the electronic device. Actions can be executed. A computer program stored in a medium according to an embodiment may be combined with hardware to execute an operation of generating a screenshot image including the size-controlled execution screen in the electronic device.

According to one embodiment, a computer-readable recording medium is provided when a screen capture signal is received from an electronic device including a display module capable of changing the size of a viewable region on one side, based on a standard set for capture. A computer program that executes an operation to change the size of the visible area can be stored. A computer-readable recording medium according to an embodiment includes a computer that performs an operation of controlling the size of at least one execution screen output through the viewable area based on the changed size of the viewable area in the electronic device. You can save the program. A computer-readable recording medium according to an embodiment may store a computer program that executes an operation of generating a screen shot image including the size-controlled execution screen in the electronic device.

1 is a block diagram of an electronic device in a network environment, according to one embodiment.
Figure 2 is a block diagram of a display module, according to one embodiment.
3A and 3B are front perspective views of an electronic device showing a closed state and an open state according to an embodiment.
4A and 4B are rear perspective views of an electronic device showing a closed state and an open state according to an embodiment.
FIGS. 5 and 6 are diagrams for explaining an operation of an electronic device in which the display size changes during capture, according to an embodiment.
FIG. 7 is a diagram illustrating an operation of an electronic device that expands a viewable area based on an expanded screen capture signal, according to an embodiment.
FIG. 8 is a diagram illustrating an operation in which the size of a visible area is restored to the size before expansion after executing expanded capture according to an embodiment.
FIGS. 9A and 9B are diagrams for explaining criteria for determining the degree to which the size of a visible area is changed according to an embodiment.
Figure 10 is a diagram for explaining an operation in which the size of a plurality of screens is controlled according to an embodiment.
FIG. 11 is a diagram for explaining a scroll capture operation according to an embodiment.
FIGS. 12A and 12B are diagrams for explaining an operation of determining the degree of scrolling during scroll capture according to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the attached drawings. In the description with reference to the accompanying drawings, identical components will be assigned the same reference numerals regardless of the reference numerals, and overlapping descriptions thereof will be omitted.

1 is a block diagram of an electronic device in a network environment, according to one embodiment.

Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with at least one of the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197. In one embodiment, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added to the electronic device 101. In one embodiment, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be.

The processor 120, for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or calculations can be performed. According to one embodiment, as at least part of data processing or computation, processor 120 stores commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134. According to one embodiment, the processor 120 includes the main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device 101 includes a main processor 121 and a secondary processor 123, the secondary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.

The auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled. According to one embodiment, coprocessor 123 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). there is. According to one embodiment, the auxiliary processor 123 (eg, neural network processing device) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (e.g., server 108). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. Memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

The input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch. The display module 160 may be capable of changing the size of a viewable region from one side (e.g., the side where the user is located), and may also be referred to as a flexible display. In other words, the visible area is exposed to the outside of the electronic device 101 and may correspond to an area where the screen is displayed. A rollable display will be described below as an example of the display module 160 that can change the size of the area shown in FIGS. 3A to 4B. The size of the visible area can also be referred to as display size.

The display size detection module (not shown) of the electronic device 101 may be a module for calculating the size of the visible area of the display module 160. The display size detection module (not shown) is based on at least one of capacitance change sensing, inductance change sensing, magnetic flux change sensing, touch point change sensing, resistance change sensing, and distance change sensing according to the change in size of the visible area, A sensing value corresponding to the above-described changed display size may be obtained (or received). The display size detection module (not shown) may be operatively connected to the processor 120 and transmit the acquired (or received) sensing value to the processor 120.

The audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).

The sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 can be confirmed or authenticated.

The wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low latency). -latency communications)) can be supported. The wireless communication module 192 may support high frequency bands (eg, mmWave bands), for example, to achieve high data rates. The wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199). According to one embodiment, the wireless communication module 192 supports peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit or receive signals or power to or from the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected to the plurality of antennas by, for example, the communication module 190. can be selected. Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna. According to one embodiment, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 197.

According to one embodiment, the antenna module 197 may form a mmWave antenna module. According to one embodiment, a mmWave antenna module includes: a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the external electronic devices 102 or 104 may be of the same or different type as the electronic device 101. According to one embodiment, all or part of the operations performed in the electronic device 101 may be executed in one or more of the external electronic devices 102, 104, or 108. For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 may perform the function or service instead of executing the function or service on its own. Alternatively, or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

Figure 2 is a block diagram of a display module, according to one embodiment.

Referring to FIG. 2, the display module 160 may include a display 210 and a display driver IC (DDI) 230 for controlling the display 210. The DDI 230 may include an interface module 231, a memory 233 (eg, buffer memory), an image processing module 235, or a mapping module 237. As an example, the display 210 may include a flexible display. For example, the DDI 230 receives image information including image data or an image control signal corresponding to a command for controlling the image data from other components of the electronic device 101 through the interface module 231. can do. For example, according to one embodiment, the image information is stored in the processor 120 (e.g., the main processor 121 (e.g., an application processor) or the auxiliary processor 123 ( For example: a graphics processing unit). The DDI 230 can communicate with the touch circuit 250 or the sensor module 176, etc. through the interface module 231. In addition, the DDI 230 can communicate with the touch circuit 250 or the sensor module 176, etc. At least a portion of the received image information may be stored, for example, in frame units, in the memory 233. The image processing module 235 may, for example, store at least a portion of the image data in accordance with the characteristics or characteristics of the image data. Preprocessing or postprocessing (e.g., resolution, brightness, or size adjustment) may be performed based at least on the characteristics of the display 210. The mapping module 237 performs preprocessing or postprocessing through the image processing module 135. A voltage value or a current value corresponding to the image data may be generated. According to one embodiment, the generation of the voltage value or the current value may be generated by, for example, an attribute of the pixels of the display 210 (e.g., an array of pixels ( RGB stripe or pentile structure), or the size of each subpixel). At least some pixels of the display 210 may be performed at least in part based on, for example, the voltage value or the current value. By driving, visual information (eg, text, image, or icon) corresponding to the image data may be displayed through the display 210.

According to one embodiment, the display module 160 may further include a touch circuit 250. The touch circuit 250 may include a touch sensor 251 and a touch sensor IC 253 for controlling the touch sensor 251. For example, the touch sensor IC 253 may control the touch sensor 251 to detect a touch input or a hovering input for a specific position of the display 210. For example, the touch sensor IC 253 may detect a touch input or a hovering input by measuring a change in a signal (eg, voltage, light amount, resistance, or charge amount) for a specific position of the display 210. The touch sensor IC 253 may provide information (e.g., location, area, pressure, or time) about the detected touch input or hovering input to the processor 120. According to one embodiment, at least a portion of the touch circuit 250 (e.g., touch sensor IC 253) is disposed as part of the display driver IC 230, the display 210, or outside the display module 160. It may be included as part of other components (e.g., auxiliary processor 123).

According to one embodiment, the display module 160 may further include at least one sensor (eg, a fingerprint sensor, an iris sensor, a pressure sensor, or an illumination sensor) of the sensor module 176, or a control circuit therefor. In this case, the at least one sensor or a control circuit therefor may be embedded in a part of the display module 160 (eg, the display 210 or the DDI 230) or a part of the touch circuit 250. For example, when the sensor module 176 embedded in the display module 160 includes a biometric sensor (e.g., a fingerprint sensor), the biometric sensor records biometric information associated with a touch input through a portion of the display 210. (e.g. fingerprint image) can be acquired. For another example, when the sensor module 176 embedded in the display module 160 includes a pressure sensor, the pressure sensor may acquire pressure information associated with a touch input through part or the entire area of the display 210. You can. According to one embodiment, the touch sensor 251 or the sensor module 176 may be disposed between pixels of a pixel layer of the display 210, or above or below the pixel layer.

3A and 3B are front perspective views of an electronic device showing a closed state and an open state according to an embodiment. 4A and 4B are rear perspective views of an electronic device showing a closed state and an open state according to an embodiment.

The electronic device 300 of FIG. 3A may be at least partially similar to the electronic device 101 of FIG. 1 or may further include other embodiments of the electronic device.

Referring to FIGS. 3A to 4B , the electronic device 300 may include a first housing 310 and a second housing 320 that is at least partially movably coupled to the first housing 310 . According to one embodiment, the first housing 310 includes a first plate 311 and a first side frame 312 extending in a substantially vertical direction (e.g., z-axis direction) along the edge of the first plate 311. ) may include. According to one embodiment, the first side frame 312 includes a first side 3121, a second side 3122 extending from one end of the first side 3121, and a second side extending from the other end of the first side 3121. It may include a third side 3123. According to one embodiment, the first housing 310 may include a first space that is at least partially closed from the outside through the first plate 311 and the first side frame 312.

According to one embodiment, the second housing 320 includes a second plate 321 and a second side frame 322 extending in a substantially vertical direction (e.g., z-axis direction) along the edge of the second plate 321. ) may include. According to one embodiment, the second side frame 322 has a fourth side 3221 facing in the opposite direction to the first side 3121, extends from one end of the fourth side 3221, and has a second side 3122. It may include a fifth side 3222 that is at least partially coupled to the sixth side 3223, which extends from the other end of the fourth side 3221 and is at least partially coupled to the third side 3123. In another embodiment, the fourth side 3221 may extend from a structure other than the second plate 321 and be coupled to the second plate 321. According to one embodiment, the second housing 320 may include a second space that is at least partially closed from the outside through the second plate 321 and the second side frame 322. According to one embodiment, the first plate 311 and the second plate 321 may be arranged to at least partially form the back of the electronic device 300. For example, the first plate 311, the second plate 321, the first side frame 312, and the second side frame 322 are made of polymer, coated or colored glass, ceramic, metal (e.g., aluminum, stainless steel) (STS), or magnesium), or a combination of at least two of the above materials.

According to one embodiment, the electronic device 300 may include a flexible display (e.g., display 210 of FIG. 2) 330 arranged to be supported by the first housing 310 and the second housing 320. You can. The display 330 may be exposed to the outside of the electronic device 300 through a display area (eg, a viewable region) of the electronic device 300. According to one embodiment, the flexible display 330 may include a flat portion supported by the second housing 320 and a bendable portion extending from the flat portion and supported by the first housing 310 . According to one embodiment, the bendable portion of the flexible display 330 may be disposed so as not to be exposed to the outside in the first space of the first housing 310 when the electronic device 300 is closed. In an open state, 300 may be exposed to the outside to extend from the flat portion while being supported by the first housing 310. Accordingly, the electronic device 300 is a rollable type electronic device in which the display screen of the flexible display 330 is expanded according to the opening operation according to the movement of the first housing 310 from the second housing 320. It can be.

According to one embodiment, the electronic device 300 may be coupled in such a way that the first housing 310 is at least partially inserted into the second space of the second housing 320 and can move in the direction ① shown. there is. For example, in the closed state, the electronic device 300 combines the first housing 310 and the second housing 320 so that the first side 3121 and the fourth side 3221 have a first distance d1. The status quo can be maintained. According to one embodiment, in the open state, the electronic device 300 is configured to have the first side 3121 protrude from the fourth side 3221 by a predetermined distance d2 and have a second separation distance d. The housing 310 may be maintained in a state protruding from the second housing 320 . According to one embodiment, in an open state, the flexible display 330 may be supported by the first housing 310 and/or the second housing 320 so that both ends have curved edges.

According to one embodiment, the electronic device 300 may automatically transition to an open state and a closed state through a driving unit disposed in the first space and/or the second space. For example, when the processor of the electronic device 300 (e.g., the processor 120 in FIG. 1) detects an event for an open/closed state transition of the electronic device 300, it operates the first housing 310 through the driving unit. Can be set to control. In another embodiment, the first housing 310 may be manually protruded from the second housing 320 through user manipulation. In this case, the first housing 310 can protrude by the amount of protrusion desired by the user, and as a result, the screen of the flexible display 330 can also be changed to have various display areas. Accordingly, the processor of the electronic device 300 (e.g., the processor 120 in FIG. 1) displays the object in various ways in response to the display area corresponding to a certain protrusion amount of the first housing 310, and displays the application program. You can also control it to run.

According to one embodiment, the electronic device 300 includes an input device 303, an audio output device 306 and 307, a sensor module 304 and 317, a camera module 305 and 316, a connector port 308, It may include at least one of a key input device (not shown) or an indicator (not shown). In another embodiment, the electronic device 300 may omit at least one of the above-described components or may additionally include other components.

According to one embodiment, the input device 303 may include a microphone 303. In one embodiment, the input device 303 may include a plurality of microphones 303 arranged to detect the direction of sound. The sound output devices 306 and 307 may include speakers 306 and 307. The speakers 306 and 307 may include an external speaker 306 and a receiver 307 for a call. In another embodiment, when the external speaker 306' is placed in the first housing 310, it may be configured to output sound through the speaker hole 306 formed in the second housing 320 in a closed state. According to one embodiment, the microphone 303 or the connector port 308 may also be formed to have substantially the same configuration. In another embodiment, the sound output devices 306 and 307 may include speakers (eg, piezo speakers) that operate without the separate speaker hole 306.

According to one embodiment, the sensor modules 304 and 317 may generate electrical signals or data values corresponding to the internal operating state of the electronic device 300 or the external environmental state. The sensor modules 304 and 317 are, for example, the first sensor module 304 (e.g., proximity sensor or illuminance sensor) disposed on the front of the second housing 320 and/or the second housing 320. It may include a second sensor module 317 (eg, HRM sensor) disposed at the rear. According to one embodiment, the first sensor module 304 may be disposed under the flexible display 330 in the second housing 320. According to one embodiment, the first sensor module 304 includes a proximity sensor, an illumination sensor 304, a time of flight (TOF) sensor, an ultrasonic sensor, a fingerprint recognition sensor, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, It may further include at least one of an acceleration sensor, a grip sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, or a humidity sensor.

According to one embodiment, the camera devices 305 and 316 include a first camera device 305 disposed on the front of the second housing 320 of the electronic device 300, and a rear of the second housing 320. It may include a second camera device 316 disposed. According to one embodiment, the electronic device 300 may include a flash 318 located near the second camera device 316. According to one embodiment, the camera devices 305 and 316 may include one or more lenses, an image sensor, and/or an image signal processor. According to one embodiment, the first camera device 305 is disposed below the flexible display 330 and may be configured to photograph a subject through a portion of the active area of the flexible display 330. According to one embodiment, the flash 318 may include, for example, a light emitting diode or a xenon lamp. In one embodiment, two or more lenses (wide-angle and telephoto lenses) and image sensors may be disposed on one side of the electronic device 300.

According to one embodiment, the electronic device 300 may include at least one antenna (not shown). According to one embodiment, at least one antenna may, for example, communicate wirelessly with an external electronic device (e.g., the electronic device 104 of FIG. 1) or wirelessly transmit and receive power required for charging. According to one embodiment, the antenna may include a legacy antenna, a mmWave antenna, a near field communication (NFC) antenna, a wireless charging antenna, and/or a magnetic secure transmission (MST) antenna. In another embodiment, an antenna structure may be formed through at least a portion of the first side frame 312 and/or the second side frame 322 made of metal.

FIGS. 5 and 6 are diagrams for explaining an operation of an electronic device in which the display size changes during capture, according to an embodiment.

An electronic device (e.g., the electronic device 101 of FIG. 1 or the electronic device 300 of FIGS. 3A to 4B) according to an embodiment includes a display module (e.g., a display module capable of changing the size of a viewable region from one side). For example, it may include the display module 160 of FIG. 1 or the display module 160 of FIG. 2). For example, the area visible from one side may include the display area of a flexible display of an electronic device (eg, the flexible display 330 in FIGS. 3A and 3B). The electronic device may monitor changes in the size of the area visible in the display module (e.g., display size). The display size may be the size, length, dimension, and/or area of a portion of the display module where an application and/or function is output.

For example, the electronic device may determine that a change in display size has occurred when detecting an input (e.g., press input) to a size change element. The resizing element may be a hardware-based operating element (e.g., a press button) and/or a software-based operating element (e.g., a button object displayed on the display) for adjusting the display size. For example, the electronic device may initiate a change in display size based on detecting a gesture input that causes a size adjustment (e.g., increasing or decreasing display size).

According to one embodiment, the display size may be changed in a range of above the minimum size and below the maximum size. For example, input to a resize element may include input that changes the display size to a specific value. For example, input to a resize element causes the display size to continue to expand, input to cause the display size to stop expanding, input to cause the display size to continue to shrink, and input to cause the display size to stop shrinking. May include input.

According to one embodiment, the electronic device may detect a change in display size using a display size detection module. The electronic device can recognize the display size using a display size detection module. For example, the display size detection module can obtain a value of the display size.

Referring to FIG. 5 , a method of operating an electronic device according to an embodiment may include an operation 510 of changing the size of a visible area based on a standard set for capture when a screen capture signal is received. .

According to one embodiment, the generation of a screen capture signal may correspond to an input that causes a change in the size of the visible area of the display. When a screen capture signal is received, the electronic device may change the size of the visible area of the display. For example, when a screen capture signal is received, the size of the visible area of the display may be expanded or reduced. A screen capture signal may be generated by detection of an input for screen capture. For example, input to a screen capture can be input to a hardware-based operating element (e.g. a button) for screen capture (e.g. a press input), input to a software-based operating element (e.g. a button object that is output to the display), input that selects), and gesture input that causes a screen capture (e.g., input that involves swiping the screen with your hand).

According to one embodiment, when a screen capture signal is received, the electronic device may change the size of the visible area based on a standard set for capture. As an example, criteria set for capture may include criteria for determining whether to change the area shown for capture. Whether or not to change the area shown for capture may be determined by a value preset in the electronic device. For example, when set to change the visible area for capture, the electronic device may change the visible area in response to receiving a screen capture signal. Meanwhile, when the visible area for capture is set to not change, the electronic device may not change the visible area in response to receiving a screen capture signal.

According to one embodiment, whether to change the area shown for capture may be determined based on the size of the entire content displayed on the screen. For example, the electronic device may determine whether there is content not displayed on the screen and, if there is content not displayed on the screen, expand the viewable area in response to receiving a screen capture signal. For example, the electronic device may compare the size of content not displayed on the screen with a threshold value and, if the size is greater than the threshold value, expand the viewable area in response to receiving a screen capture signal.

As an example, criteria set for capture may include criteria for determining the degree of change in the area shown for capture. For example, when an electronic device is set to change the size of the visible area to a predetermined standard value (e.g., maximum or minimum value) in response to receiving a screen capture signal, the size of the visible area is set to the standard value. You can change it. As an example, the electronic device may compare the size of the visible area at the time a screen capture signal is received with a reference value. If the size of the viewable area at the time the screen capture signal is received is smaller than a set reference value, the electronic device may expand the size of the viewable area. Meanwhile, if the size of the visible area at the time the screen capture signal is received is equal to or larger than the set reference value, the size of the visible area may not be changed.

For example, a criterion for determining the degree of change in the visible area for capture may be set to expand the size of the visible area until the image area recognized on the screen is fully exposed through the visible area. The electronic device can expand the size of the visible area until the image area recognized on the screen is fully exposed through the visible area. Various algorithms can be used to detect image regions. If only part of the image area recognized on the screen is exposed to the visible area, and the other part is not exposed to the visible area, the size of the visible area may be expanded to a size where the entire image area is exposed.

According to one embodiment, the size of the visible area may be determined based on the size of the image area recognized on the screen and the expandable size of the visible area. For example, if the entire image area is not exposed even if the visible area is expanded to the maximum size, the visible area may be expanded by the maximum size.

According to one embodiment, a screen output through a visible area of the display of an electronic device may include one or more execution screens. An execution screen may correspond to a single screen independently provided by an application and/or an operating system. For example, the execution screen may include an application execution screen, a web page, and a desktop screen.

A method of operating an electronic device according to an embodiment may include an operation 520 of controlling the size of an execution screen output through the viewable area based on the changed size of the viewable area. The electronic device may control the size of at least one execution screen output through the viewable area based on the changed size of the viewable area. For example, controlling the size of the execution screen may mean changing the size of the execution screen so that the execution screen can be displayed not only through the visible area before the change, but also through the visible area created by the change.

According to one embodiment, when one execution screen is output through the visible area, the one execution screen may be visualized in the form of a full screen in the visible area. When one execution screen is displayed through the visible area, the size of the execution screen may also be changed by the changed size of the visible area.

For example, referring to FIG. 6 , an example of visible areas 601-1 and 601-2 of an electronic device where one execution screen is displayed is shown. For example, when one execution screen is output through the visible areas 601-1 and 601-2, one execution screen may be displayed throughout the visible areas 601-1 and 601-2. When a screen capture signal is received while the viewable area 601-1 of the electronic device is at the first size, the viewable area 601-1 may be expanded in the first direction 603. For example, as described above in the description of operation 510 of FIG. 5, the visible area 601-1 may be changed based on a standard set for capture. The first direction 603 shown in FIG. 6 is only an example of the direction in which the visible area 601-1 is expanded, and does not limit the expansion direction. By expansion, the size of the visible area 601-1 of the electronic device may change from the first size to the second size.

According to one embodiment, the size of the screen displayed through the expanded visible area 601-2 may also be expanded. The size of the screen can be expanded to the same extent as the extent to which the visible area 601-2 is expanded. For example, when the difference between the height of the visible area 601-1 before expansion by receiving a screen capture signal and the height of the visible area 601-2 after expansion is x(604). , the height value of the newly added area in the expanded execution screen may also be x(605).

A wider area of content can be displayed (or exposed) on the expanded execution screen. For example, if the size of the content displayed on the execution screen is larger than the size of the execution screen before expansion, part of the content may be displayed on the execution screen, and other parts may not be displayed on the execution screen. When the size of the execution screen is expanded, additional content may be displayed through the area 602 newly created by the expansion. The additional content may correspond to the lower portion connected to the content displayed on the screen before expansion.

According to one embodiment, content additionally displayed on the changed execution screen may be determined according to the change direction of the visible area. As shown in FIG. 6, when the visible area 601-1 extends in the first direction 603, which is toward the bottom of the electronic device, the content connected to the visible area 601-1 is output. The lower portion may be additionally displayed through the newly created area 602. Unlike shown in FIG. 6, when the visible area 601-1 extends toward the side of the electronic device, the left or right portion of the content connected to the content output through the visible area 601-1 is It may be additionally displayed through the newly created area 602.

For example, if the size of the content displayed on the execution screen is not larger than the size of the execution screen before expansion, all of the content may be displayed on the execution screen before expansion. When the size of the execution screen is expanded, the content may be enlarged and displayed by the expanded screen ratio. For example, when the height of the execution screen increases, the content may be displayed enlarged in the height direction.

For example, if the size of the content displayed on the execution screen is not larger than the size of the execution screen before expansion, instead of the content being expanded, a function screen corresponding to the expansion may be displayed through the area newly created by the expansion. . For example, a function screen may include a software-based operating element (e.g., a button object displayed on a display) that provides functions related to content, such as a function to control content.

According to one embodiment, when a plurality of execution screens are output through a visible area, the plurality of execution screens are visualized in the visible area in a split screen form (e.g., multi-window, pop-up, and widget). It can be. For example, the size of at least one execution screen may be changed based on the arrangement of the plurality of execution screens within the visible area. For example, based on whether a plurality of execution screens are activated (or focused), the size of the activated execution screen may be changed. For example, the size of the plurality of execution screens may be changed based on the size ratio between the plurality of execution screens. The operation of controlling the size of a plurality of execution screens will be described in detail below.

A method of operating an electronic device according to an embodiment may include an operation 530 of generating a screen shot image including an execution screen whose size is controlled. A screenshot image may correspond to data generated in the form of an image of a screen output through a visible area of an electronic device. The generated screenshot image may be stored in an electronic device. As an example, the generated screenshot image may be temporarily stored in the clipboard of the electronic device.

For example, referring to FIG. 6 , as the visible area is expanded, a screen shot image 605 including an expanded execution screen may be generated. Since the screen shot image 605 is generated after expanding the viewable area of the electronic device, the screen shot image 605 may include a wider area of screen information than a screenshot image created without expanding the viewable area. .

FIG. 7 is a diagram illustrating an operation of an electronic device that expands a viewable area based on an expanded screen capture signal, according to an embodiment.

The screens 710, 720, and 730 shown in FIG. 7 are screens output through the visible area of the electronic device (e.g., the electronic device 101 in FIG. 1 or the electronic device 300 in FIGS. 3A to 4B). These are examples.

Referring to FIG. 7, when a screen capture signal is received in the state of the screen 710, the electronic device according to one embodiment may provide an interfacing object 721 that generates an extended screen capture signal like the screen 720. You can. An interfacing object (e.g., 721) is an object included in an interface implemented to receive input from a user and output a corresponding action, and may include, for example, a button, an input window, and a display window.

According to one embodiment, when a screen capture signal is received, the electronic device may provide a capture tool 722 through an interface. The capture tool 722 may include interfacing objects for requesting functions related to capture. The capture tool may include an interfacing object 721 that generates an extended screen capture signal. For example, the capture tool 722 includes a button for requesting a scroll capture, a button for calling an editing function of a screenshot image, a button for requesting a tag of additional information such as a note in the screenshot image, and a button for requesting a tag for additional information such as a note in the screenshot image. It may contain an interfacing object that includes a button for requesting sharing.

According to one embodiment, the interfacing object 721 that generates an expanded screen capture signal may be provided based on a determination of whether or not the viewable area can be expanded. For example, if it is determined that expansion of the viewable area is possible, the interfacing object 721 may be provided through an interface. Meanwhile, if it is determined that expansion of the visible area is not possible, the interfacing object 721 may not be provided. For example, if a screen capture is received while the viewable area is already at its maximum value, the viewable area cannot be expanded, so the interfacing object 721 that generates an expanded screen capture signal may not be provided.

According to one embodiment, when an expansion screen capture signal is received through the interfacing object 721 in the electronic device, the size of the viewable area may be expanded. For example, when an input for selecting the interfacing object 721 is received, an extended screen capture signal may be generated. The electronic device may receive an expanded screen capture signal to expand the size of the viewable area. As the size of the viewable area expands, the expanded screen 730 may be displayed through the viewable area. The capture tool 731 provided through the extended screen 730 may not include the interfacing object 721 that generates the extended screen capture signal. If a screen capture is received while the visible area is already at its maximum value, a screenshot image of the screen displayed through the visible area at the time the screen capture is received can be created without a separate action to expand the visible area. .

According to one embodiment, the expansion of the visible area in response to reception of the expanded screen capture signal may be performed in stages. For example, when an extended screen capture signal is received, the visible area is expanded by a certain size, and if an extended screen capture signal is additionally received within a threshold time after the extended screen capture signal is received, the visible area is expanded. It can be expanded further by a certain size.

According to one embodiment, when a screen capture signal is received, the electronic device may provide a preview window 723 of the screen shot image through an interface. As an example, the preview window 723 may be provided through a thumbnail 724 included in the capture tool. The screenshot image created through the preview window 723 can be visually confirmed immediately at the time of capture.

FIG. 8 is a diagram illustrating an operation in which the size of a visible area is restored to the size before expansion after executing expanded capture according to an embodiment.

The screens 810, 820, and 830 shown in FIG. 8 are screens output through the visible area of the electronic device (e.g., the electronic device 101 in FIG. 1 or the electronic device 300 in FIGS. 3A to 4B). These are examples.

Referring to FIG. 8, when a screen capture signal is received in the state of the screen 810, the electronic device according to one embodiment may expand the size of the visible area and the size of the execution screen output through the visible area. . The electronic device may generate a screenshot image of the screen 820 by capturing the screen 820 including the expanded execution screen. In response to the creation of a screenshot image of the expanded screen 820, the electronic device may restore the size of the viewable area to the size of the viewable area at the time the screen capture signal was received. The size of the visible area at the time the screen capture signal is received may be temporarily stored in the memory of the electronic device. As the size of the visible area is restored, the expanded screen 820 output through the visible area may be changed to the screen 830 having the screen size at the time the screen capture signal was received. The changed screen 830 may have the same size as the screen 810 at the time the screen capture signal is received.

FIGS. 9A and 9B are diagrams for explaining criteria for determining the degree to which the size of a visible area is changed according to an embodiment.

The screens 910, 920, 930, 940, and 950 shown in FIGS. 9A and 9B are views of an electronic device (e.g., the electronic device 101 in FIG. 1 or the electronic device 300 in FIGS. 3A to 4B). This is an example of screens displayed through the gray area. It is assumed that the sizes of the screens 910, 920, 930, 940, and 950 shown in FIGS. 9A and 9B are the same as the size of the visible area where the screens 910, 920, 930, 940, and 950 are output. Explain.

As described above, the size of the visible area can be changed based on criteria established for capture. As an example, criteria established for capture may include criteria for determining the extent to which the size of the viewable area is changed.

The standard for determining the extent to which the size of the visible area is changed according to one embodiment may be set by changing the visible area to a predetermined standard value. In this case, when a screen capture signal is received, the electronic device can change the size of the visible area to a predetermined reference value. For example, it may be determined as a specific value indicating the changed size of the visible area. For example, a predetermined reference value may be determined as a value indicating the maximum size at which the visible area can be changed.

For example, referring to FIG. 9A, when a screen capture signal is received in the state of the screen 910, the electronic device may change the size of the visible area to a predetermined reference value. By changing the visible area, the state of the screen 910 may be changed to the state of the screen 920 of a changed size.

The standard for determining the extent to which the size of the visible area is changed according to one embodiment may be set to expand the image area recognized on the screen until it is fully exposed through the visible area. In this case, when a screen capture is received, the electronic device may expand the size of the viewable area until the recognized image area is fully exposed through the viewable area.

For example, referring to FIG. 9B, the visible area corresponding to the size of the first value is the area where the image area 931 recognized on the screen is visible according to the criteria set for capture when a screen capture signal is received. It can be expanded to a visible area of a size that is fully exposed.

According to one embodiment, the electronic device may determine whether the image area recognized on the screen is fully exposed through the visible area. For example, whether the image area is fully exposed through the visible area can be determined by whether the image area is displayed without being cut off on the screen output through the visible area. If it is determined that the recognized image area is fully exposed through the viewable area, the electronic device may stop expanding the size of the viewable area. If it is determined that the recognized image area is not fully exposed through the visible area, the electronic device may expand the size of the visible area by a certain value. The electronic device may expand the size of the visible area by a certain value and then repeat the operation of determining whether the image area recognized on the screen is fully exposed through the visible area. As an example, the electronic device determines whether the image area recognized on the screen is fully exposed through the visible area, and expands the size of the visible area by a certain value to expand the area where the recognized image area is visible on the screen. You can repeat this until everything is exposed.

For example, referring to FIG. 9B, when a screen capture signal is received, the visible area corresponding to the size of the first value is fully exposed through the area where the image area 931 recognized on the screen 930 is visible. It can be determined whether it is possible or not. Referring to the screen 930, since the image area 931 is not fully exposed through the visible area, the size of the visible area may be expanded from the first value to a second value increased by a certain value. It may be determined whether the image area 931 recognized in the expanded screen 940 is fully exposed through the visible area. Referring to the screen 940, since the image area 931 is not fully exposed through the visible area, the size of the visible area may be expanded from the second value to a third value increased by a certain value. Since the image area 931 recognized in the expanded screen 950 is fully exposed through the visible area, expansion of the visible area may be stopped. A screenshot image of the screen 950 may be created.

Figure 10 is a diagram for explaining an operation in which the size of a plurality of screens is controlled according to an embodiment.

The screens 1010, 1020, and 1030 shown in FIG. 10 are screens output through the visible area of the electronic device (e.g., the electronic device 101 in FIG. 1 or the electronic device 300 in FIGS. 3A to 4B). These are examples. The sizes of the screens 1010, 1020, and 1030 shown in FIG. 10 will be described assuming that they are the same as the size of the visible area where the screens 1010, 1020, and 1030 are output.

Referring to FIG. 10, screens 1010, 1020, and 1030 may include a first screen (APP1) and a second screen (APP2). The first screen (APP1) and the second screen (APP2) may each correspond to an execution screen. In other words, referring to the screens 1010, 1020, and 1030, the first screen APP1 and the second screen APP2 may be output in the form of a split screen through the visible area.

For example, when a screen capture signal is received in the state of the screen 1010, the electronic device may change the size of the visible area. The electronic device may control the size of at least one of the plurality of execution screens APP1 and APP2 displayed through the visible area based on the changed size of the visible area. By controlling the size of the plurality of execution screens APP1 and APP2 output through the visible area, the state of the screen 1010 can be changed to the state of the screen 1020 of a changed size.

According to one embodiment, the electronic device displays at least one of the plurality of execution screens APP1 and APP2 based on the changed size of the viewable area and the arrangement of the plurality of execution screens APP1 and APP2 within the viewable area. The size can be changed. For example, an execution screen placed at a specific location among the plurality of execution screens APP1 and APP2 may be determined as the execution screen whose size is to be controlled. The execution screen placed at a certain location will be determined as the execution screen whose size will be controlled, depending on the direction in which the visible area is changed and the split screen type.

For example, as shown in FIG. 10, when the area shown in a split screen form in which a plurality of execution screens (APP1 and APP2) are divided into upper and lower parts is changed toward the bottom of the electronic device, the Screen 1 (APP1) may be determined as the execution screen whose size will be controlled. The size of the second screen (APP2) does not change, and the size of the first screen (APP1) may change as the visible area changes.

According to one embodiment, the electronic device may change the size of the activated execution screen among the plurality of execution screens based on the changed size of the viewable area and whether or not the plurality of execution screens APP1 and APP2 are activated. For example, the activated execution screen among the plurality of execution screens APP1 and APP2 may be determined as the execution screen whose size is to be controlled. The activated execution screen may refer to a screen that displays the execution window of an application that is determined to respond to an input received through the electronic device among applications running on the electronic device. For example, the first screen (APP1) on which the execution window of the first application is displayed and the second screen (APP2) on which the execution window of the second application is displayed are displayed through the visible area, and the first screen (APP1) is activated. In this case, the input received through the electronic device is recognized as the input of the first application, and the first application can perform an operation in response to the received input. According to one embodiment, the first screen APP1 activated at the time the screen capture signal is received may be determined as an execution screen whose size will change as the visible area changes. Among the plurality of execution screens, the size of the non-activated second screen (APP2) does not change, and the size of the activated first screen (APP1) may change as the visible area changes.

According to one embodiment, unlike shown in FIG. 10, when a screen capture signal is received, both the first screen and the second screen may be changed in proportion to the sizes of the first screen and the second screen. For example, the ratio of the size of the first screen and the size of the second screen after the change may be changed to remain the same as the ratio of the size of the first screen and the size of the second screen before the change.

According to one embodiment, after creating a screenshot image of the changed screen 1020, the size of the visible area may be restored to the size of the visible area at the time the screen capture signal is received. As the size of the visible area is restored, the changed screen 1020 output through the visible area may be changed to a screen 1030 having the size at the time the screen capture signal was received. The changed screen 1030 may have the same size as the screen 1010 at the time the screen capture signal is received.

According to one embodiment, as the size of the visible area is restored, the size of the plurality of execution screens (APP1, APP2) output through the visible area also changes to the size of the execution screens (APP1, APP2) at the time the screen capture signal is received. It can be restored to the size of APP2). For example, the size of the first screen (APP1), which has been changed like screen 1020, can be restored to the size of the first screen (APP1) at the time the screen capture signal is received, like screen 1030. . The size of the first screen APP1 included in the screen 1030 may be the same as the size of the first screen APP1 included in the screen 1010 at the time the screen capture signal is received.

FIG. 11 is a diagram for explaining a scroll capture operation according to an embodiment.

The screens 1110, 1120, and 1130 shown in FIG. 11 are screens output through the visible area of the electronic device (e.g., the electronic device 101 in FIG. 1 or the electronic device 300 in FIGS. 3A to 4B). These are examples. It is assumed that the sizes of the screens 1110, 1120, and 1130 shown in FIG. 11 are the same as the size of the visible area where the screens 1110, 1120, and 1130 are output.

Referring to FIG. 11, when a capture signal is received in the state of the screen 1110, the screen 1110 output through the visible area may be changed to the screen 1120. The screen 1120 output through the visible area may correspond to a screen displaying the first area, which is a partial area of the electronic page. A screen shot image (hereinafter referred to as a first screen shot image) of the changed screen 1120 may be created.

According to one embodiment, a scroll capture signal may be received by an electronic device. Scroll capture may correspond to a capture method that generates a screenshot image that includes an area of the electronic page wider than the screen while scrolling the electronic page. The scroll capture signal may be generated by detection of an input for scroll capture of the screen. For example, the input for capturing a scroll on the screen can be an input for a hardware-based operating element (e.g. a press button) for capturing a scroll on the screen (e.g. press input), an input for a software-based operating element (e.g. It may include an input that selects an output button object) and a gesture input that causes screen capture (e.g., an input that swipes the screen with a hand).

According to one embodiment, when an input for selecting the interfacing object 1121 is received in the electronic device, a scroll capture signal may be generated. The interfacing object 1121 may be included in the capture tool 1122 provided through the interface when a screen capture signal is received. The capture tool 1122 may be provided through an interface when a screen capture signal is received. As an example, the capture tool 1122 included in the changed screen 1120 may be provided for a certain period of time. For example, the capture tool 1122 may be provided for a predetermined period of time after the viewable area has changed. For example, the capture tool 1122 may be provided for a predetermined period of time after a screen capture signal is generated.

According to one embodiment, the electronic device may generate a second screenshot image of the screen 1130 on which the second area of the electronic page is displayed in response to receiving the scroll capture signal. The second area of the electronic page displayed on the screen 1130 may correspond to a partial area of the electronic page scrolled from the first area of the electronic page displayed on the screen 1120. For example, the degree to which an electronic page is scrolled by a scroll capture signal may be proportional to the size of the execution screen on which the electronic page is displayed (or the size of the visible area). For example, the degree to which the electronic page is scrolled by the scroll capture signal in the changed state of the screen 1120 may be greater than the degree to which the electronic page is scrolled by the scroll capture signal in the state of the screen 1110. For example, the direction in which an electronic page is scrolled by a scroll capture signal may be determined to be a specific direction based on the characteristics of the electronic page. For example, if the vertical length of the electronic page is larger than the size of the execution screen, the scrolling direction may be determined as the bottom or top direction. For example, if the horizontal length of the electronic page is larger than the size of the execution screen, the scrolling direction may be determined as left or right.

According to one embodiment, the electronic device may generate a screenshot image 1140 corresponding to the scroll capture signal by combining the first screenshot image and the second screenshot image. The screen shot image 1140 may include areas of the electronic page displayed on the execution screen by scrolling. The screen shot image 1140 may correspond to an image in which the areas of the electronic page displayed on the execution screen by scrolling are created as one page.

According to one embodiment, a screenshot image including a wide area of the page can be quickly created by performing scroll capture while the expanded execution screen is output through the visible area.

FIGS. 12A and 12B are diagrams for explaining an operation of determining the degree of scrolling during scroll capture according to an embodiment.

The screens 1210, 1220, and 1230 shown in FIG. 12A are screens output through the visible area of the electronic device (e.g., the electronic device 101 in FIG. 1 or the electronic device 300 in FIGS. 3A to 4B). These are examples. It is assumed that the sizes of the screens 1210, 1220, and 1230 shown in FIG. 12A are the same as the size of the visible area where the screens 1210, 1220, and 1230 are output.

Referring to FIG. 12A, when a capture signal is received in the state of the screen 1210, the screen 1210 output through the visible area may be changed to the screen 1220. The screen 1220 output through the visible area may correspond to a screen displaying the first area, which is a partial area of the electronic page. A screen shot image (hereinafter referred to as a first screen shot image) of the changed screen 1220 may be created.

According to one embodiment, a scroll capture signal may be received by an electronic device. The electronic device may generate a second screenshot image of the screen 1130 on which the second area of the electronic page is displayed in response to receiving the scroll capture signal. The second area of the electronic page may correspond to a partial area of the electronic page scrolled from the first area of the electronic page displayed on the screen 1220.

According to one embodiment, the electronic device may consider the image area 1221 recognized on the screen 1220 when determining the scrolling degree of the electronic page for scroll capture. As an example, the electronic page may be scrolled until the image area 1221 is fully exposed through the visible area, such as the screen 1230. A screenshot image (hereinafter referred to as a second screenshot image) of the screen 1230 on which the electronic page is scrolled until the image area 1221 is fully exposed through the visible area may be generated.

According to one embodiment, the electronic device may generate a screenshot image 1240 corresponding to the scroll capture signal by combining the first screenshot image and the second screenshot image. The screen shot image 1240 may include areas of the electronic page displayed on the screen by scrolling. The screen shot image 1240 may correspond to an image in which areas of an electronic page displayed on the screen by scrolling are created as one page.

Meanwhile, referring to FIG. 12B, the electronic page 1250 may further include an area 1251 not displayed on the screen 1220 below the area displayed on the changed screen 1220. When determining the degree of scrolling, if the image area is not considered, the screen on which the understanding area 1251 is displayed upon reception of the scroll capture signal may be output through the visible area.

An electronic device (e.g., the electronic device 101 of FIG. 1 or the electronic device 300 of FIGS. 3A to 4B) according to an embodiment may include a display module (e.g., the electronic device 300 of FIG. 1 It may include a display module 160 or the display module 160 of FIG. 2). For example, the area visible from one side may include the display area of a flexible display of an electronic device (eg, the flexible display 330 in FIGS. 3A and 3B). The electronic device may include a processor (eg, processor 120 of FIG. 1) electrically connected to the display module. For example, the processor may perform the method of operating the electronic device described above with reference to FIGS. 5 to 12 .

When a screen capture signal is received, the processor according to one embodiment may change the size of the displayed area based on a standard set for capture. The processor may control the size of at least one execution screen output through the viewable area based on the changed size of the viewable area. The processor may generate a screenshot image containing a size-controlled execution screen.

The processor according to one embodiment may, in response to the creation of a screenshot image, restore the size of the visible area to the size of the visible area at the time the screen capture signal is received.

When changing the size of the visible area, the processor according to one embodiment may change the size of the visible area to the reference value when the size of the visible area is set to change to a predetermined reference value.

When changing the size of the visible area to a reference value, the processor according to one embodiment may expand the size of the visible area if the size of the visible area at the time the screen capture signal is received is smaller than the reference value. there is.

When changing the size of the visible area, the processor according to one embodiment may expand the size of the visible area until the image area recognized in the execution screen is fully exposed through the visible area.

In controlling the size of at least one execution screen, the processor according to an embodiment may, in controlling the size of at least one execution screen, based on the changed size of the viewable area and the arrangement within the viewable area of the plurality of execution screens output through the viewable area. The size of at least one of the execution screens can be changed. For example, when controlling the size of at least one execution screen, the processor changes the size of an activated execution screen among the plurality of execution screens based on the changed size of the visible area and whether or not the plurality of execution screens are activated. You can. For example, when controlling the size of at least one execution screen, the processor may change the size of the plurality of execution screens based on the changed size of the visible area and the size ratio between the plurality of execution screens.

An execution screen according to one embodiment may include a screen displaying a partial area of an electronic page. When generating a screen shot image, the processor may generate a first screen shot image including an execution screen displaying a first area of an electronic page output through a visible area. The processor may, in response to receiving the scroll capture signal, generate a second screenshot image including an execution screen displaying a second area of the electronic page scrolled in a certain direction by a certain percentage of the changed size of the viewable area. . The processor may combine the first screenshot image and the second screenshot image to generate a screenshot image corresponding to the scroll capture signal.

When changing the size of the viewable area, the processor according to one embodiment provides an interfacing object that generates an expanded screen capture signal based on a determination of whether or not the viewable area can be expanded when a screen capture signal is received. You can. The processor may expand the size of the viewable area when an expansion screen capture signal is received through the interfacing object.

An electronic device according to an embodiment disclosed in this document may be of various types. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the above-described devices.

The various embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one component from another, and to refer to that component in other respects (e.g., importance or order) is not limited. One (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.” Where mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. can be used A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document are one or more instructions stored in a storage medium (e.g., built-in memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). It may be implemented as software (e.g., program 140) including these. For example, a processor (e.g., processor 120) of a device (e.g., electronic device 101) may call at least one command among one or more commands stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and this term refers to cases where data is semi-permanently stored in the storage medium. There is no distinction between temporary storage cases.

Methods according to various embodiments disclosed in this document may be provided and included in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store ^TM ) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to one embodiment, each component (e.g., module or program) of the above-described components may include a single or multiple entities, and some of the multiple entities may be separately placed in other components. . According to one embodiment, one or more of the above-described corresponding components or operations may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in the same or similar manner as those performed by the corresponding component of the plurality of components prior to the integration. . According to one embodiment, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or , or one or more other operations may be added.

Claims (10)

In the electronic device (101; 300),
A display module 160 capable of changing the size of the viewable region on one side; and
Processor 120 electrically connected to the display module 160
Including,
The processor 120,
When a screen capture signal is received, change the size of the visible area based on criteria set for capture,
Based on the changed size of the visible area, control the size of at least one execution screen output through the visible area,
Generating a screenshot image including the size-controlled execution screen,
Electronic devices (101; 300).
According to paragraph 1,
The processor 120,
In response to the creation of the screenshot image, restoring the size of the visible area to the size of the visible area at the time the screen capture signal is received,
Electronic devices (101; 300).
According to paragraph 1,
The processor 120,
In changing the size of the visible area,
When the size of the visible area is set to change to a predetermined standard value, the size of the visible area is changed to the standard value,
Electronic devices (101; 300).
According to paragraph 3,
The processor 120,
In changing the size of the visible area to the reference value,
If the size of the visible area at the time the screen capture signal is received is smaller than the reference value, expanding the size of the visible area,
Electronic devices (101; 300).
According to paragraph 1,
The processor 120,
In changing the size of the visible area,
Expanding the size of the visible area until the image area recognized in the execution screen is fully exposed through the visible area,
Electronic devices (101; 300).
According to paragraph 1,
The processor 120,
In controlling the size of the at least one execution screen,
changing the size of at least one of the plurality of execution screens based on the changed size of the visible area and the arrangement of the plurality of execution screens output through the visible area within the visible area;
changing the size of an activated execution screen among the plurality of execution screens based on the changed size of the visible area and whether the plurality of execution screens are activated; and
An operation of changing the size of the plurality of execution screens based on the changed size of the visible area and the size ratio between the plurality of execution screens.
Containing at least one of
Electronic devices (101; 300).
According to paragraph 1,
The execution screen includes a screen displaying a portion of an electronic page,
The processor 120,
In creating the screenshot image,
Generating a first screen shot image including an execution screen displaying a first area of an electronic page output through the visible area,
In response to receiving a scroll capture signal, generating a second screenshot image including an execution screen displaying a second area of the electronic page scrolled in a certain direction by a certain percentage of the expanded size of the viewable area,
Combining the first screenshot image and the second screenshot image to generate a screenshot image corresponding to the scroll capture signal,
Electronic devices (101; 300).
According to paragraph 1,
The processor 120,
In changing the size of the visible area,
When the screen capture signal is received, providing an interfacing object that generates an expanded screen capture signal based on a determination of whether the viewable area can be expanded,
When the expansion screen capture signal is received through the interfacing object, expanding the size of the visible area,
Electronic devices (101; 300).
In a method of operating an electronic device (101; 300) including a display module (160) capable of changing the size of a viewable region from one side,
When a screen capture signal is received, changing the size of the visible area based on a standard set for capture;
Controlling the size of at least one execution screen output through the visible area based on the changed size of the visible area; and
An operation of generating a screen shot image including the size-controlled execution screen
Including,
Method of operating the electronic device (101; 300).
Electronic devices (101; 300).
A computer program combined with hardware and stored on a medium to execute the method of claim 9.

Images