WO2024158181A1 - System and electronic device for document editing, and method for document editing in said electronic device - Google Patents

Abstract

An electronic device according to an embodiment may include a communication module, a display, and a processor. The processor according to an embodiment, when partial data in a document displayed on the display is identified as having been edited while performing a co-editing operation in which a common document can be edited by multiple devices, may transmit edited data of the electronic device, which corresponds to the edited partial data, to multiple external electronic devices by means of the communication module. The processor according to an embodiment, when edited data of the first external electronic device, corresponding to edited partial data in the document displayed on the first external electronic device, is received therefrom among the multiple external electronic devices by means of the communication module, may update the document by applying the edited data of the first external electronic device to the document.

Description

System for document editing, electronic device and method for document editing in said electronic device

This disclosure relates to a system for document editing, an electronic device, and a method for document editing in the electronic device.

When multiple users access a document simultaneously using their respective devices to perform joint editing, the multiple devices connect to the server and transmit an editing command to the server, and the server performs the editing. After editing a document stored in the server based on a command, the result of editing the document is transmitted to the plurality of devices, so that the plurality of users can visually confirm the editing of the document.

Since all actual editing operations for documents stored on the server are performed on the server, real-time performance for editing the document may depend on the performance of the server and/or the bandwidth of the network.

An electronic device according to an embodiment may include a communication module, a display, and a processor.

The processor according to an embodiment may, while performing a joint editing operation capable of editing a common document by a plurality of devices, confirm the editing of some data in the document displayed on the display, and the edited partial data Edit data of the electronic device corresponding to can be transmitted to a plurality of external electronic devices through the communication module.

The processor according to an embodiment may, through the communication module, send a first external electronic device from a first external electronic device among the plurality of external electronic devices to a first external electronic device corresponding to some data edited in the document displayed on the first external electronic device. Upon receiving edit data from the electronic device, the document can be updated by applying the edit data from the first external electronic device to the document.

A system for editing a document according to an embodiment includes an electronic device corresponding to some data edited in a document displayed on an electronic device while performing a joint editing operation capable of editing a common document by a plurality of devices. transmits the edit data to the server, and when the edit data of the first external electronic device is received from the server from the first external electronic device among the plurality of external devices, the edit data of the first external electronic device is added to the document. The electronic device may be configured to update the document by applying the document.

The system according to an embodiment, when receiving edit data of the electronic device from the electronic device, broadcasts the edit data of the electronic device to the plurality of external electronic devices, and the first of the plurality of external electronic devices 1 When receiving edit data of the first external electronic device from an external electronic device, the server may be configured to broadcast the edit data of the first external electronic device to the electronic device and the plurality of external electronic devices. .

A method of editing a document on an electronic device according to an embodiment includes editing some data in a document displayed on a display of the electronic device while performing a joint editing operation that allows editing a common document by a plurality of devices. When editing is confirmed, the operation may include transmitting edited data of an electronic device corresponding to some of the edited data to a plurality of external electronic devices through the communication module.

A method of editing a document on an electronic device according to an embodiment includes editing the document displayed on the first external electronic device from a first external electronic device among the plurality of external electronic devices through a communication module of the electronic device. When receiving edit data from a first external electronic device corresponding to some data, updating the document by applying the edit data from the first external electronic device to the document.

A method for editing a document according to an embodiment includes some data edited in a document displayed on an electronic device while performing a joint editing operation capable of editing a common document by a plurality of devices. It may include transmitting edit data of the corresponding electronic device to the server.

A method for editing a document according to an embodiment may include broadcasting the edit data of the electronic device to a plurality of external electronic devices when edit data of the electronic device is received from the electronic device by the server. You can.

A method for editing a document according to an embodiment includes, when edit data of the first external electronic device is received by the server from a first external electronic device among the plurality of external electronic devices, the first external electronic device It may include broadcasting edit data to the electronic device and the plurality of external electronic devices.

A method for editing a document according to an embodiment includes, when editing data of the first external electronic device is received from the server by the electronic device, applying the editing data of the first external electronic device to the document. Can include actions that update the document.

1 is a block diagram of an electronic device in a network environment according to an embodiment.

Figure 2 is a diagram illustrating a system for editing a document according to an embodiment.

Figure 3 is a block diagram of an electronic device according to an embodiment.

FIG. 4 is a diagram illustrating document conversion in an electronic device according to an embodiment.

FIG. 5 is a diagram for explaining a reception operation of edit data in an electronic device according to an embodiment.

FIG. 6 is a diagram illustrating an operation of separating lines from a document in an electronic device according to an embodiment.

FIGS. 7A, 7B, and 7C are diagrams for explaining an operation of generating document space area map information in a server according to an embodiment.

Figure 8 is a diagram for explaining overlapping edit data in a server according to an embodiment.

FIG. 9 is a flowchart explaining an operation of editing a document in an electronic device according to an embodiment.

FIG. 10 is a flowchart explaining an operation of editing a document in an electronic device according to an embodiment.

FIG. 11 is a flowchart illustrating an operation of broadcasting edit data from a server according to an embodiment.

FIG. 1 is a block diagram of an electronic device 101 in a network environment 100, according to one embodiment. Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with at least one of the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197. In some embodiments, at least one of these components (eg, the connection terminal 178) may be omitted, or one or more other components may be added to the electronic device 101. In some embodiments, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be.

The processor 120, for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or calculations can be performed. According to one embodiment, as at least part of data processing or computation, processor 120 stores commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134. According to one embodiment, the processor 120 includes the main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device 101 includes a main processor 121 and a secondary processor 123, the secondary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.

The auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled. According to one embodiment, coprocessor 123 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). there is. According to one embodiment, the auxiliary processor 123 (eg, neural network processing device) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (e.g., server 108). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. Memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

The input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).

The sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

Battery 189 may supply power to at least one component of electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 can be confirmed or authenticated.

The wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and access to multiple terminals (massive machine type communications (mMTC)), or ultra-reliable and low-latency (URLLC). -latency communications)) can be supported. The wireless communication module 192 may support high frequency bands (eg, mmWave bands), for example, to achieve high data rates. The wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199). According to one embodiment, the wireless communication module 192 supports peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit or receive signals or power to or from the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is, for example, connected to the plurality of antennas by the communication module 190. can be selected. Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna. According to some embodiments, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 197.

According to one embodiment, the antenna module 197 may form a mmWave antenna module. According to one embodiment, a mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the external electronic devices 102 or 104 may be of the same or different type as the electronic device 101. According to one embodiment, all or part of the operations performed in the electronic device 101 may be executed in one or more of the external electronic devices 102, 104, or 108. For example, when the electronic device 101 must perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 may perform the function or service instead of executing the function or service on its own. Alternatively, or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

FIG. 2 is a diagram 200 illustrating a system for editing a document according to an embodiment.

Referring to FIG. 2, a system for editing a document may include a plurality of devices (201, 203, 205, 207, 209, and 211) and a server (251).

The plurality of devices according to an embodiment include an electronic device 201, a first external electronic device 203, a second external electronic device 205, a third external electronic device 207, and a fourth external electronic device ( 209) and a fourth external electronic device 211.

When each of the plurality of devices 201, 203, 205, 207, 209, and 211 according to an embodiment confirms the start of a joint editing operation capable of editing a common document by a plurality of devices, the Can connect to server 251.

Each of the plurality of devices 201, 203, 205, 207, 209, and 211 according to one embodiment may store a common document.

Each of the plurality of devices 201, 203, 205, 207, 209, and 211 according to an embodiment may include an editing-related application capable of editing a common document.

The electronic device 201 among the plurality of devices 201, 203, 205, 207, 209, and 211 according to an embodiment corresponds to some data edited in a common document displayed on the electronic device 201. Edited data from the electronic device may be transmitted to the server 251.

The electronic device 201 among the plurality of devices 201, 203, 205, 207, 209, and 211 according to an embodiment is the first external electronic device among the plurality of devices from the server 251. When receiving edit data of the first external electronic device corresponding to some data edited in the common document displayed at 203, the edit data of the first external electronic device is applied to the common document to can be updated.

The configuration of the electronic device 201 can be described in detail in FIG. 3 below.

The server 251 according to one embodiment, while connected to the plurality of devices (201, 203, 205, 207, 209, and 211), the plurality of devices (201, 203, 205, 207, 209) and 211), upon receiving the edit data of the electronic device from the electronic device 201, the first external electronic device 203 and the second external Edit data of the electronic device can be broadcast to the electronic device 205, the third external electronic device 207, the fourth external electronic device 209, and the fifth external electronic device 211.

The server 251 according to one embodiment, while connected to the plurality of devices (201, 203, 205, 207, 209, and 211), the plurality of devices (201, 203, 205, 207, 209) and 211), when editing data of the first external electronic device is received from the first external electronic device 203, the electronic device 201, the second external electronic device 205, and the third external electronic device among the plurality of devices. Edit data of the first external electronic device may be broadcast to the device 207, the fourth external electronic device 209, and the fifth external electronic device 211.

The server 251 according to one embodiment, based on a plurality of index information included in a plurality of edit data received from the plurality of devices 201, 203, 205, 207, 209, and 211, the document It is possible to create and/or update spatial area map information of a document that allows the location and/or size of each of the plurality of edited data to be known. The server 251 may check the respective positions and/or sizes of the plurality of edited data in the common document based on index information indicating the location information of the device included in each of the plurality of edited data. The size of the edit data may indicate size information of the object area corresponding to the edit data in the common document, and the location of the edit data may indicate coordinate information of the object area in the common document.

The server 251 according to an embodiment, based on the spatial area map information of the document, selects the first external electronic device 203 among the plurality of devices 201, 203, 205, 207, 209, and 211. If it is confirmed that the edit data of the first external electronic device received from and the edit data of the second external electronic device received from the second external electronic device 205 are overlapping positions in the public document, based on the editing order, The edited data of the first external electronic device and the edited data of the second external electronic device are sequentially stored in the electronic device 201, the first external electronic device, among the plurality of devices 201, 203, 205, 207, 209, and 211. Device 203 (or second external electronic device 205), third external electronic device 207, fourth external electronic device 209, and fifth external electronic device 211 of the first external electronic device. Edit data can be broadcast. The server 251 may determine the editing order based on the order in which the edit data of the first external electronic device and the edit data of the second external electronic device are received or the edit time information included in the edit data. there is.

The server 251 according to an embodiment may provide index information included in the edit data of the first external electronic device among the plurality of devices 201, 203, 205, 207, 209, and 211 and the second external electronic device. Based on the index information included in the edit data of the electronic device, if the edit data of the first external electronic device and the edit data of the second external electronic device satisfy one of the following four conditions, the first It can be confirmed that the edit data of the external electronic device and the edit data of the second external electronic device overlap in the common document.

The server 251 according to an embodiment, based on index information included in the edit data of the first external electronic device, starts coordinates (r1.x, r1.y) of the edit data of the first external electronic device. ), width (r1.width), and height (r1.height) can be checked.

The server 251 according to an embodiment, based on index information included in the edit data of the second external electronic device, starts coordinates (r2.x, r2.y) of the edit data of the second external electronic device. ), width (r2.width), and height (r2.height) can be checked.

(1) r1.x <= (r2.x + r2.width)

(2) (r1.x + r1.width) >= r2.x

(3) (r1.y + r1.height) >= r2.y

(4) r1.y <= (r2.y + r2.height)

The server 251 according to an embodiment is configured to edit a first external electronic device received from the first external electronic device 203 among the plurality of devices 201, 203, 205, 207, 209, and 211. When the data capacity is confirmed to be greater than the threshold, the metadata among the metadata and original data included in the edited data of the first external electronic device is transferred to the electronic device 201 among the plurality of devices and the second external electronic device. (205), it can be broadcast to the third external electronic device 207, the fourth external electronic device 209, and the fifth external electronic device 211. After broadcasting the metadata included in the edit data of the first external electronic device, the server 251 uses a separate logical server to operate at a transmission rate lower than the transmission rate at which edit data below the threshold is broadcast. In parallel, among the plurality of devices, an electronic device 201, a second external electronic device 205, a third external electronic device 207, a fourth external electronic device 209, and a fifth external electronic device 211 You can broadcast it with .

Figure 3 is a block diagram 300 of an electronic device according to an embodiment.

Referring to FIG. 3, according to one embodiment, the electronic device 301 (e.g., the electronic device 201 of FIG. 2) includes a processor 320, a memory 330, a display 360, and a communication module. It may include (390).

At least some of the components of the electronic device 301 shown in FIG. 3 may be the same or similar to the components of the electronic device 101 of FIG. 1, and overlapping descriptions will be omitted below.

At least some of the components of the electronic device 301 shown in FIG. 3 include a plurality of external electronic devices of FIG. 2 (e.g., a plurality of external electronic devices 203, 205, 207, 209, and 211 of FIG. 2). ) may be the same or similar to the components of ), and hereinafter, overlapping descriptions will be omitted.

According to one embodiment, the processor 320 may be implemented substantially the same as or similar to the processor 120 of FIG. 1.

According to one embodiment, while performing a joint editing operation in which a common document can be edited by a plurality of devices, the processor 320 generates electronic information corresponding to some data in the document displayed on the display 360. Edited data of the device may be transmitted to a plurality of external electronic devices (eg, a plurality of external electronic devices 203, 205, 207, 209, and 211 in FIG. 2) through the communication module 390.

According to one embodiment, when the processor 320 confirms the start of a joint editing operation capable of editing a common document by a plurality of devices, the processor 320 communicates with the plurality of external electronic devices through the communication module 390. They may be connected to a connected server (e.g., server 251 in FIG. 2).

According to one embodiment, while performing the joint editing operation, the electronic device 301 (e.g., the electronic device 201 of FIG. 2) and each of the plurality of external electronic devices display the same common document. You can.

According to one embodiment, in order to perform the joint editing operation, the processor 320 executes an editing-related application capable of editing a document and edits the document through the editing-related application.

According to one embodiment, upon confirming the start of the joint editing operation, the processor 320 may convert the document displayed on the display 360 into a markup language format (eg, XML format).

According to one embodiment, when the processor 320 confirms that some data has been edited in the document converted to the markup language format, the processor 320 stores the edited data in the electronic device corresponding to the edited partial data in the document. Index information indicating the location of the edited data of the device can be detected. The processor 320 may transmit edit data of the electronic device, including index information indicating the location of the edit data of the electronic device in the document, to the server connected to the plurality of external electronic devices.

According to one embodiment, the index information may include start coordinates, area, and height of the edit data of the electronic device.

According to one embodiment, the processor 320 receives a document displayed on the display of a first external electronic device (e.g., the first external electronic device 203 in FIG. 2) among the plurality of external electronic devices from the server. Upon receiving edit data of the first external electronic device corresponding to some data edited in the electronic device, check whether there is edit data of the electronic device that has not been transmitted to the server among the edit data of the electronic device generated by the electronic device, If there is edited data of the electronic device that has not been transmitted to the server, the edited data of the electronic device that has not been transmitted to the server may be transmitted to the server.

According to one embodiment, the processor 320 receives a document displayed on the display of a first external electronic device (e.g., the first external electronic device 203 in FIG. 2) among the plurality of external electronic devices from the server. When receiving edit data of the first external electronic device corresponding to some data edited in , index information indicating the location of the edit data of the first external electronic device included in the edit data of the first external electronic device can be confirmed. there is. The processor 320 determines the location of the edit data of the first external electronic device in the document converted to the markup language format based on index information indicating the location of the edit data of the first external electronic device, , the document may be updated by applying the edit data of the first external electronic device to the confirmed location of the edit data of the first external electronic device.

According to one embodiment, the processor 320 is configured to edit a document displayed on the display of a first external electronic device (e.g., the first external electronic device 203 in FIG. 2) among the plurality of external electronic devices. When the edited data of the first external electronic device corresponding to some data has a capacity greater than or equal to a threshold value, receiving the metadata among the metadata and original data included in the edited data of the first external electronic device from the server, The location of the edited data of the first external electronic device in the document can be confirmed based on index information indicating the location of the edited data of the first external electronic device included in the metadata. The processor 320 may display an arbitrary graphic object at the location of the edited data of the confirmed first external electronic device. The processor 320 may display an arbitrary graphic object that can indicate that it is waiting to receive original data (eg, image data) included in the edited data of the first external electronic device.

According to one embodiment, while displaying the arbitrary graphic object at the location of the edit data of the first external electronic device, the processor 320 receives information included in the edit data of the first external electronic device from the server. Upon receiving the original data, display of the arbitrary graphic object may be canceled at the location of the edited data of the first external electronic device, and the received original data may be displayed.

According to one embodiment, the memory 330 may be implemented substantially the same as or similar to the memory 130 of FIG. 1 .

According to one embodiment, in the memory 330, a common memory that can be jointly edited by a plurality of devices (e.g., the plurality of devices 201, 203, 205, 207, 209, and 211 of FIG. 2) is stored in the memory 330. of documents can be saved.

According to one embodiment, the display 360 may be implemented substantially the same as or similar to the display module 160 of FIG. 1.

According to one embodiment, a common message that can be jointly edited by a plurality of devices (e.g., the plurality of devices 201, 203, 205, 207, 209, and 211 of FIG. 2) is displayed on the display 360. The document can be displayed.

According to one embodiment, the communication module 390 may be implemented substantially the same as or similar to the communication module 190 of FIG. 1 and may include a plurality of communication circuits using different communication technologies.

According to one embodiment, the communication module 390 may include at least one of a wireless LAN module (not shown) and a short-range communication module (not shown), and the short-range communication module (not shown) may be used to wide band) communication module, Wi-Fi communication module, NFC communication module, Bluetooth legacy communication module, and/or BLE communication module.

According to one embodiment, while performing a joint editing operation in which a common document can be edited by a plurality of devices through the communication module 390, some data edited in the document displayed on the display 360 The edited data of the corresponding electronic device is sent to a server connected to a plurality of external electronic devices (e.g., the plurality of external electronic devices 203, 205, 207, 209, and 211 of FIG. 2) (e.g., the server 251 of FIG. 2). )).

According to one embodiment, while performing a joint editing operation in which a common document can be edited by a plurality of devices through the communication module 390, a plurality of external electronic devices (e.g., FIG. Editing data of the external electronic device corresponding to some data edited in the document displayed on at least one external electronic device among the plurality of external electronic devices 203, 205, 207, 209, and 211 may be received. .

FIG. 4 is a diagram 400 for explaining document conversion in an electronic device according to an embodiment.

Referring to FIG. 4, an electronic device (e.g., the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2, and/or the electronic device 301 of FIG. 3) is shared by a plurality of devices. Upon confirming the start of a joint editing operation capable of editing a document, the document 411 displayed on the display of the electronic device (e.g., display 360 in FIG. 3) is displayed in a markup language format, for example, XML (extensible It can be converted into a document (431) in markup language format.

The electronic device can edit a plurality of various objects included in a document using an editing-related application that can edit a document, and when saving the edited document, a plurality of objects included in one note of the document are used. Unique properties for multiple objects (e.g., body text, stroke, text box, image, shape, and/or voice) included in each page can be maintained and stored. However, since independent updating is difficult because the plurality of objects are related to each other, the electronic device converts the document 411 into a document 431 in XML (extensible markup language) format, which is a markup language format. By converting, simultaneous editing can be made possible while minimizing interdependence between the plurality of objects.

The electronic device converts the hierarchically structured document 411 into a horizontally structured XML (extensible markup language) format document 431 and then transmits only some edited data of the document 431 to the server. You can.

FIG. 5 is a diagram 500 for explaining an operation of receiving edit data in an electronic device according to an embodiment.

Referring to FIG. 5, as shown in the <510> screen, an electronic device (e.g., the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2, and/or the electronic device 301 of FIG. 3), While performing a joint editing operation in which a common document can be edited by a plurality of devices, the document 511 may be displayed on the display (eg, display 360 of FIG. 3) of the electronic device.

The electronic device is a first external electronic device (e.g., the first external electronic device of FIG. 2) among a plurality of external electronic devices (e.g., the plurality of external electronic devices 203, 205, 207, 209, and 211 of FIG. 2). If the edit data of the first external electronic device corresponding to some data edited in the document displayed on the display of the electronic device 203 has a capacity greater than or equal to the threshold, the data from the server (e.g., server 251 in FIG. 2) The metadata may be received among the metadata and original data included in the edited data of the first external electronic device. According to one embodiment, a first external electronic device (e.g., the first external electronic device of FIG. 2) among a plurality of external electronic devices (e.g., a plurality of external electronic devices 203, 205, 207, 209, and 211 of FIG. 2). If the edited data of the first external electronic device corresponding to some data edited in the document displayed on the display of the external electronic device 203 is designated content (e.g., image, video, audio), the server (e.g., FIG. 2) The metadata among the metadata and original data included in the edited data of the first external electronic device may be received from the server 251 of .

The electronic device determines the location of the edited data of the first external electronic device in the document 511 based on index information indicating the location of the edited data of the first external electronic device included in the metadata, An arbitrary graphic object 511a may be displayed at the location of the edited data of the confirmed first external electronic device.

The electronic device may display an arbitrary graphic object 511a at the location of the edited data of the first external electronic device and then wait to receive the original data included in the edited data of the first external electronic device.

As shown in screen <530>, the electronic device displays an arbitrary graphic object 511a at the location of the edited data of the first external electronic device, included in the edited data of the first external electronic device from the server. Upon receiving the original data, the display of the arbitrary graphic object may be canceled at the location of the edited data of the first external electronic device, and image data 531b, which is the received original data, may be displayed.

FIG. 6 is a diagram 600 for explaining an operation of separating lines from a document in an electronic device according to an embodiment.

Referring to FIG. 6, as shown in the <610> screen, an electronic device (e.g., the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2, and/or the electronic device 301 of FIG. 3), While performing a joint editing operation in which a common document can be edited by a plurality of devices, the document 611 may be displayed on the display (eg, display 360 of FIG. 3) of the electronic device.

As shown in screen <630>, when the body text area of the document 611 includes many sentences, it is difficult to edit many sentences at once, so the electronic device divides the sentences by row by referring to the line break information. Work areas can be distinguished.

In addition, when many sentences in the body text area of the document 611 are handwritten, the electronic device divides the sentences into rows based on an algorithm related to handwriting recognition or an AI (artificial intelligence)-based line separation technology. can be distinguished.

FIGS. 7A, 7B, and 7C are diagrams 700a, 700b, and 700c for explaining an operation of generating document space area map information in a server according to an embodiment.

Referring to FIG. 7A, a server (e.g., server 251 in FIG. 2) includes a first external electronic device (A) (e.g., first external electronic device 203 in FIG. 2) and an electronic device (B). (e.g., the electronic device 201 in FIG. 2), the third external electronic device (C) (e.g., the third external electronic device 207 in FIG. 2), and the second external electronic device (D) (e.g., in FIG. 2 Based on a plurality of index information included in a plurality of edit data received from a plurality of devices including the third external electronic device 205 of and , the plurality of edit data in the document displayed on the plurality of devices It is possible to generate spatial area map information of a document that allows the location and/or size of the document to be known.

The server provides index information included in the edit data of the first external electronic device (A) received from the first external electronic device (A) among the plurality of devices and the third external electronic device (C) received from the third external electronic device (C). Based on the index information included in the edit data of the device, a first object area where the edit data 701 of the first external electronic device and the edit data 703 of the third external electronic device overlap in the document (a1), and the spatial area map of the document through which the first object area (a1) can be confirmed as an object area where the first external electronic device and the third external electronic device edit some data in the document. Information can be generated.

The server generates edit data 705 of the second external electronic device based on index information included in the edit data of the second external electronic device received from the second external electronic device D among the plurality of devices. A spatial area of the document that can confirm that is the second object area (a2) in the document, and confirm that the second object area (a2) is an object area in which the second external electronic device has edited some data in the document. Map information can be created.

The server determines the third object area ( a3), and spatial area map information of the document can be generated that can identify the third object area a3 as an object area in which the electronic device edited some data in the document.

Referring to FIGS. 7B to 7C, a server (e.g., server 251 of FIG. 2) operates the plurality of devices (e.g., plural devices 201, 203, 205, 207, 209 of FIG. 2). And based on at least one edit data received from 211)), spatial area map information of the document can be updated and generated in real time.

The server receives edit data from the plurality of devices, defines a timeout as the time until broadcasting of the received edit data is completed, and updates and generates spatial area map information of the document based on the timeout. You can.

The server sets the timeout to 2 seconds, the first external electronic device (A) and the third external electronic device (C) edit the first object area, and the second external electronic device (D) edits the second object area. Assuming that the electronic device (B) edits the third object area, the first external electronic device (A), the electronic device (B), and the third external electronic device ( When both C) and the second external electronic device (D) confirm that each object area has been edited, spatial area map information of a document such as 711a can be generated. The server may store edit data of the first external electronic device, which is edit data for the first object area a1 that the first external electronic device and the third external electronic device are editing together, and the edit data of the third external electronic device. Edit data may be broadcast to the first external electronic device (A) (or third external electronic device (C)), electronic device (B), and second external electronic device (D) based on the editing order. The server transmits edit data of the second external electronic device (A), which is edit data for the second object area (a2) being edited by the second external electronic device (D), in real time to the first external electronic device (A). ), the electronic device (B), and a third external electronic device (C). The server transmits edit data of the electronic device, which is edit data for the third object area (a3) being edited by the electronic device, to the first external electronic device (A) and the third external electronic device (A) in real time. C) and the second external electronic device (D)) can be broadcasted.

As shown in 713, during 4 seconds after an additional 2 seconds, if the first external electronic device (A) and the third external electronic device (C) confirm editing of the first object area (a1), 713a It can be created by converting the spatial area map information of a document such as . The server is configured to store the edit data of the first external electronic device, which is edit data for the first object area a1 that the first external electronic device and the third external electronic device are editing together, and the edit data of the third external electronic device. Edit data may be broadcast to the first external electronic device (A) (or third external electronic device (C)), electronic device (B), and second external electronic device (D) based on the editing order.

As shown in 715, for 6 seconds with an additional 2 seconds, the server receives information from the first external electronic device (A), the electronic device (B), the third external electronic device (C), and the second external electronic device (D). If edit data is not received, spatial area map information of a document such as 715a can be generated.

As shown in 717, for 8 seconds after an additional 2 seconds, if the server confirms that the third object area (a3) has been edited in the electronic device (B), it converts and generates spatial area map information of the document such as 717a. You can. The server transmits edit data of the electronic device, which is edit data for the third object area (a3) being edited by the electronic device (B), to the first external electronic device (A) and the third external electronic device in real time. It can be broadcast to (C) and a second external electronic device (D).

As shown in 719, for 10 seconds with an additional 2 seconds, the server edits the third object area (a3) in the electronic device (B) and edits the first object area (a1) in the third external electronic device (C). When the area is edited and the editing of the second object area (a2) is confirmed in the second external electronic device (D), the spatial area map information of the document such as 719a can be converted and generated. The server transmits edit data for the third object area (a3) being edited by the electronic device (B) to the first external electronic device (A), the third external electronic device (C), and the third external electronic device (C) in real time. 2 Can be broadcast to external electronic devices (D). The server transmits edit data for the first object area (a1) being edited by the third external electronic device (C) to the first external electronic device (A), the electronic device (B), and the third external electronic device (C) in real time. 2 Can be broadcast to external electronic devices (D). The server transmits edit data for the second object area (a2) being edited in the second external electronic device (D) to the first external electronic device (A), the electronic device (B), and the second external electronic device (D) in real time. 3 Can be broadcast to external electronic devices (C).

As shown in 721, for 12 seconds with an additional 2 seconds, the server allows the first external electronic device (A) and the third external electronic device (C) to edit the first object area (a1) and the second external electronic device (C) to edit the first object area (a1). If the device D confirms that the second object area a2 has been edited, spatial area map information of the document such as 721a can be generated. The server may store edit data of the first external electronic device, which is edit data for the first object area a1 that the first external electronic device and the third external electronic device are editing together, and the edit data of the third external electronic device. Edit data may be broadcast to the first external electronic device (A) (or third external electronic device (C)), electronic device (B), and second external electronic device (D) based on the editing order. The server transmits edit data of the second external electronic device, which is edit data for the second object area (a2) being edited by the second external electronic device (D), to the first external electronic device (A) in real time. , can be broadcast to the electronic device (B) and a third external electronic device (C).

FIG. 8 is a diagram 800 for explaining overlapping edit data in a server according to an embodiment.

Referring to FIG. 8, the server (e.g., server 251 in FIG. 2), as shown in 811, creates an object area of the edited data where some data has been edited in the document in the spatial area map information of the document in a rectangular shape. It can be defined as: By comparing rectangle-shaped object areas, the server can identify overlapping and non-overlapping object areas.

As shown in 813, the server may define an object area of edited data in which some data in the document is edited in the form of a polygon in the spatial area map information of the document. The server may connect control points and identify overlapping object areas and non-overlapping object areas based on comparison of areas formed by closed curves.

An electronic device (101 in FIG. 1; 201 in FIG. 2; 301 in FIG. 3) according to an embodiment includes a communication module (190 in FIG. 1; 390 in FIG. 2) and a display (160 in FIG. 1; 360 in FIG. 3). ); and a processor (120 in FIG. 1; 320 in FIG. 3).

The processor (120 in FIG. 1; 320 in FIG. 3) according to an embodiment may, while performing a joint editing operation capable of editing a common document by a plurality of devices, edit a portion of the document displayed on the display. When editing of data is confirmed, the edited data of the electronic device corresponding to some of the edited data can be transmitted to a plurality of external electronic devices (203, 205, 207, 209, and 211 in FIG. 2) through the communication module.

According to one embodiment, the processor (120 in FIG. 1; 320 in FIG. 3) receives the first external electronic device from the first external electronic device (203 in FIG. 2) among the plurality of external electronic devices through the communication module. When receiving edit data from the first external electronic device corresponding to some data edited in the document displayed on the device, the edit data from the first external electronic device can be applied to the document to update the document.

According to one embodiment, when the processor (120 in FIG. 1; 320 in FIG. 3) confirms the start of the joint editing operation, it connects the electronic device to a server (251 in FIG. 2) connected to the plurality of external electronic devices. You can connect with

According to one embodiment, when the processor (120 in FIG. 1; 320 in FIG. 3) confirms the start of the joint editing operation, it converts the document into a markup language format and converts the document into the markup language format. The edited data of the electronic device corresponding to some edited data in the document may be transmitted to the plurality of external electronic devices, including index information indicating the location of the edited data of the electronic device.

When the processor (120 in FIG. 1; 320 in FIG. 3) according to an embodiment receives edit data of the first external electronic device configured in a markup language format from the first external electronic device, the processor (120 in FIG. 1; 320 in FIG. 3) according to an embodiment Based on index information indicating the location of the edit data of the second external electronic device included in the edit data of the device, the location of the edit data of the first external electronic device can be confirmed in the document converted to markup language format. there is.

The processor (120 in FIG. 1; 320 in FIG. 3) according to an embodiment applies the edit data of the first external electronic device to the position of the edit data of the first external electronic device in the document to edit the document. It can be updated.

According to one embodiment, the processor (120 in FIG. 1; 320 in FIG. 3), when receiving edit data of the first external electronic device having a capacity greater than a threshold from the first external electronic device, The metadata may be received among metadata and original data included in edited data of an external electronic device.

The processor (120 in FIG. 1; 320 in FIG. 3) according to an embodiment may select the first information from the document based on index information indicating location information of the edit data of the first external electronic device included in the metadata. 1 The location of the edited data of the external electronic device can be confirmed, and an arbitrary graphic can be displayed at the location of the edited data of the first external electronic device.

The processor (120 in FIG. 1; 320 in FIG. 3) according to an embodiment may display the arbitrary graphic at the location of the edit data of the first external electronic device while displaying the arbitrary graphic at the location of the edit data of the first external electronic device. Upon receiving the original data, the arbitrary graphic display may be canceled and the original data of the edited data of the first external electronic device may be displayed at the location of the edited data of the first external electronic device.

A system according to an embodiment may, while performing a joint editing operation capable of editing a common document by a plurality of devices, edit data of the electronic device corresponding to some data edited in the document displayed on the electronic device. Transmits to the server, and edits data of the first external electronic device (203 in FIG. 2) among the plurality of external devices (203, 205, 207, 209, and 211 in FIG. 2) from the server. When received, the electronic device (101 in FIG. 1; 201 in FIG. 2; 301 in FIG. 3) is set to update the document by applying the edit data of the first external electronic device to the document.

The system according to one embodiment, when receiving edit data of the electronic device from the electronic device, broadcasts the edit data of the electronic device to the plurality of external electronic devices, and broadcasts the edit data of the electronic device to the plurality of external electronic devices, and the first of the plurality of external electronic devices When receiving edit data of the first external electronic device from an external electronic device, the server (251 in FIG. 2) is configured to broadcast the edit data of the first external electronic device to the electronic device and the plurality of external electronic devices. may include.

The electronic device (101 in FIG. 1; 201 in FIG. 2; 301 in FIG. 3) of the system according to one embodiment may convert the document into a markup language format when confirming the start of the joint editing operation. .

The electronic device (101 in FIG. 1; 201 in FIG. 2; 301 in FIG. 3) of the system according to one embodiment is the electronic device corresponding to partially edited data in the document converted to the markup language format. The edited data may be transmitted to the server including index information indicating the location of the edited data on the electronic device.

The server (251 in FIG. 2) of the system according to one embodiment is based on index information included in the edit data of the electronic device and a plurality of index information included in each of the edit data of the plurality of external electronic devices, Spatial area map information of the document can be generated that can determine the location and size of the edited data of the electronic device and the edited data of the plurality of external electronic devices in the document.

The server (251 in FIG. 2) of the system according to an embodiment may, based on the document space area map information, edit data of a first external electronic device and edit data of a second external electronic device among the edit data of the plurality of external electronic devices. When it is confirmed that the edit data of the device overlaps in the document, the edit data of the first external electronic device and the edit data of the second external electronic device are sequentially copied to the electronic device and the plurality of external electronic devices based on the editing order. It can be broadcast to electronic devices.

The server (251 in FIG. 2) of the system according to one embodiment, if the capacity of the edited data of the electronic device is more than a threshold, selects the metadata among the metadata and original data included in the edited data of the electronic device. It can be transmitted to the plurality of external electronic devices.

After transmitting the metadata to the plurality of external electronic devices, the server (251 in FIG. 2) of the system according to one embodiment transmits the metadata at a lower transmission rate than the edit data having a capacity of more than a threshold through a separate logical server. The original data of the edited data of the electronic device can be broadcast to the plurality of external electronic devices.

FIG. 9 is a flowchart 900 for explaining an operation of editing a document in an electronic device according to an embodiment. Operations for editing the document may include operations 901 to 915. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, at least two operations may be performed in parallel, or another operation may be added.

In operation 901, when the electronic device (e.g., the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2, and/or the electronic device 301 of FIG. 3) confirms the start of a joint editing operation, a plurality of It can be connected to a server connected to external electronic devices.

According to one embodiment, while performing the joint editing operation, each of the electronic device and the plurality of external electronic devices may display the same common document.

According to one embodiment, in order to perform the joint editing operation, the electronic device executes an editing-related application capable of editing a document and edits the document through the editing-related application.

In operation 903, the electronic device (e.g., the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2, and/or the electronic device 301 of FIG. 3) displays the display of the electronic device (e.g., the electronic device 301 of FIG. 3). The document displayed on the display 360 can be converted into a markup language format.

According to one embodiment, upon confirming the start of the joint editing operation, the electronic device may convert the document displayed on the display of the electronic device into an extensible markup language (XML) format.

In operation 905, the electronic device (e.g., the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2, and/or the electronic device 301 of FIG. 3) displays the display of the electronic device (e.g., the electronic device 301 of FIG. 3). It is possible to check whether some data has been edited in the document displayed on the display 360).

In operation 905, if the electronic device confirms that some data in the document has been edited, in operation 907, the electronic device may transmit the edited data of the electronic device corresponding to some data edited in the document to a plurality of external electronic devices. .

According to one embodiment, when the electronic device confirms that some data has been edited in a document converted to the markup language format, it can detect index information indicating the location of the edited data of the electronic device in the document.

According to one embodiment, the electronic device may transmit edit data of the electronic device including index information indicating the location of the edit data of the electronic device to the server connected to the plurality of external electronic devices.

According to one embodiment, the index information may include start coordinates, area, and height of the edit data of the electronic device.

In operation 905, if the electronic device fails to confirm that some data has been edited in the document, in operation 909, the electronic device determines whether to receive edit data of the first external electronic device from the first external electronic device among the plurality of external electronic devices. You can check it.

In operation 909, when the electronic device confirms receipt of edit data of the first external electronic device from the first external electronic device, in operation 911, the electronic device applies the edit data of the first external electronic device to the document to create the document. It can be updated.

According to one embodiment, the electronic device edits a document displayed on a display of a first external electronic device (e.g., the first external electronic device 203 in FIG. 2) among the plurality of external electronic devices from the server. When receiving edit data of the first external electronic device corresponding to some data, index information indicating the location of the edit data of the first external electronic device included in the edit data of the first external electronic device can be confirmed.

According to one embodiment, the electronic device selects the edited data of the first external electronic device from the document converted into the markup language format based on index information indicating the location of the edited data of the first external electronic device. The location may be confirmed, and the document may be updated by applying the edit data of the first external electronic device to the confirmed location of the edit data of the first external electronic device.

If, in operation 909, the electronic device fails to confirm receipt of edit data of the first external electronic device from the first external electronic device, in operation 913, the electronic device may check whether the joint editing operation has ended.

In operation 913, if the electronic device confirms the end of the joint editing operation, the electronic device may store the last updated document in operation 915.

According to one embodiment, the electronic device may store the last updated document in the memory of the electronic device (eg, memory 330 in FIG. 3).

If the electronic device fails to confirm the end of the joint editing operation in operation 913, it may perform operation 905.

FIG. 10 is a flowchart 1000 for explaining an operation of editing a document in an electronic device according to an embodiment. Operations for editing the document may include operations 1001 to 1009. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, at least two operations may be performed in parallel, or another operation may be added.

In operation 1001, when the electronic device (e.g., the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2, and/or the electronic device 301 of FIG. 3) confirms the start of a joint editing operation, a plurality of It can be connected to a server connected to external electronic devices.

According to one embodiment, while performing the joint editing operation, each of the electronic device and the plurality of external electronic devices may display the same common document.

According to one embodiment, in order to perform the joint editing operation, the electronic device executes an editing-related application capable of editing a document and edits the document through the editing-related application.

In operation 1003, the electronic device (e.g., the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2, and/or the electronic device 301 of FIG. 3) is included in the edit data of the first external electronic device. You can confirm receipt of the received metadata.

According to one embodiment, the electronic device includes some data edited in a document displayed on a display of a first external electronic device (e.g., the first external electronic device 203 in FIG. 2) among a plurality of external electronic devices. If the edit data of the corresponding first external electronic device has a capacity greater than the threshold, the metadata and original data included in the edit data of the first external electronic device are sent from a server (e.g., server 251 in FIG. 2). The meta data can be received.

According to one embodiment, the electronic device may include some data edited in a document displayed on a display of a first external electronic device (e.g., the first external electronic device 203 of FIG. 2) among a plurality of external electronic devices. If the edit data of the corresponding first external electronic device is designated content (e.g., image, video, audio), the edit data included in the edit data of the first external electronic device is sent from a server (e.g., server 251 of FIG. 2). The meta data may be received among meta data and original data.

In operation 1005, the electronic device (e.g., the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2, and/or the electronic device 301 of FIG. 3) collects edit data of the first external electronic device from the document. Any graphic can be displayed at the location of .

According to one embodiment, the electronic device determines the location of the edited data of the first external electronic device in the document based on index information indicating the location of the edited data of the first external electronic device included in the metadata. You can check it.

According to one embodiment, the electronic device may display an arbitrary graphic object at the location of the edited data of the first external electronic device identified in the document.

In operation 1007, the electronic device (e.g., the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2, and/or the electronic device 301 of FIG. 3) includes edit data of the first external electronic device. You can confirm receipt of the original data.

According to one embodiment, the electronic device displays the original data included in the edited data of the first external electronic device from the server while displaying an arbitrary graphic object at the location of the edited data of the first external electronic device. can receive.

According to one embodiment, the electronic device may receive the original data at a transmission rate lower than the transmission rate at which edit data below the threshold is broadcast through a separate logical server included in the server.

In operation 1009, the electronic device (e.g., the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2, and/or the electronic device 301 of FIG. 3) collects edit data of the first external electronic device from the document. The original data can be displayed at the location of .

According to one embodiment, the electronic device may cancel display of the arbitrary graphic object at the location of the edited data of the first external electronic device and display the received original data (e.g., image data). .

FIG. 11 is a flowchart 1100 illustrating an operation of broadcasting edit data from a server according to an embodiment. Operations for broadcasting the edit data may include operations 1101 to 1117. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, at least two operations may be performed in parallel, or another operation may be added.

In operation 1101, a server (e.g., the server 251 of FIG. 2) uses a plurality of devices (e.g., the electronic device 201 of FIG. 2, the first external electronic device 203, It can be connected to the second external electronic device 205 and the third external electronic device 207.

In operation 1103, the server (eg, server 251 of FIG. 2) may receive edit data from the first external electronic device (eg, first external electronic device 203 of FIG. 2).

According to one embodiment, the server may receive editing data in real time from the plurality of devices.

According to one embodiment, the server may receive edit data from the first external electronic device among the plurality of devices.

In operation 1105, the server (e.g., server 251 in FIG. 2) may determine whether the capacity of the edited data of the first external electronic device is greater than or equal to a threshold value.

In operation 1105, if the server determines that the capacity of the edit data of the first external electronic device is less than or equal to the threshold value, in operation 1107, the server generates spatial area map information of the document based on the edit data of the first external electronic device. Can be created or updated.

The server 251 according to an embodiment knows the location and/or size of the edited data of the first external electronic device in the document, based on index information included in the edited data of the first external electronic device. You can create or update spatial area map information of a document.

According to one embodiment, the server determines the location of the edit data in the document based on index information indicating the location of the edit data of the first external electronic device included in the edit data of the first external electronic device and/ Or you can check the size.

In operation 1109, the server (e.g., server 251 in FIG. 2) determines that there is edit data of a third external electronic device whose location overlaps with edit data of the first external electronic device based on spatial area map information of the document. You can check if it does.

According to one embodiment, based on spatial area map information of the document, the server stores edit data of the third external electronic device whose location overlaps with the edit data of the first external electronic device and is not currently broadcast. You can check if it exists.

In operation 1109, if the server confirms the existence of edit data of a third external electronic device whose location overlaps with the edit data, in operation 1111, the server edits the edit data of the first external electronic device and the third external electronic device based on the editing order. 3 Editing data from external electronic devices can be broadcast sequentially.

According to one embodiment, the server may receive edit data of a third external electronic device (e.g., the third external electronic device 207 of FIG. 2) among the plurality of devices. .

According to one embodiment, the server sequentially transmits edit data of the first external electronic device and edit data of the third external electronic device to the plurality of devices (e.g., the electronic device of FIG. 2) based on the editing order. (201), it can be broadcast to the first external electronic device 203 (or the third external electronic device 207 and the second external electronic device 205).

According to one embodiment, the server determines the editing order based on the order in which the edit data of the first external electronic device and the edit data of the third external electronic device are received or the edit time information included in the edit data. can do.

In operation 1109, if the server does not confirm the existence of edit data of the third external electronic device whose location overlaps with the edit data of the second external electronic device, in operation 1113, the server selects the edit data of the second external electronic device. Data can be broadcast.

According to one embodiment, the server, regardless of order, edits data of the second external electronic device to the plurality of devices (e.g., the electronic device 201 of FIG. 2, the first external electronic device 203, and , can be broadcast to a third external electronic device 207).

In operation 1105, if the server determines that the capacity of the edit data of the first external electronic device is greater than or equal to the threshold value, in operation 1115, the server broadcasts metadata included in the edit data of the first external electronic device. You can.

According to one embodiment, the server stores the metadata among the metadata and original data included in the edited data among the plurality of devices (e.g., the electronic device 201 of FIG. 2, a first external electronic field ( 203) and a third external electronic device 207).

In operation 1117, the server may broadcast original data included in the edited data of the first external electronic device.

According to one embodiment, after broadcasting the metadata included in the edit data of the first external electronic device, the server uses a separate logical server to lower the transmission rate at which edit data below the threshold is broadcast. The original data included in the edited data of the first external electronic device is transmitted to the plurality of devices (e.g., the electronic device 201 of FIG. 2, the first external electronic field 203, and the third external electronic device) at a transmission rate. (207)).

According to one embodiment, the server, in parallel, uses a separate logical server while the original data included in the edited data of the first external electronic device is broadcasted below the threshold. It can be broadcast to devices (e.g., the electronic device 201 of FIG. 2, the first external electronic field 203, and the third external electronic device 207).

A method of editing a document in an electronic device according to an embodiment includes editing some data in a document displayed on a display of the electronic device while performing a joint editing operation in which a common document can be edited by a plurality of devices. When editing is confirmed, the operation may include transmitting edited data of an electronic device corresponding to some of the edited data to a plurality of external electronic devices through the communication module.

A method of editing a document in an electronic device according to an embodiment includes editing the document displayed on the first external electronic device from a first external electronic device among the plurality of external electronic devices through a communication module of the electronic device. When receiving edit data from a first external electronic device corresponding to some data, updating the document by applying the edit data from the first external electronic device to the document.

The method of editing a document in an electronic device according to an embodiment may further include connecting the electronic device to a server connected to the plurality of external electronic devices upon confirming the start of the joint editing operation.

A method of editing a document in an electronic device according to an embodiment may include converting the document into a markup language format upon confirming the start of the joint editing operation.

A method of editing a document in an electronic device according to an embodiment includes indicating the location of the edit data of the electronic device in the edit data of the electronic device corresponding to partially edited data in the document converted to the markup language format. The method may further include transmitting index information to the plurality of external electronic devices.

In the method of editing a document in an electronic device according to an embodiment, the operation of updating the document includes receiving edit data of the first external electronic device in a markup language format from the first external electronic device, Based on index information indicating the location of the edit data of the second external electronic device included in the edit data of the external electronic device, the location of the edit data of the first external electronic device is determined in the document converted into markup language format. May include confirmation actions.

In the method of editing a document in an electronic device according to an embodiment, the operation of updating the document includes applying the edit data of the first external electronic device to the position of the edit data of the first external electronic device in the document. Can include actions that update the document.

A method of editing a document in an electronic device according to an embodiment includes, when receiving edit data of the first external electronic device having a capacity greater than a threshold from the first external electronic device, editing of the first external electronic device. It may include an operation of receiving metadata among metadata and original data included in the data.

A method of editing a document in an electronic device according to an embodiment includes the method of editing a document in the document based on index information indicating location information of the edit data of the first external electronic device included in the metadata. The operation may include confirming the location of the edited data and displaying an arbitrary graphic at the location of the edited data of the first external electronic device.

A method of editing a document in an electronic device according to an embodiment includes receiving original data of the edit data of the first external electronic device while displaying the arbitrary graphic at the location of the edit data of the first external electronic device. If so, the method may further include canceling the arbitrary graphic display and displaying original data of the edited data of the first external electronic device at the location of the edited data of the first external electronic device.

A method of editing a document according to an embodiment includes some data edited in a document displayed on the electronic device while performing a joint editing operation capable of editing a common document by a plurality of devices. It may include transmitting edit data of the corresponding electronic device to the server.

A method of editing a document according to an embodiment may include broadcasting the edit data of the electronic device to a plurality of external electronic devices when edit data of the electronic device is received from the electronic device by the server. You can.

A method of editing a document according to an embodiment includes, when edit data of the first external electronic device is received by the server from a first external electronic device among the plurality of external electronic devices, the first external electronic device It may include broadcasting edit data to the electronic device and the plurality of external electronic devices.

A method of editing a document according to an embodiment includes, when edit data of the first external electronic device is received from the server by the electronic device, the edit data of the first external electronic device is applied to the document. Can include actions that update the document.

A method of editing a document according to an embodiment may include converting the document into a markup language format when the electronic device confirms the start of the joint editing operation.

A method of editing a document according to an embodiment includes editing data of the electronic device corresponding to some edited data in the document converted into the markup language format by the electronic device, and editing data of the electronic device. It may further include transmitting to the server including index information indicating the location.

A method of editing a document according to an embodiment includes, by the server, based on index information included in the edit data of the electronic device and a plurality of index information included in each of the edit data of the plurality of external electronic devices, The method may further include generating spatial area map information of the document that can determine the positions and sizes of the edited data of the electronic device and the edited data of the plurality of external electronic devices in the document.

A method of editing a document according to an embodiment includes editing data of a first external electronic device and edit data of a second external electronic device among the edit data of the plurality of external electronic devices based on the document space area map information by the server. When it is confirmed that the edit data of the device is at an overlapping position in the document, the edit data of the first external electronic device and the edit data of the second external electronic device are sequentially stored in the electronic device and the plurality of external electronic devices based on the editing order. It may further include broadcasting to electronic devices.

A method of editing a document according to an embodiment includes, when the capacity of the edited data of the electronic device is greater than or equal to a threshold, the server selects the metadata among the metadata and original data included in the edited data of the electronic device. It may include transmitting to the plurality of external electronic devices.

A method of editing a document according to an embodiment is by the server. After transmitting the metadata, an operation of broadcasting the original data of the edited data of the electronic device to the plurality of external electronic devices at a lower transmission rate than the edited data having a capacity greater than a threshold through a separate logical server is further performed. It can be included.

An electronic device according to an embodiment disclosed in this document may be of various types. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the above-described devices.

An embodiment of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various changes, equivalents, or substitutes for the embodiment. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one component from another, and to refer to those components in other respects (e.g., importance or order) is not limited. One (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.” Where mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term “module” used in one embodiment of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. can be used A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

An embodiment of this document is a storage medium (e.g., built-in memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101 or electronic device 301). ) may be implemented as software (e.g., program 140) including one or more instructions stored in . For example, a processor (e.g., processor 520) of a device (e.g., electronic device 301) may call at least one command among one or more commands stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves). This term refers to cases where data is stored semi-permanently in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, a method according to an embodiment disclosed in this document may be provided and included in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store ^TM ) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to one embodiment, each component (e.g., module or program) of the above-described components may include a single or multiple entities, and some of the multiple entities may be separately placed in other components. . According to one embodiment, one or more of the above-described corresponding components or operations may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component of the plurality of components prior to the integration. . According to one embodiment, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or , or one or more other operations may be added.

According to an embodiment of the present disclosure, in a non-volatile storage medium storing instructions, the instructions are set to cause the electronic device to perform at least one operation when executed by the electronic device, and the at least one operation is , While performing a joint editing operation in which a common document can be edited by a plurality of devices, if editing of some data in the document displayed on the display of the electronic device is confirmed, the electronic device corresponding to the edited partial data transmitting edit data to a plurality of external electronic devices through the communication module, and from a first external electronic device among the plurality of external electronic devices to the first external electronic device through the communication module of the electronic device. Upon receiving edit data from a first external electronic device corresponding to some data edited in the displayed document, updating the document by applying the edit data from the first external electronic device to the document. .

According to an embodiment of the present disclosure, in a non-volatile storage medium storing instructions, the instructions are set to cause the electronic device to perform at least one operation when executed by the electronic device, and the at least one operation is , while performing a joint editing operation in which a common document can be edited by a plurality of devices by an electronic device, editing data of the electronic device corresponding to some data edited in the document displayed on the electronic device is sent to the server. An operation of transmitting, by the server, upon receiving the edit data of the electronic device from the electronic device, an operation of broadcasting the edit data of the electronic device to a plurality of external electronic devices, by the server, the plurality of external electronic devices When receiving edit data of the first external electronic device from a first external electronic device among electronic devices, broadcasting the edit data of the first external electronic device to the electronic device and the plurality of external electronic devices, and The method may include updating the document by applying the edit data of the first external electronic device to the document when the edit data of the first external electronic device is received from the server by the electronic device.

Claims (15)

In electronic devices, Communication module (190 in FIG. 1; 390 in FIG. 2); Display (160 in Figure 1; 360 in Figure 3); Processor (120 in Figure 1; 320 in Figure 3); and Includes a memory (e.g., 130 in FIG. 1; 330 in FIG. 3) that stores instructions, wherein the instructions, when executed by the processor, cause the electronic device to: While performing a joint editing operation that allows editing a common document by a plurality of devices, if editing of some data in the document displayed on the display is confirmed, editing data of the electronic device corresponding to the edited partial data is stored. Transmit to a plurality of external electronic devices (203, 205, 207, 209, and 211 in FIG. 2) through the communication module, From the first external electronic device (203 in FIG. 2) among the plurality of external electronic devices through the communication module, a first external electronic device corresponding to some data edited in the document displayed on the first external electronic device An electronic device configured to update the document by applying the edit data of the first external electronic device to the document upon receiving edit data. The method of claim 1, wherein the instructions, when executed by the processor, cause the electronic device to, upon confirming the start of the joint editing operation, connect the electronic device to a server (FIG. 2) connected to the plurality of external electronic devices. 251) Electronic devices set to connect with. The method of claim 1 or 2, wherein the instructions, when executed by the processor, cause the electronic device to: Upon confirming the start of the joint editing operation, the document is converted into a markup language format, and the edit data of the electronic device corresponding to some edited data in the document converted into the markup language format is entered into the electronic device. An electronic device configured to transmit including index information indicating the location of edited data to the plurality of external electronic devices. The method of any one of claims 1 to 3, wherein the instructions, when executed by the processor, cause the electronic device to: Upon receiving the edit data, the document converted into markup language format is selected based on index information indicating the location of the edit data of the second external electronic device included in the edit data of the first external electronic device. 1 Check the location of the edited data on the external electronic device, An electronic device configured to update the document by applying edit data of the first external electronic device to a position of edit data of the first external electronic device in the document. The method of any one of claims 1 to 4, wherein the instructions, when executed by the processor, cause the electronic device to: When receiving the edit data of the device, receive the meta data among the meta data and original data included in the edit data of the first external electronic device, The location of the edited data of the first external electronic device is confirmed in the document based on index information indicating the location information of the edited data of the first external electronic device included in the metadata, and the location of the edited data of the first external electronic device is confirmed. Display arbitrary graphics at the location of the edited data, While displaying the arbitrary graphic at the location of the edited data of the first external electronic device, upon receiving the original data of the edited data of the first external electronic device, the arbitrary graphic display is released and the first external electronic device An electronic device configured to display original data of the edited data of the first external electronic device at the location of the edited data of the device. In a system for editing documents, While performing a joint editing operation in which a common document can be edited by a plurality of devices, edit data of the electronic device corresponding to some data edited in the document displayed on the electronic device is transmitted to the server, and the editing data of the electronic device is transmitted to the server. When receiving edit data of the first external electronic device from the first external electronic device (203 in FIG. 2) among the plurality of external devices (203, 205, 207, 209, and 211 in FIG. 2), the first external electronic device the electronic device (101 in FIG. 1; 201 in FIG. 2; 301 in FIG. 3) configured to update the document by applying the device's editing data to the document; and When receiving edit data of the electronic device from the electronic device, the edit data of the electronic device is broadcast to the plurality of external electronic devices, and the first external electronic device is transmitted from the first external electronic device among the plurality of external electronic devices to the first external electronic device. A system including the server (251 in FIG. 2) configured to broadcast the edit data of the first external electronic device to the electronic device and the plurality of external electronic devices when receiving edit data of the electronic device. The method of claim 6, wherein the electronic device (101 in FIG. 1; 201 in FIG. 2; 301 in FIG. 3), Upon confirming the start of the joint editing operation, the document is converted into a markup language format, and the edited data of the electronic device corresponding to some edited data in the document converted into the markup language format is entered into the electronic device. A system that transmits to the server including index information indicating the location of edited data. The method of claim 6 or 7, wherein the server (251 in FIG. 2), Based on the index information included in the edit data of the electronic device and the plurality of index information included in each of the edit data of the plurality of external electronic devices, the edit data of the electronic device and the plurality of external electronic devices are selected from the document. A system that generates spatial area map information of a document that allows the location and size of edited data to be known. The method of any one of claims 6 to 8, wherein the server (251 in FIG. 2), Based on the document space area map information, if it is confirmed that the edit data of the first external electronic device and the edit data of the second external electronic device among the edit data of the plurality of external electronic devices overlap in the document, the editing order A system for sequentially broadcasting the edited data of the first external electronic device and the edited data of the second external electronic device to the electronic device and the plurality of external electronic devices based on . The method of any one of claims 6 to 9, wherein the server (251 in FIG. 2), If the capacity of the edited data of the electronic device is greater than the threshold, the metadata among the metadata and original data included in the edited data of the electronic device is transmitted to the plurality of external electronic devices through a separate logical server. A system for broadcasting original data of the edited data of the electronic device to the plurality of external electronic devices at a lower transmission rate than the edited data having a capacity greater than a threshold. In a method of editing a document on an electronic device, While performing a joint editing operation in which a common document can be edited by a plurality of devices, if editing of some data in the document displayed on the display of the electronic device is confirmed, the electronic device corresponding to the edited partial data Transmitting edit data to a plurality of external electronic devices through the communication module; and Edit data of the first external electronic device corresponding to some data edited in the document displayed on the first external electronic device is transmitted from a first external electronic device among the plurality of external electronic devices through the communication module of the electronic device. Upon receipt, the method includes updating the document by applying edit data from the first external electronic device to the document. According to claim 11, The method further includes connecting the electronic device to a server connected to the plurality of external electronic devices when confirming the start of the joint editing operation. The method of claim 11 or 12, Upon confirming the start of the collaborative editing operation, converting the document into a markup language format; and Editing data of the electronic device corresponding to partially edited data in the document converted to the markup language format includes index information indicating the location of the edited data of the electronic device and transmits it to the plurality of external electronic devices. How to include more actions. The method of any one of claims 11 to 13, wherein the operation of updating the document includes: When receiving edit data of the first external electronic device in a markup language format from the first external electronic device, indicating the location of the edit data of the second external electronic device included in the edit data of the first external electronic device. An operation of confirming the location of edit data of the first external electronic device in the document converted into markup language format, based on index information; and A method comprising updating the document by applying edit data of the first external electronic device to a position of edit data of the first external electronic device in the document. According to any one of claims 11 to 14, When receiving edit data of the first external electronic device having a capacity greater than a threshold from the first external electronic device, receive the meta data among the meta data and original data included in the edit data of the first external electronic device. action; The location of the edited data of the first external electronic device is confirmed in the document based on index information indicating the location information of the edited data of the first external electronic device included in the metadata, and the location of the edited data of the first external electronic device is confirmed. An operation of displaying an arbitrary graphic at the location of the edited data; and While displaying the arbitrary graphic at the location of the edited data of the first external electronic device, upon receiving the original data of the edited data of the first external electronic device, the arbitrary graphic display is released and the first external electronic device The method further includes displaying original data of the edited data of the first external electronic device at the location of the edited data of the device.

Images