KR102666410B1 - Method for conducting meeting in virtual space and apparatus therefor - Google Patents

Abstract

The present specification proposes a method for conducting a meeting in a virtual space and an apparatus therefor. Specifically, the method comprises the steps of: sorting texts converted from a voice of a user avatar and/or at least one other avatar in the virtual space by avatar and displaying the sorted texts in real time. Terms of the texts are divided into one of a general term and a corporate term, and based on a user clicking on a term related to a preset category among the general terms, basic information of a dictionary database can be displayed, and based on the user clicking on the corporate term, basic information and/or an attached file input by an administrator or updated by at least one previous meeting record can be displayed.

Description

Method for conducting a meeting in virtual space and apparatus therefor {METHOD FOR CONDUCTING MEETING IN VIRTUAL SPACE AND APPARATUS THEREFOR}

This specification relates to virtual space, and more specifically, to a method and device for checking meeting minutes in real time during a meeting process in virtual space.

Recently, virtual reality, augmented reality, and mixed reality technologies that apply computer graphics technology are developing. Virtual reality technology uses computers to build a virtual space that does not exist in the real world and then makes the virtual space feel like reality. Augmented reality or mixed reality technology adds computer-generated information to the real world. It is defined as a technology that allows real-time interaction with users by combining the real world and the virtual world.

Among these, augmented reality and mixed reality technologies are combined with technologies in various fields (e.g., broadcasting technology, medical technology, game technology, etc.) and are utilized/applied to provide services to users. A representative example is Meta-verse. There is. This metaverse is a compound word of 'Meta', meaning processing and abstraction, and 'Universe', meaning the real world, and refers to a three-dimensional virtual world. Metaverse is an advanced concept than the existing term virtual reality environment, and provides an augmented reality environment in which virtual worlds such as the web and the Internet are absorbed into the real world.

Public Patent Publication 10-2014-0108436

This specification proposes a method and device for improving work efficiency by displaying meeting minutes in real time and using the contents of the meeting minutes as data when conducting a meeting in a virtual space.

Additionally, this specification proposes a method and device for immediately confirming basic information, such as the meaning of terms less relevant to the user, among terms used in a meeting in a virtual space.

Additionally, this specification proposes a method and device for visualizing main keywords and the proximity between main keywords among terms used in virtual space meetings.

In addition, this specification proposes a method and device for immediately checking the basic information and related files of company terms among terms used in a meeting in a virtual space.

The technical problems to be achieved in this specification are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below. You will be able to.

This specification proposes a method for conducting a meeting in a virtual space. The method includes the step of displaying in real time text converted from the voice of a user avatar and/or at least one other avatar in a virtual space, separately for each avatar, wherein the terms in the text are divided into one of general terms and company terms, respectively. Based on the user clicking on a term related to a preset category among general terms, basic information from a dictionary database is displayed, and based on the user clicking on the company term, the administrator Basic information and/or attachments entered by or updated by at least one previous meeting minutes may be displayed.

In addition, in the method of the present specification, the company term is a term that is not confirmed in the dictionary database, or is a term confirmed in the dictionary database but used in a separate meaning by the company, and the general term is a term that is not the company term. You can.

Additionally, in the method of this specification, main keywords can be determined based on the importance of terms among the general terms.

Additionally, in the method of the present specification, the importance of the term may be determined based on the frequency of the term and the frequency and proximity of other terms.

Additionally, in the method of this specification, main keywords may be displayed by being arranged in concentric circle graphics based on proximity.

Additionally, in the method of the present specification, a word cloud related to one main keyword placed on the concentric circle graphic may be displayed based on a click on the one main keyword.

Additionally, in the method of the present specification, word clouds related to the two or more main keywords placed on the concentric circle graphic may be displayed based on the dragging or successive clicking of the two or more main keywords.

In addition, a user terminal used to conduct a meeting in a virtual space of the present specification includes at least one transceiver, at least one processor, operably connected to the at least one processor, and configured to be operated by the at least one processor. It includes at least one memory that stores instructions for performing operations based on what is executed, and separates the text converted from the voice of the user avatar and/or at least one other avatar in the virtual space for each avatar. Including a step of displaying in real time, wherein the terms in the text are each divided into general terms and company terms, and based on the user clicking on a term related to a preset category among the general terms, the terms are stored in a dictionary database. Basic information may be displayed, and based on the user clicking on the company term, basic information entered by an administrator or updated by at least one previous meeting minutes and/or attachments may be displayed.

Additionally, this specification proposes a method for conducting a meeting in a virtual space. The method includes converting the voice of at least one avatar in a virtual space into text in real time, wherein the text is displayed in real time separately for each avatar, and the terms in the text are divided into one of general terms and company terms, respectively. Based on the user clicking on a term related to a preset category among general terms, basic information from a dictionary database is displayed on the user terminal, and based on the user clicking on the company term, , basic information and/or attached files entered by the administrator or updated by at least one previous meeting minutes may be displayed on the user terminal.

In addition, in the method of the present specification, the company term is a term that is not confirmed in the dictionary database, or is a term confirmed in the dictionary database but used in a separate meaning by the company, and the general term is a term that is not the company term. You can.

Additionally, in the method of this specification, main keywords can be determined based on the importance of terms among the general terms.

Additionally, in the method of the present specification, the importance of the term may be determined based on the frequency of the term and the frequency and proximity of other terms.

Additionally, in the method of this specification, main keywords may be displayed by being arranged in concentric circle graphics based on proximity.

Additionally, in the method of the present specification, a word cloud related to one main keyword placed on the concentric circle graphic may be displayed based on a click on the one main keyword.

Additionally, in the method of the present specification, word clouds related to the two or more main keywords placed on the concentric circle graphic may be displayed based on the dragging or successive clicking of the two or more main keywords.

In addition, a server device used to conduct a conference in a virtual space of the present specification includes at least one transceiver, at least one processor, operably connected to the at least one processor, and configured to perform functions by the at least one processor. At least one memory storing instructions for performing operations based on what is being executed, and converting the voice of at least one avatar in the virtual space into text in real time, wherein the text is They are divided by avatar and displayed in real time, and the terms in the text are each divided into at least one of general terms and company terms, and based on the user clicking on a term related to a preset category among the general terms, a dictionary is created. Basic information from the database is displayed on the user terminal, and based on the user clicking on the company term, basic information and/or attachments entered by the administrator or updated by at least one previous meeting minutes are displayed on the user terminal. It can be displayed in .

According to this specification, when a meeting is held in a virtual space, the meeting minutes are displayed in real time and the contents of the meeting minutes can be used as data, thereby improving work efficiency.

In addition, according to the present specification, basic information such as the meaning of terms less relevant to the user among terms used in a meeting in a virtual space can be immediately confirmed, which has the effect of improving work efficiency.

In addition, according to the present specification, there is an effect of improving work efficiency by visualizing main keywords and the proximity between main keywords among terms used in meetings in a virtual space.

In addition, according to this specification, basic information and related files of company terms among terms used in a virtual space meeting can be immediately checked, which has the effect of improving work efficiency.

The effects that can be obtained in this specification are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below. .

The accompanying drawings, which are included as part of the detailed description to aid understanding of the present specification, provide examples of the present specification and explain technical features of the present specification together with the detailed description.
Figure 1 is a diagram to explain how meeting minutes are displayed in real time in a virtual space proposed in this specification.
Figure 2 is a diagram for explaining a method of checking basic information and attached files related to company terms proposed in this specification.
Figure 3 is a diagram for explaining a method of updating attached files related to company terms proposed in this specification.
Figure 4 is an example of keywords arranged in the concentric circle graphic proposed in this specification.
Figure 5 is a diagram for explaining a method of displaying a word cloud by clicking or dragging a keyword of a concentric circle graphic.
Figure 6 is a flowchart illustrating a method for conducting a meeting in a virtual space proposed in this specification.
Figure 7 is a flowchart illustrating a method for conducting a meeting in a virtual space proposed in this specification.
Figure 8 illustrates a block diagram of a system for conducting a meeting in a virtual space proposed in this specification.
Figure 9 illustrates a block diagram of the user terminal proposed in this specification.

Hereinafter, preferred embodiments according to the present specification will be described in detail with reference to the attached drawings. The detailed description set forth below in conjunction with the accompanying drawings is intended to illustrate exemplary embodiments of the present disclosure and is not intended to represent the only embodiments in which the disclosure may be practiced. The following detailed description includes specific details to provide a thorough understanding of the disclosure. However, one skilled in the art will recognize that the present disclosure may be practiced without these specific details.

In some cases, in order to avoid ambiguity in the concepts of the present specification, well-known structures and devices may be omitted or may be shown in block diagram form focusing on the core functions of each structure and device.

In this specification, ‘/’ means ‘and’, ‘or’ or ‘and/or’ depending on the context.

In this specification, ‘meeting minutes’ may be referred to as ‘text’, and ‘terms’ may be referred to as ‘nouns’ or ‘words.’

In this specification, ‘meeting’ may be replaced with ‘event’, a concept encompassing a meeting.

Real-time meeting minutes function in meetings in virtual space

Figure 1 is a diagram to explain how meeting minutes (or text) are displayed in real time in the virtual space proposed in this specification. Figure 1 is an example of a terminal screen output/displayed by the output unit of a user terminal.

Referring to FIG. 1, the terminal screen may include a virtual space display unit 110 and a user interface unit 120. The virtual space display unit 110 may display the virtual space where the user's avatar 111 is located. The user interface unit 120 may display a graphical user interface (GUI) for user convenience. For example, the user interface unit 120 may display a search window, a message button, an attendee button, a real-time meeting minutes button 121, a my information button, a workspace button, a settings button, and a scheduler button. The user can enter the content they wish to search in the search box or click buttons through the terminal's input unit. For example, when a user clicks the real-time meeting minutes button, the meeting minutes (or text) generated in real time during the meeting may be displayed on the user interface unit 140. For example, when three avatars attend a meeting or conference room in the virtual space displayed on the virtual space display unit 110, the text converted from each avatar's voice is classified for each avatar or user and entered in the meeting minutes 140 in real time. It can be displayed. Since text converted from voice in virtual space is classified by avatar, the accuracy and convenience of implementation of the real-time meeting record function can be improved.

And/or, if the user is a meeting manager, the user can input meeting-related information such as meeting purpose and meeting time through the input unit of the user terminal. And/or meeting-related information may be shared with users attending the meeting. And/or, if the meeting exceeds the input meeting time, a pop-up notifying that the meeting time has been exceeded may be displayed on the output unit (eg, display) of the meeting manager or meeting participant's terminal. Alternatively, when the meeting time is exceeded and the meeting is ended, a pop-up notifying that the meeting time has been exceeded (along with the meeting minutes) may be displayed on the output unit (e.g., display) of the terminal of the meeting manager or meeting participant.

Extract and classify terms from meeting minutes

At least one term (or noun) can be extracted from the (conversation) content of the real-time meeting minutes. And/or, at least one term may be divided into a general term and a company term based on a dictionary database. In this specification, company terms may be expressed as company internal terms, company-specific terms, internal terms, exclusive terms, etc. For example, a general term may mean a term that can be checked in a dictionary database. In other words, a general term may be a term for which the dictionary database contains basic information about the term. For example, the dictionary database may be an external database. For example, company terms may refer to terms directly managed by the company, such as the company's project name, general terms, or terms used with different meanings internally within the company. Company terminology may be updated when a separate administrator enters/updates company terminology-related information, or according to meeting minutes (or conversation content) and shared files from one or more meetings.

For example, general terms and company terms can be managed in separate databases. For example, general terms may be stored/managed in a first database, and company terms may be stored/managed in a second database.

For example, term extraction and classification operations from meeting minutes may be performed by a server device. And/or, the server device may include a first database and a second database.

Actions related to company terminology

For example, when a new company term is stored in the second database, a request to input basic information about the company term and an attached file may be sent to the administrator terminal. For example, basic information may include definitions/meanings of company terms. The administrator terminal can receive the input request and update basic information and attached files. Basic information and attached files may be stored in conjunction with company terms in a second database.

In this way, when the basic information and attached files of the company term are entered and/or updated, the user can check the basic information and attached files of the company term in the user interface unit.

Figure 2 is a diagram for explaining a method of checking basic information and attached files of company terms proposed in this specification. Referring to Figure 2, the user terminal may display real-time text on the user interface portion of the terminal screen based on information received from the server device. At least one company term may be displayed in the real-time text. Users can click on the company term to check basic information or download attached files. That is, the terminal screen may include a virtual space display unit 210 and a user interface unit 220. The virtual space display unit 210 may display avatars located in the conference room. The user interface unit 220 can display text or conversation contents of avatars in real time.

For example, when the user controlling avatar A inputs the voice 'Hello' and the user controlling avatar B inputs the voice 'Shall we start the meeting?', the user interface unit 220 displays A: 'Hello'. ', B: 'Shall we start the meeting?' can be displayed in real time. In this way, company terminology can be displayed in real time while the conversation is in progress. For example, company terms may be displayed as highlights, as shown in the user interface unit 220 of FIG. 2 . For example, ‘Metasium’, ‘HereWeAR’, and ‘Taejongdae’ may be company terms. At this time, when the user clicks on 'Metasium' through the input area, a pop-up related to basic information ('Name of the Metaverse integrated platform currently under development at headquarters') and attached files (files titled 'Project-related file list') will appear. Information 230 may be displayed on the terminal screen. Users can download the ‘project-related file list’ by clicking the attached file section.

And/or, the basic information and attachments of the Company Terms (or related to the Company Terms) may be updated based on user/avatar activity, such as shared files and conversations related to the Company Terms in one or more (previous) meetings. . And/or, the basic information and attachments of the company terminology may be updated based on user/avatar activity, such as conversation content and shared files prior to the current meeting attended. At this time, company terminology-related information may be updated based on machine learning. And/or, updating basic information and attached files based on user/avatar activity may be performed with the approval/consent of at least one of the users attending the meeting. For example, if an attending user objects to the update, the update may not be performed.

Figure 3 is a diagram for explaining a method of updating attached files related to company terms proposed in this specification. For example, as shown in Figure 3, pop-up information 310 may be displayed asking, ‘Would you like to add the currently newly shared file to the <Metasium> related files?’ At this time, if the user clicks the check button, the update may be performed, and if the user clicks the X button, the update may not be performed.

Common Terminology Related Actions

For example, before proceeding with a meeting, users can enter a non-expert field/category. That is, if a field/category (e.g., development-related words, design-related words, etc.) that the user is not familiar with is selected, if a term in that category is mentioned in a meeting, the term may be displayed in the meeting minutes. At this time, when the user clicks on the term, basic information for the term may be displayed. Alternatively, if the user's job/job/specialty/category is selected, if terms from other jobs/jobs/professional fields/categories are mentioned in the meeting, the terms may be displayed in the meeting minutes. At this time, when the user clicks on the term, basic information for the term may be displayed. And/or, the term may be a term classified as a general term. For example, the underlying information for the term may be based on a web server device, an external server device, and/or an external database.

And/or, main keywords from general terms may be extracted and the main keywords and relationships between main keywords may be visualized. For example, common terms can be identified through Natural Language Processing (NLP) algorithms (e.g. Word2Vec, etc.), other algorithms, and the frequency of term mentions in conversations at the current meeting, conversations at previous meetings, and/or on websites. Data can be comprehensively used as learning data and converted into numbers or vectors. At this time, different weights may be assigned based on the source of the data. In other words, variable vectorization can be achieved to suit the current conversation and company characteristics rather than fixed data. For example, conversations from the current meeting may be trained with the highest weights, data from a website may be learned with medium weights, and conversations from previous meetings may be learned with the lowest weights. .

And/or, term importance of general terms can be calculated. For example, the term importance of a general term in the current conference can be calculated using the vectorized data (or vector) and mention frequency described above. For example, ‘term importance = frequency of mention of the term * Σ (adjacency to other terms * frequency of mention of other terms). Here, the proximity can be calculated by the angle between the vectorized data of two words. For example, the proximity may be a value obtained by dividing the dot product of two vectorized data by the product of the sizes of the two vectorized data. Here, the other terms may be any words mentioned in the meeting. Alternatively, other terms may be words with a preset number of high frequency of mentions. Other terms may be determined in various ways to improve performance. And/or, the importance of the term may be calculated as the number of times a specific term itself is mentioned or the degree of association with other words mentioned in number is high.

And/or, a preset number of main keywords may be extracted/determined according to term importance among general terms. For example, 10 main keywords can be set to be determined/extracted. Among general terms, 10 terms can be extracted/determined sequentially starting from the highest term importance value. And/or, by setting a lower limit on term importance, if the term importance does not exceed the lower limit, it can be prevented from being determined as a main keyword.

And/or, the determined main keywords may be placed in a concentric circle graphic based on proximity. Figure 4 is an example of main keywords arranged in the concentric circle graphic proposed in this specification. Figure 4 illustrates concentric circle graphics and main keywords displayed on the terminal screen of a user terminal. Referring to Figure 4, 'Metaverse', 'HoloLens', 'Smart Office', 'Sound Technology', 'Blockchain', 'Fortnite', 'Roblox', 'Presence Tech', 'Gather Town' ', 'NFT' can be determined as main keywords. And/or, 'Metaverse', 'HoloLens', 'Smart Office', 'Sound Technology', 'Blockchain', and 'Fortnite' are placed in the same circle (first circle) graphic because their proximity to each other is high. It can be. And/or, ‘Roblox’, ‘Reality Tech’, ‘Gathertown’, and ‘NFT’ can be placed in the same circle (second circle) graphic due to their high proximity to each other. And/or, the main keywords of the first original graphic and the main keywords of the second original graphic may be arranged close to each other based on their proximity to each other. For example, 'NFT' in the second original graphic has a high degree of proximity to 'Fortnite' and 'Blockchain' in the first original graphic, so it will be placed on the second original graphic between 'Fortnite' and 'Blockchain'. You can.

Figure 5 is a diagram to explain a method of displaying a word cloud by receiving a click or drag on the main keyword of the concentric circle graphic. Referring to Figure 5, the user can click ‘Smart Office’ (51). When a user clicks on 'Smart Office', information about 'Smart Office' can be collected (on the web), and/or related information can be visualized and displayed in the form of a word cloud or mind map through big data keyword analysis. there is. And/or, if the user clicks on 'NFT' (or 'Fortnite') and moves it to 'Fortnite' (or 'NFT') and then releases the click (i.e. drag (52)), (on the web ) By collecting information about 'NFT' and 'Fortnite' or analyzing big data keywords, related information can be visualized and displayed in the form of a word cloud or mind map. When a user clicks on 'NFT' and 'Fortnite' in succession, information about 'NFT' and 'Fortnite' is collected (on the web) or related information is collected in the form of a word cloud or mind map through big data keyword analysis. It can be visualized and displayed as .

Figure 6 is a flowchart illustrating a method for conducting a meeting in a virtual space proposed in this specification. The operation method of FIG. 6 may be performed by a user terminal.

Referring to FIG. 6 , in step S610, the user terminal may display text converted into the voice of the user avatar and/or at least one other avatar in the virtual space, separately for each avatar, in real time. For example, a user avatar can be controlled by a user using a user terminal. And/or, at least one other avatar may be controlled by another user. And/or, the text may be displayed through an output unit (eg, display) of the user terminal.

And/or, the terms in the text may each be divided into one of general terms and company terms. And/or, based on the user clicking on a term related to a preset category among general terms, basic information from a dictionary database may be displayed. For example, the preset category may be a non-professional field/non-business field entered by the user. Alternatively, the preset category may be a field other than the specialty/business field entered by the user. And/or, based on the user clicking on the company term, basic information and/or attachments may be displayed as entered by the administrator or updated by at least one previous meeting minutes.

And/or, general terms and company terms may be distinguished based on their availability in a dictionary database. For example, if the basic information of the term can be checked in a dictionary database, the term may be a general term; otherwise, it may be a company term.

And/or, the company term may not be confirmed in the dictionary database, or may be a term confirmed in the dictionary database but used with a separate meaning (or different meaning) in the company or system. And/or, generic terms may be terms that are not company terms. For example, a general term may be a term that is confirmed in a dictionary database among terms used in a given meeting (or multiple meetings) and is not used in a separate meaning by the company (or system). For example, a term used with a separate meaning may have been confirmed and/or updated by an administrator to have a separate meaning. And/or, in this specification, the company may be replaced with a specific group/organization. For example, a company can be replaced by a development team within the company or a group/organization unrelated to the company that achieves the same purpose. Accordingly, company terms may be replaced with group terms, organization terms, etc.

And/or, the main keyword may be determined based on the importance of the term among general terms. And/or, the importance of a term may be determined based on the term's frequency and the frequency and proximity of other terms.

And/or, the main keywords may be displayed arranged in a concentric circle graphic based on proximity. And/or, based on one main keyword placed in the concentric circle graphic being clicked, a word cloud related to the one main keyword may be displayed. And/or, a word cloud related to two or more main keywords may be displayed based on two or more main keywords arranged in a concentric circle graphic being dragged or clicked sequentially.

Since the operating method of the user terminal in FIG. 6 is the same as the operating method of the user terminal described with reference to FIGS. 1 to 5, further detailed description will be omitted.

The operating method of the user terminal described with reference to FIG. 6 may be applied in combination with or replaced with the proposed methods of FIGS. 1 to 5. And/or, the operating method of the user terminal of FIG. 6 may be applied in conjunction with the proposed methods of FIGS. 1 to 5. It can be supplemented by suggested methods.

Figure 7 is a flowchart illustrating a method for conducting a meeting in a virtual space proposed in this specification. The operating method of FIG. 7 may be performed by a server device. Referring to FIG. 7, the server device may convert the voice of at least one avatar in the virtual space into text in real time in step S710. And/or, the text can be divided by avatar and displayed in real time. For example, the server device may transmit information about text to the user terminal, and the user terminal may display the text through an output unit (eg, display).

And/or, the terms in the text may each be divided into one of general terms and company terms. And/or, based on the user clicking on a term related to a preset category among general terms, basic information based on a dictionary database may be displayed on the user terminal. For example, the preset category may be a non-professional field/non-business field entered by the user. Alternatively, the preset category may be a field other than the specialty/business field entered by the user. And/or, based on the user clicking on the company term, basic information and/or attachments entered by the administrator or updated by at least one previous meeting minutes may be displayed on the user terminal.

And/or, general terms and corporate terms may be distinguished based on a dictionary database. For example, if the basic information of the term can be checked in the dictionary database, the term is a general term, and if not, the term is a corporate term. It can be.

And/or, the main keyword may be determined based on the importance of the term among general terms. And/or, the importance of a term may be determined based on the term's frequency and the frequency and proximity of other terms.

And/or, the main keywords may be displayed arranged in a concentric circle graphic based on proximity. And/or, based on one main keyword placed in the concentric circle graphic being clicked, a word cloud related to the one main keyword may be displayed. And/or, a word cloud related to two or more main keywords may be displayed based on two or more main keywords arranged in a concentric circle graphic being dragged or clicked continuously.

According to the method proposed in this specification, real-time meeting minutes can be used not only for recording purposes but also to increase practical work efficiency.

Since the operating method of the server device in FIG. 7 is the same as the operating method of the server device described with reference to FIGS. 1 to 6, detailed descriptions other than this will be omitted.

The operating method of the server device described with reference to FIG. 7 may be applied in combination with or replaced with the proposed methods of FIGS. 1 to 6. And/or, the operating method of the server device of FIG. 7 may be applied in conjunction with the proposed methods of FIGS. 1 to 6. It can be supplemented by suggested methods.

Figure 8 illustrates a block diagram of a system for conducting a meeting in a virtual space proposed in this specification.

Referring to FIG. 8, a system for conducting a meeting in a virtual space may include at least one of a user terminal 100, a server device 200, and/or a communication network 300.

The user terminal 100 can access the server device 200 through the communication network 300 and check the meeting minutes in real time during a meeting in a virtual space, as described above. The user terminal 100 may be controlled by the user.

The server device 200 may be a user terminal 100 connected through the communication network 300 or a server device that allows users of these devices to check/use meeting minutes in real time. For example, the operations of the server devices in FIGS. 1 to 7 may be performed separately as operations of one or more server devices. At this time, server devices can transmit and receive information between each other using wired or wireless communication.

Communication network 300 may refer to a wired communication network, a wireless communication network, and/or a wired/wireless communication network. And/or, the user terminal 100 and/or the server device 200 may communicate with each other through the communication network 300, but communicate directly without going through the communication network 300 (e.g., sidelink communication). You may.

For example, the user terminal 100 and/or the server device 200 may be a robot, an eXtendedReality (XR) device, a vehicle, a mobile device, a home appliance, an IoT device, an AI device/server, etc., or may form part of these. You can. For example, vehicles may include vehicles equipped with wireless communication functions, autonomous vehicles, vehicles capable of inter-vehicle communication, etc. Here, the vehicle may include an Unmanned Aerial Vehicle (UAV) (eg, a drone). XR devices include AR (Augmented Reality)/VR (Virtual Reality)/MR (Mixed Reality) devices, HMD (Head-Mounted Device), HUD (Head-Up Display) installed in vehicles, televisions, smartphones, and computers. , can be implemented in the form of wearable devices, home appliances, digital signage, vehicles, robots, etc. Portable devices may include smartphones, smart pads, wearable devices (e.g., smartwatches, smart glasses), and computers (e.g., laptops). Home appliances may include TVs, refrigerators, washing machines, etc. IoT devices may include sensors, smart meters, etc.

Figure 9 illustrates a block diagram of the user terminal proposed in this specification.

Referring to FIG. 9 , the user terminal 100 may include at least one of one or more transceivers 110, one or more processors 120, and/or one or more memories 130.

Processor 120 controls memory 130 and/or transceiver 110 and may be configured to implement the descriptions, functions, procedures, suggestions, methods and/or operational flowcharts disclosed herein. For example, the processor 120 may process information in the memory 130 to generate first information/signal and then transmit a wireless signal including the first information/signal through the transceiver 110. Additionally, the processor 120 may receive a wireless signal including the second information/signal through the transceiver 110 and then store information obtained from signal processing of the second information/signal in the memory 130.

The memory 130 may be connected to the processor 120 and may store various information related to the operation of the processor 120. For example, memory 130 may perform some or all of the processes controlled by processor 120 or instructions for performing the descriptions, functions, procedures, suggestions, methods, and/or operational flowcharts disclosed herein. Software code containing them can be stored.

The transceiver 110 may be connected to the processor 120 and may transmit and/or receive wireless signals and/or wired signals through one or more antennas. Transceiver 110 may include a transmitter and/or receiver. The transceiver 110 may be used interchangeably with an RF (RadioFrequency) unit.

The block diagram of the server device 200 may be the same as the block diagram of the user terminal 100 described above.

And/or, the user terminal 100 may further include an input unit and/or an output unit. The input unit may be connected to the transceiver 110, processor 120, and/or memory 130, and may receive a command from the user and send a command to the transceiver 110, processor 120, and/or memory 130. It can be delivered. For example, the input unit may be a keyboard, mouse, joystick, controller, headset, microphone, wearable input device, or parts thereof. The output unit may be connected to the processor 120 and/or the memory 130, and may output signals to the user according to commands from the processor 120 and/or the memory 130. For example, the output unit may be connected to the processor 120 and/or the memory 130. It may be a display, speaker, headset, wearable output device, or parts thereof.

For example, the user terminal 100 is operably connected to at least one transceiver, at least one processor, and the at least one processor, and performs operations based on execution by the at least one processor. At least one memory for storing instructions, and displaying in real time the text converted into the voice of the user avatar and/or at least one other avatar in the virtual space, separately for each avatar, The terms in the text are each divided into general terms and company terms, and based on the user clicking on a term related to a preset category among the general terms, basic information from the dictionary database is displayed, and the user clicks on a term related to a preset category among the general terms. Based on clicking on a term, basic information and/or attachments may be displayed as entered by the administrator and/or updated by at least one previous meeting minutes.

For example, a server device may include at least one transceiver, at least one processor, and operably coupled to the at least one processor, instructions to perform operations based on execution by the at least one processor. It includes at least one memory for storing (instructions), converting the voice of at least one avatar in a virtual space into text in real time, and displaying the text in real time by dividing it for each avatar, and the terms of the text are each It is divided into at least one of general terms and company terms, and based on the user clicking on a term related to a preset category among the general terms, basic information from the dictionary database is displayed on the user terminal, and when the user clicks on the company term, Based on this, basic information and/or attachments entered by the administrator and/or updated by at least one previous meeting minutes may be displayed on the user terminal.

The embodiments described above combine the elements and features of the present specification in a predetermined form. Each component or feature should be considered optional unless explicitly stated otherwise. Each component or feature may be implemented in a form that is not combined with other components or features. Additionally, it is possible to configure an embodiment of the present invention by combining some components and/or features. The order of operations described in embodiments of the present invention may be changed. Some features or features of one embodiment may be included in other embodiments or may be replaced with corresponding features or features of other embodiments. It is obvious that claims that do not have an explicit reference relationship in the patent claims can be combined to form an embodiment or included as a new claim through amendment after filing.

Embodiments according to the present specification may be implemented by various means, for example, hardware, firmware, software, or a combination thereof. In the case of implementation by hardware, an embodiment of the present invention is one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), and field programmable FPGAs (FPGAs). gatearrays), processors, controllers, microcontrollers, microprocessors, etc.

In the case of implementation by firmware or software, an embodiment of the present invention may be implemented in the form of a module, procedure, function, etc. that performs the functions or operations described above. Software code can be stored in memory and run by a processor. The memory is located inside or outside the processor and can exchange data with the processor through various known means.

It is obvious to those skilled in the art that the present specification can be embodied in other specific forms without departing from the essential features of the present specification. Accordingly, the above detailed description should not be construed as restrictive in all respects and should be considered illustrative. The scope of this specification should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of this specification are included in the scope of this specification.

Claims (16)

Including the step of displaying text converted from the voice of a user avatar and/or at least one other avatar in a virtual space separately for each avatar in real time,
The terms in the above text are (i) company terms that include terms not identified in the dictionary database and terms identified in the dictionary database but used by the company with a separate meaning, and (ii) terms that are not the above company terms. is distinguished by one of the general terms,
Based on the user clicking on a term related to a preset category among general terms, basic information from the dictionary database is displayed,
Based on the user clicking on the company term, basic information and/or attachments entered by an administrator or updated by at least one previous meeting minutes are displayed, the company term is managed by the administrator, and
A method in which main keywords among the general terms are determined based on the importance of the term and displayed by being arranged in a concentric circle graphic based on proximity. According to paragraph 1,
A method in which the importance of the term is determined based on the frequency of mention of the term * Σ (adjacency between the term and other terms * frequency of mention of the other terms). According to paragraph 2,
A method wherein the proximity between the corresponding term and the other term is a value obtained by dividing the inner product of the vectorized data of the corresponding term and the vectorized data of the other term by the product of their sizes. According to paragraph 1,
A method in which the importance of the term is determined based on the frequency of the term and the frequency and proximity of other terms. delete According to paragraph 1,
A method of displaying a word cloud related to one main keyword placed on the concentric circle graphic based on the click. According to paragraph 1,
A method of displaying a word cloud related to two or more main keywords arranged in the concentric circle graphic based on the dragging or successive clicking of the two or more main keywords. In a user terminal used to conduct a meeting in a virtual space,
at least one transceiver;
at least one processor; and
At least one memory operably coupled to the at least one processor and storing instructions to perform operations based on execution by the at least one processor,
The user terminal displays text converted from the voice of the user avatar and/or at least one other avatar in the virtual space, separately for each avatar, in real time,
The terms in the above text are (i) company terms that include terms not identified in the dictionary database and terms identified in the dictionary database but used by the company with a separate meaning, and (ii) terms that are not the above company terms. is distinguished by one of the general terms,
Based on the user clicking on a term related to a preset category among general terms, basic information from the dictionary database is displayed,
Based on the user clicking on the company term, basic information and/or attachments entered by an administrator or updated by at least one previous meeting minutes are displayed, the company term is managed by the administrator, and
A user terminal in which main keywords among the general terms are determined based on the importance of the term and displayed in concentric circle graphics based on proximity. Converting the voices of two or more avatars in a virtual space into text in real time,
The text is divided by avatar and displayed in real time,
The terms in the above text are (i) company terms that include terms not identified in the dictionary database and terms identified in the dictionary database but used by the company with a separate meaning, and (ii) terms that are not the above company terms. is distinguished by one of the general terms,
Based on the user clicking on a term related to a preset category among general terms, basic information from the dictionary database is displayed on the user terminal,
Based on the user clicking on the company term, basic information and/or attachments entered by an administrator or updated by at least one previous meeting minutes are displayed on the user terminal, and the company term is displayed by the administrator. managed,
A method in which main keywords among the general terms are determined based on the importance of the term and displayed by being arranged in a concentric circle graphic based on proximity. According to clause 9,
A method in which the importance of the term is determined based on the frequency of mention of the term * Σ (adjacency between the term and other terms * frequency of mention of the other terms). According to clause 10,
A method wherein the proximity between the corresponding term and the other term is a value obtained by dividing the inner product of the vectorized data of the corresponding term and the vectorized data of the other term by the product of their sizes. According to clause 9,
A method in which the importance of the term is determined based on the frequency of the term and the frequency and proximity of other terms. delete According to clause 9,
A method of displaying a word cloud related to one main keyword placed on the concentric circle graphic based on the click. According to clause 9,
A method of displaying a word cloud related to two or more main keywords arranged in the concentric circle graphic based on the dragging or successive clicking of the two or more main keywords. In a server device used to conduct a meeting in a virtual space,
at least one transceiver;
at least one processor; and
At least one memory operably coupled to the at least one processor and storing instructions to perform operations based on execution by the at least one processor,
The server device converts the voices of two or more avatars in the virtual space into text in real time, and displays the text in real time, divided by avatar,
The terms in the above text are (i) company terms that include terms not identified in the dictionary database and terms identified in the dictionary database but used by the company with a separate meaning, and (ii) terms that are not the above company terms. is distinguished by one of the general terms,
Based on the user clicking on a term related to a preset category among general terms, basic information from the dictionary database is displayed on the user terminal,
Based on the user clicking on the company term, basic information and/or attachments entered by an administrator or updated by at least one previous meeting minutes are displayed on the user terminal, and the company term is displayed by the administrator. managed,
A server device in which main keywords among the general terms are determined based on the importance of the term and displayed in concentric circle graphics based on proximity.