JP2025062680A - Image right protection system, protection method and protection program - Google Patents

Abstract

To provide a portrait voice right management system capable of proving that data of human voice is unique by associating and managing the human voice with personal information on the owner of the voice and of efficiently and securely managing and utilizing voice data by guaranteeing the voice data to a "portrait voice right" corresponding to a portrait right.SOLUTION: In a portrait voice right management system, a guarantee system includes a voice data generation part for acquiring a sound signal to generate voice data D1, a relevant data acquisition part for acquiring personal information D2 including personal information, a portrait voice right management part for associating voice data with the personal information to generate portrait voice right data, and a plurality of nodes 90a to 90f for encrypting and storing at least part of the portrait voice right data. The nodes 90a to 90f aggregate at least part of the portrait voice right data at prescribed timing to form a block chain and share the block chain by a plurality of nodes to store the block chain as a distributed ledger.SELECTED DRAWING: Figure 9

Description

The present invention relates to a system, method and program for protecting voice data, including characteristics unique to each individual.

Voice data recorded from a human voice contains the so-called "voiceprint," a unique characteristic of each individual, and is made up of many elements such as frequency, pitch, tone, and intensity. Like fingerprints and retinal scans, voice data is used as one of the biometrics for identifying individual people (see, for example, Patent Document 1).

This voice data is highly personal because it can identify individual people with a high degree of certainty, and since its unauthorized acquisition and use could lead to a violation of privacy, it requires advanced security measures for its storage and transfer, as well as appropriate management and use.

JP 2007-052496 A

However, when voice data is not properly managed as described above, it is often distributed anonymously and its ownership and origin are unclear, creating a situation where unauthorized use and infringement of rights are likely to occur. In addition, because voice data is digital data, it can be easily copied or tampered with, which can result in unauthorized copying and misuse. Furthermore, voice data, like the voiceprints mentioned above, contains information that can identify individuals, and if this data is misused, it could lead to privacy violations or incidents or accidents.

The present invention aims to solve the above problems by providing a monitoring system, monitoring method, and monitoring program that can efficiently and safely manage and utilize voice data by linking a person's voice with the personal information of the person who owns that voice and managing it using a blockchain, thereby proving that the voice data is unique and even guaranteeing a "right to likeness," which is equivalent to the right to one's image.

In order to solve the above problems, the present invention provides a system for managing voice data as a voice record, comprising:
a voice data generating unit that acquires an acoustic signal and generates voice data;
a related data acquisition unit for acquiring related data including personal information;
a voice data generating unit for generating voice data by associating the voice data with the related data;
and a data storage means for encrypting and storing at least a part of the image rights data.

The present invention also provides a method for managing voice data as a voice record, comprising the steps of:
(1) A voice data generating step in which a voice data generating unit acquires an acoustic signal to generate voice data, a related data acquiring unit acquires related data including personal information, and a voice data generating step associates the voice data with the related data to generate voice data;
(2) The method is characterized in that the data storage means includes a data storage step of encrypting and storing at least a part of the image right data.

In the above invention, the data storage means includes a guarantee system linking unit that links with a guarantee system constructed on a communication network and encrypts and stores at least a part of the image right data;
The security system includes a plurality of nodes that encrypt and store at least a portion of the image recognition data;
It is preferable that the node aggregates at least a portion of the voting rights data at a predetermined timing, forms a block, links the block to an existing block to form a blockchain, and shares the blockchain among multiple nodes and stores it as a distributed ledger.

In the above invention, the voice data generation unit has a function of adding time information including a date and time when the acquired acoustic signal was acquired to the associated data,
It is preferable that the associated data acquisition unit has a function of analyzing the correlation between the date and time when the added acoustic signal was acquired and information relating to age contained in the personal information, and including the analysis result in the associated data.

In the above invention,
a voice feature extraction unit for extracting any one of frequency, duration, amplitude, intensity, and frequency components contained in the voice data as a feature parameter;
a conversion unit that converts the voice quality or language of the voice data based on the feature parameters;
It is preferable that the voice data transmission apparatus further comprises a conversion parameter recording section for recording, as conversion parameters, characteristic parameters of the voice data after the conversion section converts the voice quality or language.

In addition, in the above invention,
a voice feature extraction unit for extracting any one of frequency, duration, amplitude, intensity, and frequency components contained in the voice data as a feature parameter;
a conversion unit that converts the voice quality or language of the voice data based on the feature parameters;
It is preferable that the voice data transmission apparatus further comprises a conversion parameter recording section for recording, as conversion parameters, characteristic parameters of the voice data after the conversion section converts the voice quality or language.

The above-mentioned system and method according to the present invention can be realized by executing the program of the present invention written in a specific language on a computer. That is, by installing the program of the present invention in an IC chip or memory device of a portable terminal device, smartphone, wearable terminal, mobile PC or other information processing terminal, or a general-purpose computer such as a personal computer or server computer and executing it on the CPU, a system having the above-mentioned functions can be constructed and the method according to the present invention can be implemented.

The program of the present invention can be distributed, for example, via communication lines, and can be transferred as a package application that runs on a stand-alone computer by recording it on a computer-readable recording medium. Specifically, the recording medium can be a magnetic recording medium such as a flexible disk or cassette tape, or an optical disk such as a CD-ROM or DVD-ROM, or a RAM card, or other various recording media. Furthermore, a computer-readable recording medium on which the program is recorded can make it possible to easily implement the above-mentioned system and method using a general-purpose computer or a dedicated computer, and the program can be easily stored, transported, and installed.

As described above, these inventions allow for the efficient and safe management and use of voice data by linking a person's voice with the personal information of the voice's owner and guaranteeing the rights to that voice data. In more detail, the present invention allows for the protection of voice data as a "voice image right," and this voice image right allows for clear ownership of the voice data, making it possible to prevent unauthorized use and infringement of rights.

In addition, with this invention, voice data is linked to the personal information of its owner via blockchain technology, providing strong privacy protection and establishing the right to voice ownership, making it easier to take legal action against unauthorized use of voice data.

Furthermore, the present invention makes it possible to properly protect voice data as a voice right, enabling new business models for safe commercialization; it also allows clear ownership of voice data and enables the owner of the voice data to be appropriately compensated for its use, allowing voice data to be applied more freely and safely for creative purposes; and, because voice data is authenticated and its reliability is ensured, it is expected that the use of voice data in a variety of industries will be promoted.

1 is a conceptual diagram showing an overall configuration of a copyright management system according to an embodiment; A block diagram showing the internal configuration of a voice rights management server according to an embodiment. FIG. 2A is a block diagram showing the internal configuration of a smartphone according to an embodiment, and FIG. 2B is a block diagram showing the configurations of a voice data generating unit and a related data acquiring unit. 1 is a block diagram showing an internal configuration of a guarantee system according to an embodiment. 10 is a sequence diagram showing an operation of the voice right management service according to the embodiment; FIG. A sequence diagram showing the operation when regenerating voice data from obtaining voice data to obtaining related data in the embodiment. FIG. 1 is a flow diagram showing a procedure for NFT transfer in the image rights management system according to the embodiment. 2 is an explanatory diagram illustrating a relationship between a public key and a private key in the image rights management system according to the embodiment; An explanatory diagram illustrating the definition of transactions related to the issuance, transfer, and cancellation of NFTs in an embodiment. FIG. 1 is an explanatory diagram of a block chain of a copyright management system according to an embodiment. FIG. 1 is an explanatory diagram of a block chain of a copyright management system according to an embodiment. FIG. 1 is an explanatory diagram of a block chain of a copyright management system according to an embodiment.

Below, with reference to the attached drawings, an embodiment of the voice rights management method, management system, and management program according to the present invention will be described in detail. In this embodiment, an example is shown of a case where the environmental value digital art generation method according to the present invention is used in an energy trading service provided by a voice rights management system. Note that the embodiment shown below is an example of an apparatus for embodying the technical idea of the present invention, and the technical idea of the present invention does not specify the material, shape, structure, arrangement, etc. of each component part as described below. The technical idea of the present invention may be modified in various ways within the scope of the claims.

(Overall configuration of the photography rights management system)
In this embodiment, a voice right management service is provided by a voice right management system. Fig. 1 is a conceptual diagram showing a transaction form in the voice right management service according to this embodiment. As shown in the figure, in this embodiment, a voice right management service for managing and using voice rights is provided through a voice right management system 1 constructed on a communication network 2. Specifically, in this service, the voice data of a user U1 is recorded as voice data D1 through a smartphone 5 used by the user, and is managed and operated by a voice rights management server 3.

Here, voice rights refer to the linking and management of a person's voice and the personal information D2 of the voice owner via blockchain, and guaranteeing them as rights. Voice rights allow clear ownership to be set for the voice data, making it possible to prevent unauthorized use and infringement of rights. Voice rights can be set for the voice recorded for each user U1 at each age (for example, from infancy to old age) and the unique value of the voice of each age group can be protected as a right and used.

More specifically, the voice rights management system 1 according to this embodiment is configured by connecting a voice rights management server 3, which manages voice data D1 as a voice right, and a smartphone 5, which is an information processing terminal used by each user, through a communication network 2. In this embodiment, the smartphone 5 is described as an example of an information processing terminal. In addition, a guarantee system 4 is installed on the communication network 2, which provides a blockchain interface service that guarantees the voice rights management, and it is possible to connect to a distributed ledger system such as a blockchain through this guarantee system 4.

The communication network 2 is an IP network such as the Internet that uses the communication protocol TCP/IP, and is a distributed communication network constructed by interconnecting various communication lines (public lines such as telephone lines, ISDN lines, ADSL lines, and optical lines, dedicated lines, fourth generation (4G) communication methods such as LTE, and fifth generation (5G) and later communication methods, as well as wireless communication networks such as Wi-Fi (registered trademark) and Bluetooth (registered trademark). This IP network also includes LANs such as intranets (corporate networks) and home networks using 10BASE-T, 100BASE-TX, etc.

The voice rights management server 3 is a server device that manages and utilizes voice rights, and in this embodiment has the function of generating, storing, and managing the voice data D1 of the user U1 as voice rights data D3 through the smartphone 5, and can be realized by a single server device or a group of multiple server devices. The voice rights management server 3 is configured to virtually construct multiple functional modules on a CPU, with each functional module working together to execute processing. The voice rights management server 3 can also send and receive data through the communication network 2 using the communication function, and can present websites and provide services through browser software using the web server function.

On the other hand, the smartphone 5 is a portable information processing terminal device that uses wireless communication, and the smartphone 5 communicates wirelessly with relay points such as the wireless base station 22, allowing users to receive communication services such as phone calls and data communications while moving. Examples of communication methods include 3G (3rd Generation), LTE (Long Term Evolution), 4G, FDMA, TDMA, CDMA, W-CDMA, and PHS (Personal Handyphone System). The smartphone 5 also includes various functions such as a digital camera function, an application software execution function, and a location information acquisition function using the Global Positioning System (GPS), and also includes mobile computers such as tablet PCs.

The location information acquisition function of the smartphone 5 is a function for acquiring and recording location information indicating the location of the smartphone itself. Examples of this location information acquisition function include, as shown in FIG. 1, a method of detecting the location of the smartphone itself using signals from a satellite 21, such as GPS, and a method of detecting the location using the radio wave strength from a mobile phone wireless base station 22 or a Wi-Fi communication access point.

The smartphone 5 is provided with a display unit 53a such as a liquid crystal display as a display unit that displays information, and an operation device such as an operation button that allows the user to perform input operations. The operation device includes a touch panel 52a as an input unit that is arranged superimposed on the liquid crystal display and acquires an operation signal by a touch operation that specifies a coordinate position on the liquid crystal display. Specifically, the touch panel 52a is an input device that inputs an operation signal by pressure or electrostatic detection by a touch operation using the user's fingertip or pen, and is configured by superimposing a liquid crystal display that displays graphics and a touch sensor that receives an operation signal corresponding to the coordinate position of the graphic displayed on the liquid crystal display.

(Internal structure of each device)
Next, the internal structure of each device constituting the voice rights management system 1 will be described. Fig. 2 is a block diagram showing the internal configuration of the voice rights management server 3 according to this embodiment, and Fig. 3 is a block diagram showing the internal configuration of the smartphone 5 according to this embodiment. Note that the term "module" used in the description refers to a functional unit that is configured by hardware such as a device or equipment, software having the function, or a combination of these, and that performs a predetermined operation.

(1) Voice Rights Management Server 3
First, there will be described an internal configuration of the voice rights management server 3. The voice rights management server 3 is a server device disposed on the communication network 2, and is capable of transmitting and receiving data to and from each smartphone 5 via the communication network 2.

Specifically, the voice rights management server 3 includes a communication interface 31 that communicates data via the communication network 2, an authentication unit 33 that authenticates the authority of users and user terminals, a location information management unit 32 that collects and manages the location information of each user terminal, a voice rights data control unit 36 that controls the generation, storage, and management of voice rights data, an information distribution unit 34 that distributes information to each user, and various databases 35a to 35b.

The database group includes a portrait rights database 35a as a data storage means for storing the generated portrait rights, a user database 35b for storing information about users, and an accumulated information database 35c for storing external information such as current events, weather, and economic information collected from the Internet. Each of these databases may be a single database, or may be divided into multiple databases and a relational database in which each data is linked to the other data by setting relationships between them.

The ivory right database 35a is a data storage means that encrypts and stores at least a portion of the ivory right data. The data stored in this ivory right database 35a includes voice data uploaded by each user, time information and location information at the time the voice data was acquired, and personal information data linked to it, and this information is recorded as ivory right. The ivory right database 35a is equipped with advanced security functions and plays an important role in safely storing users' voice data and related information. Each data item in this database is managed by a unique identifier, and multi-layered security measures are implemented to prevent unauthorized access and data tampering.

The information stored in user database 35b includes authentication information that links an identifier (user ID, terminal ID) that identifies the user or the information processing terminal used by the user with a password, etc., and also includes personal information of the user linked to the user ID and the model of the terminal device. In addition, user database 35b also stores authentication history (access history) for each user or each user terminal, and information (including related information) regarding the portrait right for each user through a relationship with portrait right database 35a.

In addition, the user database 35b can also store image information of official identification documents such as driver's licenses, passports, and My Number cards for the purpose of detailed authentication and identity confirmation of users. The user database 35b also stores image data and text data extracted from these identification documents, and information such as the face photo, name, address, issue date, and expiration date of the driver's license, information such as the face photo, name, nationality, issue date, and expiration date of the passport, and information such as the face photo, name, address, issue date, expiration date, and My Number card are stored as user information. Since this personal information is highly confidential, it is encrypted and stored using powerful encryption technology. Such image information and text data of identification documents are used to ensure safety and meet legal requirements for the use of services, such as user identity confirmation, age confirmation, and identity confirmation during transactions. For example, when buying, selling, or transferring portrait rights, this information is referenced to confirm the identities of both parties in the transaction and prevent fraud and dishonesty.

The information stored in the accumulated information database 35c includes external information such as current affairs news information, weather information, traffic information, stock price and exchange rate information, real estate price information, and sports and entertainment information. More specifically, the accumulated information database 35c aggregates information for capturing the social background and environment at the time the voice data was generated, which makes it possible to reproduce and understand not only the voice data but also the social environment and cultural background at the time the voice data was acquired. Specifically, current affairs news information reflects important events and topics of the time, weather information is the climate and weather conditions at the time, traffic information is the means of transportation and traffic congestion, stock price and exchange rate information is economic trends, real estate price information is the local economic situation and demographics, and sports and entertainment information is stored as information indicating people's entertainment and interests at that time.

The authentication unit 33 is a module that establishes a communication session with each smartphone 5 through the communication interface 31 and performs authentication processing for each established communication session. This authentication processing involves obtaining authentication information from the smartphone 5 of the accessing user, referencing the user database 35b, identifying the user, etc., and authenticating their authority. The authentication results by this authentication unit 33 (user ID, authentication time, session ID, etc.) are sent to the authentication right data control unit 36 and are also stored in the user database 35b as authentication history.

The location information management unit 32 is a module that acquires location information acquired by the user's smartphone 5 and sent to the voice rights management server 3. The location information management unit 32 links the identifiers (user ID, terminal ID, etc.) of the user or user terminal device identified by the authentication process by the authentication unit 33 with the location information, and stores it as a usage history in the user database 35b.

The portrait right data control unit 36 is a module that executes and manages the generation (issuance), update, transfer, and cancellation of portrait right data, and updates the blockchain in order to execute the generation, update, transfer, or cancellation of each portrait right data in cooperation with the guarantee system cooperation unit 36c. Specifically, the portrait right data control unit 36 includes a portrait data control unit 36a, a related data control unit 36b, and a guarantee system cooperation unit 36c.

The voice data control unit 36a is a module that functions as a voice data generation unit that acquires an acoustic signal of the user's voice and generates voice data. The related data control unit 36b is a module that functions as a related data acquisition unit that acquires related data including personal information. The voice data control unit 36 associates the voice data generated by the voice data control unit 36a with the related data acquired by the related data control unit 36b to generate voice data.

The guarantee system linking unit 36c is a module that requests the guarantee system 4 on the network to perform the processes necessary for ivory right management, such as information related to the ivory right and other security management and storage of transfer records, and cooperates with the guarantee system 4 to proceed with the processes. The ivory right data control unit 36 manages the generation, transition, and transfer of ivory rights by linking with the guarantee system 4 through the guarantee system linking unit 36c. For example, each ownership is transferred by adding a public address related to the acquirer of the ivory right and changing the owner of the various rights certified by the blockchain.

The guarantee system 4, which is a blockchain interface service, has multiple nodes that encrypt and store at least a portion of the signature rights data. These nodes link the signature data and related information contained in the signature rights data, aggregate at least a portion of the information at a predetermined timing, and form blocks. These blocks are linked to existing blocks to form a blockchain, which is shared by multiple nodes and stored as a distributed ledger.

The information distribution unit 34 is a module that, in response to access from users, presents a website related to the voice rights management service, provides each user with a unique My Page, and enables each user to individually view information regarding the voice rights they own. It also has a function to present an NFT trading platform for registering and trading voice rights as NFTs, and distributes the generated graphics and user interface of the NFT trading platform to each user via the communication interface 31.

(2) Smartphone 5
Next, a description will be given of the internal configuration of the smartphone 5. As shown in Figures 3(a) and (b), the smartphone 5 is roughly composed of a communication interface 51, an input interface 52, an output interface 53, an application execution unit 54, and a memory 55.

The communication interface 51 is a communication device for making calls or data communications, and has the function of non-contact communication by radio or the like, and contact (wired) communication by a cable, adapter means, or the like. The input interface 52 is a device for inputting user operations, such as a mouse, keyboard, operation buttons, or touch panel 52a. The output interface 53 is a device for outputting video and audio, such as a display or speaker. In particular, the output interface 53 includes a display unit 53a such as a liquid crystal display, which is superimposed on the touch panel 52a, which is the input interface.

Memory 55 is a storage device that stores the OS (Operating System), firmware, programs for various applications, and other data. In addition to a user ID that identifies the user, this memory 55 also stores application data downloaded from the voice rights management server 3, as well as various data processed by the application execution unit 54. In particular, in this embodiment, memory 55 stores rights information obtained from the voice rights management server 3.

The application execution unit 54 is a module that executes applications such as a general OS, game applications, and browser software, and is usually realized by a CPU, etc. In this application execution unit 54, a voice rights management unit 543, a display data generation unit 546, a display control unit 545, and a location information acquisition unit 544 are virtually constructed by executing the program of the voice rights management application according to the present invention.

The voice right management unit 543 is a module having a function of performing operations such as generating, acquiring, changing, and deleting voice right data on the smartphone 5. In particular, the voice right management unit 543 functions as a voice right data generation unit that generates voice data D3 by associating personal information D2 with voice data D1. The voice right management unit 543 then associates the generated voice right data with metadata such as a user ID, time, and location information and stores it in the memory 55. In this embodiment, the voice right management unit 543 includes a voice data generation unit 541, an associated data acquisition unit 542, and a synchronization processing unit 540.

The voice data generation unit 541 is a module that acquires an acoustic signal and generates voice data; it receives the user's voice as an input audio signal, and records and saves it as digital data. When the user performs an operation such as "record voice" on the application, this part is activated and acquires voice data using the built-in microphone or an external microphone, and encodes and saves it in an appropriate format. In addition, it assigns a timestamp to the recorded voice data, and also saves information about when the data was acquired.

In this embodiment, the voice data generation unit 541 includes a language conversion unit 541a and a voice quality conversion unit 541b.
The language conversion unit 541a is a module that converts the language of the voice data based on the feature parameters extracted by the voice feature extraction unit 542a. Specifically, the language conversion unit 541a recognizes phrases and words in the voice data uttered by the user through a voice recognition process, converts non-standard formats such as abbreviations, shorthands, and slang for the corresponding text into a standard format, and translates the text into the target language. In this translation process, translation is performed by referring to dictionary data or using a neural network-based model, and, as necessary, converts the text into a non-standard format or style such as a colloquial style or a dialect with a specific accent. The text data whose language has been converted in this way is regenerated as voice data by the voice synthesis engine of the voice data generation unit 541.

On the other hand, the voice quality conversion unit 541b is a module that converts the voice quality of the voice data based on the feature parameters extracted by the voice feature extraction unit 542a. Voice conversion by the voice quality conversion unit 541b uses signal processing technology to change the characteristics of the input voice and regenerate a voice that is different from the original voice. Specifically, the voice conversion process by the voice quality conversion unit 541b involves changing the pitch (frequency) of the voice to change the pitch, or changing the speed (tempo) of the voice to shorten or extend the duration of the voice. At this time, it is also possible to use pitch shift technology to change only the pitch without changing the speed of the voice, or to change only the tempo without changing the pitch.

The voice conversion unit 541b can also convert the voice to that of a different age or gender by changing the formant, which is an element that determines the characteristics of the voice, and can also add echo or reverb to add reverberation or delay to the voice, modulate the frequency or amplitude of the audio signal with modulation effects or filtering, or remove specific frequency bands to create special voice effects such as the voice of a robot or an alien. By combining these processes, the voice conversion unit 541b can generate a variety of voice effects, and detailed adjustments and customization are possible through user settings operations, making it possible to create realistic conversions and special voice effects.

In addition, when generating voice data in the voice data generation unit 541, it also has a function of singing a song by inheriting the feature parameters of the voice data acquired from the user. Specifically, in order to cover a variety of phrases, words, pitches, and pronunciations, the voice data generation unit 541 acquires the voice of various sentences and songs by recording, etc., and performs preprocessing such as noise removal and normalization on the voice data for the voice, and extracts feature parameters such as Mel Frequency Cepstral Coefficients (MFCC), pitch, pronunciation speed, and sound intensity via the voice feature extraction unit 542a. Then, based on the extracted feature parameters, a voice synthesis model is constructed, and the voice of the target person is synthesized based on text such as lyrics and melody information.

On the other hand, the related data acquisition unit 542 is a module that acquires related data, including personal information, to be stored together with the voice data. This includes, for example, location information at the time of recording the voice data, information about the user's device, the recording environment (e.g., indoors, outdoors, presence or absence of noise, etc.), and other metadata. These related data can provide more detailed context and background information when analyzing and using the voice data. In this embodiment, the related data acquisition unit 542 has a voice feature extraction unit 542a, a conversion parameter recording unit 542b, and a processing information control unit 542c.

The voice feature extraction unit 542a is a module that extracts any of the frequency, duration, amplitude, intensity, or frequency components contained in the voice data as feature parameters. Specifically, the voice feature extraction unit 542a extracts the fundamental frequency that indicates the pitch of an individual's voice, the resonant frequency (formant frequency) that indicates the characteristics of an individual's vowels, the Mel-Frequency Cepstral Coefficients (MFCCs) for capturing specific characteristics and patterns of an individual's voice, the vibration pattern of the vocal cords, the spectral envelope that is a characteristic of the frequency components of the voice, the intensity or power (energy) of an individual's voice, the spectral shape, etc.

The related data acquisition unit 542 is a module that records various parameters used when the voice quality or language is converted by the voice data generation unit 541, including them in the related data. In particular, the conversion parameter recording unit 542b of this conversion parameter recording unit 542b provides a function to record, as conversion parameters, the characteristic parameters of the voice data after it has been processed, such as generated, converted, or synthesized, by the voice data generation unit 541.

The processing information control unit 542c is a module that controls various information required for the processing of voice generation, conversion, synthesis, processing, etc. performed by the voice data generation unit 541 as processing information. This processing information includes conversion parameters (pitch, tempo, formant, effects, etc.) required for voice synthesis or voice conversion, as well as preset information, text data, character settings, music data, etc. Here, the text data includes text such as sentences and lyrics, as well as information required for language, pronunciation, accent, emphasis, speed, pronunciation in a specific language or dialect, and adjustment of the degree of emphasis of words and phrases, which are written in text form. The character settings include information required to adjust the tone and intonation of the voice in accordance with the attributes and characteristics of the character, such as the gender, age, personality, emotions, and nationality of the person (person, animal, creature, etc.) of the synthetic voice. Furthermore, the music data includes melody, rhythm, tempo, volume, as well as information required to change the pitch and speed of the voice in accordance with the melody and rhythm of the music, and to adjust the volume and emphasize specific parts.

This processing information can be preset information, that is, a specific voice profile that can be set in advance by the user or provided by the software. By appropriately combining this information, a wide variety of voice conversions and voice synthesis are possible, and by adjusting these conversion parameters according to the user's requests and purposes, a more natural and realistic voice can be generated.

Such processing information may be provided by, for example, a graphical user interface (GUI) provided by the GUI control unit 545a, with visual elements such as sliders, drop-down menus, and check boxes, allowing the user to intuitively adjust parameters, and information or commands may be entered directly into a text box as text data. In addition, the above-mentioned various settings may be prepared as presets, such as "old man" or "angry cat," and the user may select from these presets. These profiles, audio data, and music data may be uploaded directly to the related data acquisition unit 542, or the application may link with external services and databases to automatically acquire and input information.

The synchronization processing unit 540 is a module that synchronizes the voice rights management processing on the smartphone 5 side with the voice rights management processing on the voice rights management server 3 side. Specifically, the voice rights management server 3 side predicts possible event processing based on the positions of other users' characters and objects, generates the conditions for the event processing on the voice rights management server 3 side, transmits the conditions to the smartphone 5 side, and receives the conditions for the event processing on the synchronization processing unit 540. The actual event processing and the graphic processing for the event processing are executed by the GUI control unit 545a on the smartphone 5 side based on the conditions for the event processing received from the voice rights management server 3. The results of the event processing executed by the GUI control unit 545a on the smartphone 5 side (such as the outcome of a battle or mini-game, or points) are notified to the GUI control unit 545a on the voice rights management server 3 side through the synchronization processing unit 540, and are reflected in the subsequent game progress processing.

The display data generating unit 546 is a module that generates display data to be displayed on the display unit 53a. The display data is data that is generated by combining graphic data, image data, character data, video data, audio data, and other data, and generates a screen that displays, for example, a list of portrait rights or a detailed display of specific portrait rights data. The display process of the display data generated by this display data generating unit 546 is controlled by the display control unit 545.

The display control unit 545 is a module that controls the specific screen display based on the data generated by the display data generation unit 546. In this embodiment, the display control unit 545 has a GUI control unit 545a, and realizes interaction with the user via the touch panel 52a and the display unit 53a, and performs appropriate screen transitions and information updates in response to user operations.

The GUI control unit 545a is a module responsible for displaying and controlling the graphical user interface (GUI) on the display of the smartphone 5. This GUI control unit 545a displays graphical elements such as various buttons, menus, icons, and windows on the display so that the user can intuitively operate applications, and performs appropriate reactions and actions in response to inputs such as touch operations from the user. The GUI control unit 545a works in conjunction with the display data generation unit 546.

Based on the data and information generated by the display data generation unit 546, the GUI control unit 545a presents it to the user in a visual and easy-to-operate format. For example, when displaying a list of voice rights, the GUI control unit 545a controls design elements such as the design, layout, and color usage of the list. Furthermore, the GUI control unit 545a also has the role of calling up appropriate application functions in response to user operations. For example, when the user taps the "Record new voice data" button, the GUI control unit 545a receives the operation and sends a command to the voice rights management unit 543 to start the voice data recording process.

The location information acquisition unit 544 is a module that has a function of acquiring current location information using the built-in GPS sensor of the smartphone 5 and communication information with a wireless base station. Specifically, the location information acquisition unit 544 acquires information using the Global Positioning System (GPS) using artificial satellites, base station positioning using triangulation based on the signal strength from the base station and base station information, and Wi-Fi positioning using a database that combines the Wi-Fi SSID (Service Set ID) and signal conditions with longitude and latitude.

In addition, in this embodiment, the location information acquisition unit 544 has a time information acquisition unit 544a. The location information and time information acquired by this location information acquisition unit 544 are linked as metadata, which is related data, when the voice data is generated, and are saved as information on when and where the voice data was acquired. This function makes it possible to give the voice data a temporal and geographical context, thereby enriching the story and background behind the voice data.

(3) Guarantee System 4
As described above, in this embodiment, a guarantee system 4 that guarantees the identity of a person using blockchain technology is provided. Specifically, as shown in Fig. 4, the guarantee system 4 includes a communication interface 43, an authentication unit 42, a rights management execution unit 44, an NFT transaction history database 41a, a key information database 41b, and an account database 41c.

The communication interface 43 is a module that transmits and receives data to and from other communication devices via the communication network 2, and in this embodiment is connected to each voice rights management server 3. The authentication unit 42 is a computer or software with that function that verifies the legitimacy of the accessor, and executes authentication processing based on a user ID that identifies each user. In this embodiment, the authentication unit 42 obtains the user's unique public address, public key, user ID, password, etc. from the accessor's smartphone 5 via the communication network 2, and verifies whether the accessor has the right and whether the accessor is the person in question by comparing them with the key information database 41b.

The rights management execution unit 44 is a module that handles the votive rights through NFT (Non-Fungible Token) technology. In this embodiment, the votive rights are also one of the so-called digital assets, and the uniqueness and rarity of the votive rights are proven and guaranteed through the rights management execution unit 44 based on blockchain technology. The rights management execution unit 44 employs this NFT technology to confirm and guarantee the uniqueness and rarity of the votive rights data.

In this embodiment, the voice rights data generated by the user is issued as an NFT, and related information and attributes are stored on the blockchain. Through this process, the originality and ownership of the voice rights data are reliably protected, and unauthorized copying and distribution by third parties can be prevented. Furthermore, the voice rights data as an NFT can be traded on the market, allowing users to buy and sell rights related to their own voices as NFTs, creating new economic value.

Specifically, in this embodiment, the portrait right in the NFT is linked to the public account of the legitimate owner, and one can prove that one is the legitimate owner by presenting the public account relationship. In addition, only the legitimate owner can carry out transfer procedures such as assignment of the portrait right.

The rights management execution unit 44 has a function of linking with the guarantee system linking unit 36c on the voice rights management server 3 side, and this guarantee system linking function is requested by devices of other service providers, for example the guarantee system linking unit 36c of the voice rights management server 3, to perform rights management-related processes such as security management related to voice rights management using NFT, transaction records, and storage of service history, and proceeds with rights management processes through NFT by interacting with each of these devices. Specifically, the rights management execution unit 44 includes a rights information providing unit 44a, a public address management unit 44b, a validity verification unit 44c, and a data update unit 44d.

The rights information provider 44a is a module that provides, via the Internet or the like, detailed rights information when a user issues a cryptocurrency as an NFT. The provided information includes the price of the cryptocurrency, the date the cryptocurrency was created (the user's age, generation, etc.), the current owner, and transfer benefits such as how many times it has been traded.

The public address management unit 44b is a module that manages users' public accounts (public addresses) and has a private key issuance function that issues public addresses generated from a public key in a public key cryptosystem to identify a specific user, and private keys that can be paired with the public keys to identify the public key and are used for electronic signatures for voice rights management via the public addresses, and these issued public addresses and their associated key information are stored in the key information database 41b. When a user trades NFTs, this public address becomes the key that proves the legitimacy of the transaction, and the public address functions as the user's identifier on the blockchain and is used to uniquely identify the NFTs and transaction history owned by the user.

The legitimacy verification unit 44c is a module that verifies whether an operation is legitimate when a transfer or transaction of a imitation right is performed. Specifically, it verifies the transaction information against the public address managed by the public address management unit 44b, and verifies whether the transaction is performed by the legitimate owner. This prevents fraudulent transactions and unauthorized access by third parties. For example, the legitimacy verification unit 44c verifies that the imitation right related to an NFT transaction belongs to the current owner through a legitimate transaction and has not been tampered with, and verifies the legitimacy of the imitation right using the public key of the current owner linked to the public account. It also accumulates all transactions related to the imitation right in the NFT transaction history database 41a, and can verify the legitimacy by checking the NFT transaction history database 41a based on the public key.

The data update unit 44d is a module that updates information related to the token. This part is activated when a user wishes to change the information on the token or when a new token is acquired. The data update unit adds new information to the blockchain and performs procedures to maintain consistency with previous information. For example, the data update unit 44d obtains information related to the token through the NFT, adds a public address related to the new NFT owner, and changes the token owner certified in the distributed ledger, thereby transferring the ownership of the token (NFT). The data updates by the data update unit 44d are protected by high-level security, and double transfers and tampering with transaction history are firmly prevented.

(Method of managing portrait rights)
The method for managing a portrait right of the present invention can be implemented by operating the portrait right management system 1 described above. Fig. 5 is a sequence diagram showing the operation of the portrait right management system. Note that the processing procedure described below is merely an example, and each process may be modified as much as possible. Furthermore, steps may be omitted, replaced, or added to the processing procedure described below as appropriate depending on the embodiment.

First, the voice rights management server 3 is accessed from the smartphone 5, which is the user terminal, and authentication processing begins (S201). Specifically, user U1 operates the voice rights management application on the smartphone 5 and attempts to access the voice rights management server 3. If the connection to the voice rights management server 3 is successful, the user is prompted to enter a user ID and password as login information, and when the user enters this information correctly, the server compares it with the authentication information stored in the user database 35b. If this authentication information matches, the user is successfully authenticated and the user is identified (S101).

On the user terminal side, if the authentication process is successful, voice data is acquired (S202), related data is acquired (S203), and voice record data is generated (S204). More specifically, if the authentication process is successful on the smartphone 5 side, the voice data generation unit 541 records and stores an acoustic signal as digital data. Here, when user U1 performs an operation such as "record voice" on the application, the voice acoustic signal is acquired as voice data via the smartphone 5's built-in microphone or an external microphone. The acquired voice data is encoded in an appropriate format, and a timestamp is added at the same time, so that information on when the data was generated is also stored.

Next, the related data acquisition unit 542 collects various personal information D2 to be stored together with the voice data D1. This related data includes the current location information of the place where the voice was recorded, time information, user device information, details of the recording environment (e.g., whether the recording was made indoors or outdoors, whether there was noise in the background, etc.), and other metadata. This information is accumulated for the purpose of providing the background and context under which the voice data was recorded when the voice data is analyzed or used in the future.

In this embodiment, when acquiring voice data (step S202) and related data (S203), the voice quality, language, and other parameters of the original voice data can be converted as necessary to regenerate the voice data, and the related voice data can be generated based on this new voice data. Figure 6 shows the procedure for regenerating voice data.

In step S202, an acoustic signal is acquired as voice data, and the voice feature extraction unit 542a extracts any one of the frequency, duration, amplitude, intensity, or frequency components contained in the voice data as feature parameters. These feature parameters are passed to the voice quality conversion unit 541b and the language conversion unit 541a.

In step S202a, the voice quality conversion unit 541b converts the voice quality of the voice data based on the characteristic parameters extracted by the voice feature extraction unit 542a. At this time, the voice quality conversion unit 541b acquires various information necessary for processing such as voice generation, conversion, synthesis, and processing as processing information through the processing information control unit 542c. This processing information includes conversion parameters (pitch, tempo, formant, effect, etc.) necessary for voice synthesis or voice conversion, as well as preset information, text data, character settings, music data, etc. For example, if the original voice data is the voice of a woman in her twenties, the age and gender can be changed by raising or lowering the frequency to raise or lower the pitch of the voice and at the same time adjusting some formants, making it possible to make the voice of an elderly person or the voice of a teenage idol. In addition, filters and effects can be applied to reproduce specific accents and pronunciation characteristics, such as nationalities and dialects, and the pitch of the input voice can be significantly raised or lowered to reproduce the cries of small animals such as birds and mice, or the voices of wild animals such as lions and bears, and the voices of aliens and creatures can be reproduced by applying effects such as echo, reverb, filtering, and modulation. The voice quality conversion unit 541b can convert into various voices by combining these processes, and can also use AI and machine learning to achieve more realistic voice conversion.

In step S202b, the language conversion unit 541a converts the language of the voice data based on the feature parameters extracted by the voice feature extraction unit 542a. Specifically, the language conversion unit 541a recognizes phrases and words in the voice data spoken by the user through voice recognition processing, converts non-standard formats such as abbreviations, shortened forms, and slang for the corresponding text into standard formats, and translates the text into the target language. In this translation processing, translation is performed by referring to dictionary data or using a neural network-based model, and, if necessary, converts the text into a non-standard format or style, such as a colloquial style or a dialect with a specific accent.

In this way, by converting the voice quality and language, a variety of voice data can be generated. For example, as shown in FIG. 6, the voice data of a woman in her twenties can be converted into a conversation voice in Italian, which she is not supposed to be able to speak, into a teenage idol singing in English, into the voice of a character or creature such as a cat or an alien speaking the languages of various countries, or even into a conversation voice in the future by increasing the age.

Then, the text data with converted voice quality and language is regenerated as voice data by the voice synthesis engine of the voice data generation unit 541 (S202c). At the same time, the conversion parameter recording unit 542b records, via the related data acquisition unit 542, the various conversion parameters and processing data used when the voice quality or language was converted by the voice data generation unit 541, including them in the related data (S203). At this time, the conversion parameter recording unit 542b also records, as conversion parameters, the characteristic parameters of the voice data after processing such as generation, conversion, and synthesis by the voice data generation unit 541 (S202d).

Next, once all of this information has been collected, voice rights data is generated (S204). This generated data is packaged by combining the voice and related data, and is treated as the user's one and only voice rights. The generated voice rights data is then uploaded to the voice rights management server 3 (S205), and is received by the voice rights management server 3 (S102). Specifically, once a series of processes on the smartphone 5 side is completed and voice rights data D3 is generated, uploading of this voice rights data D3 from the smartphone 5 via the communication network 2 to the voice rights management server 3 begins (S205).

Upon receiving this upload, the voice rights management server 3 carries out a process to receive the transmitted voice rights data (S102). Once the voice rights data has been accurately received by the voice rights management server 3, the validity of the data is then verified (S103). In validity verification, the reliability of the newly received data is confirmed by comparing it with existing information stored on the voice rights management server 3 and data uploaded by other users, focusing on whether the received voice rights data is reliable and whether there are any elements that may be suspected of tampering or fraud.

After the validity of the voice rights data is successfully verified, the user performs a rights setting operation (S107), and the voice rights management server 3 executes a rights setting process (S108). Specifically, the voice rights data is registered in the voice rights database 35a and stored in the blockchain through the guarantee system 4 (S105), and the setting of the voice rights is completed (S106). When setting the rights here, the user's intentions and setting contents are set based on the user's operation, and rules and restrictions regarding the management and use of data are established. That is, the set voice rights data is registered in the voice rights database 35a. In addition, in this embodiment, in addition to registering in the database, in order to increase the reliability and immutability of the data, it is also stored in a system using blockchain technology via the guarantee system 4. The blockchain makes it extremely difficult to tamper with the data, thereby ensuring the safety and reliability of the voice rights data. In this way, the setting of the user's right regarding his/her voice, that is, the voice rights, is completed (S106).

After the setting of the portrait right is completed, a right creation notification is sent to the smartphone 5 to inform the user that the right has been created. On the smartphone 5 side that receives this notification (S208), a right creation completion process is executed, and the application data on the user terminal side is updated.

(Operation of the warranty system)
Here, the mechanism of the distributed ledger system adopted in the above-mentioned guarantee system will be described in detail. In this embodiment, the guarantee system provides a blockchain interface service, and this service includes a plurality of nodes that store at least a part or all of the data generated by the voice rights management server 3, and these nodes aggregate and block the stored data at a predetermined timing, form a blockchain using the blocks, and share the blockchain among the plurality of nodes and store it as a distributed ledger.

Specifically, as shown in FIG. 9, the national anthem management system 1 according to this embodiment issues a key pair of a public key PKa and a private key SKa based on a public key cryptosystem through a guarantee system 4 when issuing, transferring, or canceling an NFT related to a national anthem, and generates a public address PAa from the public key PKa corresponding to the issued NFT. This public address PAa is used as an address indicating the transferee (purchaser) and transferor (rights holder) in the national anthem trading contract, while the private key SKa is used for the electronic signature of the transaction in which the public address PAa is the transfer source.

The copyright management in this embodiment is carried out between two nodes on a P2P (Peer-to-Peer) network 90 (here, between the rights holder and the purchaser), and the transaction information is broadcast to and shared among the nodes 90a to 90f in the P2P network 90. As a result, a transaction history database (a so-called blockchain) based on a distributed ledger system is formed on the P2P network 90, and transaction history for various tokens and copyright management is stored.

In this embodiment, transactions using this distributed ledger system are performed, approved, and managed through the voice rights management server 3 when issuing NFTs or rewriting their owners. The voice rights management server 3, which acts as an intermediary in voice rights transactions, generates an intermediary public address PA3 that is unique to the voice rights management server 3 (unique to each individual transaction) as an NFT platform to mediate transactions between the rights holder and the purchaser, and relays the transfer of tokens, with the tokens being the subject of the transaction being temporarily deposited in the voice rights management server 3.

The parties to the transaction (rights holder and purchaser) then use the voice rights management system 1 to transfer the NFT from the current rights holder to an intermediary public address PA3 that is unique to this transaction and set in the voice rights management server 3, thereby initially receiving the NFT, and then transferring it to the new purchaser via the intermediary public address PA3, thereby establishing a sales contract on the NFT platform between the rights holder and the purchaser.

Here, the NFT transfer process will be described in detail. FIG. 7 is a flow diagram illustrating the processing procedure during transfer of the energy trading system according to this embodiment, and FIG. 8 illustrates the relationship between the public key and the private key according to this embodiment. In this embodiment, the NFT transfer process and the account processing related to the NFT transfer utilize the mechanism of the distributed ledger system according to this embodiment. Here, an example will be described in which a rights holder sells an NFT to a purchaser who becomes a new rights holder through an NFT trading platform. As shown in FIG. 8, this NFT transaction includes step S301 of issuing a public address and a private key, step S302 of registering related service history information, and step S303 of executing the rights transfer process.

First, in step S301, in the guarantee system 4, the public address management unit 44b issues a pair of an intermediary public address PA3 unique to the NFT trading platform and a private key SK3 corresponding to this intermediary public address PA3. Specifically, as illustrated in FIG. 8, the guarantee system 4 uses a random number generator or the like to generate the private key SK3 associated with the public address unique to the token trading platform by public key cryptography. The random number generator may be built into the public address management unit 44b as a program, for example.

Next, the guarantee system 4 generates a public key PK3 from the private key SK3 based on an electronic signature algorithm such as Elliptic Curve Digital Signature Algorithm (ESDSA). The generated public key PK3 and private key SK3 form a key pair in a public key cryptosystem, and due to the nature of this public key cryptosystem, it is possible to generate the public key PK3 from the private key SK3, but it is configured such that it is impossible to generate the private key SK3 from the public key PK3 in terms of the amount of calculation required. In other words, it is not possible to identify the private key SK3 from the public key PK3, but it is possible to identify the public key PK3 from the private key SK3. Note that the type of electronic signature algorithm used is not limited to Elliptic Curve DSA, and may be selected appropriately depending on the embodiment.

Then, the assurance system 4 generates an intermediary public address PA3 from the public key PK3 by applying a one-way hash function such as SHA-256 or RIPEMD-160 to the public key PK3. For example, the assurance system 4 can generate the intermediary public address PA3 by applying SHA-256 twice to the public key PK3. In other words, this intermediary public address PA3 is a hash value of the public key used to sign the transaction described above, and is used to identify the transfer destination and transfer source of the NFT.

In the next step S302, transaction history data associated with the NFT, such as the history of services provided to the NFT trading platform by the rights holder who is the source of the transfer, is linked to the intermediary public address PA3 generated in step S301 and recorded in the node. Specifically, the power of attorney data obtained by the guarantee system 4 is linked to the intermediary public address PA3 and made public. This power of attorney data can be freely viewed by anyone who has obtained the public key PK3 related to the intermediary public address PA3. As a result, anyone can verify whether there has been any fraud or tampering with the history of the power generation method and power generation location from which the electricity originates, or the transaction history.

After that, in step S303, the guarantee system 4 performs a transaction of transfer of rights to the intermediary public address PA3 generated in step S301. Then, when the transfer is completed, the guarantee system 4 ends the processing related to this operation example. Here, an application executed on the smartphone 5, for example, is used for the exchange of NFT related to this embodiment. Therefore, an application that executes the mechanism of NFT transactions is also installed in the public address management unit 44b of the guarantee system 4, and this application controls the intermediary public address managed by the platform.

While the portrait rights as an NFT belong to the right holder, the NFT's unique public address PAa is associated with a paired private key SKa on the right holder's smartphone 5, and when the transfer procedure is carried out on the NFT trading platform, the purchaser uses an information terminal such as a smartphone to temporarily transfer the NFT from the source public address PAa (transfer source) to the intermediary public address PA3 (transfer destination) generated by the NFT platform in step S301.

In response to this, a buyer who wishes to purchase a new NFT can use their own information processing terminal device, such as a smartphone 5, to obtain the public key PK3 linked to the NFT, and the buyer can view voice data related to the cryptocurrency, transaction progress information, and related external information linked to the intermediary public address PA3 of the NFT trading platform.

Specifically, an application for NFT transactions is also installed on the purchaser's smartphone 5, and this application manages the public address PAb held by the purchaser. The purchaser's private key SKb is associated with the public address PAb, which allows the purchaser to further transfer the NFT from his or her public address PAb to another person. In other words, each private key SKb allows the purchaser to freely use the NFT stored in the public address PAb and its transaction history. Here, the purchaser uses the application on the smartphone 5 to receive the NFT transferred from the intermediary public address PA3 specific to the NFT platform to the public address PAb.

As a result, the transferee (purchaser) can receive the NFT at his/her public address PAb, and can view the service history and use the service linked to this intermediary public address PA3. This public address may be issued by the voice rights management server 3, or by software on each transaction user terminal, or by the server of an independent service management institution or financial institution. Here, we will explain in detail the detailed mechanism of NFT transactions. Figures 10 to 12 show examples of part of the token transaction history (blockchain).

The transaction history regarding the issuance, transfer, and cancellation of an NFT is defined as a chain of a series of electronic signatures. When the owner of this NFT transfers its transaction history to the next owner, they add to the token's transaction history the hash value of the previous transaction and the hash value of the public key related to the next owner, which are digitally signed with their own private key. Note that a one-way hash function such as SHA-256 or RIPEMD-160 is used to calculate these hash values.

Figure 10 illustrates, as a specific example of a transaction, a scene in which an NFT is transferred from owner Z to owner A, from owner A to owner B, and then from owner B to owner C. In this case, when transferring a token from owner A to owner B, owner A adds to the token a hash value of the transfer transaction from owner Z to owner A and a hash value of the public key of the next owner, owner B, digitally signed with owner A's private key.

Any subsequent owner of the token, including owner B, can determine whether the transaction has been tampered with by comparing the value obtained by decrypting this electronic signature with owner A's public key with the hash value of the transfer transaction from owner Z to owner A and the hash value of owner B's public key. Similarly, when transferring a token from owner B to owner C, owner B adds to the token the hash value of the transfer transaction from owner A to owner B and the hash value of the public key of the next owner, owner C, electronically signed with owner B's private key. This makes it possible to determine whether the transfer transaction from owner B to owner C has been tampered with.

NFT can be defined as a chain of such a series of electronic signatures. Here, the hash value of the public key is the public address. In other words, the tokens stored in this public address can only be transferred by those who can perform an electronic signature of the token with this public address as the transfer source, that is, by those who have the private key corresponding to this public address. Therefore, the private key is generally kept secret so as not to be leaked to anyone other than the owner. Note that the token and data related to it, such as transaction history, are stored in a public address linked to the current owner. In addition, since this electronic signature alone cannot verify that any of the past owners of the token have used the token multiple times (transferred it multiple times), the token transaction mechanism according to this embodiment uses a mechanism called a blockchain, exemplified in FIG. 11 and FIG. 12, to prevent this multiple use.

As illustrated in Figures 11 and 12, each block recorded in a token or the like stores multiple transactions, a nonce, and the hash value of the previous block. A nonce is a disposable random value used in cryptographic communications, and the node (miner) 90a to 90f that first discovers this value acts as an approver and updates the blockchain by adding the block in which the nonce was discovered to the end of the blockchain.

As a result, a consistent transaction history is recorded in the blockchain, and by sharing this blockchain among all nodes 90a to 90f participating in the P2P network 90, a consistent transaction history can be shared throughout the entire P2P network 90. In other words, this blockchain serves as part or all of the NFT transaction history database 41a and key information database 41b in the guarantee system 4 described above. In this embodiment, NFT transactions are carried out using this mechanism in the identity management based on the public key cryptography method.

(Action and Effects)
As described above, according to this embodiment, a person's voice and the personal information of the owner of that voice are linked by a blockchain and managed as an NFT, and the person's voice can be guaranteed as a right, and each individual's voice data can be efficiently and safely managed and utilized. In more detail, according to this embodiment, the voice data can be protected as a "voice right," and a clear ownership right can be set for the individual's voice data in the form of this voice right, making it possible to prevent unauthorized use and infringement of rights.

In this embodiment, the original voice data is converted as necessary in terms of voice quality, language, etc. to regenerate new voice data that is different from the original, and the voice rights based on this new voice data can be utilized in a variety of services to increase the added value of the services. For example, by using the reproduced voice data, the voice rights can be utilized in a variety of fields, such as education, entertainment, games, welfare, and travel, for example, a virtual travel experience in which the user simulates a travel experience in a foreign country by speaking a foreign language in their own voice, promotions using foreign language versions of songs, a dialogue simulation in a different space in which the user enjoys dialogue in a virtual space as an animal character or an alien, simulating a dialogue with the past or future self by making the user's voice younger or older, providing an opportunity to think about life choices and goals, and language learning assistance.

In addition, in this embodiment, voice data is linked to the personal information of its owner via blockchain technology, so privacy is strongly protected, and the establishment of a voice right makes it easier to take legal action against unauthorized use of the voice data. Furthermore, this embodiment allows voice data to be properly protected as a voice right, enabling a new business model for safe commercialization, and clear ownership rights can be set for the voice data, while the owner of the voice data can be appropriately compensated for its use. This allows the voice data to be applied more freely and safely to creative uses, and since the voice data is authenticated and its reliability is ensured, it is expected that voice data will be used in a variety of industries.

The present invention is not limited to the above-described embodiments as they are, and in the implementation stage, the components can be modified to the extent that does not deviate from the gist of the invention. In addition, various inventions can be created by appropriately combining multiple components disclosed in the above embodiments. For example, some components may be deleted from all of the components shown in the embodiments.

D1...Voice data D2...Personal information D3...Voice rights data PAa...Public address PAb...Public address PKa...Public key SKa...Private key SKb...Private key U1...User 1...Voice rights management system 2...Communication network 3...Voice rights management server 4...Guarantee system 5...Smartphone 21...Satellite 22...Wireless base station 31...Communication interface 32...Location information management unit 33...Authentication unit 34...Information distribution unit 35a...Voice rights database 35b...User database 35c...Storage information database 36...Voice rights data control unit 36a...Voice data control unit 36b...Related data control unit 36c...Guarantee system linkage unit 41a...NFT transaction history database 41b...Key information database 41c...Account database 42...Authentication unit 43...Communication interface 44...Rights management execution unit 44a...Rights information provision unit 44b...Public address management unit 44c... Validity verification unit 44d... Data update unit 51... Communication interface 52... Input interface 52a... Touch panel 53... Output interface 53a... Display unit 54... Application execution unit 55... Memory 90... P2P network 90a to 90f... Nodes 540... Synchronization processing unit 541... Voice data generation unit 541a... Language conversion unit 541b... Voice quality conversion unit 542... Related data acquisition unit 542a... Voice feature extraction unit 542b... Conversion parameter recording unit 542c... Processing information control unit 543... Voice rights management unit 544... Position information acquisition unit 544a... Time information acquisition unit 545... Display control unit 545a... GUI control unit 546... Display data generation unit

Claims (12)

A system for managing voice data as a voice right, comprising:
a voice data generating unit that acquires an acoustic signal and generates voice data;
a related data acquisition unit for acquiring related data including personal information;
a voice data generating unit for generating voice data by associating the voice data with the related data;
and a data storage means for encrypting and storing at least a part of the copyright data. The data storage means includes a guarantee system linking unit that links with a guarantee system constructed on a communication network to encrypt and store at least a part of the image right data;
The security system includes a plurality of nodes that encrypt and store at least a portion of the image recognition data;
The copyright management system according to claim 1, characterized in that the node aggregates at least a portion of the copyright data at a predetermined timing, forms a block, links the block to an existing block to form a blockchain, and shares the blockchain among a plurality of the nodes and stores it as a distributed ledger. the voice data generating unit has a function of adding time information including a date and time of acquisition of the acquired acoustic signal to the associated data;
The voice rights management system according to claim 1, characterized in that the related data acquisition unit has a function of analyzing a correlation between a date and time when the added acoustic signal was acquired and information regarding age included in the personal information, and including the analysis result in the related data. a voice feature extraction unit for extracting any one of frequency, duration, amplitude, intensity, and frequency components contained in the voice data as a feature parameter;
a conversion unit that converts the voice quality or language of the voice data based on the feature parameters;
The system according to claim 1 , further comprising a conversion parameter recording unit for recording, as conversion parameters, characteristic parameters of the voice data after the conversion unit converts the voice quality or language. A method for managing voice data as a voice right using the voice right management system according to claim 1, comprising:
a voice data generating step in which a voice data generating unit obtains an acoustic signal to generate voice data, a related data obtaining unit obtains related data including personal information, and a voice data generating step in which the voice data and the related data are related to each other to generate voice data;
and a data storage step in which data storage means encrypts and stores at least a part of the voice right data. the data storage step includes a guarantee system linking step of encrypting and storing at least a part of the image right data in cooperation with a guarantee system constructed on a communication network;
The security system includes a plurality of nodes that encrypt and store at least a portion of the image recognition data;
The method for managing rights to the personal computer as described in claim 5, characterized in that, in the data storage step, the node aggregates at least a portion of the personal computer data at a predetermined timing to form a block, links the block to an existing block to form a blockchain, and shares the blockchain among a plurality of the nodes to store it as a distributed ledger. In the voice data generating step, the voice data generating unit adds time information including a date and time of acquisition of the acquired acoustic signal to the associated data,
The method for managing voice rights according to claim 5, characterized in that the related data acquisition unit analyzes the correlation between the date and time when the added acoustic signal was acquired and information regarding age included in the personal information, and includes the analysis result in the related data. In the image data generating step,
a voice feature extraction step in which a voice feature extraction unit extracts any one of frequency, duration, amplitude, intensity, or frequency components contained in the voice data as a feature parameter;
a conversion step of converting a voice quality or a language of the voice data based on the feature parameters by a conversion unit;
6. The method of claim 5, further comprising a conversion parameter recording unit for recording characteristic parameters of the voice data after the conversion unit converts the voice quality or language as conversion parameters. A program for managing voice data as a voice record, comprising:
a voice data generating unit that acquires an acoustic signal and generates voice data;
a related data acquisition unit for acquiring related data including personal information;
a voice data generating unit for generating voice data by associating the voice data with the related data;
a computer program product for managing a copyright, the computer program product being operable as a data storage means for encrypting and storing at least a portion of the copyright data; The data storage means includes a guarantee system linking unit that links with a guarantee system constructed on a communication network to encrypt and store at least a part of the image right data;
The security system includes a plurality of nodes that encrypt and store at least a portion of the image recognition data;
The computer-implemented program for managing the right to vote according to claim 9, characterized in that the node aggregates at least a portion of the right to vote data at a predetermined timing, forms a block, links the block to an existing block to form a blockchain, and shares the blockchain among a plurality of the nodes and stores it as a distributed ledger. the voice data generating unit has a function of adding time information including a date and time of acquisition of the acquired acoustic signal to the associated data;
The voice right management program according to claim 9, characterized in that the related data acquisition unit has a function of analyzing a correlation between a date and time when the added acoustic signal was acquired and information regarding age included in the personal information, and including the analysis result in the related data. The information processing device,
a voice feature extraction unit for extracting any one of frequency, duration, amplitude, intensity, and frequency components contained in the voice data as a feature parameter;
a conversion unit that converts the voice quality or language of the voice data based on the feature parameters;
10. The voice right management program according to claim 9, further functioning as a conversion parameter recording unit for recording characteristic parameters of the voice data after the conversion unit converts the voice quality or language as conversion parameters.