JP7538581B1 - Voice generation device, voice generation system, and computer program - Google Patents

Abstract

A voice generation device that generates voice phrases having rhythmic changes for input character data, symbol data, and combinations thereof, and associates various content data with the voice phrases and provides them.When content data is input, the voice generation device generates corresponding voice data, the voice generation device being characterized by having the following configuration:Generates packet data by associating content data with at least one of a first note attribute code corresponding to a pitch name code constituting one tone, and a second note attribute code and a third note attribute code corresponding to pitch name codes constituting multiple tones.Performs processing to generate the voice data composed of the pitch name code corresponding to the packet data.

Description

The present invention relates to a voice generation device, a voice generation system and a computer program.

In today's information and communications society, various methods have been proposed, such as speech conversion methods that output input text information as speech in a specified language system, and methods for generating unique expressions that can identify specific information.

In Patent Document 1, the inventor proposes a voice generation device, a voice generation method, and a program. According to Patent Document 1, it is possible to generate musical phrases that have the linguistic meaning of Japanese from character data in the Japanese language.

JP 2014-224976 A

In the invention proposed in Patent Document 1, two musical note codes are extracted for each input Japanese character to generate audio data, so the musical phrases related to the audio data are generally flat with no change in rhythm. Therefore, the challenge was to generate musical phrases with a specified rhythm.

The object of this invention is to generate audio phrases with rhythmic changes for input character data, symbol data, and combinations thereof, and to provide the audio phrases by associating them with various content data.

[1]
A voice generating device that, when content data is input, generates corresponding voice data,
A voice generating device comprising the following configuration.
(1) Packet data constructed as follows is stored in a storage means.
(a) a sound information storage area consisting of (n+2) (n≧1) sound information storage slots, with one (n+2) sound beat being one unit; (b) a first sound attribute code corresponding to a pitch name code constituting one sound is set in the first sound information storage slot.
(c) A second note attribute code corresponding to a note name code constituting a plurality of notes less than (n+2) is set in the note information storage slot under the following conditions:
(c1) It is set in the first sound information storage slot.
(c2) When n=1, the second or third sound information storage slot is set.
(c3) In the case where n≧2, it is set to one of the sound information storage slots selected from the even-numbered, odd-numbered, and (n+2)-th sound information storage slots.
(c4) In the case where n≧2, it is further set to a combination of a plurality of the sound information storage slots selected from the even-numbered, odd-numbered and (n+2)-th sound information storage slots.
(d) A third note attribute code corresponding to a note name code constituting the (n+2) notes is set in all of the note information storage slots.
(2) A sound generation means for generating sound data in which one unit of (n+2) sound beats corresponds to the input content data, according to the following procedure: (a) A process for generating the packet data by associating the input content data with at least one of the first sound attribute code, the second sound attribute code, and the third sound attribute code.
(b) performing a process of generating the voice data composed of the pitch name code corresponding to the packet data;

[2]
A voice generation system including: a voice generation device that generates corresponding voice data when content data is input; and a receiving terminal that receives the voice data from the voice generation device,
1. A voice generation system comprising the following configuration.
(1) The voice generating device includes a storage means for storing packet data constructed as follows:
(a) a sound information storage area consisting of (n+2) (n≧1) sound information storage slots, with one (n+2) sound beat being one unit; (b) a first sound attribute code corresponding to a pitch name code constituting one sound is set in the first sound information storage slot.
(c) A second note attribute code corresponding to a note name code constituting a plurality of notes less than (n+2) is set in the note information storage slot under the following conditions:
(c1) It is set in the first sound information storage slot.
(c2) When n=1, the second or third sound information storage slot is set.
(c3) In the case where n≧2, it is set to one of the sound information storage slots selected from the even-numbered, odd-numbered, and (n+2)-th sound information storage slots.
(c4) In the case where n≧2, it is further set to a combination of a plurality of the sound information storage slots selected from the even-numbered, odd-numbered and (n+2)-th sound information storage slots.
(d) A third note attribute code corresponding to a note name code constituting the (n+2) notes is set in all of the note information storage slots.
(2) The sound generating device includes a sound generating means for generating sound data with (n+2) sound beats as one unit, which corresponds to the input content data, according to the following procedure.
(a) performing a process of generating the packet data by associating the input content data with at least one of the first sound attribute code, the second sound attribute code, and the third sound attribute code;
(b) performing a process of generating the voice data composed of the pitch name code corresponding to the packet data;
(3) The voice generating device includes a voice data output unit that outputs the generated voice data.
(4) The receiving terminal includes a data conversion means for converting the generated voice data into the content data.

According to this invention, audio phrases having rhythmic changes can be generated for input character data, symbol data, and combinations thereof, and various content data can be associated with the audio phrases and provided.

(a) is a diagram showing an example of the hardware configuration of a receiving terminal constituting the voice generation device and voice generation system of the present embodiment; (b) is a diagram showing an example of the software configuration of the voice generation device of the present embodiment; and (c) is a diagram showing an example of the software configuration of a receiving terminal constituting the voice generation system of the present embodiment. 1A is a diagram showing an example of a sound information storage area; FIG. 1B is a diagram showing an example of the correspondence between a sound name code and a conversion code; FIG. 1C is a diagram showing an example of packet data; and FIG. 1D is a diagram showing an example of voice data. FIG. 1A is a diagram showing an example of a one-tone matrix; FIG. 1B is a diagram showing an example of a two-tone matrix; and FIG. 1C is a diagram showing an example of a three-tone matrix. FIG. 1A is a diagram showing another example of a sound information storage area; FIG. 1B is a diagram showing an example of the correspondence between a pitch name code and a conversion code; FIG. 1C is a diagram showing another example of packet data; and FIG. FIG. 1A is a diagram showing an example of a one-tone matrix; FIG. 1B is a diagram showing an example of a two-tone matrix; FIG. 1C is a diagram showing an example of a three-tone matrix; and FIG. 1D is a diagram showing an example of a four-tone matrix. 1A is a diagram showing another example of a sound information storage area; FIG. 1B is a diagram showing another example of the correspondence between a pitch name code and a conversion code; A diagram showing the arrangement patterns of sound attribute codes FIG. 1 is a diagram for explaining the structure of a sound ID. FIG. 1 is a diagram illustrating an example of a hierarchical structure of packet data. FIG. 1 is a diagram illustrating an example of generating voice data from input data. FIG. 1 is a diagram illustrating an example of generating voice data from input data in a hierarchical structure of packet data. FIG. 12 is a diagram illustrating an example of generating voice data from input data, following FIG. FIG. 1 is a diagram illustrating an example of a hierarchical structure of content data. FIG. 1 is a flow diagram showing an example of processing by the voice generation system of the present embodiment.

An example of an embodiment of the present invention will now be described with reference to the accompanying drawings. The voice generation device, which is one aspect of this embodiment, is a device or server that generates voice data corresponding to content data (hereinafter sometimes referred to as "input data") consisting of character data, symbol data, image data, video data, or a combination of these.

The voice generation process by the voice generation device of this embodiment can be exemplified as follows.
- A mode in which the voice generation device of this embodiment accepts input data, and generates and outputs corresponding voice data.- A mode in which the voice generation device of this embodiment accepts input data, generates corresponding voice data, and transmits the voice data to an external output device or device that is a receiving terminal for output.- A mode in which the voice generation device of this embodiment receives input data from an external input device or device, and generates and outputs corresponding voice data.- A mode in which the voice generation device of this embodiment receives input data from an external input device or device, generates corresponding voice data, and transmits the voice data to an external output device or device that is a receiving terminal for output. In this embodiment, it is described that character data includes data for Japanese kana characters and characters in other language systems, and symbol data includes data for voiced consonants, handakuten consonants, long vowels, punctuation marks, numbers, and other symbols.

This embodiment also includes a computer program that causes a computer to function as the voice generation system described in this embodiment.

The voice generation device and receiving terminal described in this embodiment have application software installed related to the voice generation service provided by the voice generation system of this embodiment. By executing this application software, it is possible to generate and output voice data corresponding to input data, and to convert voice data into input data.

[Speech generating device]
The sound generating device 1 of this embodiment is a terminal device such as a personal computer, smartphone, or tablet, or an electronic device that can handle MIDI data or audio data such as a music sequencer, MIDI controller, synthesizer, or music workstation, or a server device.

As shown in FIG. 1(a), the hardware configuration includes a CPU 2 for executing various computer programs and carrying out arithmetic processing, a memory 3 for storing various data such as RAM and ROM, an auxiliary storage device 4 such as an internal storage, a communication module 5 for sending and receiving various information to and from external input and output devices via communication means such as a wired connection such as a MIDI cable, an Internet communication network, or a network connection via a wireless communication network defined by a wireless communication standard, input devices 6 such as a mouse, keyboard, touch panel, etc., and output devices 7 such as an LCD display, speakers, etc.

As shown in Fig. 1(b), the software configuration of the voice generating device 1 includes a data input unit 101, a data receiving unit 102, a storage unit 103, a voice data generating unit 105, and a voice data output unit 106. The CPU 2, memory 3, etc. work together to control information processing by these processing units.

When a data inputter, such as a business operator, uses the voice generating device 1 as the above-mentioned terminal device or electronic device, the data input unit 101 displays an input window for content data on the display screen and performs a process to accept input data.

The data receiving unit 102 performs processing to receive input data transmitted from the external input device or device described above. The external input device or device may be a terminal device such as a personal computer, smartphone, tablet, etc., or an electronic device capable of handling MIDI data or audio data such as a music sequencer, MIDI controller, synthesizer, music workstation, etc.

The memory unit 103 stores packet data 17. In this embodiment, the packet data 17 has a sound information storage area consisting of (n+2) (n≧1) sound information storage slots, with (n+2) sound beats as one unit. An example of the configuration of the packet data 17 is shown below.

(Packet Data Configuration Example 1)
In the example of n=1 shown in FIG. 2, the packet data 17 includes a sound information storage area 9 having three sound information storage slots 10a, 10b, and 10c, each of which has three sounds and one beat as one unit.

The first sound information storage slot 10a is set with a one-sound matrix 11a as shown in Figure 3(a).

The one-note matrix 11a is a matrix in which ten different conversion codes 12 corresponding to one note can be set. As shown in Figures 2(b), (c) and 3(a), in the first note information storage slot 10a, ten first note attribute codes (one-note attribute codes) 13 corresponding to one note can be set using ten different conversion codes 12 from 0 to 9. Below, a rest code representing a rest is set in any note information storage slot 10 in which no conversion code 12 is set.

A pitch name code 16 is associated with the first sound attribute code 13. For example, as shown in FIG. 2(d), a pitch name code 16 representing the pitch name "C" is associated with the first sound attribute code 13 "0" set in the first sound information storage slot 10a.

For the combination of the first sound information storage slot 10a and the second sound information storage slot 10b or the combination of the first sound information storage slot 10a and the third sound information storage slot 10c, a two-tone matrix 11b as shown in Figure 3 (b) is set.

The two-tone matrix 11b is a matrix in which 200 different conversion codes 12 corresponding to two tones can be set. As shown in Figs. 2(b), (c) and 3(b), 200 different second sound attribute codes (two-tone attribute codes) 14 corresponding to two tones can be set using 10 types of conversion codes 12 from 0 to 9 for the combination of the first sound information storage slot 10a and the second sound information storage slot 10b and the combination of the first sound information storage slot 10a and the third sound information storage slot 10c.

A pitch name code 16 is associated with the second note attribute code 14. For example, as shown in FIG. 2(d), two pitch name codes 16 representing the pitch name "E-G" are associated with the second note attribute code 14 "24" set in the combination of the first note information storage slot 10a and the second note information storage slot 10b.

A three-tone matrix 11c as shown in Figure 3(c) is set for the combination of the first sound information storage slot 10a, the second sound information storage slot 10b and the third sound information storage slot 10c.

The three-tone matrix 11c is a matrix in which 1000 different conversion codes 12 corresponding to three tones can be set. As shown in Figures 2(b), (c) and 3(c), 1000 different third sound attribute codes (three-tone attribute codes) 15 representing three tones can be set using 10 types of conversion codes 12 from 0 to 9 for the combination of the first sound information storage slot 10a, the second sound information storage slot 10b and the third sound information storage slot 10c.

A pitch name code 16 is associated with the third note attribute code 15. For example, as shown in FIG. 2(d), three pitch name codes 16 representing the pitch name "Do-re-la (CDA)" are associated with the third note attribute code 15 "015" set in the combination of the first note information storage slot 10a, the second note information storage slot 10b, and the third note information storage slot 10c.

Packet data 17 in which content data is associated with at least one of the first sound attribute code 13, the second sound attribute code 14, and the third sound attribute code 15 is stored in the memory unit 103.

From the above, when n=1, the packet data 17 is constructed in the following manner, and 1210 types of content data can be set.
(a) A sound information storage area 9 consisting of three sound information storage slots 10, each of which is a unit of three sounds and one beat
(b) A first note attribute code 13 corresponding to a note name code constituting one note is set in the first note information storage slot 10a.
(c) A second note attribute code 14 corresponding to the note name code constituting the two notes is set in the following note information storage slot 10.
(c1) First sound information storage slot 10a
(c2) The second sound information storage slot 10b or the third sound information storage slot 10c
(d) A third note attribute code 15 corresponding to the note name codes constituting the three notes is set in the note information storage slots 10a, 10b, and 10c.

(Packet Data Configuration Example 2)
In the example of n=2 shown in FIG. 4, the packet data 17 includes a sound information storage area 9 consisting of four sound information storage slots 10, each of which has four sounds per beat as one unit.

The first sound information storage slot 10a is set with a one-sound matrix 11a as shown in Figure 5(a).

The one-note matrix 11a is a matrix in which ten different conversion codes 12 corresponding to one note can be set. As shown in Figures 4(b), (c) and 5(a), the first note information storage slot 10a can be set in ten different ways as the first note attribute code (one-note attribute code) 13 corresponding to one note using ten different conversion codes 12 from 0 to 9.

A pitch name code 16 is associated with the first sound attribute code 13. For example, as shown in FIG. 4(d), a pitch name code 16 representing the pitch name "C" is associated with the first sound attribute code 13 "0" set in the first sound information storage slot 10a.

For the combination of the first sound information storage slot 10a and the second sound information storage slot 10b, the combination of the first sound information storage slot 10a and the third sound information storage slot 10c, or the combination of the first sound information storage slot 10a and the fourth sound information storage slot 10d, a two-tone matrix 11b as shown in Figure 5 (b) is set.

The two-tone matrix 11b is a matrix in which 300 different conversion codes 12 corresponding to two tones can be set. As shown in Fig. 4(b), (c) and Fig. 5(b), the combination of the first sound information storage slot 10a and the second sound information storage slot 10b, the combination of the first sound information storage slot 10a and the third sound information storage slot 10c, and the combination of the first sound information storage slot 10a and the fourth sound information storage slot 10d can be set in 300 different ways using 10 types of conversion codes 12 from 0 to 9 for the second sound attribute code (two-tone attribute code) 14a corresponding to two tones.

The second note attribute code 14a is associated with a note name code 16. For example, as shown in FIG. 4(d), two note name codes 16 representing the note name "E-G" are associated with the second note attribute code 14a "24" set in the combination of the first note information storage slot 10a and the second note information storage slot 10b.

A three-tone matrix 11c as shown in Figure 5(c) is set for each of the combinations of the first sound information storage slot 10a, the second sound information storage slot 10b, and the third sound information storage slot 10c, the combination of the first sound information storage slot 10a, the third sound information storage slot 10c, and the fourth sound information storage slot 10d, or the combination of the first sound information storage slot 10a, the second sound information storage slot 10b, and the fourth sound information storage slot 10d.

The three-tone matrix 11c is a matrix in which 3000 different conversion codes 12 corresponding to three tones can be set. For example, as shown in Figs. 4(b), (c) and 5(c), the combination of the first sound information storage slot 10a, the second sound information storage slot 10b and the third sound information storage slot 10c, the combination of the first sound information storage slot 10a, the third sound information storage slot 10c and the fourth sound information storage slot 10d, and the combination of the first sound information storage slot 10a, the second sound information storage slot 10b and the fourth sound information storage slot 10d can be set in 3000 different ways using 10 types of conversion codes 12 from 0 to 9 for the second sound attribute code (three-tone attribute code) 14b corresponding to three tones.

The second note attribute code 14b is associated with a note name code 16. For example, as shown in FIG. 4(d), three note name codes 16 representing the note name "Do-re-la (CDA)" are associated with the second note attribute code 14b "015" set in the combination of the first note information storage slot 10a, the second note information storage slot 10b, and the third note information storage slot 10c.

A four-tone matrix 11d as shown in Figure 5 (d) is set for the combination of the first sound information storage slot 10a, the second sound information storage slot 10b, the third sound information storage slot 10c and the fourth sound information storage slot 10d.

The four-tone matrix 11d is a matrix that can set 10,000 different conversion codes 12 corresponding to the four tones. As shown in Figures 4(b), (c) and 5(d), for the combination of the first sound information storage slot 10a, the second sound information storage slot 10b, the third sound information storage slot 10c and the fourth sound information storage slot 10d, the third sound attribute code (four-tone attribute code) 15 corresponding to the four tones can be set 10,000 times using ten types of conversion codes 12 from 0 to 9.

A pitch name code 16 is associated with the third note attribute code 15. For example, as shown in FIG. 4(d), four pitch name codes 16 representing the pitch name "Do-re-la-fa (CDAF)" are associated with the third note attribute code 15 "0153" set in the combination of the first note information storage slot 10a, the second note information storage slot 10b, the third note information storage slot 10c, and the fourth note information storage slot 10d.

Packet data 17 in which content data is associated with at least one of the first sound attribute code 13, the second sound attribute codes 14a, 14b, and the third sound attribute code 15 is stored in the memory unit 103.

From the above, when n=2, the packet data 17 is constructed in the following manner, and 13,310 types of content data can be set.
(a) A sound information storage area 9 consisting of four sound information storage slots 10, each of which is a unit of four sounds or one beat
(b) A first note attribute code 13 corresponding to a note name code constituting one note is set in the first note information storage slot 10a.
(c) Second note attribute codes 14a, 14b corresponding to note name codes constituting two notes and three notes are set in the following note information storage slots 10.
(c1) First sound information storage slot 10a
(c2) The second (even-numbered) sound information storage slot 10b or the third (odd-numbered) sound information storage slot 10c
(c3) A plurality of sound information storage slots 10 selected from the second (even-numbered) sound information storage slot 10b, the third (odd-numbered) sound information storage slot 10c, and the fourth ((n+2)) sound information storage slot 10d.
(d) The third note attribute code 15 corresponding to the note name codes constituting the four notes is set in the note information storage slots 10a, 10b, 10c, and 10d.

Moreover, from the packet data configuration examples 1 and 2, when n≧2, the packet data 17 is constructed in the following configuration.
(a) A sound information storage area 9 consisting of (n+2) sound information storage slots 10, with one (n+2) sound beat as one unit.
(b) A first note attribute code 13 corresponding to a note name code constituting one note is set in the first note information storage slot 10a.
(c) A second note attribute code 14 corresponding to a note name code constituting a plurality of notes less than (n+2) is set in the following note information storage slot 10.
(c1) First sound information storage slot 10a
(c2) One sound information storage slot 10 selected from the even-numbered sound information storage slots 10, the odd-numbered sound information storage slots 10, and the (n+2)-th sound information storage slot 10
(c3) In addition to the above (c2), a combination of a plurality of sound information storage slots 10 selected from an even-numbered sound information storage slot 10, an odd-numbered sound information storage slot 10, and an (n+2)-th sound information storage slot 10. (d) A third sound attribute code 15 corresponding to the pitch name code constituting the (n+2) sound is set in all sound information storage slots 10.

(Packet Data Configuration Example 3)
In the example shown in FIG. 6 to FIG. 8, the packet data 17 includes a sound information storage area 9 consisting of four sound information storage slots 10, each of which has four sounds and one beat as one unit.

A one-sound matrix 11a is set in the first sound information storage slot 10a.

The one-note matrix 11a is a matrix in which 25 different conversion codes 12 corresponding to one note can be set. Specifically, in the first sound information storage slot 10a, 25 different first sound attribute codes (one-note attribute codes) 13 corresponding to one note can be set using the 25 types of conversion codes 12 shown in FIG. 6(b).

In addition, the packet data 17 in which the first sound attribute code 13 is set is assigned a pattern code 20 "a" as shown in Figure 7. The pattern code 20 represents the setting pattern of the first sound attribute code 13, the second sound attribute code 14, and the third sound attribute code 15 in the four sound information storage slots 10.

The first sound attribute code 13 is set in the first sound information storage slot 10a as shown in Figure 7, so there is only one type of pattern code 20.

A pitch name code 16 is associated with the first sound attribute code 13. For example, as shown in Figures 6(b) and 7, a pitch name code 16 representing the pitch name "C" is associated with the first sound attribute code 13 "1" set in the first sound information storage slot 10a.

A two-tone matrix 11b is set for the combination of the first sound information storage slot 10a and the second sound information storage slot 10b, the combination of the first sound information storage slot 10a and the third sound information storage slot 10c, or the combination of the first sound information storage slot 10a and the fourth sound information storage slot 10d.

The two-tone matrix 11b is a matrix in which the conversion code 12 corresponding to two tones can be set in 1875 ways. Specifically, the second sound attribute code (two-tone attribute code) 14a corresponding to two tones can be set in 1875 (625 x 3) ways using the 25 types of conversion codes 12 shown in Figure 6 (b) for the combination of the first sound information storage slot 10a and the second sound information storage slot 10b, the combination of the first sound information storage slot 10a and the third sound information storage slot 10c, and the combination of the first sound information storage slot 10a and the fourth sound information storage slot 10d.

In addition, packet data 17 in which the second sound attribute code 14a is set is assigned one of pattern codes 20 "b", "c", or "d" as shown in Figure 7.

The second sound attribute code 14a is set to a combination of the first sound information storage slot 10a and the second sound information storage slot 10b, a combination of the first sound information storage slot 10a and the third sound information storage slot 10c, or a combination of the first sound information storage slot 10a and the fourth sound information storage slot 10d, as shown in Figure 7, so there are three types of pattern codes 20.

The second sound attribute code 14a is associated with a pitch name code 16. For example, as shown in Fig. 6B and Fig. 7, two pitch name codes 16 representing the pitch name "C-C- ^# (CC ^# )" are associated with the second sound attribute code 14a "12" set in the combination of the first sound information storage slot 10a and the second sound information storage slot 10b.

A three-tone matrix 11c is set for the combination of the first sound information storage slot 10a, the second sound information storage slot 10b, and the third sound information storage slot 10c, the combination of the first sound information storage slot 10a, the second sound information storage slot 10b, and the fourth sound information storage slot 10d, or the combination of the first sound information storage slot 10a, the third sound information storage slot 10c, and the fourth sound information storage slot 10d.

The three-tone matrix 11c is a matrix in which the conversion code 12 corresponding to three tones can be set in 46875 ways. Specifically, the second sound attribute code (three-tone attribute code) 14b corresponding to three tones can be set in 46875 (15625 x 3) ways using the 25 types of conversion codes 12 shown in FIG. 6B for the combination of the first sound information storage slot 10a, the second sound information storage slot 10b, and the third sound information storage slot 10c, the combination of the first sound information storage slot 10a, the second sound information storage slot 10b, and the fourth sound information storage slot 10d, and the combination of the first sound information storage slot 10a, the third sound information storage slot 10c, and the fourth sound information storage slot 10d.

In addition, packet data 17 in which the second sound attribute code 14b is set is assigned a pattern code 20 of "e", "f", or "g" as shown in Figure 7.

The second sound attribute code 14b is set to a combination of the first sound information storage slot 10a, the second sound information storage slot 10b, and the third sound information storage slot 10c, a combination of the first sound information storage slot 10a, the second sound information storage slot 10b, and the fourth sound information storage slot 10d, or a combination of the first sound information storage slot 10a, the third sound information storage slot 10c, and the fourth sound information storage slot 10d, as shown in Figure 7, so there are three types of pattern codes 20.

The second sound attribute code 14b is associated with the pitch name code 16. For example, as shown in Fig. 6B and Fig. 7, three pitch name codes 16 representing the pitch name "DoDo#Re (CC#D ⁾ " are associated with the second sound attribute code 14b " ¹²³ " set in the combination of the first sound information storage slot 10a, the second sound information storage slot 10b, and the third sound information storage slot 10c.

A four-tone matrix 11d is set for the combination of the first sound information storage slot 10a, the second sound information storage slot 10b, the third sound information storage slot 10c and the fourth sound information storage slot 10d.

The four-tone matrix 11d is a matrix in which the conversion codes 12 corresponding to the four tones can be set in 390625 ways. Specifically, the third sound attribute code (four-tone attribute code) 15 corresponding to the four tones can be set in 390625 ways using the 25 types of conversion codes 12 shown in FIG. 6(b) for the combination of the first sound information storage slot 10a, the second sound information storage slot 10b, the third sound information storage slot 10c, and the fourth sound information storage slot 10d.

A pitch name code 16 is associated with the third pitch attribute code 15. For example, as shown in Fig. 6(b) and Fig. 7, four pitch name codes 16 representing the pitch name "DoDo#ReRe ^# (CC ^# DD ^# )" are associated with the third pitch attribute code 15 "1234" set in the combination of the first pitch information storage slot 10a, the second pitch information storage slot 10b, the third pitch information storage slot 10c, and the fourth pitch information ^storage slot 10d.

In addition, packet data 17 in which the third sound attribute code 15 is set is assigned pattern code 20 "h" as shown in Figure 7.

The third sound attribute code 15 is set to a combination of the first sound information storage slot 10a, the second sound information storage slot 10b, the third sound information storage slot 10c, and the fourth sound information storage slot 10d as shown in Figure 7, so that there is only one type of pattern code 20.

Packet data 17 in which content data is associated with at least one of the first sound attribute code 13, the second sound attribute codes 14a and 14b, and the third sound attribute code 15 is stored in the storage unit 103. In the packet data 17 of this configuration example, 439,400 types of content data can be set.

In addition, in this configuration example, a phrase code 21 is assigned to the combination of pattern code 20 and first sound attribute code 13, the combination of pattern code 20 and second sound attribute code 14a, 14b, or the combination of pattern code 20 and third sound attribute code 15, and multiple phrase codes 21 are set as sound IDs 22.

In the example shown in Figure 8, three phrase codes 21 are set as the sound ID 22. This allows a specific melody with a fixed number of phrase codes 21 and a fixed pitch code 16 to be set as the sound ID 22.

(Packet Data Configuration Example 4)
In this configuration example, a voice information storage area relating to another packet data is set in the sound information storage area relating to the packet data described in the above configuration examples 1 to 3.

In the example shown in Fig. 9, three packet data 17a, 17b, and 17c having a sound information storage area 9 in which a 1-sound matrix 11a, a 2-sound matrix 11b, and a 3-sound matrix 11c are set are hierarchically organized. In Fig. 9, the following hierarchical structure is formed.
A sound information storage area 9b relating to packet data 17b is set in each sound information storage slot 10 of the sound information storage area 9a relating to packet data 17a.
A sound information storage area 9c relating to packet data 17c is set in each sound information storage slot 10 of the sound information storage area 9b relating to packet data 17b.

This type of structure makes it possible to organize information into a tree by melody and index the information.

If the same effect as above can be obtained, the four packet data 17a, 17b, 17c, and 17d having the sound information storage area 9 in which the 1-sound matrix 11a, the 2-sound matrix 11b, the 3-sound matrix 11c, and the 4-sound matrix 11d are set may be hierarchized. In this case, the following hierarchical structure is formed.
A sound information storage area 9b relating to packet data 17b is set in each sound information storage slot 10 of the sound information storage area 9a relating to packet data 17a.
A sound information storage area 9c related to packet data 17c is set in each sound information storage slot 10 of the sound information storage area 9b related to packet data 17b.
A sound information storage area 9d related to packet data 17d is set in each sound information storage slot 10 of the sound information storage area 9c related to packet data 17c.

The voice data generation unit 105 performs processing to generate voice data corresponding to the input data. In this embodiment, the input data is processed as follows to generate voice data.

(1) When packet data 17 is composed of a one-note matrix 11a, a two-note matrix 11b, and a three-note matrix 11c described in packet data configuration example 1 above, the input data is associated with at least one of the first sound attribute code 13, the second sound attribute code 14, and the third sound attribute code 15.

For example, as shown in Figure 10, when the character data "Thank you" is input, the following processing is performed.

(a1) The character data "T", "n" and "o" are each assigned to the first sound information storage slot 10a of the packet data 17 and associated with the first sound attribute codes 13 "0", "6" and "2" corresponding to one sound.

(a2) The character data "h", "k" and "u" are assigned to the first sound information storage slot 10a and the second sound information storage slot 10b of the packet data 17, respectively, and are associated with the second sound attribute codes 14 "12", "78" and "34" corresponding to the two sounds.

(a3) The character data "a" and "y" are assigned to the first sound information storage slot 10a, the second sound information storage slot 10b, and the third sound information storage slot 10c of the packet data 17, respectively, and are associated with the third sound attribute codes 15 "345" and "901" corresponding to the three sounds.
In addition to the above, the following processing can be performed.

(b1) The first sound attribute codes 13 "0", "6" and "2" corresponding to one sound are set in the first sound information storage slot 10a of the first, fourth and seventh packet data 17, respectively.

(b2) The second sound attribute codes 14 "12", "78" and "34" corresponding to two sounds are set in the first sound information storage slot 10a and the second sound information storage slot 10b of the second, fifth and eighth packet data 17, respectively.

(b3) A third sound attribute code 15 "345" and "901" corresponding to three sounds are set in the first sound information storage slot 10a, the second sound information storage slot 10b, and the third sound information storage slot 10c of the third and sixth packet data 17, respectively.

(b4) "Thank you" is associated with the combination "0 12 345 6 78 901 2 34" of the first sound attribute code 13, the second sound attribute code 14 and the third sound attribute code 15.

The audio data generation unit 105 performs processing to generate one or more pieces of audio data composed of the above-mentioned associated sound attribute codes.

For example, as shown in Figures 2(b) and 10, processing is performed to generate eight phrases of audio data 19 with three notes per beat, which are composed of pitch name codes 16 representing "C (Do)", "B (Si)", and "E (Mi)" corresponding to the first note attribute codes 13 "0", "6", and "2", "DE (ReMi)", "C2D2 (Do 2 Re 2)", and "FG (Fa So)" corresponding to the second note attribute codes 14 "12", "78", and "34", and "FGA (Fa So La)" and "E2CD (Mi 2 Do Re)" corresponding to the third note attribute codes 15 "345" and "901".

(2) When packet data 17 is composed of the 1-sound matrix 11a, 2-sound matrix 11b, 3-sound matrix 11c, and 4-sound matrix 11d described in packet data configuration example 3 above, and a voice information storage area related to another packet data is set in each sound information storage slot 10 of the sound information storage area related to the packet data described in packet data configuration example 4 above, the input data is associated with at least one of the first sound attribute code 13, second sound attribute code 14, and third sound attribute code 15 of the hierarchical sound information storage area.

In the example shown in Figure 11, two packet data 17a, 17b are hierarchically organized, each having a sound information storage area 9 in which a 1-tone matrix 11a, a 2-tone matrix 11b, a 3-tone matrix 11c, and a 4-tone matrix 11d are set. A sound information storage area 9b relating to a second layer packet data 17b is set in a sound information storage slot 10a of a sound information storage area 9a relating to a first layer packet data 17a.

Moreover, each packet data 17a in the first layer is assigned the pattern code 20 "g", "b", or "h" and phrase code 21 "g359", "b13", or "hKMNW" shown in Fig. 7, and the three phrase codes 21 are set as sound IDs 22. Furthermore, packet data 17b in the second layer is assigned the pattern code 20 "d" and phrase code 21 "d4P" shown in Fig. 7.

In this case, when the address of a specific website consisting of a combination of Roman letters and symbols, or the address of a link to a product, is entered, the following processing is carried out.

(a1) Of the website address, the character data "www." is assigned to the first sound information storage slot 10a, the third sound information storage slot 10c, and the fourth sound information storage slot 10d of the first packet data 17a in the first layer, and is associated with the second sound attribute code 14b "359" corresponding to the three sounds.

(a2) Of the website address, the character data "XYZ." portion is assigned to the first sound information storage slot 10a and the second sound information storage slot 10b of the second packet data 17a in the first layer, and is associated with the second sound attribute code 14a "13" corresponding to two sounds.

(a3) Of the website address, the character data "co.jp" portion is assigned to the first sound information storage slot 10a, the second sound information storage slot 10b, the third sound information storage slot 10c, and the fourth sound information storage slot 10d of the third packet data 17a in the first layer, and is associated with the third sound attribute code 15 "KMNW" corresponding to the four sounds.

(a4) Of the address of the product information page that is the link destination from the HP, the character data portion "/pro" is assigned to the first sound information storage slot 10a and the fourth sound information storage slot 10d of the second layer packet data 17b, and is associated with the second sound attribute code 14a "4P" corresponding to two sounds.
In addition to the above, the following processing can be performed.

(b1) The combination of second sound attribute codes 14a, 14b and third sound attribute code 15 in the first hierarchy, "359 13 KMNW", is associated with the website address "www.XYZ.co.jp".

(b2) The second sound attribute code 14a "4P" at the second level is associated with the character data "/pro" portion of the address of the product information page.

The audio data generation unit 105 performs processing to generate one or more pieces of audio data composed of the above-mentioned associated sound attribute codes.

For example, as shown in FIG. 6B and FIG. 11, the process is performed to generate audio data 19a of three phrases with four notes and one beat, which are composed of pitch name codes 16 representing "DEG ^# (ReMiSo ^# )" corresponding to the second sound attribute code 14b "359", "CD (DoRe)" corresponding to the second sound attribute code 14a "13", and "ABC2A2 (RaShiDo2La2)" corresponding to the third sound attribute code 15 "KMNW", and "D ^# D2 (Re ^# Re2)" corresponding to the second sound attribute code 14a "4P".

In the example of Figure 11, a company's website is represented by audio data 19a consisting of packet data 17a of three phrases, each consisting of four sounds per beat, and this is fixed as sound ID 22. In addition, a linked page of product information is represented by audio data 19b consisting of packet data 17b of one phrase, each consisting of four sounds per beat, and this is linked to sound ID 22.

As shown in Figure 13, by setting voice data 19 evoking the website of a certain business XYZ as sound ID 22 and setting voice data 19 representing various pages linked from the website as phrase codes 21, information can be hierarchically organized by voice. Also, by setting voice data 19 as sound ID 22, a sound domain that identifies a specific person is assigned.

The audio data output unit 106 performs processing to output the audio data 19 generated by the audio data generation unit 105 as audio. When outputting the audio data 19, the input data can also be displayed on a display screen.

[Receiving device]
The receiving terminal 8 in this embodiment is a terminal device such as a personal computer, a smartphone, or a tablet.

As shown in FIG. 1(a), the hardware configuration includes a CPU 2 for executing various computer programs and performing calculations, a memory 3 for storing various data such as RAM and ROM, an auxiliary storage device 4 such as an internal storage, a communication module 5 for sending and receiving various information to and from an external voice generating device 1 via communication means such as the Internet communication network or a network connection via a wireless communication network defined by a wireless communication standard, input devices 6 such as a mouse, keyboard, touch panel, microphone, etc., and output devices 7 such as an LCD display, speakers, etc.

As shown in FIG. 1(c), the receiving terminal 8 has a software configuration including a data receiving unit 801, a storage unit 802, and a data conversion unit 803. The CPU 2, memory 3, etc. cooperate with each other to control information processing by these processing units.

The data receiving unit 801 performs processing to receive voice data 19 output from the voice generating device 1.

The storage unit 802 stores packet data 17. The configuration of the packet data 17 is the same as that described for the voice generating device 1, and therefore a description thereof will be omitted.
The data conversion unit 803 performs a process of converting the received voice data 19 into content data inputted by the voice generating device 1 .

For example, in the case of audio data 19 consisting of eight phrases with three notes per beat, each consisting of "C (Do)", "DE (Re Mi)", "FGA (Fa So La)", "B (Si)", "C2D2 (Do 2 Re 2)", "E2CD (Mi 2 Do Re)", "E (Mi)", and "FG (Fa So La)" as shown in FIG. 10, the first note attribute codes 13 "0", "6", and "2" set in the note name code 16 of each note, the second note attribute codes 14 "12", "78", and "34", and the third note attribute codes 15 "345" and "901" are identified, and a process of converting each note attribute code into character data of "Thank you" to which it is associated is performed.

In addition, for example, in the case where the audio data 19 is four phrases of four notes and one beat consisting of "DEG ^# (ReMiSo ^# )", "CD (DoRe)", "ABC2A2 (RaShiDo2La2)", and "D ^# D2 (Re ^# Re2)" as shown in FIG. 11, the phrase code 21 of the sound ID 22 set in the packet data 17a, the second sound attribute code 14b "359" set in the note name code 16 of each note from the phrase code 21 assigned to the packet data 17b, the second sound attribute code 14a "13", the third sound attribute code 15 "KMNW", and the second sound attribute code 14a "4P" are discriminated, and a process of converting them into the page contents of "www.XYZ.co.jp" to which each sound attribute code is associated is performed.

The converted information is displayed on the display of the receiving terminal 8.

[Processing flow by the voice generation system]
A process flow of the voice generation system according to one aspect of the present embodiment will be described with reference to Figures 11 to 14. In this process flow, as an example, a voice generation device 1, which is a tablet, is installed at a predetermined location in a convenience store, and a smartphone, which is a receiving terminal 8 owned by a user who visits the store, receives voice data generated by the voice generation device 1 and displays the content. In addition, packet data 17 will be described as a combination of packet data configuration examples 3 and 4.

(S101)
In the voice generation device 1, the data receiving unit 102 performs processing to receive input data transmitted from the external input device or apparatus described above, such as the XYZ homepage containing the content "10% off drinks from 4pm!", a list page of target products, and a discount page for target products.

(S102)
The voice data generating unit 105 performs the following processes.
As shown in Figure 11, the second sound attribute code 14b "359" corresponding to three sounds is set in the first sound information storage slot 10a, the third sound information storage slot 10c, and the fourth sound information storage slot 10d of the first packet data 17a in the first layer.
The second sound attribute code 14a "13" corresponding to the two sounds is set in the first sound information storage slot 10a and the second sound information storage slot 10b of the second packet data 17a in the first layer.
The third sound attribute code 15 "KMNW" corresponding to the four sounds is set in the first sound information storage slot 10a, the second sound information storage slot 10b, the third sound information storage slot 10c, and the fourth sound information storage slot 10d of the third packet data 17a in the first layer.
Each packet data 17a in the first layer is assigned the pattern codes 20 “g”, “b”, and “h” and phrase codes 21 “g359”, “b13”, and “hKMNW” shown in FIG.
The combination "359 13 KMNW" of the second sound attribute codes 14a, 14b and the third sound attribute code 15 in the first layer is associated with the website address "www.XYZ.co.jp" which is the input data 18a.
11, the second sound attribute code 14a "4P" corresponding to two sounds is set in the first sound information storage slot 10a and the fourth sound information storage slot 10d of the packet data 17b of the second layer. Note that the sound information storage area 9b related to the packet data 17b of the second layer is set in the first sound information storage slot 10a of the first packet data 17a of the first layer.
A pattern code 20 “d” and a phrase code 21 “d4P” shown in FIG. 7 are assigned to the packet data 17 b of the second layer, and the phrase code 21 is linked to a sound ID 22 .
The second sound attribute code 14a "4P" in the second hierarchy is associated with the character data "/pro" in the address of the target product list page that is the link destination from the HP, which is the input data 18b.
12, the second sound attribute code 14a "VK" corresponding to two sounds is set in the first sound information storage slot 10a and the third sound information storage slot 10c of the packet data 17c of the third layer. Note that the sound information storage area 9c related to the packet data 17c of the third layer is set in the first sound information storage slot 10a of the packet data 17b of the second layer.
The pattern code 20 “c” and phrase code 21 “cVK” shown in FIG. 7 are assigned to the packet data 17 c of the third layer, and the phrase code 21 is linked to the sound ID 22 .
The second sound attribute code 14a "VK" in the third hierarchical level is associated with the character data "/a-discount" portion of the address of the discount page for the target product, which is the link destination from the target product list page, which is the input data 18c.

(S103)
The voice data generating unit 105 further performs the following processes.
Three phrases of audio data 19a are generated, each having four notes and one beat, which are composed of pitch name codes 16 representing "DEG ^# (ReMiSo ^# )" corresponding to the second sound attribute code 14b "359" of the first layer, "CD (DoRe)" corresponding to the second sound attribute code 14a "13," and "ABC2A2 (RaShiDo2La2)" corresponding to the third sound attribute code 15 "KMNW."
Voice data 19b is generated for one phrase, which is made up of four notes and one beat, and is composed of a pitch name code 16 representing "D ^# D2 (Re ^# Re2)" corresponding to the second note attribute code 14a "4P" of the second layer.
Voice data 19c of one phrase is generated, which is made up of four notes and one beat, and is composed of a pitch name code 16 representing "G ^# 2A (G ^# 2A)" corresponding to the second note attribute code 14a "VK" of the third layer.

(S104)
The voice data output unit 106 performs processing for outputting the voice data 19a, 19b, and 19c generated by the voice data generating unit 105 at a predetermined timing for a predetermined period of time. For example, the voice data 19 is output at one-minute intervals from 4:00 p.m. to 5:00 p.m.

(S105)
When a user visits the convenience store and operates the receiving terminal 8 to execute the application software, the data receiving section 801 receives the voice data 19a, 19b, and 19c.

(S106)
The data conversion unit 803 performs the following processes.
The second sound attribute code 14b "359", the second sound attribute code 14a "13", and the third sound attribute code 15 "KMNW" set in the pitch name code 16 of each sound are identified from the phrase code 21 of the sound ID 22 set in the packet data 17a, and a process of converting the code into the page contents of "www.XYZ.co.jp" to which each sound attribute code is associated is performed.
The second sound attribute code 14a "4P" set in the pitch name code 16 of each sound is identified from the phrase code 21 assigned to the packet data 17b, and a process of converting it into the page content of "www.XYZ.co.jp/pro/list" to which the second sound attribute code 14a is associated is performed.
The second sound attribute code 14a "VK" set in the pitch name code 16 of each sound is identified from the phrase code 21 assigned to the packet data 17c, and a process of converting it into the page content of "www.XYZ.co.jp/pro/list/a-discount" to which the second sound attribute code 14a is associated is performed.

(S107)
The converted website, the target product list page, and the target product discount page are displayed on the display screen, and the user can view and use these contents.

As described above, in this embodiment, the sound information storage area is composed of sound information storage slots having a uniform time axis including sound attribute codes, making it possible to convert information into melodies and melodies into information, and making it possible to encode and decode this information.

In particular, the packet data is hierarchically organized (layered) when it is encoded and decoded, which makes it possible to organize and index information into a tree by melody, making it possible to access a huge amount of information.

The content data, which is composed of at least one of character data, symbol data, image data, video data or a combination of these, is converted into a melody, so that when this melody is received by a receiving terminal, the specific information linked to the melody can be instantly accessed.

The voice generation device, the voice generation system, and the computer program according to the present embodiment contribute to industrial applicability through the following application examples.
・Used to provide a musical language system ・Used to provide various information through melodies ・Used to provide access information linked to the Internet through melodies ・Used to provide sound information storage slots to businesses ・Used for audio advertising media in radio, TV, public transportation, etc. ・Used to license melodies ・Used to archive information ・Used as audio encryption for businesses

For example, in the voice generation system according to this embodiment, a plurality of packet data 17 for identifying websites of the government, government agencies, local governments, etc. are prepared and set as sound IDs 22 .
Various information is associated with the phrase code 21 linked to the sound ID 22.
The voice data 19 consisting of the sound ID 22 and phrase code 21 is outputted from disaster prevention speakers installed in each area.
Local residents receive the voice data 19 by operating a smartphone, which is the receiving terminal 8 .
The receiving terminal 8 displays emergency information (disaster information, etc.) converted from the voice data 19 .

Such use cases can have the following effects in the event of a disaster or other emergency.
- Information that cannot be conveyed in words, such as information about individual areas around the site of a disaster, can be instantly provided and used using voice data.
・Information can also be provided and used in foreign languages.
- Information can be obtained even during a power outage.

9 Sound information storage areas 10a-10d Sound information storage slots 11 n-note matrix 11a 1-note matrix 11b 2-note matrix 11c 3-note matrix 11d 4-note matrix 12 Conversion code 13 First sound attribute code 14 Second sound attribute code 15 Third sound attribute code 16 Pitch name code 17 Packet data 18 Input data 19 Voice data 20 Pattern code 21 Phrase code 22 Sound ID

Claims (6)

A voice generating device that, when content data is input, generates corresponding voice data,
A voice generating device comprising the following configuration.
(1) Packet data constructed as follows is stored in a storage means.
(a) a sound information storage area consisting of (n+2) (n≧1) sound information storage slots, with one (n+2) sound beat being one unit; (b) a first sound attribute code corresponding to a pitch name code constituting one sound is set in the first sound information storage slot.
(c) A second note attribute code corresponding to a note name code constituting a plurality of notes less than (n+2) is set in the note information storage slot under the following conditions:
(c1) It is set in the first sound information storage slot.
(c2) When n=1, the second or third sound information storage slot is set.
(c3) In the case where n≧2, it is set to one of the sound information storage slots selected from the even-numbered, odd-numbered, and (n+2)-th sound information storage slots.
(c4) In the case where n≧2, it is further set to a combination of a plurality of the sound information storage slots selected from the even-numbered, odd-numbered and (n+2)-th sound information storage slots.
(d) A third note attribute code corresponding to a note name code constituting the (n+2) notes is set in all of the note information storage slots.
(2) A sound generation means for generating sound data in which one unit of (n+2) sound beats corresponds to the input content data, according to the following procedure: (a) A process for generating the packet data by associating the input content data with at least one of the first sound attribute code, the second sound attribute code, and the third sound attribute code.
(b) performing a process of generating the voice data composed of the pitch name code corresponding to the packet data; The voice generating device according to claim 1 , further comprising:
(1) (e) A pattern code representing a setting pattern of the first sound attribute code, the second sound attribute code, and the third sound attribute code in the sound information storage slot is added to the packet data.
(f) A combination of the pattern code and the first sound attribute code, the second sound attribute code, or the third sound attribute code is defined as a phrase code, and a plurality of the phrase codes are set as sound IDs. The voice generating device according to claim 1 , further comprising:
(1) (e) A plurality of the packet data are hierarchically organized, and the sound information storage area relating to one packet data is set to the sound information storage area relating to another packet data.
(2) (c) A process is performed to associate the input content data with at least one of the first sound attribute code, the second sound attribute code, and the third sound attribute code set in the packet data of any one of the layers. 4. The voice generating device according to claim 1, further comprising:
(3) a voice data output means for outputting the generated voice data A voice generation system including: a voice generation device that generates corresponding voice data when content data is input; and a receiving terminal that receives the voice data from the voice generation device,
1. A voice generation system comprising the following configuration.
(1) The voice generating device includes a storage means for storing packet data constructed as follows:
(a) a sound information storage area consisting of (n+2) (n≧1) sound information storage slots, with one (n+2) sound beat being one unit; (b) a first sound attribute code corresponding to a pitch name code constituting one sound is set in the first sound information storage slot.
(c) A second note attribute code corresponding to a note name code constituting a plurality of notes less than (n+2) is set in the note information storage slot under the following conditions:
(c1) It is set in the first sound information storage slot.
(c2) When n=1, the second or third sound information storage slot is set.
(c3) In the case where n≧2, it is set to one of the sound information storage slots selected from the even-numbered, odd-numbered, and (n+2)-th sound information storage slots.
(c4) In the case where n≧2, it is further set to a combination of a plurality of the sound information storage slots selected from the even-numbered, odd-numbered and (n+2)-th sound information storage slots.
(d) A third note attribute code corresponding to a note name code constituting the (n+2) notes is set in all of the note information storage slots.
(2) The sound generating device includes a sound generating means for generating sound data with (n+2) sound beats as one unit, which corresponds to the input content data, according to the following procedure.
(a) performing a process of generating the packet data by associating the input content data with at least one of the first sound attribute code, the second sound attribute code, and the third sound attribute code;
(b) performing a process of generating the voice data composed of the pitch name code corresponding to the packet data;
(3) The voice generating device includes a voice data output unit that outputs the generated voice data.
(4) The receiving terminal includes a data conversion means for converting the generated voice data into the content data. A computer program for causing a computer to function as the voice generation system described in claim 5.

Images