KR20230118430A - Interactive idol goods device, system and method for providing voice service using the same - Google Patents

Abstract

The present invention relates to idol goods to provide services specialized for idol content and personalized differentiated services, and an idol goods system and interactive voice service providing method using the same. According to the present invention, the idol goods comprises: a communication unit transmitting and receiving various data from a server or electronic device; a data storage unit storing various data required to operate the idol goods; a notification unit notifying a user visually or audibly when the new news or response message is input from the server or electronic device; a function control unit outputting the new news or response message by manipulation; an audio input unit receiving and encoding a user's voice; an audio output unit receiving a response message to the new news or the input user's voice from the server or electronic device to decode and output the response message by an operation of the function control unit; and a control unit control the communication unit, the data storage unit, the notification unit, the function control unit, the audio input unit, and the audio output unit. The voice output from the audio output unit is a synthesized voice of a specific person designated by the user.

Description

Interactive idol goods, an interactive idol goods system having a voice service function using the same, and a method for providing an interactive voice service

The present invention relates to interactive idol goods, an interactive idol goods system having a voice service function using the same, and a method for providing an interactive voice service, and more specifically, to a wireless communication function such as Wi-Fi, Bluetooth, UWB or USB, UART The present invention relates to an idol goods product capable of exchanging data with a system or server providing an interactive service with an idol goods product supporting a wired communication function, an idol goods system using the same, and a method for providing an interactive voice service.

Existing idol goods products only provide monotonous services of devices that support only colors or simple functions that fit the identity representing idols in entertainment agencies. In addition, most of the idol goods in circulation are mostly printed materials such as key chains and stickers, and in the case of character goods, only visual elements in the form of simple dolls without IT functions are provided to users. In addition, the market is being distorted in the global market due to low-quality imitation products, and appropriate compensation is not being made according to content development.

Currently, K-POP contents are at an important point in global marketing, and as technology and environment develop, planning and development in Korea are more necessary for new and diverse contents suitable for them. As K-content applied with IT technology, Korea needs to play a leading role as a first mover in the market along with competitiveness in the global market. Existing AI devices provide services with universality based on standard platforms, so there was a problem that services specialized for K-contents could not be provided.

In addition, idol goods were recognized only as simple ornaments, and there were few examples of them being used as IT devices.

Domestic registered utility model No. 20-0489048

The present invention aims to solve the foregoing and other problems. Another object is to provide interactive idol goods, an interactive idol goods system having a voice service function using the same, and a method for providing an interactive voice service.

According to one aspect of the present invention in order to achieve the above or other object, a communication unit for transmitting and receiving various data to and from a server or an electronic device; a data storage unit storing various data required to operate idol goods; a notification unit notifying the user through visual or auditory information when new news or a response message is input from the server or the electronic device; a function control unit that outputs the news or response message by manipulation; an audio input unit that receives and encodes a user's voice; an audio output unit for receiving, decoding, and outputting the response message to the new news or the input user's voice from the server or the electronic device by the operation of the function control unit; And a control unit for controlling the communication unit, data storage unit, notification unit, function operation unit, audio input unit and audio output unit, and the voice output through the audio output unit is synthesized with the voice of a specific person designated by the user Interactive idol goods having a voice service function may be provided.

According to one aspect of the present invention, the idol goods are selected from light sticks, pendants, bag rings, table clocks, figures, bracelets, AR / VR / MR / XR / METAVERSE devices and character dolls There can be more than one.

According to one aspect of the present invention, idol goods (idol goods) for receiving data wired or wirelessly and outputting a voice message synthesized with the voice of a specific person designated by the user; and a server that transmits various data to the idol goods, unidirectionally or bidirectionally communicates with the idol goods, and stores personal information of a user of the idol goods, wherein the server stores data for providing interactive services, It may perform a function of analyzing data delivered from idol goods and delivering appropriate services or contents to the idol goods.

According to one aspect of the present invention, a first server configured to communicate with the idol goods to transmit/receive voice data, synthesize a voice signal suitable for input information of a user based on data analysis, and transmit the synthesized voice signal to the idol goods; a second server that is connected to the first server to store personal information of the user and transmits the personal information of the user to the first server upon request of the first server; a third server connected to the first server and configured to analyze voice data input by the user and transmit the analyzed voice data to the first server; and acquiring voice data of a specific person designated by a user through communication connection with the first server, and synthesizing a response message to a voice message input by the user into a voice signal based on sampled voice data of the specific person designated by the user. A fourth server for transmitting to the first server may be included.

According to one aspect of the present invention, when the server and the idol goods cannot communicate directly, the server and the idol goods are communicatively connected to transmit data received from the idol goods to the server, and the data received from the server may include an electronic device that transmits to the idol goods.

According to one aspect of the present invention, the voice message includes event information related to a specific person designated by the user, a message for marketing promotion or an event, a greeting message from a specific person designated by the user, news related to a specific person designated by the user, and a personal event of the user. It may include a unidirectional message including a message related to and a bidirectional message including a conversation message and content delivery.

According to one aspect of the present invention, the step of inputting a user's voice through idol goods capable of voice input; converting the input user's voice into data and transmitting it to a server; analyzing the user's intention through the user's voice data transmitted from the server to the server; synthesizing a voice signal suitable for user input information based on sampled voice data of a specific person designated by the user based on the analyzed user's intention; transmitting the synthesized voice signal from the server to the idol goods; and outputting the voice signal received from the server on the idol goods. A method of providing an interactive voice service using idol goods may be provided.

According to one aspect of the present invention, the user's personal information is stored in the server, and in the step of synthesizing a voice signal suitable for the user's input information, when the user's personalized service is to be provided, the user's personal information can utilize

According to one aspect of the present invention, when the server and the idol goods cannot communicate directly, data received from the idol goods is transmitted to the server by an electronic device that communicates with the server and the idol goods, and the server Data received from may be transmitted to the idol goods.

An interactive interactive idol goods system according to the present invention, an interactive idol goods system having a voice service function using the same, and a method for providing an interactive voice service will be described as follows.

According to at least one of the embodiments of the present invention, it is possible to provide a one-way notification/notification/marketing promotion service or a two-way conversation service using idol goods.

According to at least one of the embodiments of the present invention, there is an advantage in that a service specialized for idol contents and a personalized differentiated service can be provided to the user.

According to at least one of the embodiments of the present invention, subscription service revenue can be generated through regular subscription of interactive services.

According to at least one of the embodiments of the present invention, a user's ID can be assigned to various types of idol goods. Specialized services and contents can be developed and provided to users in conjunction with personal ID through MAC ADDRESS or personal phone number.

According to at least one of the embodiments of the present invention, in order to prevent unauthorized copying of idol goods, a genuine product authentication function is built in to guarantee the rights of users who have paid a legitimate fee and to prevent distortion in the market.

A further scope of the applicability of the present invention will become apparent from the detailed description that follows. However, since various changes and modifications within the spirit and scope of the present invention can be clearly understood by those skilled in the art, it should be understood that the detailed description and specific examples such as preferred embodiments of the present invention are given by way of example only.

1 is a configuration diagram of idol goods related to the present invention.
2 is a communication connection diagram between idol goods and a server related to the present invention.
3 is a communication connection diagram of idol goods, electronic devices and servers related to the present invention.
4 is a flowchart of data transmission and reception related to the present invention.
5 is a flowchart of a method for providing an interactive voice service related to the present invention.

Hereinafter, the embodiments disclosed in this specification will be described in detail with reference to the accompanying drawings, but the same reference numerals will be given to the same or similar components regardless of reference numerals, and overlapping descriptions thereof will be omitted. The suffix "part" for components used in the following description is given or used interchangeably in consideration of ease of writing the specification, and does not itself have a meaning or role distinct from each other. In addition, in describing the embodiments disclosed in this specification, if it is determined that a detailed description of a related known technology may obscure the gist of the embodiment disclosed in this specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in this specification, the technical idea disclosed in this specification is not limited by the accompanying drawings, and all changes included in the spirit and technical scope of the present invention , it should be understood to include equivalents or substitutes.

Terms including ordinal numbers, such as first and second, may be used to describe various components, but the components are not limited by the terms. These terms are only used for the purpose of distinguishing one component from another.

Singular expressions include plural expressions unless the context clearly dictates otherwise.

In this application, terms such as "comprise" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

In one embodiment of the present invention, a system or server that provides interactive services with idol goods products supporting wireless communication functions such as Wi-Fi, Bluetooth, and UWB or wired communication functions such as USB and UART, or a server capable of exchanging data connect communication In addition, when an idol goods user attempts an interactive service using the input device built into the idol goods product, the interactive service system delivers contents such as conversations and videos appropriate to the situation to the user through various types of idol goods. It provides two-way service like having a real conversation with your favorite idol. At this time, it is possible to provide differentiated personalized service for each individual based on the user-related personal profile (personal information) input by the user. In addition, in order to prevent unauthorized copying of the idol goods, a genuine authentication function is built in to guarantee the rights of users who have paid a legitimate fee and to prevent distortion in the market.

In one embodiment of the present invention, the idol goods 100 can input voice information of the idol goods user 170, and can communicate with the realistic service providing system or server 220 to send and receive data, In the idol goods 100, audio and video output capable of reproducing audio or video information simultaneously with audio are possible. In addition, the server 220 in one embodiment of the present invention can store data for providing interactive services, send and receive data with the idol goods 100 through wired or wireless communication, and transmit data from the idol goods 100 The analyzed data is analyzed and service or content suitable for it is delivered to the idol goods 100.

FIG. 1 is a configuration diagram of idol goods 100 related to the present invention. Hereinafter, the idol goods 100 according to an embodiment of the present invention will be described with reference to FIG. 1 .

The idol goods 100 in an embodiment of the present invention include a communication unit 110 that transmits and receives various data to and from a server 220 or an electronic device 210, and a data storage in which various data necessary for operating the idol goods are stored The unit 120 and the notification unit 130, which informs the user through visual or auditory information when new news or a response message is input from the server 220 or the electronic device 210, and the new news or response message by manipulation. The function control unit 140 for outputting, the audio input unit 150 for receiving and encoding the user's voice, and the operation of the function control unit 140 respond to the news or the input user's voice. An audio output unit 160 that receives a response message from the server 220 or the electronic device 210, decodes it, and outputs it, the communication unit 110, the data storage unit 120, and the notification unit 130 ), a function control unit 140, an audio input unit 150, and a control unit 165 that controls the audio output unit 160. At this time, the voice output through the audio output unit 160 is synthesized with the voice of a specific person designated by the user. However, the synthesized voice of a specific person is not always output, and the voice of a specific person may be output, or a general mechanical voice or AI voice may be output. In one embodiment of the present invention, the AI voice means a general voice synthesized by a machine, not a synthesized voice of a specific person. The notification unit 130 may be an LED, a light source, or a buzzer, and may be displayed through means such as a display. In addition, in an embodiment of the present invention, audio data input through the audio input unit 150 is mainly described, but it is not necessarily limited thereto, and image data such as face recognition through a camera may be input.

The idol goods may be one or more selected from light rods, pendants, bag rings, table clocks, figures, bracelets, AR/VR/MR/XR/METAVERSE devices, and character dolls, which are one embodiment. , so it is not limited thereto.

In addition, in one embodiment of the present invention, an interactive idol goods system 200 (hereinafter referred to as 'idol goods system') having a voice service function is provided. and the idol goods 100 that receives and outputs a voice message synthesized with the voice of a specific person designated by the user, and transmits various data to the idol goods 100 and unidirectional or bidirectional with the idol goods 100 and a server 220 that communicates with and stores personal information of the idol goods user.

The server 220 stores data for providing interactive services, analyzes the data transmitted from the idol goods 100, and delivers a service or content suitable for the data to the idol goods 100.

In addition, the server 220 is communicatively connected to the idol goods 100 to transmit and receive voice data, synthesize a voice signal suitable for user input information based on data analysis, and transmit it to the idol goods 100 1 server 221, a second server 222 that is connected to the first server 221 and stores personal information of the user, and a second server 222 that is connected to the first server 221 and is connected to the voice input by the user A third server 223 that analyzes data and transmits the analyzed voice data to the first server, and acquires voice data of a specific person designated by a user through communication with the first server 221, and and a fourth server 224 synthesizing a voice signal based on sampled voice data of a specific person designated by a user and transmitting a response message to a voice message to the first server. In the above, the server 220 has been described by dividing the first server 221 to the fourth server 224, but it is not limited thereto, and all functions of the first server 221 to the fourth server 224 are integrated. can be a single server. However, hereinafter, the first server 221 to the fourth server 224 will be mainly described.

2 is a communication connection diagram between idol goods and a server related to the present invention, and FIG. 3 is a communication connection diagram between idol goods, electronic devices and a server related to the present invention. An idol goods system 200 according to an embodiment will be described.

The server 220 is connected to a first server 221 that synthesizes a voice signal suitable for the user's input information and transmits it to the idol goods 100, and is connected to the first server 221, and the idol goods user 170 The personal information of ) is stored and the second server 222 that transmits the personal information of the user 170 to the first server 221 upon request of the first server 221 is included.

The first server 221 and the second server 222 communicate with each other to transmit and receive necessary data, in particular, personal information such as the birthday, gender, nationality, and current location of the user 170 . The first server 221 may be referred to as a service management server, and the second server 222 may be referred to as a personal information storage server. When the first server 221 needs to verify the personal information of the user 170 of the idol goods 100, the first server 221 requests the second server 222 for confirmation. Meanwhile, the third server 223 may be referred to as a voice recognition engine server, and the fourth server 224 may be referred to as a voice/video data storage server. At this time, the personal information of the user 170 is input while registering the idol goods 100 as a genuine product, and the input user's personal information is stored in the server 220 so that it can be used for services provided by the server 220 in the future. Personal information stored in the server 220 is utilized. However, the user's personal information is not always stored in the idol goods 100, and the user's personal information is stored in the idol goods 100, and if necessary, the user's personal information is stored in the idol goods 100 on the server 220 ) is also possible.

The first server 221 has a function of storing new software (SW) and new contents that can be updated in the idol goods 100, a function of notifying the existence of new software and new contents to be updated in the idol goods 100, the It performs a function of transmitting new software and new contents to be updated to the idol goods 100 to the electronic device 210 in which the update tool is built. In one embodiment of the present invention, when providing content to the idol goods 100 or updating software, etc., a device with an update tool is required. may be, for example, the server 220 or the electronic device 210.

If direct wired or wireless communication is possible between the idol goods 100 and the server 220, and the idol goods 100 can receive various data and messages from the server 220, a separate No additional electronics 210 are required. For example, as shown in FIG. 2 , when the idol goods 100 are figure-type idol goods 100 with built-in IT functions, the idol goods 100 communicate with the server 220 Software (SW) related to the idol goods 100 can be updated, and various contents such as notifications or messages can be downloaded. In this case, the idol goods 100 include a function for direct wireless communication with the server 220, such as Wi-Fi, and the idol goods 100 may support various wired and wireless communication functions, but only some functions may be supported. may be In the case of wireless communication, both short-distance communication and long-distance communication functions may be supported, but only some functions may be supported.

However, when it is difficult for the idol goods 100 to communicate directly with the server 220, as shown in FIG. When the same electronic device 210 is located, the electronic device 210 and the server 220 transmit and receive data to each other, and the idol goods 100 and the electronic device 210 transmit and receive data to each other. Furthermore, when the idol goods 100 perform wired communication, the idol goods 100 receive data through wired communication with the electronic device 210 . At this time, the electronic device 210 has a built-in update tool. More specifically, a software program for updating the idol goods 100 with new software and new content is installed in the electronic device 210 . The electronic device 210 performs a function of notifying the user of the existence of new software and new contents of the server 220, receives new software and new contents transmitted from the server 220, and performs wireless communication and/or You can use wired communication, and you can activate the product to be updated. All functions of the electronic device 210 can be performed by the server 220 . Therefore, the server 220 can also perform genuine authentication for the idol goods 100, and when the performance of the idol goods 100 is low and the electronic device 210 is required, the electronic device 210 assists. send and receive data with That is, the electronic device 210 has an update tool built in, and the update tool is built into the server 220 and/or the electronic device 210 .

In addition, the idol goods 100 can support wireless communication and/or wired communication functions with the update tool, support genuine authentication functions such as exchanging encryption keys with the update tool, and provide visual signals (LED color expression including video), voice It supports the play function and can drive or play updated software and contents.

At this time, a personal message of a specific person can be output to the user 170 through the idol goods 100. The specific person is designated by the user, and an interactive service is provided by synthesizing the voice of the specific person (idol). Conversational services provide services tailored to the user's personal information/environment through learned AI. Furthermore, the user 170 of the idol goods 100 can receive messages related to the user's personal event by registering his/her own event schedule, etc. in addition to his or her personal information. For a more in-depth service, various types of information other than the user's event schedule may be utilized.

The voice message output through the idol goods 100 is a one-way message provided unilaterally from the server 220 to the idol goods 100 and a two-way message exchanged between the idol goods 100 and the server 220. includes The one-way message includes a user's birthday celebration message based on the user's personal information, event information related to a specific person designated by the user, messages about marketing promotion or events, greetings from a specific person designated by the user, news related to a specific person designated by the user, and Contains messages related to the user's personal events.

In this way, in one embodiment of the present invention, if the user 170 stores the user's event schedule in the idol goods 100 or the server 220 and shares it in addition to the user's personal information, it is possible to provide a service suitable for this. That is, in one embodiment of the present invention, the user can have a conversation in a situation suitable for the user's event by sharing his or her event schedule with AI in addition to personal information. For example, if a user shares an exam schedule with AI, a specific person (idol) can have a conversation with a topic such as a comment asking if the test went well or whether the test went well.

If direct wired or wireless communication is possible between the idol goods 100 and the server 220, and the idol goods 100 can receive various data and messages from the server 220, a separate No additional electronics 210 are required. For example, when the idol goods 100 are light sticks with built-in IT functions, the light sticks can update software (SW) related to the idol goods 100 by communicating with the server 220 Various contents such as , notifications or messages are downloaded to the idol goods 100 . In this case, the idol goods 100 include a function for direct wireless communication with the server 220, such as Wi-Fi, and the idol goods 100 may support various wired and wireless communication functions, but only some functions may be supported. may be In the case of wireless communication, both short-distance communication and long-distance communication functions may be supported, but only some functions may be supported.

However, when it is difficult for the idol goods 100 to communicate directly with the server 220, an electronic device 210 such as a smartphone or a Wi-Fi router is located between the server 220 and the idol goods 100 Thus, the electronic device 210 and the server 220 transmit and receive data to each other, and the idol goods 100 and the electronic device 210 transmit and receive data to each other. Furthermore, when the idol goods 100 perform wired communication, the idol goods 100 receive data through wired communication with the electronic device 210 .

In one embodiment of the present invention, a one-way notification/notification/marketing promotion service or a two-way interactive service is provided according to the function-supportable specifications of the idol goods 100. In the former case, one-way content is delivered from the server 220 to the idol goods 100, and based on the personal information registered by the user, the content suitable for the personalized service is delivered, and the sound service synthesized with the voice of the user's favorite idol is provided. to provide. For example, “Happy birthday, Mr. OOO” may be output as a synthesized voice of a specific person designated by the user.

When a two-way interactive service is provided, conversational messages and contents are delivered between the server 220 and the idol goods 100, and based on the user information of the idol goods 100, contents suitable for the personalized service are delivered or Through the idol goods 100, content capable of conversing with a synthesized voice of a favorite idol may be provided.

4 is a flowchart of data transmission and reception related to the present invention, and FIG. 5 is a flowchart of a method for providing an interactive voice service related to the present invention. Hereinafter, idol goods (100 The operation sequence of ) will be described.

In one embodiment of the present invention, the transmission of a one-way voice message is unilaterally transmitted from the server 220 to the idol goods 100, and when new contents stored in the server 220 are automatically transmitted to the idol goods 100 Since this is a method, hereinafter, bidirectional voice message transmission will be mainly described.

First, the user 170 inputs voice to the idol goods 100 through the audio input unit 150 (①) (S110), and the input user's voice is converted into data and transmitted to the server 220 (②) (S120) )do. The server 220 analyzes the user's intention through the transmitted voice data of the user (S130), obtains voice data of a specific person designated by the user, and provides interactive services based on the sampled voice data. The voice signal is synthesized, the data transmitted to the server 220 is analyzed, and the audio signal suitable for the user's input information is synthesized based on the data analysis (S140) and transmitted to the idol goods 100 (⑨) (S150 ), and outputs (⑩) the response message, which is the received voice signal, from the idol goods 100 to the user 170 (S160).

To this end, first, when a user wants an interactive service, the user of the idol goods 100 registers the idol goods 100 in the server 220 before using the interactive service, and when registering the interactive service, necessary according to the type of interactive service Enter the minimum personal information such as name, date of birth, personal event schedule, etc. These personal information includes various data necessary to operate the idol goods 100, and all personal information is transmitted to the server 220 through a program or application of a smart device / PC that inputs a personal profile or registers a product, , stored and managed in the server 220. Furthermore, when there are multiple idols such as a group, the user 170 selects one or two or more preferred idols and receives the idol goods 100 with audio and/or video of the selected idol through interactive service.

In order to provide interactive interactive service according to an embodiment of the present invention, the first server 221 configures data for providing interactive service. More specifically, the fourth server 224 acquires voice and video sampling standard data of a specific person, such as an idol, and synthesizes a voice signal and a video signal for providing an interactive service based on the sampled voice data and the sampled image data. At this time, the specific person's voice signal can be converted into data by recording the specific person's voice and dividing it into phonemes, syllables, morphemes, etc. and synthesizing it, and the specific person's video signal is recorded with a video recording device to record the specific person's various facial expressions and movements over a minute time period. It can be converted into data by cutting and synthesizing at intervals, and it can also be expressed using deep-learning based image synthesis technology.

In addition, an interactive service is requested through the idol goods 100 through which the user 170 of the idol goods 100 can input audio and video information, and the idol goods 100 provides an interactive service system through a wireless or wired communication connection ( 200) to communicate with one of the servers 220. Then, when the user's voice data transmitted to the server 220 (②) is transmitted to the third server 223 (③), the third server 223 analyzes the user's intention through a data analysis algorithm such as AI. (S130), and the voice data analysis contents are transmitted to the first server 211 (④). Thereafter, the first server 211 matches the user's personal information data, the user's input voice data, and idol synthesized voice data received from the second to fourth servers 222, 223, and 224 to the user's input information based on data analysis. Audio or audio and video signals are synthesized (S140). For example, if the first server 221 requests (⑦) the fourth server 224 to synthesize the voice of a specific person such as an idol based on the intention of the user 170, the fourth server ( Based on the voice data sampled in 224), a synthesized voice signal suitable for the user's input information for providing the interactive service requested by the first server 221 is transmitted to the first server 211 (⑧). In this case, based on the sampling image data, a video signal suitable for user input information for providing interactive service may be synthesized. The video signal at this time may be output through a display of the notification unit 130 .

Voice input of the user 170 in the first server 211, analysis of the input voice data, search and synthesis (combination) of a specific person's voice signal that has already been synthesized and stored according to the user's input information, and synthesis (combination) of the specific person's voice According to the logical flow such as signal output, the synthesized idol voice signal or idol voice signal and video signal are delivered to the idol goods 100 (⑨) (S150), and the idol goods 100 transmits the transmitted audio signal and / or The video signal is reproduced (⑩) through the output device (S160).

Reproduction at this time may be provided based on a personalized service. That is, when a personalized service is provided based on the personal information of the user of the idol goods 100 already registered in the server 220 and a response is made to a request for the idol goods 100 of the realistic service, the first server 211 ) requests (⑤) the personal information of the user from the second server 222, and the second server 222 that receives the request transmits (⑥) the personal information of the user 170 to the first server 211. do. This allows the user's name to be used as a title. For example, a voice message such as "Hello, 000" may be output using the user's name. In addition, the user 170 of the idol goods 100 may communicate with the synthesized AI voice of a favorite idol through the idol goods 100 . For example, user 170 may ask "How's the weather today?" When a question is asked, a specific person designated by the user 170 may output a voice message such as "I think I need to bring an umbrella".

Furthermore, in an embodiment of the present invention, the idol goods 100 may be used for marketing publicity and idol fandom management.

That is, based on the personal information of the idol goods user 170 registered in the server 220, a general voice announcement or an idol voice may be used to provide a marketing promotion service at an entertainment company. For example, when the user 170 of the idol goods 100 asks, “When is the new song release schedule?” is scheduled for May, and we will inform you later when the exact schedule is decided." A response message may be displayed. Celebrity agencies can also manage idol fandoms with normal voices or idol voices. For example, when the user 170 of the idol goods 100 asks "Where is Jungkook of BTS?", a voice message such as "I'm on vacation in London" is sent with the synthesized voice of Jungkook of BTS. can be printed out. When the user 170 of the idol goods 100 asks a question such as "What time does BTS go to bed?", a response message may be output, "I sleep when I am tired" in a normal voice.

Hereinafter, various embodiments of an interactive service according to an embodiment of the present invention will be described.

Various use scenes are possible through the interactive idol goods (100) device, and through this, it specializes in differentiated functions and emotional services different from existing AI (artificial intelligence) devices, and the corresponding function is AR (Augmented Reality) / VR (Virtual Reality)/MR (Mixed Reality)/XR (eXtended Reality)/metaverse, etc. can be applied to software (SW) platform services, and through this, it is not a standardized service for users, but a specialized service that each user wants. can provide.

First, through the idol goods 100 according to an embodiment of the present invention, counseling can be conducted with an idol. In the idol fandom, there are many adolescent and teenage fans, and there are concerns that adults do not know about and concerns that cannot be told to their parents. To this end, it is possible to lead emotionally sensitive teenagers in a positive direction by consulting with the idol goods (100), such as the user's favorite idol character, to consult with each other, and by inducing suitable conversation with the idol AI.

In addition, AR/VR/Metaverse interactive services can be provided.

For example, AR/VR/MR/XR/Metaverse service platforms can be created. Existing games are a form of service in which characters in the game play games with each other or with other users. Conventionally, AR/VR/MR/XR/Metaverse was limited to game contents, but in one embodiment of the present invention, interactive functions can be added along with idol character avatars or AI shapes, and limited to game contents. It is possible to produce infinite situations according to various situations, not shapes.

Also, a scene in which table tennis is played with an idol may be provided. In AR/VR/MR/XR, you can play table tennis with your favorite idol rather than a character in the game, and depending on the situation, you can talk to each other to provide emotional service functions other than games.

In addition, a world tour with idols can be provided.

In the case of the existing technology, in the case of content touring the world landmarks, the user was at the level of watching the screen alone and enjoying it, but when using the idol goods 100 in one embodiment of the present invention, an emotional service of traveling with an idol can be provided there is. In this case, the current location of the user 170 can be known through the global positioning system (GPS) built into the idol goods 100 or the electronic device 210 . For example, it is possible to create a situation in which you can talk to each other while watching the Eiffel Tower in Paris with an idol, and it can also serve as a narration where an idol who likes information about the Eiffel Tower explains it. In addition, through an interactive service with a favorite idol, a service that satisfies the user's emotional needs is possible through talking and listening according to the situation, rather than simply viewing content.

Furthermore, a dance lecture taught by an idol may be implemented.

When a favorite idol provides a service that teaches users the dance choreography of their own song, a service that listens to and responds to the user's words is possible, rather than judging and responding only to the user's motion sensor. In addition, idols who like dance choreography teach directly, increasing the value of service merchandising, and users can learn dance choreography while talking with their favorite idols, maximizing their satisfaction.

For example, if the user says, "Tell me how to step in this part~", the idol can respond with something like, "Try to lightly hop with your right foot to the right and let your left foot follow your right foot as if sliding."

Also, a scene of Korean language lectures with idols is possible.

Due to the popularity of K-POP (Korean Popular Music) contents, more and more overseas fans are learning Korean. For such a global fandom, a service in which users' favorite idols directly teach Korean is possible. It is not just a one-way online education method, but it is possible to provide education and marketing services such as recognizing overseas fans' Korean pronunciation and correcting pronunciation by idol AI characters.

At this time, the answer to the question of the user 170 is configured in the first server 211 . For example, counseling answers to the user's concerns, voices of companions exercising together on AR / VR / MR / XR, voices of idols traveling together, voices of idols in dance lectures, pronunciation correction in Korean lectures The voice of the idol is synthesized and output based on the data for various situations stored in the first server 211 . For example, in the case of an answer to trouble counseling, some of the answer data for various troubles is output, and in the case of teaching dance in a dance lecture, the operation of the user 170 is monitored by a camera or the like provided in the idol goods 100 Recognized and outputted based on data about which part of the dance the motion stored in the first server 211 corresponds to.

Hereinafter, a method for authenticating idol goods 100 according to an embodiment of the present invention will be described.

First, in the idol goods 100, information assigned to each idol goods for wired/wireless communication, for example, MAC address for wired/wireless communication, product serial number, etc. can be used, which is unique information of the product given for each idol goods am. The server 220 or the electronic device 210 stores unique information of the idol goods 100 or corresponding information and uses an encryption key matched with the corresponding information for encryption/decryption. The encryption key is used for user product or authenticity verification at the time of initiation of communication.

More specifically, the idol goods 100 and the server 220 or electronic device 210 are connected through communication, and whether the MAC address is valid is checked. If the MAC address is valid, the product number stored in the idol goods 100 is read, and the product number of the idol goods 100 registered in the server 210 or the electronic device 210 is received. Prior to that, the electronic device 210 transmits the idol goods 100 registration information to the server 220 . In addition, if the product number of the idol goods 100 is identical to the product number of the idol goods 100 registered in the server 220 by checking the product number with the encrypted symmetric key, genuine product authentication is completed. In addition, if the MAC address is not valid, it is notified that it is not genuine at that stage and authentication is terminated. When the activation of the idol goods 100 is completed, the idol goods 100 are updated by receiving new software and new contents from the server 220, and the idol goods that the user updated the new software or new contents ( 100) to use the product. The activation is not only possible through the electronic device 210, but the same process can be performed between the idol goods 100 and the server 200 as well. Therefore, a detailed description thereof will be omitted.

Utilizing the idol goods 100 according to an embodiment of the present invention and the idol goods system 200 using the same, an interactive AI platform service business can be operated, and furthermore, a subscription service business can be operated. In other words, you can use the voice data of idols and celebrities to provide interactive AI subscription services with your favorite celebrities. The voice output through the idol goods 100 in one embodiment of the present invention can be a specific person's voice that has already been recorded, but it is characterized by providing a conversational AI service suitable for the situation through voice synthesis.

The idol goods 100 are supplied with power by the power supply unit 101 .

The above detailed description should not be construed as limiting in all respects and should be considered illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

Reference Numerals 100: idol goods, 101: power supply unit, 110: communication unit, 120: data storage unit, 130: notification unit, 140: function control unit, 150: audio input unit, 160: audio output unit, 165: control unit, 170: user, 200 : idol goods system, 210: electronic device, 220: server, 221: first server, 222: second server, 223: third server, 224: fourth server

Claims (10)

A communication unit that transmits and receives various data with a server or an electronic device;
a data storage unit for storing various data necessary to operate idol goods;
a notification unit notifying the user through visual or auditory information when new news or a response message is input from the server or the electronic device;
a function control unit that outputs the news or response message by manipulation;
an audio input unit that receives and encodes a user's voice;
an audio output unit for receiving the new news or a response message to the input user's voice from the server or the electronic device by the operation of the function control unit and decoding and outputting the received message; and
A control unit for controlling the communication unit, data storage unit, notification unit, function operation unit, audio input unit and audio output unit,
Interactive idol goods having a voice service function, characterized in that the voice output through the audio output unit is synthesized with the voice of a specific person designated by the user. According to claim 1,
Voice service, characterized in that the idol goods are at least one selected from light sticks, pendants, bag rings, table clocks, figures, bracelets, AR / VR / MR / XR / Metaverse devices and character dolls Interactive idol goods with various functions. idol goods that receive data wired or wirelessly and output a synthesized voice message with the voice of a specific person designated by the user; and
A server that transmits various data to the idol goods, unidirectionally or bidirectionally communicates with the idol goods, and stores personal information of a user of the idol goods;
The server,
An interactive idol goods system having a voice service function in which data for providing interactive services is stored, data transmitted from the idol goods is analyzed, and services or contents corresponding thereto are transmitted to the idol goods. According to claim 3,
The server,
a first server communicating with the idol goods to transmit/receive voice data, synthesize a voice signal suitable for input information of a user based on data analysis, and transmit the synthesized voice signal to the idol goods;
a second server that is connected to the first server to store personal information of the user and transmits the personal information of the user to the first server upon request of the first server;
a third server connected to the first server and configured to analyze voice data input by the user and transmit the analyzed voice data to the first server; and
Communication is connected to the first server, voice data of a specific person designated by the user is acquired, and a response message to the voice message input by the user is synthesized into a voice signal based on sampled voice data of the specific person designated by the user. An interactive idol goods system having a voice service function, characterized in that it comprises a fourth server transmitting to 1 server. According to claim 3,
When the server and the idol goods cannot communicate directly, the server and the idol goods are communicatively connected to transmit data received from the idol goods to the server, and to transmit the data received from the server to the idol goods. An interactive idol goods system having a voice service function, characterized in that it includes a device. According to claim 3,
The voice message,
One-way messages including event information related to a specific person specified by the user, messages about marketing promotions or events, greetings from a specific person specified by the user, news related to a specific person specified by the user, and messages related to personal events of the user;
An interactive idol goods system having a voice service function, characterized in that it includes a interactive message including a conversation message and content delivery. According to claim 5,
The idol goods,
a communication unit that transmits and receives various data with the server or electronic device;
a data storage unit storing various data required to operate the idol goods;
a notification unit notifying the user through visual or auditory information when new news or a response message is input from the server or the electronic device;
a function control unit that outputs the news or response message by manipulation;
an audio input unit that receives and encodes a user's voice;
an audio output unit for receiving the new news or a response message to the input user's voice from the server or the electronic device by the operation of the function control unit and decoding and outputting the received message; and
The interactive idol goods system having a voice service function, characterized in that it comprises a control unit for controlling the communication unit, data storage unit, notification unit, function operation unit, audio input unit and audio output unit. inputting a user's voice through idol goods capable of voice input;
converting the input user's voice into data and transmitting it to a server;
analyzing the user's intention through the user's voice data transmitted from the server to the server;
synthesizing a voice signal suitable for user input information based on sampled voice data of a specific person designated by the user based on the analyzed user's intention;
transmitting the synthesized voice signal from the server to the idol goods; and
A method of providing an interactive voice service using idol goods, comprising outputting a voice signal transmitted from the server on the idol goods. According to claim 8,
The user's personal information is stored in the server, and when the user's personalized service is to be provided,
An interactive voice service providing method characterized by utilizing the user's personal information in the step of synthesizing a voice signal suitable for the user input information. According to claim 8,
When the server and the idol goods cannot communicate directly, data received from the idol goods is transmitted to the server by an electronic device connected to the server and the idol goods, and the data received from the server is transmitted to the idol goods An interactive voice service providing method characterized by transmitting to.

Images