JP2026015090A - system - Google Patents

Abstract

[Problem] To provide a system. [Solution] The system includes a means for users to chat one-on-one with an AI character of a specific athlete, a means for providing real-time game results and original content, a means for users to take and share photos with the athlete using AR functions, and a means for users to purchase gourmet food recommended by the athlete and official support goods. [Selected Figure] Figure 1

Description

The technology disclosed herein relates to a system.

Patent document 1 discloses a persona chatbot control method executed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot's character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Japanese Patent Application Laid-Open No. 2022-180282

Traditionally, sports spectators mainly watched games on television or the internet, with little direct communication with athletes and teams. This led to low fan engagement and often made fans hesitant to visit the stadium. Furthermore, with limited availability of live game results and original content, fans' enjoyment was not fully satisfied. Furthermore, there were few opportunities for stadiums to lead to consumer activity around the area, limiting their contribution to the local economy.

This invention is a system that allows users to have one-on-one chats with an AI character of a specific athlete. This allows users to enjoy private communication with the athlete and hear directly about their enthusiasm before the game and their thoughts after the game. The system also has the ability to provide real-time game results and original content, allowing users to instantly receive the latest game information and unique content. Furthermore, the system provides a function that allows users to take and share photos with athletes using AR functionality, thereby increasing fan engagement. Additionally, the system has the ability to easily purchase gourmet food recommended by athletes and official support merchandise, which can promote consumer activity around the stadium and contribute to the local economy.

An "AI athlete character" is an artificial intelligence program modeled after a specific athlete, and communicates with users in natural language through chat.

"User" means a person who uses the system to chat with a specific athlete's AI character and use other features.

"Chat" refers to communication between the user and the athlete's AI character via text messages.

"Live Match Results" is a feature that instantly delivers the results of sports matches taking place in real time.

"Original content" refers to media such as independently created videos or articles related to a specific sports team or athlete.

The "AR function" is a function that uses augmented reality technology to overlay virtual objects on real-world scenery.

"Gourmet" is a general term for food served at specific events or locations.

"Official cheering merchandise" refers to cheering items officially approved and sold by sports teams or athletes.

A "login screen" is a screen where users enter their ID and password to access the system.

"Authentication" is the process of verifying that a user has valid access to a system.

"Profile Information" refers to basic information about a particular athlete, including their name, image, and biography.

"Push notifications" are a function that sends information from the system to the user's device in real time.

"Streaming" is a technology that plays digital content in real time.

"Photography" refers to the act of recording images or videos using a camera.

"SNS" stands for Social Networking Service, a web platform that allows users to interact online.

A "content list" is a list of original content that users can view.

An "item list" is a list of gourmet foods and goods that users can purchase.

A "purchase request" refers to a user requesting the system to purchase a specific gourmet food or merchandise.

1 is a conceptual diagram illustrating an example of the configuration of a data processing system according to a first embodiment. 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. FIG. 10 is a conceptual diagram illustrating an example of the configuration of a data processing system according to a second embodiment. FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. FIG. 10 is a conceptual diagram illustrating an example of the configuration of a data processing system according to a third embodiment. FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. 1 shows an emotion map onto which multiple emotions are mapped. 1 shows an emotion map onto which multiple emotions are mapped. FIG. 2 is a sequence diagram illustrating a processing flow of the data processing system according to the first embodiment. FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in application example 1. FIG. 10 is a sequence diagram showing the flow of processing of the data processing system in the second embodiment when an emotion engine is combined. FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined.

Below, an example of an embodiment of a system relating to the technology disclosed herein will be described with reference to the accompanying drawings.

First, let me explain the terminology used in the following explanation.

In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, a processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose Computing on Graphics Processing Units), an APU (Accelerated Processing Unit), etc.

In the following embodiments, coded random access memory (RAM) is memory in which information is temporarily stored and is used as work memory by the processor.

In the following embodiments, the coded storage refers to one or more non-volatile storage devices that store various programs, parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

In the following embodiments, a communication I/F (Interface) with a symbol is an interface that includes a communication processor, an antenna, etc. The communication I/F controls communication between multiple computers. Examples of communication standards that can be applied to the communication I/F include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

In the following embodiments, "A and/or B" is synonymous with "at least one of A and B." In other words, "A and/or B" means that it may be just A, just B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and/or B" also applies when three or more things are expressed connected by "and/or."

[First embodiment]

Figure 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

As shown in FIG. 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

The data processing device 12 includes a computer 22, a database 24, and a communication I/F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and communication I/F 26 are also connected to the bus 34. The communication I/F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and/or a LAN (Local Area Network).

The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I/F 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

The reception device 38 is equipped with a touch panel 38A, a microphone 38B, etc., and receives user input. The touch panel 38A detects contact with an indicator (e.g., a pen or finger) to receive user input via the indicator. The microphone 38B detects the user's voice to receive user input via voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

The output device 40 is equipped with a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible by the user 20 (e.g., audio and/or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

The communication I/F 44 is connected to the network 54. The communication I/Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54.

Figure 2 shows an example of the main functions of the data processing device 12 and smart device 14.

As shown in FIG. 2, in the data processing device 12, specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

Storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

Next, we will explain the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following explanation, the data processing device 12 will be referred to as the "server" and the smart device 14 will be referred to as the "terminal."

This invention relates to a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized by the following programs and processes.

User server connection and authentication

When a user uses a terminal to access the system, they first go to the login screen. They enter their ID and password and attempt to log in. The terminal sends the entered authentication information to the server, which then compares the received information with a database to authenticate the user. If authentication is successful, the user proceeds to the main menu.

Player Selection

When a user selects the "Select Player" option from the main menu, the device will display a list of players. The user can tap on a specific player they want to chat with and send the player ID to the server. The server will retrieve the player's profile information from its database and return it to the device, which will then display it, allowing the user to view information about that player.

Start chat with an AI character

When a specific player is selected, a chat screen appears and the user can enter a message. When the user presses the send button, the device sends the message to the server, which then relays the message to the AI chatbot. The AI chatbot analyzes the received message and generates a response in the style of the player. The server returns the generated response to the device, which then displays it on the chat screen.

Get live match results

As the match progresses, the server retrieves match results in real time. When the server retrieves new match results, it sends them to the user's device via push notification. The device receives the notification and displays the match results to the user.

Distribution of original content

When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves the list of original content from the content database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format.

AR photo taking and sharing

When a user selects the "AR Photo Taking" option, the device's camera function will be activated, allowing them to take a photo with the player using the AR function. Once the user has finished taking the photo, the device will upload the photo data to the server. The server will save the photo, generate a sharing link, and return it to the device. The user can then use the link to share the photo on social media, etc.

Purchase recommended gourmet foods and merchandise

When a user selects the "Recommended Food and Goods" option from the menu, the device sends a request to the server, which retrieves recommended food and goods information from a database and returns it to the device. The device displays the list, and when the user selects a specific item, a purchase request is sent to the server. The server completes the purchase process and arranges for delivery.

Specific examples

For example, a user logs in, selects a specific athlete (Athlete A), and sends a message saying, "Please tell us your enthusiasm before the game." The server receives the message and passes it to an AI chatbot, which then generates a response such as, "My goal this season is to win!" This response is displayed on the user's chat screen. If a game is in progress, real-time game results are sent to the user's device via push notification. The user can then view original content from the main menu or take photos with the player using the AR function.

In this way, this system allows users to enjoy private communication with athletes while receiving match results and original content in real time. Furthermore, by using the AR and merchandise purchasing functions, it is possible to increase engagement with fans and promote contributions to the local economy.

The processing flow is explained below.

Program processing steps

User server connection and authentication

Step 1:

The user launches the Hawks Connection app and goes to the login screen.

Step 2:

The user enters their ID and password on the login screen and clicks the login button.

Step 3:

The device sends ID and password authentication information to the server.

Step 4:

The server compares the received ID and password with the database and performs authentication.

Step 5:

If authentication is successful, the server returns a successful authentication message to the terminal, and the terminal displays the main menu.

Player Selection

Step 1:

The user selects the "Select Player" option from the main menu.

Step 2:

The device will display the player list screen, and the user can tap on the player they want to chat with.

Step 3:

The device sends the player ID to the server.

Step 4:

The server retrieves the player's profile information from the database and returns it to the device.

Step 5:

The device will display the player's profile information received to the user.

Start chat with an AI character

Step 1:

The user enters a message in the chat input field and presses the send button.

Step 2:

The device sends the user's message to the server.

Step 3:

The server passes the message to the AI chatbot.

Step 4:

The AI chatbot analyzes the messages it receives and generates responses in the style of a player.

Step 5:

The server returns the generated response to the device, which displays the response on the chat screen.

Quick match results notifications

Step 1:

The server retrieves match results in real time.

Step 2:

The server that obtains the match results will send a push notification to the user's device.

Step 3:

The device will receive a notification and display the match results to the user.

Distribution of original content

Step 1:

The user selects the "Original Content" option from the main menu.

Step 2:

The device requests a content list from the server.

Step 3:

The server retrieves a list of original content from the content database and returns it to the device.

Step 4:

The device displays a content list and the user selects specific content.

Step 5:

The device requests the selected content data from the server, and the server streams the data.

AR photo taking and sharing

Step 1:

The user selects the "Take AR Photo" option from the menu.

Step 2:

The device's camera function will be activated, and you can use the AR function to take a photo with the player.

Step 3:

Once the user has finished taking a photo, the device uploads the photo data to the server.

Step 4:

The server stores the photo data, generates a sharing link, and returns it to the device.

Step 5:

Users can use the link to share photos on social media etc.

Purchase recommended gourmet foods and merchandise

Step 1:

The user selects the "Recommended Gourmet & Goods" option from the main menu.

Step 2:

The device sends a request to the server, which retrieves information from the database.

Step 3:

The server returns a list of recommended gourmet foods and goods to the device.

Step 4:

The device displays a list and the user selects a specific item.

Step 5:

The device sends a purchase request to the server, and the server processes the purchase.

Step 6:

The server handles purchase confirmation and shipping arrangements.

(Example 1)

Next, we will explain Example 1. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

Traditional sports fan engagement systems were limited to providing athlete information and content distribution, and lacked the means for fans to interact one-on-one with athletes, receive real-time match results, take photos using augmented reality features, or purchase recommended meals or official support merchandise. This made it difficult to increase user satisfaction and engagement.

The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

In this invention, the server includes a means for users to chat one-on-one with a specific avatar, a means for providing match results and content in real time, a means for users to take and share photos with the avatar using augmented reality functions, a means for users to purchase recommended meals and official support merchandise, a means for users to enter login authentication information and be authenticated by the server, a means for providing information about the avatar selected by the user, a means for the avatar to generate a response to the user's message, and a means for displaying the generated response to the user. This allows users to enjoy multifaceted engagement with athletes, improving system usage satisfaction.

"User" refers to an individual or organization that uses this system.

An "avatar" is a virtual character based on a specific athlete that is designed to interact one-on-one with users.

"Server" refers to a computer system used to manage and provide user authentication information, avatar data, match results, and other content.

"Database" refers to a system for storing and managing data used in the system, such as athlete profile information, match results, and content.

"Response" refers to the answer or reaction generated by an avatar in response to a message from a user.

"Match Results" refers to the results data of ongoing or completed sports matches.

"Content" refers to media information provided to users, such as original videos, articles, and images.

"Augmented reality (AR)" refers to technology that uses a device's camera to overlay virtual objects onto real-world images.

"Recommended Meals" refers to diet-related products or services recommended by an athlete or the System to a user.

"Official support merchandise" refers to official goods and merchandise related to an athlete's team or brand.

"Login credentials" refers to the ID and password combination required by a user to access the system.

"Authentication" refers to the process by which the server verifies that the login credentials provided by the user are accurate.

This invention provides a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized through the following specific hardware and software configuration and processing.

First, the user accesses the system using a device (smartphone, tablet, PC, etc.) and goes to the login screen. The user enters their ID and password and attempts to log in. The device sends the entered authentication information to the server. The server compares the received information with a database (e.g., MySQL) for authentication, and if authentication is successful, the user proceeds to the main menu.

When a user selects the "Select Player" option from the main menu, the device requests a list of players from the server. The server retrieves the list of players from the database and sends it to the device. The user can then tap or click to select a specific player and view their profile information.

Once a player is selected, the user can begin chatting with the AI character. When the user enters a message and presses the send button, the device sends the message to the server, which then passes it to an AI chatbot (such as GPT-3 as a generative AI model). The AI chatbot analyzes the message and generates a response in the style of the player, which the server then sends back to the device and displays on the user's chat screen.

Also, while the match is in progress, the server obtains match results in real time via external APIs such as sports data APIs. When new match results become available, the server sends them to the user's device via push notification, which then receives the notification and displays it to the user.

Furthermore, if the user selects the "Original Content" option, the device will request a content list from the server. The server will retrieve the content data from the database and send it to the device. When the user selects specific content, the server will provide that content in streaming format.

When a user selects "AR Photo Shooting" in the AR photo option, the device's camera function and AR library (e.g., ARKit) are activated to take a photo with the player's virtual character. After taking the photo, the device uploads the photo data to the server, which saves the photo and generates a sharing link that is returned to the device. The user can then use this link to share the photo on social media, etc.

Finally, when the user selects the "Recommended Gourmet/Goods" option, the device sends a request to the server, which retrieves information about recommended meals and official support products from its database and returns it to the device. When the user selects a specific item, a purchase request is sent to the server, which then processes the purchase and arranges for delivery.

Example prompt

Please tell us your enthusiasm before the match.

What are your goals this season?

What do you think about the next match?

In this way, this system allows users to enjoy private communication with athletes while receiving match results and original content in real time. Furthermore, by using the AR and merchandise purchasing functions, it is possible to increase engagement with fans and promote contributions to the local economy.

The flow of the identification process in Example 1 will be explained using Figure 11.

Step 1:

The user uses a terminal to navigate to the login screen and enter their ID and password. Input: User's ID and password. The terminal sends this authentication information to the server. The server compares the received information with the database for authentication. If authentication is successful, Output: An instruction to proceed to the main menu is returned. Specific operation: The server uses an SQL query to search the database for authentication information, and returns success if it matches, or an error message if it does not match.

Step 2:

The user selects the "Select Player" option from the main menu. Input: The user requests to select a player. The device requests a list of players from the server. The server retrieves the list of players from the database and returns it to the device. Output: The player list is displayed on the device. Specific behavior: The server retrieves player information using an SQL query and returns it to the device in JSON format.

Step 3:

The user selects a specific player and starts a chat with that player. Input: User's player selection and message. When the user enters a message and presses the send button, the device sends the message to the server. The server passes the message to the AI chatbot. Output: The response generated by the chatbot. Specific operation: The server invokes an AI model (e.g., GPT-3) to analyze the message and generate a response. The response is returned to the device in JSON format and displayed on the chat screen.

Step 4:

As the match progresses, the server retrieves match results in real time from an external API (e.g., a sports data API). Input: Updated match status data. If there are new match results, the server sends them to the user's device via push notification. Output: Push notification of match results. Specific operation: The server periodically calls the API and notifies the user via WebSocket or Firebase Cloud Messaging if there is new data.

Step 5:

The user selects the "Original Content" option from the main menu. Input: The user requests content. The device sends a request to the server, which retrieves the content data from the database and sends it to the device. Output: A content list is displayed on the device. When the user selects specific content, the server provides it in streaming format. Specific behavior: The server provides media files in HLS format, and the device plays them in the appropriate player.

Step 6:

When a user selects the "AR Photo Shoot" option, the device activates the camera function and AR library (e.g., ARKit). Input: User's photo request. A photo is taken with the player's virtual character. After the photo is taken, the device uploads the photo data to the server, which saves the photo and generates a sharing link that is returned to the device. Output: Shared link. Specific operation: A photo is taken using the device's camera and AR library, and uploaded to the server via REST API. The server generates a link and sends it back.

Step 7:

When the user selects the "Recommended Food & Goods" option, the device sends a request to the server. Input: User's item selection request. The server retrieves information about recommended meals and official support products from the database and returns it to the device. Output: A product list is displayed on the device. When the user selects a specific item, a purchase request is sent to the server, which completes the purchase and arranges for delivery. Specific operation: The server retrieves the product information, completes the purchase through a payment gateway (e.g., Stripe), and notifies the user of the order information.

(Application Example 1)

Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the smart device 14 will be referred to as the "terminal."

Today's sports fans want to interact more closely with their favorite athletes, receive real-time game information, and watch original content. However, conventional systems have difficulty providing these services comprehensively, limiting the means to increase fan engagement. This has created a growing need for systems that provide virtual communication with athletes, real-time game information notifications, AR photography, the distribution of original content, and the ability to purchase recommended products.

The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

In this invention, the server includes: a means for allowing users to chat one-on-one with an AI character of a specific athlete; a means for providing real-time game results and original video content; a means for users to take and share photos with the athlete using AR functions; a means for users to purchase food and drink recommended by the athlete and official support merchandise; a means for users to log in from their device, select a specific athlete, and use a generative AI model to generate and display athlete-style responses; a means for obtaining game progress in real time and notifying the user; and a means for users to view original content via their device. This enables deep engagement with athletes, allowing fans to enjoy game information and original content in real time, and further increasing satisfaction through AR functions and recommended merchandise.

An "athlete" is a person who competes in a particular sport, and is virtually reproduced as an AI character within the system.

"One-on-one chat" means that users can engage in individual, two-way messaging with an AI character of a specific athlete.

"Live Match Results" means the latest match status and results provided to users in real time for ongoing or completed sports matches.

"Original video content" refers to independently created video data about athletes and related events that is distributed to users.

The "AR function" uses augmented reality technology to allow users to synthesize and photograph virtual images of athletes in real-world scenes.

"Athlete-recommended foods, beverages, and official support products" refer to foods and beverages recommended by athletes and products officially approved for support, which can be purchased by users.

"Generative AI model" refers to artificial intelligence technology that generates athlete-style responses based on a user's message.

"Get in real time" means continuously monitoring the progress of the match and notifying the user immediately.

"Terminal" refers to a device that a user uses to access and operate the system, such as a smartphone or tablet.

This invention relates to a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized by the following programs and processes.

First, a user must log in to access the system using a terminal. The user enters their ID and password on the login screen and sends the authentication information to the server. The server authenticates the received authentication information by comparing it with a database, and if authentication is successful, the user can proceed to the main menu. The hardware used is a smartphone, and the software used is a back-end server and database management system.

The user then selects the "Select Player" option from the main menu, and the device displays a list of players. The user taps on the specific athlete they want to chat with and sends the athlete ID to the server. The server retrieves the athlete's profile information from the database and returns it to the device, which then displays it, allowing the user to view information about the athlete. The hardware used is a smartphone, and the software used is a back-end server and database management system.

Once a specific athlete is selected, a chat screen appears, allowing the user to enter a message. When the user presses the send button, the device sends the message to the server, which uses the generative AI model to analyze the message and generate a response in the style of the athlete. This response is returned from the server to the device, which displays it on the chat screen. The hardware used is a smartphone, and the software used is the generative AI model and back-end server.

Also, while a match is in progress, the server obtains the match status in real time and sends it to the user's device via push notification. The device receives the notification and displays the match results to the user. The hardware used is a smartphone, and the software used is a server with real-time data acquisition capabilities.

Furthermore, when the user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves a list of original video content from the content database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format. The hardware used is a smartphone, and the software used is a streaming server.

When a user selects the "AR Photo Shooting" option, the device's camera function is activated, allowing them to take a photo with the athlete using AR functionality. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo, generates a sharing link, and returns it to the device. The user can then use the link to share the photo on social media, etc. The hardware used is a smartphone (camera function), and the software used is an application using AR technology and a back-end server.

For example, a user can generate an athlete-like response using the following prompt: "What are your thoughts before the game?" If the user sends a message, the generative AI model can generate a response such as "My goal this season is to win!" and display it in the user's chat screen.

In this way, a system will be created that enables deep engagement with athletes, allows fans to enjoy real-time game information and original content, and further enhances satisfaction through AR functions and recommended products.

The flow of the specific processing in Application Example 1 will be explained using Figure 12.

Step 1:

A user accesses the system using a terminal. The user enters their ID and password on the login screen and sends the input data to the terminal. The terminal sends the authentication information to the server, which then compares it with a database for authentication. The server returns the authentication result to the terminal, and the terminal displays the main menu if authentication is successful, or an error message if authentication is unsuccessful.

Enter: User ID, Password

Data processing: Sending authentication information and database verification

Output: Authentication result (success/failure)

Step 2:

The user selects the "Select Player" option from the main menu. The device sends a request for a player list to the server, which retrieves the player list from the database and returns it to the device. The device displays the player list, and when the user taps on a specific athlete, the player ID is sent to the server. The server retrieves the player's profile information and returns it to the device, which displays it.

Input: Player selection request, player ID

Data processing: Obtaining player lists and profile information

Output: Player list, player profile information

Step 3:

When the user selects a player, a chat screen is displayed. When the user enters a message and presses the send button, the device sends the message to the server. The server analyzes the message using a generative AI model, generates an athlete-style response, and returns the response to the device. The device displays the athlete-style response on the chat screen.

Input: User message

Data processing: Message analysis and response generation using generative AI models

Output: Athlete-like response

Step 4:

When a match is in progress, the server continues to obtain the match status in real time. Every time the server detects new match status, it pushes the match results to the user's device. The device receives the notification and displays the match results to the user.

Input: Real-time match status data

Data processing: Monitoring match conditions

Output: Match results via push notification

Step 5:

When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves a list of original video content from the database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format.

Input: Original content request

Data processing: Obtaining content lists and content data

Output: Original content list, streaming content

Step 6:

When a user selects the "AR Photo Shoot" option, the device's camera function will activate and use the AR function to take a photo with the athlete. Once the user has finished taking the photo, the device will upload the photo data to the server. The server will save the photo and generate a sharing link that will be returned to the device. The user can then use the link to share the photo on social media, etc.

Input: Photo request, photo data

Data processing: Upload and save photo data, generate sharing links

Output: Shared link

Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

This invention achieves even higher levels of fan engagement by combining an emotion engine with a system in which users communicate with AI athlete characters. This system is realized through the following programs and processes.

User server connection and authentication

When a user uses a terminal to access the system, they first go to the login screen. They enter their ID and password and attempt to log in. The terminal sends the entered authentication information to the server, which then compares the received information with a database to authenticate the user. If authentication is successful, the user proceeds to the main menu.

Player Selection

When a user selects the "Select Player" option from the main menu, the device displays a list of players and the user taps on the specific player they want to chat with. The device sends the player ID to the server, which retrieves the player's profile information from its database and returns it to the device. The device displays this, allowing the user to view information about that player.

Start chat with an AI character

Once a specific player is selected, a chat screen appears and the user can enter a message. When the user presses the send button, the device sends the message to the server, which then passes it on to the AI chatbot. The AI chatbot analyzes the received message and uses an emotion engine to generate a player-like response. The emotion engine analyzes the emotion from the user's message and generates an optimal response based on that emotion. The server returns the generated response to the device, which then displays it on the chat screen.

The role of the emotional engine

The emotion engine analyzes the messages and actions entered by the user and recognizes their emotions. For example, if a user enters, "I had so much fun today!", the emotion engine will recognize the user's emotion as "joy." Based on this information, the AI chatbot will generate a response that corresponds to joy, such as, "That's great! Please come again!"

Quick match results notifications

As the match progresses, the server retrieves match results in real time. When the server retrieves new match results, it sends them to the user's device via push notification. The device receives the notification and displays the match results to the user. The emotion engine analyzes the user's emotions and can optimize responses to match results.

Distribution of original content

When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves the list of original content from the content database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format. The emotion engine can also recommend appropriate content based on the user's emotions.

AR photo taking and sharing

When a user selects the "AR Photo Taking" option, the device's camera function will be activated, allowing them to take a photo with the player using the AR function. Once the user has finished taking the photo, the device will upload the photo data to the server. The server will save the photo, generate a sharing link, and return it to the device. The user can then use the link to share the photo on social media, etc.

Purchase recommended gourmet foods and merchandise

When a user selects the "Recommended Food and Goods" option from the menu, the device sends a request to the server, which retrieves recommended food and goods information from a database and returns it to the device. The device displays a list, and when the user selects a specific item, a purchase request is sent to the server. The server completes the purchase process and arranges for delivery. The emotion engine can present recommended items taking into account the user's emotional state.

Specific examples

For example, suppose a user logs in, selects a specific athlete (Athlete A), and sends a message on the chat screen saying, "I'm so happy today!" The server receives this message, and the emotion engine analyzes the emotion of "joy." Based on this information, the AI chatbot generates a response such as, "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. If a game is in progress, real-time game results are sent to the user's device via push notification. Users can also watch original content from the main menu and take photos with players using the AR function.

By incorporating an emotion engine, the system can provide flexible and personalized responses based on user emotions, further increasing engagement. This improves the fan experience and drives more visitors to stadiums and related facilities.

The processing flow is explained below.

Program processing steps

User server connection and authentication

Step 1:

The user launches the Hawks Connection app and goes to the login screen.

Step 2:

The user enters their ID and password on the login screen and clicks the login button.

Step 3:

The device sends ID and password authentication information to the server.

Step 4:

The server compares the received ID and password with the database and performs authentication.

Step 5:

If authentication is successful, the server returns a successful authentication message to the terminal, and the terminal displays the main menu.

Player Selection

Step 1:

The user selects the "Select Player" option from the main menu.

Step 2:

The device will display the player list screen, and the user can tap on the player they want to chat with.

Step 3:

The device sends the player ID to the server.

Step 4:

The server retrieves the player's profile information from the database and returns it to the device.

Step 5:

The device will display the player's profile information received to the user.

Start chat with an AI character

Step 1:

The user enters a message in the chat input field and presses the send button.

Step 2:

The device sends the user's message to the server.

Step 3:

The server sends the message to the emotion engine, which analyzes the user's emotions.

Step 4:

The server passes the analysis results to the AI chatbot.

Step 5:

The AI chatbot generates appropriate responses based on the results of emotion analysis.

Step 6:

The server returns the generated response to the device, which displays the response on the chat screen.

Quick match results notifications

Step 1:

The server retrieves match results in real time.

Step 2:

The server will send the match results to the user's device via push notification.

Step 3:

The device will receive a notification and display the match results to the user.

Distribution of original content

Step 1:

The user selects the "Original Content" option from the main menu.

Step 2:

The device requests a content list from the server.

Step 3:

The server retrieves a list of original content from the content database and returns it to the device.

Step 4:

The device displays a content list and the user selects specific content.

Step 5:

The device requests the selected content data from the server, and the server streams the data.

AR photo taking and sharing

Step 1:

The user selects the "Take AR Photo" option from the menu.

Step 2:

The device's camera function will be activated, and you can use the AR function to take a photo with the player.

Step 3:

Once the user has finished taking a photo, the device uploads the photo data to the server.

Step 4:

The server stores the photo data, generates a sharing link, and returns it to the device.

Step 5:

Users use the link to share photos on social media etc.

Purchase recommended gourmet foods and merchandise

Step 1:

The user selects the "Recommended Gourmet & Goods" option from the main menu.

Step 2:

The device sends a request to the server, which retrieves information from the database.

Step 3:

The server returns a list of recommended gourmet foods and goods to the device.

Step 4:

The device displays a list and the user selects a specific item.

Step 5:

The device sends a purchase request to the server, and the server processes the purchase.

Step 6:

The server handles purchase confirmation and shipping arrangements.

Using the Emotion Engine

Step 1:

When a user sends a message, the server receives the message and sends it to the emotion engine.

Step 2:

The emotion engine analyzes messages and recognizes the user's emotions.

Step 3:

The emotion engine returns the recognized emotion to the server.

Step 4:

The server communicates the emotion analysis results to the AI chatbot.

Step 5:

The AI chatbot generates appropriate responses based on the results of sentiment analysis.

Step 6:

The server returns the generated response to the terminal, which displays the response to the user.

Specific examples

For example, suppose a user logs in, selects a specific athlete (Athlete A), and sends a message on the chat screen saying, "I'm so happy today!" The server receives this message, and the emotion engine analyzes the emotion of "joy." Based on this information, the AI chatbot generates a response such as, "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. While a game is in progress, real-time game results are sent to the user's device via push notification. Users can also watch original content from the main menu and take photos with players using the AR function. With the introduction of the emotion engine, the system can provide flexible and personalized responses based on the user's emotions, further increasing engagement. This improves the fan experience and encourages more people to visit stadiums and related facilities.

(Example 2)

Next, we will explain Example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

The problem this invention aims to solve is to achieve more natural and emotional dialogue in a system that increases fan engagement between users and athletes, and to respond to users' real-time and individual needs. Conventional systems do not provide responses that reflect the user's emotions, and do not adequately provide real-time game results or distribute original content. Furthermore, the user experience is limited, such as the ability to take photos using AR functions or purchase recommended gourmet food or merchandise. It is necessary to solve these problems and improve user satisfaction.

The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

In this invention, the server includes: means for allowing a user to chat one-on-one with an AI character of a specific athlete; means for authenticating the ID and password entered by the user on the login screen; means for providing profile information of the athlete selected by the user; means for the AI character to receive the user's message, analyze emotions using an emotion engine, and generate a response based on those emotions; means for displaying the generated response to the user; means for providing real-time game results and original content; means for the user to take and share photos with the athlete using the AR function; means for the user to purchase gourmet food recommended by the athlete and official cheering merchandise; means for the emotion engine to analyze the user's message and recognize emotions; means for the AI chatbot to generate an optimal response based on the recognized emotions; and means for the server to obtain game results in real time while the game is in progress and send them to the device via push notification. This allows users to receive personalized responses based on emotions, providing real-time information and a diverse entertainment experience.

"AI Athlete Characters" are virtual characters created using artificial intelligence to mimic athletes and can chat one-on-one with users.

"Users" refer to people who use this system and communicate with the AI athlete characters within the system.

An "emotion engine" is a software component that analyzes emotions from messages entered by users and generates responses based on those emotions.

An "AI chatbot" is an artificial intelligence program that receives messages from users, analyzes them, and generates appropriate responses.

An "ID" is identification information used to identify a user, and is usually composed of a unique string of characters or numbers.

A "password" is a secret string of characters used in combination with an ID to authenticate a user.

"Authentication information" refers to the ID and password combination entered by the user when logging in.

A "database" is a collection of electronically managed data that stores user information, athlete profile information, etc.

The "Main Menu" is the screen that serves as the gateway to the system's main functions, which users can access after successful authentication.

"Profile information" refers to detailed data about a specific athlete, including the athlete's background, performance, characteristics, etc.

"Real-time" means that data is generated and transmitted immediately, without delay.

"Match Results Updates" is a means of providing information to users quickly and effectively regarding the results of ongoing or completed matches.

"Original content" refers to original digital content such as video, audio, and text that the system provides to users.

"AR function" is an augmented reality technology that overlays digital information onto real-world scenery.

"Means for taking photos" refers to the method by which a user generates image data using the device's camera function.

"Sharing methods" are the ways in which users can share photos they take and content they generate with other users online.

"Gourmet" refers to high-quality foods and beverages recommended by athletes.

"Official cheering merchandise" refers to cheering items and accessories officially approved by athletes or organizations.

"Means of purchase" refers to the mechanism by which users order and pay for gourmet food and official support merchandise through the system.

"Push notifications" are a method by which a server sends important information to a user's device in real time.

The system of the present invention is an advanced fan engagement system that combines multiple technologies to enable users to communicate with AI athlete characters. The system includes hardware and software to implement specific methods.

System Configuration

This system mainly consists of the following components:

(Server): Database server, AI chatbot, emotion engine, push notification system

(Device): A device (smartphone, tablet, PC, etc.) that accepts user operations and displays information accordingly.

(User): The person who operates the system and communicates with the athlete AI character.

Key technical components and processing overview

User authentication and login

When a user accesses the system using a terminal, they first go to a login screen. They enter their ID and password, and if authentication is successful, they proceed to the main menu. Databases such as MySQL and PostgreSQL are used here.

Select a player and view their profile

The user selects the "Select Player" option from the main menu and chooses a specific player from the displayed list of players. The device sends the player ID to the server, which retrieves the player's profile information from the database and returns it to the device, allowing the user to view the player's details.

Chat with AI characters

When a user wants to chat with a selected player, they enter a message on the chat screen and press the send button. The device sends the message to the server, which then forwards it to the AI chatbot. The AI chatbot uses a generative AI model (e.g., GPT-4) and an emotion engine to analyze the sentiment of the message. Based on the results of this analysis, it generates an optimal response and returns it to the device. The device then displays the generated response on the chat screen.

Match result notification

As the match progresses, the server retrieves the match results in real time, and when important results are obtained, they are sent to the user's device via push notification. This notification function uses push notification services such as Firebase Cloud Messaging (FCM).

Distribution of original content

When a user selects the "Original Content" option, the device requests a content list from the server. The server retrieves the list from the content database and returns it to the device, providing the user's selected content in streaming format.

AR photo taking and sharing

When a user selects the "AR Photo Shoot" option, the device's camera function will be activated, allowing the user to take a photo with the player using the AR function. After the photo is taken, the device will upload the photo data to the server, which will then generate a sharing link and return it to the device. The user can then share the link on social media, etc.

Purchase recommended gourmet foods and merchandise

When a user selects the "Recommended Food and Goods" option, the device sends a request to the server, which retrieves information about recommended food and goods from a database and returns it to the device. When the user selects a specific item and sends a purchase request to the server, the server completes the purchase process and arranges for delivery.

Specific examples

For example, the following shows the process flow when a user logs in, selects a specific athlete (Athlete A), and sends the message "I'm so happy today!" on the chat screen. The server receives this message, and the emotion engine analyzes the "joy." Based on this information, the AI chatbot generates a response such as "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. Additionally, if a game is in progress, real-time game results are sent to the user's device via push notification. Furthermore, users can view original content from the main menu and take photos with players using the AR function.

Example prompt

"I want to send a message to a specific athlete (Athlete A) and get an emotional response. For example, if I send the message 'I'm really happy today!', please generate an appropriate reply."

By implementing this invention, users can receive personalized responses based on their emotions, enabling real-time information provision and diverse entertainment experiences.

The flow of the identification process in Example 2 will be explained using Figure 13.

Step 1:

The user boots up using a terminal and accesses the system login screen.

Step 2:

The user enters their ID and password on the login screen. This input information is sent to the server by the device. The input data is sent to the server in the form of "user ID" and "password."

Step 3:

The server compares the received ID and password with a database, which stores pre-registered user information. The result of the comparison determines whether authentication was successful.

Step 4:

The server sends the authentication result to the terminal. If authentication is successful, a success message is sent along with access information to the main menu. If authentication fails, an authentication error message is sent.

Step 5:

Based on the authentication results received by the device from the server, if authentication is successful, the main menu screen will be displayed, allowing the user to select their next action.

Step 6:

The user selects the "Select Player" option from the main menu. A request for a player list is sent from the device to the server.

Step 7:

The server retrieves the player list from the database and returns the data to the device. Player names, profile photos, etc. are retrieved from the database.

Step 8:

The device displays the player list received from the server to the user. The user selects the specific player they want to chat with from the list.

Step 9:

When a user selects a specific player, the player's ID is sent by the device to the server, which retrieves the player's details from the database and returns them to the device.

Step 10:

The device displays the player's detailed profile received from the server to the user. The user is then taken to a screen where they can start chatting with the player.

Step 11:

The user enters a message on the chat screen and presses the send button. The entered message is sent from the device to the server.

Step 12:

The server forwards the received message to the AI chatbot, which analyzes the message using a generative AI model (e.g., GPT-4).

Step 13:

The AI chatbot analyzes the content of the message and recognizes emotions using an emotion engine. Emotion-analyzed data is obtained in the form of "joy" or "sadness," etc.

Step 14:

The AI chatbot generates a response message based on the analysis results of the emotion engine. For example, if the emotion "joy" is recognized, the response message generated will be "That's wonderful!"

Step 15:

The server sends the generated response message to the terminal.

Step 16:

The device will display the response message on the chat screen so that the user can view it.

Step 17:

While a match is in progress, the server obtains match results in real time. For example, it uses an API to obtain match status data.

Step 18:

When the server obtains new match results, they are sent to the user's device via push notification.

Step 19:

The device receives the notification and displays the match results to the user. At the same time, the emotion engine analyzes the user's reaction and provides optimal feedback.

Step 20:

If the user selects the "Original Content" option, the device will request a content list from the server.

Step 20:

The server retrieves a list of original content from the content database and returns it to the device. The retrieved data includes video thumbnails and titles.

Step 21:

The device displays the received list to the user, allowing them to select content.

Step 22:

When a user selects the content they want to watch, the server provides that content in streaming format.

Step 23:

The device receives the streaming data and the user can watch the content.

Step 24:

When a user selects the "AR Photo Taking" option, the device's camera function will be activated. The AR function will be enabled, allowing the user to take photos with the players.

Step 25:

Once the user has taken a photo, the device uploads the photo data to the server.

Step 26:

The server stores the uploaded photos and generates a sharing link that is returned to the device.

Step 27:

The device displays the received link information to the user, who can then use the link to share the photo on social media, etc.

Step 28:

The user selects the "Recommended Food and Goods" option. The device sends a request to the server, which retrieves information about recommended food and goods from the database and returns it to the device.

Step 29:

The device displays the received list to the user and allows them to select a specific item.

Step 30:

When a user selects a specific item, a purchase request is sent from the device to the server. The purchase request includes user information and details of the selected item.

Step 31:

The server processes the purchase request and the purchase is completed through the payment system. Delivery arrangements are then made.

Step 32:

The emotion engine analyzes the user's emotional state and recommends appropriate items based on that state. For example, if the user is in a "joy" state, it will recommend related fun goods.

Step 33:

Recommended items will be displayed on the device, allowing the user to start the purchase process again.

The above are the specific processing steps of this system.

(Application Example 2)

Next, we will explain Application Example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the smart device 14 will be referred to as the "terminal."

Traditional methods of interaction between athletes and fans make it difficult to respond flexibly to fans' emotions, and the provision of personalized content is limited. Furthermore, notifications of match results and recommendations of related content are not optimized to take user emotions into account. Under these circumstances, there are challenges in not being able to fully improve fan engagement or deepen the fan experience.

The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for allowing a user to have a one-on-one conversation with an AI character of a specific athlete; means for providing real-time game progress updates and unique content; means for users to take and share photos with athletes using an augmented reality function; means for users to purchase athlete-recommended food and beverages and official support merchandise; means for recognizing a user's emotions using an emotion analysis engine and personalizing and recommending content based on those emotions; means for authenticating identification information and a password entered by the user on the login screen; means for providing profile information of an athlete selected by the user; means for recommending and delivering personalized sports-related content based on the user's emotions; means for an AI character to generate a response to a user's message; means for displaying the generated response; and means for obtaining game results in real time and generating and notifying a response based on emotions. This enables the provision of personalized content based on the user's emotions, improving fan engagement and deepening the fan experience.

"AI character of a specific athlete" refers to a virtual character with artificial intelligence created to imitate a specific athlete, which communicates with users.

"User" refers to an individual, fan, or user who uses this system.

"Means for dialogue" refers to a mechanism that allows users to exchange messages with a specific athlete's AI character and for them to respond to each other.

"Match progress updates" refers to information provided in real time about the progress and results of a match.

"Original Content" refers to videos, articles, interviews, behind-the-scenes footage, and other information specifically created and provided by the System.

"Means of providing information in real time" refers to technologies and mechanisms that deliver information to users instantly.

"Augmented reality" refers to technology that overlays digital information onto the real world, for example, by synthesizing virtual characters onto the scenery seen through a camera.

An "emotion analysis engine" refers to an algorithm or software that analyzes messages and actions entered by users and recognizes their emotions.

"Personalized content" refers to information that is optimized and customized based on a user's interests and emotional state.

"Identification information" refers to information that uniquely identifies a user, and typically refers to a user ID and password.

"Encryption" means secret information used to protect identifying information, including passwords and PIN codes.

"Profile information" refers to detailed information about an athlete, such as their name, biography, statistics, and photo.

A "generated response" is a reply created by an AI character based on the user's message.

"Means of notification" refers to the technology or mechanism used to notify users of new information, such as push notifications or email.

"Food and drink" refers to food and drink recommended by the competitor.

"Official support merchandise" refers to support goods and related products authorized by an athlete or team.

This invention is a system that allows users to have one-on-one conversations with an AI character of a specific athlete, and includes features such as providing real-time updates on match progress and original content, using augmented reality to take and share photos with athletes, purchasing food and drink and official support merchandise, and using an emotion analysis engine to recognize users' emotions and personalize and recommend content based on those emotions. Each element of the system and its functions are explained below.

Overall structure

The system consists of a user's device, a central server, a database, an AI character, an emotion analysis engine, and various software that integrates them. Users access the system using a smartphone application.

Authentication Process

The user enters their identification information (ID) and password on the login screen. This information is sent from the device to a central server, which then compares it with a database for authentication. This process authenticates the user.

Player selection and profile information

When a user selects a specific athlete, the selected athlete's profile information is retrieved from the database and displayed on the user's device. This information includes the athlete's name, biography, photo, statistical data, etc.

Interactive features

Users interact with the AI character of the contestant they have selected. When the user presses the send button, a message is sent to a central server, which analyzes the message using an emotion analysis engine. Based on the emotional information analyzed by the emotion analysis engine, the AI character generates an appropriate response, which is then displayed on the user's device.

Match progress notifications and content distribution

Game progress and results are obtained in real time by a central server and pushed to users' devices. In addition, personalized sports-related content is recommended and delivered based on the results of user sentiment analysis.

Augmented reality features

Users can use the augmented reality function to take photos with athletes. By activating the device's camera function, they can take a photo in which the virtual athlete is superimposed on the real-world scenery. The captured photo is uploaded to a central server and a sharing link is generated. This link can be used to share the photo on social media, etc.

Product purchase function

When a user purchases athlete-recommended food and drink or official support merchandise, the device sends a request to the server and retrieves product information from the database. When the user selects a specific item and submits a purchase request, the server completes the purchase process and arranges for delivery.

Hardware and software used

Hardware: Smartphone (iOS or Android)

Software: Python, emotion analysis engine (EmotionAnalyzer), content database (ContentDatabase)

Server: Cloud service (AWS, Azure, etc.)

Specific examples and prompt sentence examples

For example, if a user logs in, selects a specific athlete, and sends a message saying, "I'm so happy today!", the emotion analysis engine will analyze the emotion as "joy." As a result, the AI character will generate a response such as, "That's great! I'll do my best in the next game!" This response will then be displayed on the user's chat screen.

Example prompt:

I'm really happy today!

The flow of the specific processing in Application Example 2 will be explained using Figure 14.

Step 1:

The user enters identification information (ID) and password into a login screen on their device. The device sends this to a central server, which then checks it against a database for authentication. This process authenticates the user. The input is identification information and password, and the output is the authentication result. The process includes querying the database and analyzing the results.

Step 2:

When a user selects a specific athlete, the selected athlete's profile information is retrieved from the database and displayed on the device. The input is the athlete ID, and the output is the athlete's profile information. As part of the process, the server queries the database and returns the results to the device.

Step 3:

The user begins a conversation with an AI character. When the user enters a message and presses the send button, the device sends the message to the server. The server analyzes this message using an emotion analysis engine (EmotionAnalyzer). The input is the user's message, and the output is the analyzed emotion. As part of the process, the server calls the emotion analysis engine and analyzes the message.

Step 4:

Based on the emotional information analyzed by the emotion analysis engine, the AI character generates an appropriate response. The server sends the generated response to the device, which then displays it to the user. The input is the analyzed emotion, and the output is the generated response. As part of the processing, the AI character's response generation algorithm is executed.

Step 5:

Match progress and results are obtained in real time by the server and pushed to the user's device. The input is real-time match data, and the output is notification messages. As part of the process, the server obtains data from an external match data provider and sends it to the user's device as a push notification.

Step 6:

Personalized sports-related content is recommended and delivered based on the results of user emotion analysis. The server retrieves content related to the user's emotions from a database and sends it to the device for display. The input is the user's emotion analysis results, and the output is the recommended content. As part of the process, the server queries the content database based on the emotion analysis results, retrieves appropriate content, and sends it to the user's device.

Step 7:

The user uses the augmented reality function to take a photo with the competitor, and the device uploads the photo to the server. The server saves the photo, generates a sharing link, and returns it to the device. The input is the AR photo, and the output is the sharing link. As part of the process, the device collects camera data and uploads it to the server, which then saves it in a storage service and generates a link.

Step 8:

When a user purchases athlete-recommended food and drink or official support merchandise, the terminal sends a request to the server, which retrieves product information from the database. When the user selects a specific item and submits a purchase request, the server processes the purchase and arranges for delivery. The input is the purchase request, and the output is a notification that the purchase is complete. As part of the process, the server processes the order information, checks inventory, and arranges for delivery.

In this way, each step works together to create a system that provides users with an advanced and personalized fan engagement experience.

The specific processing unit 290 transmits the results of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the results of the specific processing. The microphone 38B acquires audio indicating the user input regarding the results of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

Data generation model 58 is what is known as generative AI (artificial intelligence). Examples of data generation model 58 include generative AI such as ChatGPT (Internet search <URL: https://openai.com/blog/chatgpt>) and Gemini (Internet search <URL: https://gemini.google.com/?hl=ja>). Data generation model 58 is obtained by performing deep learning on a neural network. A prompt containing an instruction is input to data generation model 58, and inference data such as voice data indicating speech, text data indicating text, and image data indicating an image is also input. Data generation model 58 performs inference on the input inference data in accordance with the instructions indicated by the prompt, and outputs the inference results in the form of data such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and/or summarization.

In the above embodiment, an example was given in which the specific processing was performed by the data processing device 12, but the technology disclosed herein is not limited to this, and the specific processing may also be performed by the smart device 14.

[Second embodiment]

Figure 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

As shown in FIG. 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

The data processing device 12 includes a computer 22, a database 24, and a communication I/F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and communication I/F 26 are also connected to the bus 34. The communication I/F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and/or a LAN (Local Area Network).

The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I/F 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the user 20's surroundings (e.g., an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

The communication I/F 44 is connected to the network 54. The communication I/Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I/Fs 44 and 26 is carried out in a secure manner.

Figure 4 shows an example of the main functions of the data processing device 12 and smart glasses 214. As shown in Figure 4, in the data processing device 12, specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32.

The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as the specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

Storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

Next, we will explain the identification process performed by the identification processing unit 290 of the data processing device 12. In the following explanation, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

This invention relates to a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized by the following programs and processes.

User server connection and authentication

When a user uses a terminal to access the system, they first go to the login screen. They enter their ID and password and attempt to log in. The terminal sends the entered authentication information to the server, which then compares the received information with a database to authenticate the user. If authentication is successful, the user proceeds to the main menu.

Player Selection

When a user selects the "Select Player" option from the main menu, the device will display a list of players. The user can tap on a specific player they want to chat with and send the player ID to the server. The server will retrieve the player's profile information from its database and return it to the device, which will then display it, allowing the user to view information about that player.

Start chat with an AI character

When a specific player is selected, a chat screen appears and the user can enter a message. When the user presses the send button, the device sends the message to the server, which then relays the message to the AI chatbot. The AI chatbot analyzes the received message and generates a response in the style of the player. The server returns the generated response to the device, which then displays it on the chat screen.

Quick match results notifications

As the match progresses, the server retrieves match results in real time. When the server retrieves new match results, it sends them to the user's device via push notification. The device receives the notification and displays the match results to the user.

Distribution of original content

When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves the list of original content from the content database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format.

AR photo taking and sharing

When a user selects the "AR Photo Taking" option, the device's camera function will be activated, allowing them to take a photo with the player using the AR function. Once the user has finished taking the photo, the device will upload the photo data to the server. The server will save the photo, generate a sharing link, and return it to the device. The user can then use the link to share the photo on social media, etc.

Purchase recommended gourmet foods and merchandise

When a user selects the "Recommended Food and Goods" option from the menu, the device sends a request to the server, which retrieves recommended food and goods information from a database and returns it to the device. The device displays the list, and when the user selects a specific item, a purchase request is sent to the server. The server completes the purchase process and arranges for delivery.

Specific examples

For example, a user logs in, selects a specific athlete (Athlete A), and sends a message saying, "Please tell us your enthusiasm before the game." The server receives the message and passes it to an AI chatbot, which then generates a response such as, "My goal this season is to win!" This response is displayed on the user's chat screen. If a game is in progress, real-time game results are sent to the user's device via push notification. The user can then view original content from the main menu or take photos with the player using the AR function.

In this way, this system allows users to enjoy private communication with athletes while receiving match results and original content in real time. Furthermore, by using the AR and merchandise purchasing functions, it is possible to increase engagement with fans and promote contributions to the local economy.

The processing flow is explained below.

Program processing steps

User server connection and authentication

Step 1:

The user launches the Hawks Connection app and goes to the login screen.

Step 2:

The user enters their ID and password on the login screen and clicks the login button.

Step 3:

The device sends ID and password authentication information to the server.

Step 4:

The server compares the received ID and password with the database and performs authentication.

Step 5:

If authentication is successful, the server returns a successful authentication message to the terminal, and the terminal displays the main menu.

Player Selection

Step 1:

The user selects the "Select Player" option from the main menu.

Step 2:

The device will display the player list screen, and the user can tap on the player they want to chat with.

Step 3:

The device sends the player ID to the server.

Step 4:

The server retrieves the player's profile information from the database and returns it to the device.

Step 5:

The device will display the player's profile information received to the user.

Start chat with an AI character

Step 1:

The user enters a message in the chat input field and presses the send button.

Step 2:

The device sends the user's message to the server.

Step 3:

The server passes the message to the AI chatbot.

Step 4:

The AI chatbot analyzes the messages it receives and generates responses in the style of a player.

Step 5:

The server returns the generated response to the device, which displays the response on the chat screen.

Quick match results notifications

Step 1:

The server retrieves match results in real time.

Step 2:

The server that obtains the match results will send a push notification to the user's device.

Step 3:

The device will receive a notification and display the match results to the user.

Distribution of original content

Step 1:

The user selects the "Original Content" option from the main menu.

Step 2:

The device requests a content list from the server.

Step 3:

The server retrieves a list of original content from the content database and returns it to the device.

Step 4:

The device displays a content list and the user selects specific content.

Step 5:

The device requests the selected content data from the server, and the server streams the data.

AR photo taking and sharing

Step 1:

The user selects the "Take AR Photo" option from the menu.

Step 2:

The device's camera function will be activated, and you can use the AR function to take a photo with the player.

Step 3:

Once the user has finished taking a photo, the device uploads the photo data to the server.

Step 4:

The server stores the photo data, generates a sharing link, and returns it to the device.

Step 5:

Users can use the link to share photos on social media etc.

Purchase recommended gourmet foods and merchandise

Step 1:

The user selects the "Recommended Gourmet & Goods" option from the main menu.

Step 2:

The device sends a request to the server, which retrieves information from the database.

Step 3:

The server returns a list of recommended gourmet foods and goods to the device.

Step 4:

The device displays a list and the user selects a specific item.

Step 5:

The device sends a purchase request to the server, and the server processes the purchase.

Step 6:

The server handles purchase confirmation and shipping arrangements.

(Example 1)

Next, we will explain Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

Traditional sports fan engagement systems were limited to providing athlete information and content distribution, and lacked the means for fans to interact one-on-one with athletes, receive real-time match results, take photos using augmented reality features, or purchase recommended meals or official support merchandise. This made it difficult to increase user satisfaction and engagement.

The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

In this invention, the server includes a means for users to chat one-on-one with a specific avatar, a means for providing match results and content in real time, a means for users to take and share photos with the avatar using augmented reality functions, a means for users to purchase recommended meals and official support merchandise, a means for users to enter login authentication information and be authenticated by the server, a means for providing information about the avatar selected by the user, a means for the avatar to generate a response to the user's message, and a means for displaying the generated response to the user. This allows users to enjoy multifaceted engagement with athletes, improving system usage satisfaction.

"User" refers to an individual or organization that uses this system.

An "avatar" is a virtual character based on a specific athlete that is designed to interact one-on-one with users.

"Server" refers to a computer system used to manage and provide user authentication information, avatar data, match results, and other content.

"Database" refers to a system for storing and managing data used in the system, such as athlete profile information, match results, and content.

"Response" refers to the answer or reaction generated by an avatar in response to a message from a user.

"Match Results" refers to the results data of ongoing or completed sports matches.

"Content" refers to media information provided to users, such as original videos, articles, and images.

"Augmented reality (AR)" refers to technology that uses a device's camera to overlay virtual objects onto real-world images.

"Recommended Meals" refers to diet-related products or services recommended by an athlete or the System to a user.

"Official support merchandise" refers to official goods and merchandise related to an athlete's team or brand.

"Login credentials" refers to the ID and password combination required by a user to access the system.

"Authentication" refers to the process by which the server verifies that the login credentials provided by the user are accurate.

This invention provides a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized through the following specific hardware and software configuration and processing.

First, the user accesses the system using a device (smartphone, tablet, PC, etc.) and goes to the login screen. The user enters their ID and password and attempts to log in. The device sends the entered authentication information to the server. The server compares the received information with a database (e.g., MySQL) for authentication, and if authentication is successful, the user proceeds to the main menu.

When a user selects the "Select Player" option from the main menu, the device requests a list of players from the server. The server retrieves the list of players from the database and sends it to the device. The user can then tap or click to select a specific player and view their profile information.

Once a player is selected, the user can begin chatting with the AI character. When the user enters a message and presses the send button, the device sends the message to the server, which then passes it to an AI chatbot (such as GPT-3 as a generative AI model). The AI chatbot analyzes the message and generates a response in the style of the player, which the server then sends back to the device and displays on the user's chat screen.

Also, while the match is in progress, the server obtains match results in real time via external APIs such as sports data APIs. When new match results become available, the server sends them to the user's device via push notification, which then receives the notification and displays it to the user.

Furthermore, if the user selects the "Original Content" option, the device will request a content list from the server. The server will retrieve the content data from the database and send it to the device. When the user selects specific content, the server will provide that content in streaming format.

When a user selects "AR Photo Shooting" in the AR photo option, the device's camera function and AR library (e.g., ARKit) are activated to take a photo with the player's virtual character. After taking the photo, the device uploads the photo data to the server, which saves the photo and generates a sharing link that is returned to the device. The user can then use this link to share the photo on social media, etc.

Finally, when the user selects the "Recommended Gourmet/Goods" option, the device sends a request to the server, which retrieves information about recommended meals and official support products from its database and returns it to the device. When the user selects a specific item, a purchase request is sent to the server, which then processes the purchase and arranges for delivery.

Example prompt

Please tell us your enthusiasm before the match.

What are your goals this season?

What do you think about the next match?

In this way, this system allows users to enjoy private communication with athletes while receiving match results and original content in real time. Furthermore, by using the AR and merchandise purchasing functions, it is possible to increase engagement with fans and promote contributions to the local economy.

The flow of the identification process in Example 1 will be explained using Figure 11.

Step 1:

The user uses a terminal to navigate to the login screen and enter their ID and password. Input: User's ID and password. The terminal sends this authentication information to the server. The server compares the received information with the database for authentication. If authentication is successful, Output: An instruction to proceed to the main menu is returned. Specific operation: The server uses an SQL query to search the database for authentication information, and returns success if it matches, or an error message if it does not match.

Step 2:

The user selects the "Select Player" option from the main menu. Input: The user requests to select a player. The device requests a list of players from the server. The server retrieves the list of players from the database and returns it to the device. Output: The player list is displayed on the device. Specific behavior: The server retrieves player information using an SQL query and returns it to the device in JSON format.

Step 3:

The user selects a specific player and starts a chat with that player. Input: User's player selection and message. When the user enters a message and presses the send button, the device sends the message to the server. The server passes the message to the AI chatbot. Output: The response generated by the chatbot. Specific operation: The server invokes an AI model (e.g., GPT-3) to analyze the message and generate a response. The response is returned to the device in JSON format and displayed on the chat screen.

Step 4:

As the match progresses, the server retrieves match results in real time from an external API (e.g., a sports data API). Input: Updated match status data. If there are new match results, the server sends them to the user's device via push notification. Output: Push notification of match results. Specific operation: The server periodically calls the API and notifies the user via WebSocket or Firebase Cloud Messaging if there is new data.

Step 5:

The user selects the "Original Content" option from the main menu. Input: The user requests content. The device sends a request to the server, which retrieves the content data from the database and sends it to the device. Output: A content list is displayed on the device. When the user selects specific content, the server provides it in streaming format. Specific behavior: The server provides media files in HLS format, and the device plays them in the appropriate player.

Step 6:

When a user selects the "AR Photo Shoot" option, the device activates the camera function and AR library (e.g., ARKit). Input: User's photo request. A photo is taken with the player's virtual character. After the photo is taken, the device uploads the photo data to the server, which saves the photo and generates a sharing link that is returned to the device. Output: Shared link. Specific operation: A photo is taken using the device's camera and AR library, and uploaded to the server via REST API. The server generates a link and sends it back.

Step 7:

When the user selects the "Recommended Food & Goods" option, the device sends a request to the server. Input: User's item selection request. The server retrieves information about recommended meals and official support products from the database and returns it to the device. Output: A product list is displayed on the device. When the user selects a specific item, a purchase request is sent to the server, which completes the purchase and arranges for delivery. Specific operation: The server retrieves the product information, completes the purchase through a payment gateway (e.g., Stripe), and notifies the user of the order information.

(Application Example 1)

Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

Today's sports fans want to interact more closely with their favorite athletes, receive real-time game information, and watch original content. However, conventional systems have difficulty providing these services comprehensively, limiting the means to increase fan engagement. This has created a growing need for systems that provide virtual communication with athletes, real-time game information notifications, AR photography, the distribution of original content, and the ability to purchase recommended products.

The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

In this invention, the server includes: a means for allowing users to chat one-on-one with an AI character of a specific athlete; a means for providing real-time game results and original video content; a means for users to take and share photos with the athlete using AR functions; a means for users to purchase food and drink recommended by the athlete and official support merchandise; a means for users to log in from their device, select a specific athlete, and use a generative AI model to generate and display athlete-style responses; a means for obtaining game progress in real time and notifying the user; and a means for users to view original content via their device. This enables deep engagement with athletes, allowing fans to enjoy game information and original content in real time, and further increasing satisfaction through AR functions and recommended merchandise.

An "athlete" is a person who competes in a particular sport, and is virtually reproduced as an AI character within the system.

"One-on-one chat" means that users can engage in individual, two-way messaging with an AI character of a specific athlete.

"Live Match Results" means the latest match status and results provided to users in real time for ongoing or completed sports matches.

"Original video content" refers to independently created video data about athletes and related events that is distributed to users.

The "AR function" uses augmented reality technology to allow users to synthesize and photograph virtual images of athletes in real-world scenes.

"Athlete-recommended foods, beverages, and official support products" refer to foods and beverages recommended by athletes and products officially approved for support, which can be purchased by users.

"Generative AI model" refers to artificial intelligence technology that generates athlete-style responses based on a user's message.

"Get in real time" means continuously monitoring the progress of the match and notifying the user immediately.

"Terminal" refers to a device that a user uses to access and operate the system, such as a smartphone or tablet.

This invention relates to a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized by the following programs and processes.

First, a user must log in to access the system using a terminal. The user enters their ID and password on the login screen and sends the authentication information to the server. The server authenticates the received authentication information by comparing it with a database, and if authentication is successful, the user can proceed to the main menu. The hardware used is a smartphone, and the software used is a back-end server and database management system.

The user then selects the "Select Player" option from the main menu, and the device displays a list of players. The user taps on the specific athlete they want to chat with and sends the athlete ID to the server. The server retrieves the athlete's profile information from the database and returns it to the device, which then displays it, allowing the user to view information about the athlete. The hardware used is a smartphone, and the software used is a back-end server and database management system.

Once a specific athlete is selected, a chat screen appears, allowing the user to enter a message. When the user presses the send button, the device sends the message to the server, which uses the generative AI model to analyze the message and generate a response in the style of the athlete. This response is returned from the server to the device, which displays it on the chat screen. The hardware used is a smartphone, and the software used is the generative AI model and back-end server.

Also, while a match is in progress, the server obtains the match status in real time and sends it to the user's device via push notification. The device receives the notification and displays the match results to the user. The hardware used is a smartphone, and the software used is a server with real-time data acquisition capabilities.

Furthermore, when the user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves a list of original video content from the content database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format. The hardware used is a smartphone, and the software used is a streaming server.

When a user selects the "AR Photo Shooting" option, the device's camera function is activated, allowing them to take a photo with the athlete using AR functionality. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo, generates a sharing link, and returns it to the device. The user can then use the link to share the photo on social media, etc. The hardware used is a smartphone (camera function), and the software used is an application using AR technology and a back-end server.

For example, a user can generate an athlete-like response using the following prompt: "What are your thoughts before the game?" If the user sends a message, the generative AI model can generate a response such as "My goal this season is to win!" and display it in the user's chat screen.

In this way, a system will be created that enables deep engagement with athletes, allows fans to enjoy real-time game information and original content, and further enhances satisfaction through AR functions and recommended products.

The flow of the specific processing in Application Example 1 will be explained using Figure 12.

Step 1:

A user accesses the system using a terminal. The user enters their ID and password on the login screen and sends the input data to the terminal. The terminal sends the authentication information to the server, which then compares it with a database for authentication. The server returns the authentication result to the terminal, and the terminal displays the main menu if authentication is successful, or an error message if authentication is unsuccessful.

Enter: User ID, Password

Data processing: Sending authentication information and database verification

Output: Authentication result (success/failure)

Step 2:

The user selects the "Select Player" option from the main menu. The device sends a request for a player list to the server, which retrieves the player list from the database and returns it to the device. The device displays the player list, and when the user taps on a specific athlete, the player ID is sent to the server. The server retrieves the player's profile information and returns it to the device, which displays it.

Input: Player selection request, player ID

Data processing: Obtaining player lists and profile information

Output: Player list, player profile information

Step 3:

When the user selects a player, a chat screen is displayed. When the user enters a message and presses the send button, the device sends the message to the server. The server analyzes the message using a generative AI model, generates an athlete-style response, and returns the response to the device. The device displays the athlete-style response on the chat screen.

Input: User message

Data processing: Message analysis and response generation using generative AI models

Output: Athlete-like response

Step 4:

When a match is in progress, the server continues to obtain the match status in real time. Every time the server detects new match status, it pushes the match results to the user's device. The device receives the notification and displays the match results to the user.

Input: Real-time match status data

Data processing: Monitoring match conditions

Output: Match results via push notification

Step 5:

When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves a list of original video content from the database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format.

Input: Original content request

Data processing: Obtaining content lists and content data

Output: Original content list, streaming content

Step 6:

When a user selects the "AR Photo Shoot" option, the device's camera function will activate and use the AR function to take a photo with the athlete. Once the user has finished taking the photo, the device will upload the photo data to the server. The server will save the photo and generate a sharing link that will be returned to the device. The user can then use the link to share the photo on social media, etc.

Input: Photo request, photo data

Data processing: Upload and save photo data, generate sharing links

Output: Shared link

It is also possible to further combine an emotion engine that estimates the user's emotion. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

This invention achieves even higher levels of fan engagement by combining an emotion engine with a system in which users communicate with AI athlete characters. This system is realized through the following programs and processes.

User server connection and authentication

When a user uses a terminal to access the system, they first go to the login screen. They enter their ID and password and attempt to log in. The terminal sends the entered authentication information to the server, which then compares the received information with a database to authenticate the user. If authentication is successful, the user proceeds to the main menu.

Player Selection

When a user selects the "Select Player" option from the main menu, the device displays a list of players and the user taps on the specific player they want to chat with. The device sends the player ID to the server, which retrieves the player's profile information from its database and returns it to the device. The device displays this, allowing the user to view information about that player.

Start chat with an AI character

Once a specific player is selected, a chat screen appears and the user can enter a message. When the user presses the send button, the device sends the message to the server, which then passes it on to the AI chatbot. The AI chatbot analyzes the received message and uses an emotion engine to generate a player-like response. The emotion engine analyzes the emotion from the user's message and generates an optimal response based on that emotion. The server returns the generated response to the device, which then displays it on the chat screen.

The role of the emotional engine

The emotion engine analyzes the messages and actions entered by the user and recognizes their emotions. For example, if a user enters, "I had so much fun today!", the emotion engine will recognize the user's emotion as "joy." Based on this information, the AI chatbot will generate a response that corresponds to joy, such as, "That's great! Please come again!"

Quick match results notifications

As the match progresses, the server retrieves match results in real time. When the server retrieves new match results, it sends them to the user's device via push notification. The device receives the notification and displays the match results to the user. The emotion engine analyzes the user's emotions and can optimize responses to match results.

Distribution of original content

When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves the list of original content from the content database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format. The emotion engine can also recommend appropriate content based on the user's emotions.

AR photo taking and sharing

When a user selects the "AR Photo Taking" option, the device's camera function will be activated, allowing them to take a photo with the player using the AR function. Once the user has finished taking the photo, the device will upload the photo data to the server. The server will save the photo, generate a sharing link, and return it to the device. The user can then use the link to share the photo on social media, etc.

Purchase recommended gourmet foods and merchandise

When a user selects the "Recommended Food and Goods" option from the menu, the device sends a request to the server, which retrieves recommended food and goods information from a database and returns it to the device. The device displays a list, and when the user selects a specific item, a purchase request is sent to the server. The server completes the purchase process and arranges for delivery. The emotion engine can present recommended items taking into account the user's emotional state.

Specific examples

For example, suppose a user logs in, selects a specific athlete (Athlete A), and sends a message on the chat screen saying, "I'm so happy today!" The server receives this message, and the emotion engine analyzes the emotion of "joy." Based on this information, the AI chatbot generates a response such as, "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. If a game is in progress, real-time game results are sent to the user's device via push notification. Users can also watch original content from the main menu and take photos with players using the AR function.

By incorporating an emotion engine, the system can provide flexible and personalized responses based on user emotions, further increasing engagement. This improves the fan experience and drives more traffic to stadiums and related facilities.

The processing flow is explained below.

Program processing steps

User server connection and authentication

Step 1:

The user launches the Hawks Connection app and goes to the login screen.

Step 2:

The user enters their ID and password on the login screen and clicks the login button.

Step 3:

The device sends ID and password authentication information to the server.

Step 4:

The server compares the received ID and password with the database and performs authentication.

Step 5:

If authentication is successful, the server returns a successful authentication message to the terminal, and the terminal displays the main menu.

Player Selection

Step 1:

The user selects the "Select Player" option from the main menu.

Step 2:

The device will display the player list screen, and the user can tap on the player they want to chat with.

Step 3:

The device sends the player ID to the server.

Step 4:

The server retrieves the player's profile information from the database and returns it to the device.

Step 5:

The device will display the player's profile information received to the user.

Start chat with an AI character

Step 1:

The user enters a message in the chat input field and presses the send button.

Step 2:

The device sends the user's message to the server.

Step 3:

The server sends the message to the emotion engine, which analyzes the user's emotions.

Step 4:

The server passes the analysis results to the AI chatbot.

Step 5:

The AI chatbot generates appropriate responses based on the results of emotion analysis.

Step 6:

The server returns the generated response to the device, which displays the response on the chat screen.

Quick match results notifications

Step 1:

The server retrieves match results in real time.

Step 2:

The server will send the match results to the user's device via push notification.

Step 3:

The device will receive a notification and display the match results to the user.

Distribution of original content

Step 1:

The user selects the "Original Content" option from the main menu.

Step 2:

The device requests a content list from the server.

Step 3:

The server retrieves a list of original content from the content database and returns it to the device.

Step 4:

The device displays a content list and the user selects specific content.

Step 5:

The device requests the selected content data from the server, and the server streams the data.

AR photo taking and sharing

Step 1:

The user selects the "Take AR Photo" option from the menu.

Step 2:

The device's camera function will be activated, and you can use the AR function to take a photo with the player.

Step 3:

Once the user has finished taking a photo, the device uploads the photo data to the server.

Step 4:

The server stores the photo data, generates a sharing link, and returns it to the device.

Step 5:

Users can use the link to share photos on social media etc.

Purchase recommended gourmet foods and merchandise

Step 1:

The user selects the "Recommended Gourmet & Goods" option from the main menu.

Step 2:

The device sends a request to the server, which retrieves information from the database.

Step 3:

The server returns a list of recommended gourmet foods and goods to the device.

Step 4:

The device displays a list and the user selects a specific item.

Step 5:

The device sends a purchase request to the server, and the server processes the purchase.

Step 6:

The server handles purchase confirmation and shipping arrangements.

Using the Emotion Engine

Step 1:

When a user sends a message, the server receives the message and sends it to the emotion engine.

Step 2:

The emotion engine analyzes messages and recognizes the user's emotions.

Step 3:

The emotion engine returns the recognized emotion to the server.

Step 4:

The server communicates the emotion analysis results to the AI chatbot.

Step 5:

The AI chatbot generates appropriate responses based on the results of sentiment analysis.

Step 6:

The server returns the generated response to the terminal, which displays the response to the user.

Specific examples

For example, suppose a user logs in, selects a specific athlete (Athlete A), and sends a message on the chat screen saying, "I'm so happy today!" The server receives this message, and the emotion engine analyzes the emotion of "joy." Based on this information, the AI chatbot generates a response such as, "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. While a game is in progress, real-time game results are sent to the user's device via push notification. Users can also watch original content from the main menu and take photos with players using the AR function. With the introduction of the emotion engine, the system can provide flexible and personalized responses based on the user's emotions, further increasing engagement. This improves the fan experience and encourages more people to visit stadiums and related facilities.

(Example 2)

Next, we will explain Example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

The problem this invention aims to solve is to achieve more natural and emotional dialogue in a system that increases fan engagement between users and athletes, and to respond to users' real-time and individual needs. Conventional systems do not provide responses that reflect the user's emotions, and do not adequately provide real-time game results or distribute original content. Furthermore, the user experience is limited, such as the ability to take photos using AR functions or purchase recommended gourmet food or merchandise. It is necessary to solve these problems and improve user satisfaction.

The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

In this invention, the server includes: means for allowing a user to chat one-on-one with an AI character of a specific athlete; means for authenticating the ID and password entered by the user on the login screen; means for providing profile information of the athlete selected by the user; means for the AI character to receive the user's message, analyze emotions using an emotion engine, and generate a response based on those emotions; means for displaying the generated response to the user; means for providing real-time game results and original content; means for the user to take and share photos with the athlete using the AR function; means for the user to purchase gourmet food recommended by the athlete and official cheering merchandise; means for the emotion engine to analyze the user's message and recognize emotions; means for the AI chatbot to generate an optimal response based on the recognized emotions; and means for the server to obtain game results in real time while the game is in progress and send them to the device via push notification. This allows users to receive personalized responses based on emotions, providing real-time information and a diverse entertainment experience.

"AI Athlete Characters" are virtual characters created using artificial intelligence to mimic athletes and can chat one-on-one with users.

"Users" refer to people who use this system and communicate with the AI athlete characters within the system.

An "emotion engine" is a software component that analyzes emotions from messages entered by users and generates responses based on those emotions.

An "AI chatbot" is an artificial intelligence program that receives messages from users, analyzes them, and generates appropriate responses.

An "ID" is identification information used to identify a user, and is usually composed of a unique string of characters or numbers.

A "password" is a secret string of characters used in combination with an ID to authenticate a user.

"Authentication information" refers to the ID and password combination entered by the user when logging in.

A "database" is a collection of electronically managed data that stores user information, athlete profile information, etc.

The "Main Menu" is the screen that serves as the gateway to the system's main functions, which users can access after successful authentication.

"Profile information" refers to detailed data about a specific athlete, including the athlete's background, performance, characteristics, etc.

"Real-time" means that data is generated and transmitted immediately, without delay.

"Match Results Updates" is a means of providing information to users quickly and effectively regarding the results of ongoing or completed matches.

"Original content" refers to original digital content such as video, audio, and text that the system provides to users.

"AR function" is an augmented reality technology that overlays digital information onto real-world scenery.

"Means for taking photos" refers to the method by which a user generates image data using the device's camera function.

"Sharing methods" are the ways in which users can share photos they take and content they generate with other users online.

"Gourmet" refers to high-quality foods and beverages recommended by athletes.

"Official cheering merchandise" refers to cheering items and accessories officially approved by athletes or organizations.

"Means of purchase" refers to the mechanism by which users order and pay for gourmet food and official support merchandise through the system.

"Push notifications" are a method by which a server sends important information to a user's device in real time.

The system of the present invention is an advanced fan engagement system that combines multiple technologies to enable users to communicate with AI athlete characters. The system includes hardware and software to implement specific methods.

System Configuration

This system mainly consists of the following components:

(Server): Database server, AI chatbot, emotion engine, push notification system

(Device): A device (smartphone, tablet, PC, etc.) that accepts user operations and displays information accordingly.

(User): The person who operates the system and communicates with the athlete AI character.

Key technical components and processing overview

User authentication and login

When a user accesses the system using a terminal, they first go to a login screen. They enter their ID and password, and if authentication is successful, they proceed to the main menu. Databases such as MySQL and PostgreSQL are used here.

Select a player and view their profile

The user selects the "Select Player" option from the main menu and chooses a specific player from the displayed list of players. The device sends the player ID to the server, which retrieves the player's profile information from the database and returns it to the device, allowing the user to view the player's details.

Chat with AI characters

When a user wants to chat with a selected player, they enter a message on the chat screen and press the send button. The device sends the message to the server, which then forwards it to the AI chatbot. The AI chatbot uses a generative AI model (e.g., GPT-4) and an emotion engine to analyze the sentiment of the message. Based on the results of this analysis, it generates an optimal response and returns it to the device. The device then displays the generated response on the chat screen.

Match result notification

As the match progresses, the server retrieves the match results in real time, and when important results are obtained, they are sent to the user's device via push notification. This notification function uses push notification services such as Firebase Cloud Messaging (FCM).

Distribution of original content

When a user selects the "Original Content" option, the device requests a content list from the server. The server retrieves the list from the content database and returns it to the device, providing the user's selected content in streaming format.

AR photo taking and sharing

When a user selects the "AR Photo Shoot" option, the device's camera function will be activated, allowing the user to take a photo with the player using the AR function. After the photo is taken, the device will upload the photo data to the server, which will then generate a sharing link and return it to the device. The user can then share the link on social media, etc.

Purchase recommended gourmet foods and merchandise

When a user selects the "Recommended Food and Goods" option, the device sends a request to the server, which retrieves information about recommended food and goods from a database and returns it to the device. When the user selects a specific item and sends a purchase request to the server, the server completes the purchase process and arranges for delivery.

Specific examples

For example, the following shows the process flow when a user logs in, selects a specific athlete (Athlete A), and sends the message "I'm so happy today!" on the chat screen. The server receives this message, and the emotion engine analyzes the "joy." Based on this information, the AI chatbot generates a response such as "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. Additionally, if a game is in progress, real-time game results are sent to the user's device via push notification. Furthermore, users can view original content from the main menu and take photos with players using the AR function.

Example prompt

"I want to send a message to a specific athlete (Athlete A) and get an emotional response. For example, if I send the message 'I'm really happy today!', please generate an appropriate reply."

By implementing this invention, users can receive personalized responses based on their emotions, enabling real-time information provision and diverse entertainment experiences.

The flow of the identification process in Example 2 will be explained using Figure 13.

Step 1:

The user boots up using a terminal and accesses the system login screen.

Step 2:

The user enters their ID and password on the login screen. This input information is sent to the server by the device. The input data is sent to the server in the form of "user ID" and "password."

Step 3:

The server compares the received ID and password with a database, which stores pre-registered user information. The result of the comparison determines whether authentication was successful.

Step 4:

The server sends the authentication result to the terminal. If authentication is successful, a success message is sent along with access information to the main menu. If authentication fails, an authentication error message is sent.

Step 5:

Based on the authentication results received by the device from the server, if authentication is successful, the main menu screen will be displayed, allowing the user to select their next action.

Step 6:

The user selects the "Select Player" option from the main menu. A request for a player list is sent from the device to the server.

Step 7:

The server retrieves the player list from the database and returns the data to the device. Player names, profile photos, etc. are retrieved from the database.

Step 8:

The device displays the player list received from the server to the user. The user selects the specific player they want to chat with from the list.

Step 9:

When a user selects a specific player, the player's ID is sent by the device to the server, which retrieves the player's details from the database and returns them to the device.

Step 10:

The device displays the player's detailed profile received from the server to the user. The user is then taken to a screen where they can start chatting with the player.

Step 11:

The user enters a message on the chat screen and presses the send button. The entered message is sent from the device to the server.

Step 12:

The server forwards the received message to the AI chatbot, which analyzes the message using a generative AI model (e.g., GPT-4).

Step 13:

The AI chatbot analyzes the content of the message and recognizes emotions using an emotion engine. Emotion-analyzed data is obtained in the form of "joy" or "sadness," etc.

Step 14:

The AI chatbot generates a response message based on the analysis results of the emotion engine. For example, if the emotion "joy" is recognized, the response message generated will be "That's wonderful!"

Step 15:

The server sends the generated response message to the terminal.

Step 16:

The device will display the response message on the chat screen so that the user can view it.

Step 17:

While a match is in progress, the server obtains match results in real time. For example, it uses an API to obtain match status data.

Step 18:

When the server obtains new match results, they are sent to the user's device via push notification.

Step 19:

The device receives the notification and displays the match results to the user. At the same time, the emotion engine analyzes the user's reaction and provides optimal feedback.

Step 20:

If the user selects the "Original Content" option, the device will request a content list from the server.

Step 20:

The server retrieves a list of original content from the content database and returns it to the device. The retrieved data includes video thumbnails and titles.

Step 21:

The device displays the received list to the user, allowing them to select content.

Step 22:

When a user selects the content they want to watch, the server provides that content in streaming format.

Step 23:

The device receives the streaming data and the user can watch the content.

Step 24:

When a user selects the "AR Photo Taken" option, the device's camera function will be activated. The AR function will be enabled, allowing the user to take photos with the players.

Step 25:

Once the user has taken a photo, the device uploads the photo data to the server.

Step 26:

The server stores the uploaded photos and generates a sharing link that is returned to the device.

Step 27:

The device displays the received link information to the user, who can then use the link to share the photo on social media, etc.

Step 28:

The user selects the "Recommended Food and Goods" option. The device sends a request to the server, which retrieves information about recommended food and goods from the database and returns it to the device.

Step 29:

The device displays the received list to the user and allows them to select a specific item.

Step 30:

When a user selects a specific item, a purchase request is sent from the device to the server. The purchase request includes user information and details of the selected item.

Step 31:

The server processes the purchase request and the purchase is completed through the payment system. Delivery arrangements are then made.

Step 32:

The emotion engine analyzes the user's emotional state and recommends appropriate items based on that state. For example, if the user is in a "joy" state, it will recommend related fun goods.

Step 33:

Recommended items will be displayed on the device, allowing the user to start the purchase process again.

The above are the specific processing steps of this system.

(Application Example 2)

Next, we will explain Application Example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

Traditional methods of interaction between athletes and fans make it difficult to respond flexibly to fans' emotions, and the provision of personalized content is limited. Furthermore, notifications of match results and recommendations of related content are not optimized to take user emotions into account. Under these circumstances, there are challenges in not being able to fully improve fan engagement or deepen the fan experience.

The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for allowing a user to have a one-on-one conversation with an AI character of a specific athlete; means for providing real-time game progress updates and unique content; means for users to take and share photos with athletes using an augmented reality function; means for users to purchase athlete-recommended food and beverages and official support merchandise; means for recognizing a user's emotions using an emotion analysis engine and personalizing and recommending content based on those emotions; means for authenticating identification information and a password entered by the user on the login screen; means for providing profile information of an athlete selected by the user; means for recommending and delivering personalized sports-related content based on the user's emotions; means for an AI character to generate a response to a user's message; means for displaying the generated response; and means for obtaining game results in real time and generating and notifying a response based on emotions. This enables the provision of personalized content based on the user's emotions, improving fan engagement and deepening the fan experience.

"AI character of a specific athlete" refers to a virtual character with artificial intelligence created to imitate a specific athlete, which communicates with users.

"User" refers to an individual, fan, or user who uses this system.

"Means for dialogue" refers to a mechanism that allows users to exchange messages with a specific athlete's AI character and for them to respond to each other.

"Match progress updates" refers to information provided in real time about the progress and results of a match.

"Original Content" refers to videos, articles, interviews, behind-the-scenes footage, and other information specifically created and provided by the System.

"Means of providing information in real time" refers to technologies and mechanisms that deliver information to users instantly.

"Augmented reality" refers to technology that overlays digital information onto the real world, for example, by synthesizing virtual characters onto the scenery seen through a camera.

An "emotion analysis engine" refers to an algorithm or software that analyzes messages and actions entered by users and recognizes their emotions.

"Personalized content" refers to information that is optimized and customized based on a user's interests and emotional state.

"Identification information" refers to information that uniquely identifies a user, and typically refers to a user ID and password.

"Encryption" means secret information used to protect identifying information, including passwords and PIN codes.

"Profile information" refers to detailed information about an athlete, such as their name, biography, statistics, and photo.

A "generated response" is a reply created by an AI character based on the user's message.

"Means of notification" refers to the technology or mechanism used to notify users of new information, such as push notifications or email.

"Food and drink" refers to food and drink recommended by the competitor.

"Official support merchandise" refers to support goods and related products authorized by an athlete or team.

This invention is a system that allows users to have one-on-one conversations with an AI character of a specific athlete, and includes features such as providing real-time updates on match progress and original content, using augmented reality to take and share photos with athletes, purchasing food and drink and official support merchandise, and using an emotion analysis engine to recognize users' emotions and personalize and recommend content based on those emotions. Each element of the system and its functions are explained below.

Overall structure

The system consists of a user's device, a central server, a database, an AI character, an emotion analysis engine, and various software that integrates them. Users access the system using a smartphone application.

Authentication Process

The user enters their identification information (ID) and password on the login screen. This information is sent from the device to a central server, which then compares it with a database for authentication. This process authenticates the user.

Player selection and profile information

When a user selects a specific athlete, the selected athlete's profile information is retrieved from the database and displayed on the user's device. This information includes the athlete's name, biography, photo, statistical data, etc.

Interactive features

Users interact with the AI character of the contestant they have selected. When the user presses the send button, a message is sent to a central server, which analyzes the message using an emotion analysis engine. Based on the emotional information analyzed by the emotion analysis engine, the AI character generates an appropriate response, which is then displayed on the user's device.

Match progress notifications and content distribution

Game progress and results are obtained in real time by a central server and pushed to users' devices. In addition, personalized sports-related content is recommended and delivered based on the results of user sentiment analysis.

Augmented reality features

Users can use the augmented reality function to take photos with athletes. By activating the device's camera function, they can take a photo in which the virtual athlete is superimposed on the real-world scenery. The captured photo is uploaded to a central server and a sharing link is generated. This link can be used to share the photo on social media, etc.

Product purchase function

When a user purchases athlete-recommended food and drink or official support merchandise, the device sends a request to the server and retrieves product information from the database. When the user selects a specific item and submits a purchase request, the server completes the purchase process and arranges for delivery.

Hardware and software used

Hardware: Smartphone (iOS or Android)

Software: Python, emotion analysis engine (EmotionAnalyzer), content database (ContentDatabase)

Server: Cloud service (AWS, Azure, etc.)

Specific examples and prompt sentence examples

For example, if a user logs in, selects a specific athlete, and sends a message saying, "I'm so happy today!", the emotion analysis engine will analyze the emotion as "joy." As a result, the AI character will generate a response such as, "That's great! I'll do my best in the next game!" This response will then be displayed on the user's chat screen.

Example prompt:

I'm really happy today!

The flow of the specific processing in Application Example 2 will be explained using Figure 14.

Step 1:

The user enters identification information (ID) and password into a login screen on their device. The device sends this to a central server, which then checks it against a database for authentication. This process authenticates the user. The input is identification information and password, and the output is the authentication result. The process includes querying the database and analyzing the results.

Step 2:

When a user selects a specific athlete, the selected athlete's profile information is retrieved from the database and displayed on the device. The input is the athlete ID, and the output is the athlete's profile information. As part of the process, the server queries the database and returns the results to the device.

Step 3:

The user begins a conversation with an AI character. When the user enters a message and presses the send button, the device sends the message to the server. The server analyzes this message using an emotion analysis engine (EmotionAnalyzer). The input is the user's message, and the output is the analyzed emotion. As part of the process, the server calls the emotion analysis engine and analyzes the message.

Step 4:

Based on the emotional information analyzed by the emotion analysis engine, the AI character generates an appropriate response. The server sends the generated response to the device, which then displays it to the user. The input is the analyzed emotion, and the output is the generated response. As part of the processing, the AI character's response generation algorithm is executed.

Step 5:

Match progress and results are obtained in real time by the server and pushed to the user's device. The input is real-time match data, and the output is notification messages. As part of the process, the server obtains data from an external match data provider and sends it to the user's device as a push notification.

Step 6:

Personalized sports-related content is recommended and delivered based on the results of user emotion analysis. The server retrieves content related to the user's emotions from a database and sends it to the device for display. The input is the user's emotion analysis results, and the output is the recommended content. As part of the process, the server queries the content database based on the emotion analysis results, retrieves appropriate content, and sends it to the user's device.

Step 7:

The user uses the augmented reality function to take a photo with the competitor, and the device uploads the photo to the server. The server saves the photo, generates a sharing link, and returns it to the device. The input is the AR photo, and the output is the sharing link. As part of the process, the device collects camera data and uploads it to the server, which then saves it in a storage service and generates a link.

Step 8:

When a user purchases athlete-recommended food and drink or official support merchandise, the terminal sends a request to the server, which retrieves product information from the database. When the user selects a specific item and submits a purchase request, the server processes the purchase and arranges for delivery. The input is the purchase request, and the output is a notification that the purchase is complete. As part of the process, the server processes the order information, checks inventory, and arranges for delivery.

In this way, each step works together to create a system that provides users with an advanced and personalized fan engagement experience.

The specific processing unit 290 transmits the results of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the results of the specific processing. The microphone 238 acquires audio indicating the user input regarding the results of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

Data generation model 58 is what is known as generative AI (artificial intelligence). Examples of data generation model 58 include generative AI such as ChatGPT (Internet search <URL: https://openai.com/blog/chatgpt>) and Gemini (Internet search <URL: https://gemini.google.com/?hl=ja>). Data generation model 58 is obtained by performing deep learning on a neural network. A prompt containing an instruction is input to data generation model 58, and inference data such as voice data indicating speech, text data indicating text, and image data indicating an image is also input. Data generation model 58 performs inference on the input inference data in accordance with the instructions indicated by the prompt, and outputs the inference results in the form of data such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and/or summarization.

In the above embodiment, an example was given in which the specific processing was performed by the data processing device 12, but the technology disclosed herein is not limited to this, and the specific processing may also be performed by the smart glasses 214.

[Third embodiment]

Figure 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

As shown in FIG. 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

The data processing device 12 includes a computer 22, a database 24, and a communication I/F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and communication I/F 26 are also connected to the bus 34. The communication I/F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and/or a LAN (Local Area Network).

The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I/F 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the user 20's surroundings (e.g., an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

The communication I/F 44 is connected to the network 54. The communication I/Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I/Fs 44 and 26 is carried out in a secure manner.

Figure 6 shows an example of the main functions of the data processing device 12 and headset terminal 314. As shown in Figure 6, in the data processing device 12, specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32.

The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as the specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

Storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

In the headset terminal 314, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

Next, we will explain the identification process performed by the identification processing unit 290 of the data processing device 12. In the following explanation, the data processing device 12 will be referred to as the "server" and the headset-type terminal 314 will be referred to as the "terminal."

This invention relates to a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized by the following programs and processes.

User server connection and authentication

When a user uses a terminal to access the system, they first go to the login screen. They enter their ID and password and attempt to log in. The terminal sends the entered authentication information to the server, which then compares the received information with a database to authenticate the user. If authentication is successful, the user proceeds to the main menu.

Player Selection

When a user selects the "Select Player" option from the main menu, the device will display a list of players. The user can tap on a specific player they want to chat with and send the player ID to the server. The server will retrieve the player's profile information from its database and return it to the device, which will then display it, allowing the user to view information about that player.

Start chat with an AI character

When a specific player is selected, a chat screen appears and the user can enter a message. When the user presses the send button, the device sends the message to the server, which then relays the message to the AI chatbot. The AI chatbot analyzes the received message and generates a response in the style of the player. The server returns the generated response to the device, which then displays it on the chat screen.

Quick match results notifications

As the match progresses, the server retrieves match results in real time. When the server retrieves new match results, it sends them to the user's device via push notification. The device receives the notification and displays the match results to the user.

Distribution of original content

When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves the list of original content from the content database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format.

AR photo taking and sharing

When a user selects the "AR Photo Taking" option, the device's camera function will be activated, allowing them to take a photo with the player using the AR function. Once the user has finished taking the photo, the device will upload the photo data to the server. The server will save the photo, generate a sharing link, and return it to the device. The user can then use the link to share the photo on social media, etc.

Purchase recommended gourmet foods and merchandise

When a user selects the "Recommended Food and Goods" option from the menu, the device sends a request to the server, which retrieves recommended food and goods information from a database and returns it to the device. The device displays the list, and when the user selects a specific item, a purchase request is sent to the server. The server completes the purchase process and arranges for delivery.

Specific examples

For example, a user logs in, selects a specific athlete (Athlete A), and sends a message saying, "Please tell us your enthusiasm before the game." The server receives the message and passes it to an AI chatbot, which then generates a response such as, "My goal this season is to win!" This response is displayed on the user's chat screen. If a game is in progress, real-time game results are sent to the user's device via push notification. The user can then view original content from the main menu or take photos with the player using the AR function.

In this way, this system allows users to enjoy private communication with athletes while receiving match results and original content in real time. Furthermore, by using the AR and merchandise purchasing functions, it is possible to increase engagement with fans and promote contributions to the local economy.

The processing flow is explained below.

Program processing steps

User server connection and authentication

Step 1:

The user launches the Hawks Connection app and goes to the login screen.

Step 2:

The user enters their ID and password on the login screen and clicks the login button.

Step 3:

The device sends ID and password authentication information to the server.

Step 4:

The server compares the received ID and password with the database and performs authentication.

Step 5:

If authentication is successful, the server returns a successful authentication message to the terminal, and the terminal displays the main menu.

Player Selection

Step 1:

The user selects the "Select Player" option from the main menu.

Step 2:

The device will display the player list screen, and the user can tap on the player they want to chat with.

Step 3:

The device sends the player ID to the server.

Step 4:

The server retrieves the player's profile information from the database and returns it to the device.

Step 5:

The device will display the player's profile information received to the user.

Start chat with an AI character

Step 1:

The user enters a message in the chat input field and presses the send button.

Step 2:

The device sends the user's message to the server.

Step 3:

The server passes the message to the AI chatbot.

Step 4:

The AI chatbot analyzes the messages it receives and generates responses in the style of a player.

Step 5:

The server returns the generated response to the device, which displays the response on the chat screen.

Quick match results notifications

Step 1:

The server retrieves match results in real time.

Step 2:

The server that obtains the match results will send a push notification to the user's device.

Step 3:

The device will receive a notification and display the match results to the user.

Distribution of original content

Step 1:

The user selects the "Original Content" option from the main menu.

Step 2:

The device requests a content list from the server.

Step 3:

The server retrieves a list of original content from the content database and returns it to the device.

Step 4:

The device displays a content list and the user selects specific content.

Step 5:

The device requests the selected content data from the server, and the server streams the data.

AR photo taking and sharing

Step 1:

The user selects the "Take AR Photo" option from the menu.

Step 2:

The device's camera function will be activated, and you can use the AR function to take a photo with the player.

Step 3:

Once the user has finished taking a photo, the device uploads the photo data to the server.

Step 4:

The server stores the photo data, generates a sharing link, and returns it to the device.

Step 5:

Users can use the link to share photos on social media etc.

Purchase recommended gourmet foods and merchandise

Step 1:

The user selects the "Recommended Gourmet & Goods" option from the main menu.

Step 2:

The device sends a request to the server, which retrieves information from the database.

Step 3:

The server returns a list of recommended gourmet foods and goods to the device.

Step 4:

The device displays a list and the user selects a specific item.

Step 5:

The device sends a purchase request to the server, and the server processes the purchase.

Step 6:

The server handles purchase confirmation and shipping arrangements.

(Example 1)

Next, Example 1 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset-type terminal 314 will be referred to as the "terminal."

Traditional sports fan engagement systems were limited to providing athlete information and content distribution, and lacked the means for fans to interact one-on-one with athletes, receive real-time match results, take photos using augmented reality features, or purchase recommended meals or official support merchandise. This made it difficult to increase user satisfaction and engagement.

The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

In this invention, the server includes a means for users to chat one-on-one with a specific avatar, a means for providing match results and content in real time, a means for users to take and share photos with the avatar using augmented reality functions, a means for users to purchase recommended meals and official support merchandise, a means for users to enter login authentication information and be authenticated by the server, a means for providing information about the avatar selected by the user, a means for the avatar to generate a response to the user's message, and a means for displaying the generated response to the user. This allows users to enjoy multifaceted engagement with athletes, improving system usage satisfaction.

"User" refers to an individual or organization that uses this system.

An "avatar" is a virtual character based on a specific athlete that is designed to interact one-on-one with users.

"Server" refers to a computer system used to manage and provide user authentication information, avatar data, match results, and other content.

"Database" refers to a system for storing and managing data used in the system, such as athlete profile information, match results, and content.

"Response" refers to the answer or reaction generated by an avatar in response to a message from a user.

"Match Results" refers to the results data of ongoing or completed sports matches.

"Content" refers to media information provided to users, such as original videos, articles, and images.

"Augmented reality (AR)" refers to technology that uses a device's camera to overlay virtual objects onto real-world images.

"Recommended Meals" refers to diet-related products or services recommended by an athlete or the System to a user.

"Official support merchandise" refers to official goods and merchandise related to an athlete's team or brand.

"Login credentials" refers to the ID and password combination required by a user to access the system.

"Authentication" refers to the process by which the server verifies that the login credentials provided by the user are accurate.

This invention provides a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized through the following specific hardware and software configuration and processing.

First, the user accesses the system using a device (smartphone, tablet, PC, etc.) and goes to the login screen. The user enters their ID and password and attempts to log in. The device sends the entered authentication information to the server. The server compares the received information with a database (e.g., MySQL) for authentication, and if authentication is successful, the user proceeds to the main menu.

When a user selects the "Select Player" option from the main menu, the device requests a list of players from the server. The server retrieves the list of players from the database and sends it to the device. The user can then tap or click to select a specific player and view their profile information.

Once a player is selected, the user can begin chatting with the AI character. When the user enters a message and presses the send button, the device sends the message to the server, which then passes it to an AI chatbot (such as GPT-3 as a generative AI model). The AI chatbot analyzes the message and generates a response in the style of the player, which the server then sends back to the device and displays on the user's chat screen.

Also, while the match is in progress, the server obtains match results in real time via external APIs such as sports data APIs. When new match results become available, the server sends them to the user's device via push notification, which then receives the notification and displays it to the user.

Furthermore, if the user selects the "Original Content" option, the device will request a content list from the server. The server will retrieve the content data from the database and send it to the device. When the user selects specific content, the server will provide that content in streaming format.

When a user selects "AR Photo Shooting" in the AR photo option, the device's camera function and AR library (e.g., ARKit) are activated to take a photo with the player's virtual character. After taking the photo, the device uploads the photo data to the server, which saves the photo and generates a sharing link that is returned to the device. The user can then use this link to share the photo on social media, etc.

Finally, when the user selects the "Recommended Gourmet/Goods" option, the device sends a request to the server, which retrieves information about recommended meals and official support products from its database and returns it to the device. When the user selects a specific item, a purchase request is sent to the server, which then processes the purchase and arranges for delivery.

Example prompt

Please tell us your enthusiasm before the match.

What are your goals this season?

What do you think about the next match?

In this way, this system allows users to enjoy private communication with athletes while receiving match results and original content in real time. Furthermore, by using the AR and merchandise purchasing functions, it is possible to increase engagement with fans and promote contributions to the local economy.

The flow of the identification process in Example 1 will be explained using Figure 11.

Step 1:

The user uses a terminal to navigate to the login screen and enter their ID and password. Input: User's ID and password. The terminal sends this authentication information to the server. The server compares the received information with the database for authentication. If authentication is successful, Output: An instruction to proceed to the main menu is returned. Specific operation: The server uses an SQL query to search the database for authentication information, and returns success if it matches, or an error message if it does not match.

Step 2:

The user selects the "Select Player" option from the main menu. Input: The user requests to select a player. The device requests a list of players from the server. The server retrieves the list of players from the database and returns it to the device. Output: The player list is displayed on the device. Specific behavior: The server retrieves player information using an SQL query and returns it to the device in JSON format.

Step 3:

The user selects a specific player and starts a chat with that player. Input: User's player selection and message. When the user enters a message and presses the send button, the device sends the message to the server. The server passes the message to the AI chatbot. Output: The response generated by the chatbot. Specific operation: The server invokes an AI model (e.g., GPT-3) to analyze the message and generate a response. The response is returned to the device in JSON format and displayed on the chat screen.

Step 4:

As the match progresses, the server retrieves match results in real time from an external API (e.g., a sports data API). Input: Updated match status data. If there are new match results, the server sends them to the user's device via push notification. Output: Push notification of match results. Specific operation: The server periodically calls the API and notifies the user via WebSocket or Firebase Cloud Messaging if there is new data.

Step 5:

The user selects the "Original Content" option from the main menu. Input: The user requests content. The device sends a request to the server, which retrieves the content data from the database and sends it to the device. Output: A content list is displayed on the device. When the user selects specific content, the server provides it in streaming format. Specific behavior: The server provides media files in HLS format, and the device plays them in the appropriate player.

Step 6:

When a user selects the "AR Photo Shoot" option, the device activates the camera function and AR library (e.g., ARKit). Input: User's photo request. A photo is taken with the player's virtual character. After the photo is taken, the device uploads the photo data to the server, which saves the photo and generates a sharing link that is returned to the device. Output: Shared link. Specific operation: A photo is taken using the device's camera and AR library, and uploaded to the server via REST API. The server generates a link and sends it back.

Step 7:

When the user selects the "Recommended Food & Goods" option, the device sends a request to the server. Input: User's item selection request. The server retrieves information about recommended meals and official support products from the database and returns it to the device. Output: A product list is displayed on the device. When the user selects a specific item, a purchase request is sent to the server, which completes the purchase and arranges for delivery. Specific operation: The server retrieves the product information, completes the purchase through a payment gateway (e.g., Stripe), and notifies the user of the order information.

(Application Example 1)

Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the headset-type terminal 314 will be referred to as the "terminal."

Today's sports fans want to interact more closely with their favorite athletes, receive real-time game information, and watch original content. However, conventional systems have difficulty providing these services comprehensively, limiting the means to increase fan engagement. This has created a growing need for systems that provide virtual communication with athletes, real-time game information notifications, AR photography, the distribution of original content, and the ability to purchase recommended products.

The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

In this invention, the server includes: a means for allowing users to chat one-on-one with an AI character of a specific athlete; a means for providing real-time game results and original video content; a means for users to take and share photos with the athlete using AR functions; a means for users to purchase food and drink recommended by the athlete and official support merchandise; a means for users to log in from their device, select a specific athlete, and use a generative AI model to generate and display athlete-style responses; a means for obtaining game progress in real time and notifying the user; and a means for users to view original content via their device. This enables deep engagement with athletes, allowing fans to enjoy game information and original content in real time, and further increasing satisfaction through AR functions and recommended merchandise.

An "athlete" is a person who competes in a particular sport, and is virtually reproduced as an AI character within the system.

"One-on-one chat" means that users can engage in individual, two-way messaging with an AI character of a specific athlete.

"Live Match Results" means the latest match status and results provided to users in real time for ongoing or completed sports matches.

"Original video content" refers to independently created video data about athletes and related events that is distributed to users.

The "AR function" uses augmented reality technology to allow users to synthesize and photograph virtual images of athletes in real-world scenes.

"Athlete-recommended foods, beverages, and official support products" refer to foods and beverages recommended by athletes and products officially approved for support, which can be purchased by users.

"Generative AI model" refers to artificial intelligence technology that generates athlete-style responses based on a user's message.

"Get in real time" means continuously monitoring the progress of the match and notifying the user immediately.

"Terminal" refers to a device that a user uses to access and operate the system, such as a smartphone or tablet.

This invention relates to a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized by the following programs and processes.

First, a user must log in to access the system using a terminal. The user enters their ID and password on the login screen and sends the authentication information to the server. The server authenticates the received authentication information by comparing it with a database, and if authentication is successful, the user can proceed to the main menu. The hardware used is a smartphone, and the software used is a back-end server and database management system.

The user then selects the "Select Player" option from the main menu, and the device displays a list of players. The user taps on the specific athlete they want to chat with and sends the athlete ID to the server. The server retrieves the athlete's profile information from the database and returns it to the device, which then displays it, allowing the user to view information about the athlete. The hardware used is a smartphone, and the software used is a back-end server and database management system.

Once a specific athlete is selected, a chat screen appears, allowing the user to enter a message. When the user presses the send button, the device sends the message to the server, which uses the generative AI model to analyze the message and generate a response in the style of the athlete. This response is returned from the server to the device, which displays it on the chat screen. The hardware used is a smartphone, and the software used is the generative AI model and back-end server.

Also, while a match is in progress, the server obtains the match status in real time and sends it to the user's device via push notification. The device receives the notification and displays the match results to the user. The hardware used is a smartphone, and the software used is a server with real-time data acquisition capabilities.

Furthermore, when the user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves a list of original video content from the content database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format. The hardware used is a smartphone, and the software used is a streaming server.

When a user selects the "AR Photo Shooting" option, the device's camera function is activated, allowing them to take a photo with the athlete using AR functionality. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo, generates a sharing link, and returns it to the device. The user can then use the link to share the photo on social media, etc. The hardware used is a smartphone (camera function), and the software used is an application using AR technology and a back-end server.

For example, a user can generate an athlete-like response using the following prompt: "What are your thoughts before the game?" If the user sends a message, the generative AI model can generate a response such as "My goal this season is to win!" and display it in the user's chat screen.

In this way, a system will be created that enables deep engagement with athletes, allows fans to enjoy real-time game information and original content, and further enhances satisfaction through AR functions and recommended products.

The flow of the specific processing in Application Example 1 will be explained using Figure 12.

Step 1:

A user accesses the system using a terminal. The user enters their ID and password on the login screen and sends the input data to the terminal. The terminal sends the authentication information to the server, which then compares it with a database for authentication. The server returns the authentication result to the terminal, and the terminal displays the main menu if authentication is successful, or an error message if authentication is unsuccessful.

Enter: User ID, Password

Data processing: Sending authentication information and database verification

Output: Authentication result (success/failure)

Step 2:

The user selects the "Select Player" option from the main menu. The device sends a request for a player list to the server, which retrieves the player list from the database and returns it to the device. The device displays the player list, and when the user taps on a specific athlete, the player ID is sent to the server. The server retrieves the player's profile information and returns it to the device, which displays it.

Input: Player selection request, player ID

Data processing: Obtaining player lists and profile information

Output: Player list, player profile information

Step 3:

When the user selects a player, a chat screen is displayed. When the user enters a message and presses the send button, the device sends the message to the server. The server analyzes the message using a generative AI model, generates an athlete-style response, and returns the response to the device. The device displays the athlete-style response on the chat screen.

Input: User message

Data processing: Message analysis and response generation using generative AI models

Output: Athlete-like response

Step 4:

When a match is in progress, the server continues to obtain the match status in real time. Every time the server detects new match status, it pushes the match results to the user's device. The device receives the notification and displays the match results to the user.

Input: Real-time match status data

Data processing: Monitoring match conditions

Output: Match results via push notification

Step 5:

When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves a list of original video content from the database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format.

Input: Original content request

Data processing: Obtaining content lists and content data

Output: Original content list, streaming content

Step 6:

When a user selects the "AR Photo Shoot" option, the device's camera function will activate and use the AR function to take a photo with the athlete. Once the user has finished taking the photo, the device will upload the photo data to the server. The server will save the photo and generate a sharing link that will be returned to the device. The user can then use the link to share the photo on social media, etc.

Input: Photo request, photo data

Data processing: Upload and save photo data, generate sharing links

Output: Shared link

It is also possible to further combine an emotion engine that estimates the user's emotion. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

This invention achieves even higher levels of fan engagement by combining an emotion engine with a system in which users communicate with AI athlete characters. This system is realized through the following programs and processes.

User server connection and authentication

When a user uses a terminal to access the system, they first go to the login screen. They enter their ID and password and attempt to log in. The terminal sends the entered authentication information to the server, which then compares the received information with a database to authenticate the user. If authentication is successful, the user proceeds to the main menu.

Player Selection

When a user selects the "Select Player" option from the main menu, the device displays a list of players and the user taps on the specific player they want to chat with. The device sends the player ID to the server, which retrieves the player's profile information from its database and returns it to the device. The device displays this, allowing the user to view information about that player.

Start chat with an AI character

Once a specific player is selected, a chat screen appears and the user can enter a message. When the user presses the send button, the device sends the message to the server, which then passes it on to the AI chatbot. The AI chatbot analyzes the received message and uses an emotion engine to generate a player-like response. The emotion engine analyzes the emotion from the user's message and generates an optimal response based on that emotion. The server returns the generated response to the device, which then displays it on the chat screen.

The role of the emotional engine

The emotion engine analyzes the messages and actions entered by the user and recognizes their emotions. For example, if a user enters, "I had so much fun today!", the emotion engine will recognize the user's emotion as "joy." Based on this information, the AI chatbot will generate a response that corresponds to joy, such as, "That's great! Please come again!"

Quick match results notifications

As the match progresses, the server retrieves match results in real time. When the server retrieves new match results, it sends them to the user's device via push notification. The device receives the notification and displays the match results to the user. The emotion engine analyzes the user's emotions and can optimize responses to match results.

Distribution of original content

When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves the list of original content from the content database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format. The emotion engine can also recommend appropriate content based on the user's emotions.

AR photo taking and sharing

When a user selects the "AR Photo Taking" option, the device's camera function will be activated, allowing them to take a photo with the player using the AR function. Once the user has finished taking the photo, the device will upload the photo data to the server. The server will save the photo, generate a sharing link, and return it to the device. The user can then use the link to share the photo on social media, etc.

Purchase recommended gourmet foods and merchandise

When a user selects the "Recommended Food and Goods" option from the menu, the device sends a request to the server, which retrieves recommended food and goods information from a database and returns it to the device. The device displays a list, and when the user selects a specific item, a purchase request is sent to the server. The server completes the purchase process and arranges for delivery. The emotion engine can present recommended items taking into account the user's emotional state.

Specific examples

For example, suppose a user logs in, selects a specific athlete (Athlete A), and sends a message on the chat screen saying, "I'm so happy today!" The server receives this message, and the emotion engine analyzes the emotion of "joy." Based on this information, the AI chatbot generates a response such as, "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. If a game is in progress, real-time game results are sent to the user's device via push notification. Users can also watch original content from the main menu and take photos with players using the AR function.

By incorporating an emotion engine, the system can provide flexible and personalized responses based on user emotions, further increasing engagement. This improves the fan experience and drives more visitors to stadiums and related facilities.

The processing flow is explained below.

Program processing steps

User server connection and authentication

Step 1:

The user launches the Hawks Connection app and goes to the login screen.

Step 2:

The user enters their ID and password on the login screen and clicks the login button.

Step 3:

The device sends ID and password authentication information to the server.

Step 4:

The server compares the received ID and password with the database and performs authentication.

Step 5:

If authentication is successful, the server returns a successful authentication message to the terminal, and the terminal displays the main menu.

Player Selection

Step 1:

The user selects the "Select Player" option from the main menu.

Step 2:

The device will display the player list screen, and the user can tap on the player they want to chat with.

Step 3:

The device sends the player ID to the server.

Step 4:

The server retrieves the player's profile information from the database and returns it to the device.

Step 5:

The device will display the player's profile information received to the user.

Start chat with an AI character

Step 1:

The user enters a message in the chat input field and presses the send button.

Step 2:

The device sends the user's message to the server.

Step 3:

The server sends the message to the emotion engine, which analyzes the user's emotions.

Step 4:

The server passes the analysis results to the AI chatbot.

Step 5:

The AI chatbot generates appropriate responses based on the results of emotion analysis.

Step 6:

The server returns the generated response to the device, which displays the response on the chat screen.

Quick match results notifications

Step 1:

The server retrieves match results in real time.

Step 2:

The server will send the match results to the user's device via push notification.

Step 3:

The device will receive a notification and display the match results to the user.

Distribution of original content

Step 1:

The user selects the "Original Content" option from the main menu.

Step 2:

The device requests a content list from the server.

Step 3:

The server retrieves a list of original content from the content database and returns it to the device.

Step 4:

The device displays a content list and the user selects specific content.

Step 5:

The device requests the selected content data from the server, and the server streams the data.

AR photo taking and sharing

Step 1:

The user selects the "Take AR Photo" option from the menu.

Step 2:

The device's camera function will be activated, and you can use the AR function to take a photo with the player.

Step 3:

Once the user has finished taking a photo, the device uploads the photo data to the server.

Step 4:

The server stores the photo data, generates a sharing link, and returns it to the device.

Step 5:

Users can use the link to share photos on social media etc.

Purchase recommended gourmet foods and merchandise

Step 1:

The user selects the "Recommended Gourmet & Goods" option from the main menu.

Step 2:

The device sends a request to the server, which retrieves information from the database.

Step 3:

The server returns a list of recommended gourmet foods and goods to the device.

Step 4:

The device displays a list and the user selects a specific item.

Step 5:

The device sends a purchase request to the server, and the server processes the purchase.

Step 6:

The server handles purchase confirmation and shipping arrangements.

Using the Emotion Engine

Step 1:

When a user sends a message, the server receives the message and sends it to the emotion engine.

Step 2:

The emotion engine analyzes messages and recognizes the user's emotions.

Step 3:

The emotion engine returns the recognized emotion to the server.

Step 4:

The server communicates the emotion analysis results to the AI chatbot.

Step 5:

The AI chatbot generates appropriate responses based on the results of sentiment analysis.

Step 6:

The server returns the generated response to the terminal, which displays the response to the user.

Specific examples

For example, suppose a user logs in, selects a specific athlete (Athlete A), and sends a message on the chat screen saying, "I'm so happy today!" The server receives this message, and the emotion engine analyzes the emotion of "joy." Based on this information, the AI chatbot generates a response such as, "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. While a game is in progress, real-time game results are sent to the user's device via push notification. Users can also watch original content from the main menu and take photos with players using the AR function. With the introduction of the emotion engine, the system can provide flexible and personalized responses based on the user's emotions, further increasing engagement. This improves the fan experience and encourages more people to visit stadiums and related facilities.

(Example 2)

Next, Example 2 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset-type terminal 314 will be referred to as the "terminal."

The problem this invention aims to solve is to achieve more natural and emotional dialogue in a system that increases fan engagement between users and athletes, and to respond to users' real-time and individual needs. Conventional systems do not provide responses that reflect the user's emotions, and do not adequately provide real-time game results or distribute original content. Furthermore, the user experience is limited, such as the ability to take photos using AR functions or purchase recommended gourmet food or merchandise. It is necessary to solve these problems and improve user satisfaction.

The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

In this invention, the server includes: means for allowing a user to chat one-on-one with an AI character of a specific athlete; means for authenticating the ID and password entered by the user on the login screen; means for providing profile information of the athlete selected by the user; means for the AI character to receive the user's message, analyze emotions using an emotion engine, and generate a response based on those emotions; means for displaying the generated response to the user; means for providing real-time game results and original content; means for the user to take and share photos with the athlete using the AR function; means for the user to purchase gourmet food recommended by the athlete and official cheering merchandise; means for the emotion engine to analyze the user's message and recognize emotions; means for the AI chatbot to generate an optimal response based on the recognized emotions; and means for the server to obtain game results in real time while the game is in progress and send them to the device via push notification. This allows users to receive personalized responses based on emotions, providing real-time information and a diverse entertainment experience.

"AI Athlete Characters" are virtual characters created using artificial intelligence to mimic athletes and can chat one-on-one with users.

"Users" refer to people who use this system and communicate with the AI athlete characters within the system.

An "emotion engine" is a software component that analyzes emotions from messages entered by users and generates responses based on those emotions.

An "AI chatbot" is an artificial intelligence program that receives messages from users, analyzes them, and generates appropriate responses.

An "ID" is identification information used to identify a user, and is usually composed of a unique string of characters or numbers.

A "password" is a secret string of characters used in combination with an ID to authenticate a user.

"Authentication information" refers to the ID and password combination entered by the user when logging in.

A "database" is a collection of electronically managed data that stores user information, athlete profile information, etc.

The "Main Menu" is the screen that serves as the gateway to the system's main functions, which users can access after successful authentication.

"Profile information" refers to detailed data about a specific athlete, including the athlete's background, performance, characteristics, etc.

"Real-time" means that data is generated and transmitted immediately, without delay.

"Match Results Updates" is a means of providing information to users quickly and effectively regarding the results of ongoing or completed matches.

"Original content" refers to original digital content such as video, audio, and text that the system provides to users.

"AR function" is an augmented reality technology that overlays digital information onto real-world scenery.

"Means for taking photos" refers to the method by which a user generates image data using the device's camera function.

"Sharing methods" are the ways in which users can share photos they take and content they generate with other users online.

"Gourmet" refers to high-quality foods and beverages recommended by athletes.

"Official cheering merchandise" refers to cheering items and accessories officially approved by athletes or organizations.

"Means of purchase" refers to the mechanism by which users order and pay for gourmet food and official support merchandise through the system.

"Push notifications" are a method by which a server sends important information to a user's device in real time.

The system of the present invention is an advanced fan engagement system that combines multiple technologies to enable users to communicate with AI athlete characters. The system includes hardware and software to implement specific methods.

System Configuration

This system mainly consists of the following components:

(Server): Database server, AI chatbot, emotion engine, push notification system

(Device): A device (smartphone, tablet, PC, etc.) that accepts user operations and displays information accordingly.

(User): The person who operates the system and communicates with the athlete AI character.

Key technical components and processing overview

User authentication and login

When a user accesses the system using a terminal, they first go to a login screen. They enter their ID and password, and if authentication is successful, they proceed to the main menu. Databases such as MySQL and PostgreSQL are used here.

Select a player and view their profile

The user selects the "Select Player" option from the main menu and chooses a specific player from the displayed list of players. The device sends the player ID to the server, which retrieves the player's profile information from the database and returns it to the device, allowing the user to view the player's details.

Chat with AI characters

When a user wants to chat with a selected player, they enter a message on the chat screen and press the send button. The device sends the message to the server, which then forwards it to the AI chatbot. The AI chatbot uses a generative AI model (e.g., GPT-4) and an emotion engine to analyze the sentiment of the message. Based on the results of this analysis, it generates an optimal response and returns it to the device. The device then displays the generated response on the chat screen.

Match result notification

As the match progresses, the server retrieves the match results in real time, and when important results are obtained, they are sent to the user's device via push notification. This notification function uses push notification services such as Firebase Cloud Messaging (FCM).

Distribution of original content

When a user selects the "Original Content" option, the device requests a content list from the server. The server retrieves the list from the content database and returns it to the device, providing the user's selected content in streaming format.

AR photo taking and sharing

When a user selects the "AR Photo Shoot" option, the device's camera function will be activated, allowing the user to take a photo with the player using the AR function. After the photo is taken, the device will upload the photo data to the server, which will then generate a sharing link and return it to the device. The user can then share the link on social media, etc.

Purchase recommended gourmet foods and merchandise

When a user selects the "Recommended Food and Goods" option, the device sends a request to the server, which retrieves information about recommended food and goods from a database and returns it to the device. When the user selects a specific item and sends a purchase request to the server, the server completes the purchase process and arranges for delivery.

Specific examples

For example, the following shows the process flow when a user logs in, selects a specific athlete (Athlete A), and sends the message "I'm so happy today!" on the chat screen. The server receives this message, and the emotion engine analyzes the "joy." Based on this information, the AI chatbot generates a response such as "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. Additionally, if a game is in progress, real-time game results are sent to the user's device via push notification. Furthermore, users can view original content from the main menu and take photos with players using the AR function.

Example prompt

"I want to send a message to a specific athlete (Athlete A) and get an emotional response. For example, if I send the message 'I'm really happy today!', please generate an appropriate reply."

By implementing this invention, users can receive personalized responses based on their emotions, enabling real-time information provision and diverse entertainment experiences.

The flow of the identification process in Example 2 will be explained using Figure 13.

Step 1:

The user boots up using a terminal and accesses the system login screen.

Step 2:

The user enters their ID and password on the login screen. This input information is sent to the server by the device. The input data is sent to the server in the form of "user ID" and "password."

Step 3:

The server compares the received ID and password with a database, which stores pre-registered user information. The result of the comparison determines whether authentication was successful.

Step 4:

The server sends the authentication result to the terminal. If authentication is successful, a success message is sent along with access information to the main menu. If authentication fails, an authentication error message is sent.

Step 5:

Based on the authentication results received by the device from the server, if authentication is successful, the main menu screen will be displayed, allowing the user to select their next action.

Step 6:

The user selects the "Select Player" option from the main menu. A request for a player list is sent from the device to the server.

Step 7:

The server retrieves the player list from the database and returns the data to the device. Player names, profile photos, etc. are retrieved from the database.

Step 8:

The device displays the player list received from the server to the user. The user selects the specific player they want to chat with from the list.

Step 9:

When a user selects a specific player, the player's ID is sent by the device to the server, which retrieves the player's details from the database and returns them to the device.

Step 10:

The device displays the player's detailed profile received from the server to the user. The user is then taken to a screen where they can start chatting with the player.

Step 11:

The user enters a message on the chat screen and presses the send button. The entered message is sent from the device to the server.

Step 12:

The server forwards the received message to the AI chatbot, which analyzes the message using a generative AI model (e.g., GPT-4).

Step 13:

The AI chatbot analyzes the content of the message and recognizes emotions using an emotion engine. Emotion-analyzed data is obtained in the form of "joy" or "sadness," etc.

Step 14:

The AI chatbot generates a response message based on the analysis results of the emotion engine. For example, if the emotion "joy" is recognized, the response message generated will be "That's wonderful!"

Step 15:

The server sends the generated response message to the terminal.

Step 16:

The device will display the response message on the chat screen so that the user can view it.

Step 17:

While a match is in progress, the server obtains match results in real time. For example, it uses an API to obtain match status data.

Step 18:

When the server obtains new match results, they are sent to the user's device via push notification.

Step 19:

The device receives the notification and displays the match results to the user. At the same time, the emotion engine analyzes the user's reaction and provides optimal feedback.

Step 20:

If the user selects the "Original Content" option, the device will request a content list from the server.

Step 20:

The server retrieves a list of original content from the content database and returns it to the device. The retrieved data includes video thumbnails and titles.

Step 21:

The device displays the received list to the user, allowing them to select content.

Step 22:

When a user selects the content they want to watch, the server provides that content in streaming format.

Step 23:

The device receives the streaming data and the user can watch the content.

Step 24:

When a user selects the "AR Photo Taking" option, the device's camera function will be activated. The AR function will be enabled, allowing the user to take photos with the players.

Step 25:

Once the user has taken a photo, the device uploads the photo data to the server.

Step 26:

The server stores the uploaded photos and generates a sharing link that is returned to the device.

Step 27:

The device displays the received link information to the user, who can then use the link to share the photo on social media, etc.

Step 28:

The user selects the "Recommended Food and Goods" option. The device sends a request to the server, which retrieves information about recommended food and goods from the database and returns it to the device.

Step 29:

The device displays the received list to the user and allows them to select a specific item.

Step 30:

When a user selects a specific item, a purchase request is sent from the device to the server. The purchase request includes user information and details of the selected item.

Step 31:

The server processes the purchase request and the purchase is completed through the payment system. Delivery arrangements are then made.

Step 32:

The emotion engine analyzes the user's emotional state and recommends appropriate items based on that state. For example, if the user is in a "joy" state, it will recommend related fun goods.

Step 33:

Recommended items will be displayed on the device, allowing the user to start the purchase process again.

The above are the specific processing steps of this system.

(Application Example 2)

Next, we will explain Application Example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the headset-type terminal 314 will be referred to as the "terminal."

Traditional methods of interaction between athletes and fans make it difficult to respond flexibly to fans' emotions, and the provision of personalized content is limited. Furthermore, notifications of match results and recommendations of related content are not optimized to take user emotions into account. Under these circumstances, there are challenges in not being able to fully improve fan engagement or deepen the fan experience.

The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for allowing a user to have a one-on-one conversation with an AI character of a specific athlete; means for providing real-time game progress updates and unique content; means for users to take and share photos with athletes using an augmented reality function; means for users to purchase athlete-recommended food and beverages and official support merchandise; means for recognizing a user's emotions using an emotion analysis engine and personalizing and recommending content based on those emotions; means for authenticating identification information and a password entered by the user on the login screen; means for providing profile information of an athlete selected by the user; means for recommending and delivering personalized sports-related content based on the user's emotions; means for an AI character to generate a response to a user's message; means for displaying the generated response; and means for obtaining game results in real time and generating and notifying a response based on emotions. This enables the provision of personalized content based on the user's emotions, improving fan engagement and deepening the fan experience.

"AI character of a specific athlete" refers to a virtual character with artificial intelligence created to imitate a specific athlete, which communicates with users.

"User" refers to an individual, fan, or user who uses this system.

"Means for dialogue" refers to a mechanism that allows users to exchange messages with a specific athlete's AI character and for them to respond to each other.

"Match progress updates" refers to information provided in real time about the progress and results of a match.

"Original Content" refers to videos, articles, interviews, behind-the-scenes footage, and other information specifically created and provided by the System.

"Means of providing information in real time" refers to technologies and mechanisms that deliver information to users instantly.

"Augmented reality" refers to technology that overlays digital information onto the real world, for example, by synthesizing virtual characters onto the scenery seen through a camera.

An "emotion analysis engine" refers to an algorithm or software that analyzes messages and actions entered by users and recognizes their emotions.

"Personalized content" refers to information that is optimized and customized based on a user's interests and emotional state.

"Identification information" refers to information that uniquely identifies a user, and typically refers to a user ID and password.

"Encryption" means secret information used to protect identifying information, including passwords and PIN codes.

"Profile information" refers to detailed information about an athlete, such as their name, biography, statistics, and photo.

A "generated response" is a reply created by an AI character based on the user's message.

"Means of notification" refers to the technology or mechanism used to notify users of new information, such as push notifications or email.

"Food and drink" refers to food and drink recommended by the competitor.

"Official support merchandise" refers to support goods and related products authorized by an athlete or team.

This invention is a system that allows users to have one-on-one conversations with an AI character of a specific athlete, and includes features such as providing real-time updates on match progress and original content, using augmented reality to take and share photos with athletes, purchasing food and drink and official support merchandise, and using an emotion analysis engine to recognize users' emotions and personalize and recommend content based on those emotions. Each element of the system and its functions are explained below.

Overall structure

The system consists of a user's device, a central server, a database, an AI character, an emotion analysis engine, and various software that integrates them. Users access the system using a smartphone application.

Authentication Process

The user enters their identification information (ID) and password on the login screen. This information is sent from the device to a central server, which then compares it with a database for authentication. This process authenticates the user.

Player selection and profile information

When a user selects a specific athlete, the selected athlete's profile information is retrieved from the database and displayed on the user's device. This information includes the athlete's name, biography, photo, statistical data, etc.

Interactive features

Users interact with the AI character of the contestant they have selected. When the user presses the send button, a message is sent to a central server, which analyzes the message using an emotion analysis engine. Based on the emotional information analyzed by the emotion analysis engine, the AI character generates an appropriate response, which is then displayed on the user's device.

Match progress notifications and content distribution

Game progress and results are obtained in real time by a central server and pushed to users' devices. In addition, personalized sports-related content is recommended and delivered based on the results of user sentiment analysis.

Augmented reality features

Users can use the augmented reality function to take photos with athletes. By activating the device's camera function, they can take a photo in which the virtual athlete is superimposed on the real-world scenery. The captured photo is uploaded to a central server and a sharing link is generated. This link can be used to share the photo on social media, etc.

Product purchase function

When a user purchases athlete-recommended food and drink or official support merchandise, the device sends a request to the server and retrieves product information from the database. When the user selects a specific item and submits a purchase request, the server completes the purchase process and arranges for delivery.

Hardware and software used

Hardware: Smartphone (iOS or Android)

Software: Python, emotion analysis engine (EmotionAnalyzer), content database (ContentDatabase)

Server: Cloud service (AWS, Azure, etc.)

Specific examples and prompt sentence examples

For example, if a user logs in, selects a specific athlete, and sends a message saying, "I'm so happy today!", the emotion analysis engine will analyze the emotion as "joy." As a result, the AI character will generate a response such as, "That's great! I'll do my best in the next game!" This response will then be displayed on the user's chat screen.

Example prompt:

I'm really happy today!

The flow of the specific processing in Application Example 2 will be explained using Figure 14.

Step 1:

The user enters identification information (ID) and password into a login screen on their device. The device sends this to a central server, which then checks it against a database for authentication. This process authenticates the user. The input is identification information and password, and the output is the authentication result. The process includes querying the database and analyzing the results.

Step 2:

When a user selects a specific athlete, the selected athlete's profile information is retrieved from the database and displayed on the device. The input is the athlete ID, and the output is the athlete's profile information. As part of the process, the server queries the database and returns the results to the device.

Step 3:

The user begins a conversation with an AI character. When the user enters a message and presses the send button, the device sends the message to the server. The server analyzes this message using an emotion analysis engine (EmotionAnalyzer). The input is the user's message, and the output is the analyzed emotion. As part of the process, the server calls the emotion analysis engine and analyzes the message.

Step 4:

Based on the emotional information analyzed by the emotion analysis engine, the AI character generates an appropriate response. The server sends the generated response to the device, which then displays it to the user. The input is the analyzed emotion, and the output is the generated response. As part of the processing, the AI character's response generation algorithm is executed.

Step 5:

Match progress and results are obtained in real time by the server and pushed to the user's device. The input is real-time match data, and the output is notification messages. As part of the process, the server obtains data from an external match data provider and sends it to the user's device as a push notification.

Step 6:

Personalized sports-related content is recommended and delivered based on the results of user emotion analysis. The server retrieves content related to the user's emotions from a database and sends it to the device for display. The input is the user's emotion analysis results, and the output is the recommended content. As part of the process, the server queries the content database based on the emotion analysis results, retrieves appropriate content, and sends it to the user's device.

Step 7:

The user uses the augmented reality function to take a photo with the competitor, and the device uploads the photo to the server. The server saves the photo, generates a sharing link, and returns it to the device. The input is the AR photo, and the output is the sharing link. As part of the process, the device collects camera data and uploads it to the server, which then saves it in a storage service and generates a link.

Step 8:

When a user purchases athlete-recommended food and drink or official support merchandise, the terminal sends a request to the server, which retrieves product information from the database. When the user selects a specific item and submits a purchase request, the server processes the purchase and arranges for delivery. The input is the purchase request, and the output is a notification that the purchase is complete. As part of the process, the server processes the order information, checks inventory, and arranges for delivery.

In this way, each step works together to create a system that provides users with an advanced and personalized fan engagement experience.

The specific processing unit 290 transmits the results of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the results of the specific processing. The microphone 238 acquires audio indicating the user input regarding the results of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

Data generation model 58 is what is known as generative AI (artificial intelligence). Examples of data generation model 58 include generative AI such as ChatGPT (Internet search <URL: https://openai.com/blog/chatgpt>) and Gemini (Internet search <URL: https://gemini.google.com/?hl=ja>). Data generation model 58 is obtained by performing deep learning on a neural network. A prompt containing an instruction is input to data generation model 58, and inference data such as voice data indicating speech, text data indicating text, and image data indicating an image is also input. Data generation model 58 performs inference on the input inference data in accordance with the instructions indicated by the prompt, and outputs the inference results in the form of data such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and/or summarization.

In the above embodiment, an example was given in which the specific processing was performed by the data processing device 12, but the technology disclosed herein is not limited to this, and the specific processing may also be performed by the headset-type terminal 314.

[Fourth embodiment]

Figure 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

As shown in FIG. 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

The data processing device 12 includes a computer 22, a database 24, and a communication I/F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and communication I/F 26 are also connected to the bus 34. The communication I/F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and/or a LAN (Local Area Network).

The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I/F 44, and a control target 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and control target 443 are also connected to the bus 52.

The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the user 20's surroundings (e.g., an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

The communication I/F 44 is connected to the network 54. The communication I/Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I/Fs 44 and 26 is carried out in a secure manner.

The control object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, in the data processing device 12, specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32.

The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as the specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

Storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

In the robot 414, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

Next, we will explain the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 will be referred to as the "terminal."

This invention relates to a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized by the following programs and processes.

User server connection and authentication

When a user uses a terminal to access the system, they first go to the login screen. They enter their ID and password and attempt to log in. The terminal sends the entered authentication information to the server, which then compares the received information with a database to authenticate the user. If authentication is successful, the user proceeds to the main menu.

Player Selection

When a user selects the "Select Player" option from the main menu, the device will display a list of players. The user can tap on a specific player they want to chat with and send the player ID to the server. The server will retrieve the player's profile information from its database and return it to the device, which will then display it, allowing the user to view information about that player.

Start chat with an AI character

When a specific player is selected, a chat screen appears and the user can enter a message. When the user presses the send button, the device sends the message to the server, which then relays the message to the AI chatbot. The AI chatbot analyzes the received message and generates a response in the style of the player. The server returns the generated response to the device, which then displays it on the chat screen.

Quick match results notifications

As the match progresses, the server retrieves match results in real time. When the server retrieves new match results, it sends them to the user's device via push notification. The device receives the notification and displays the match results to the user.

Distribution of original content

When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves the list of original content from the content database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format.

AR photo taking and sharing

When a user selects the "AR Photo Taking" option, the device's camera function will be activated, allowing them to take a photo with the player using the AR function. Once the user has finished taking the photo, the device will upload the photo data to the server. The server will save the photo, generate a sharing link, and return it to the device. The user can then use the link to share the photo on social media, etc.

Purchase recommended gourmet foods and merchandise

When a user selects the "Recommended Food and Goods" option from the menu, the device sends a request to the server, which retrieves recommended food and goods information from a database and returns it to the device. The device displays the list, and when the user selects a specific item, a purchase request is sent to the server. The server completes the purchase process and arranges for delivery.

Specific examples

For example, a user logs in, selects a specific athlete (Athlete A), and sends a message saying, "Please tell us your enthusiasm before the game." The server receives the message and passes it to an AI chatbot, which then generates a response such as, "My goal this season is to win!" This response is displayed on the user's chat screen. If a game is in progress, real-time game results are sent to the user's device via push notification. The user can then view original content from the main menu or take photos with the player using the AR function.

In this way, this system allows users to enjoy private communication with athletes while receiving match results and original content in real time. Furthermore, by using the AR and merchandise purchasing functions, it is possible to increase engagement with fans and promote contributions to the local economy.

The processing flow is explained below.

Program processing steps

User server connection and authentication

Step 1:

The user launches the Hawks Connection app and goes to the login screen.

Step 2:

The user enters their ID and password on the login screen and clicks the login button.

Step 3:

The device sends ID and password authentication information to the server.

Step 4:

The server compares the received ID and password with the database and performs authentication.

Step 5:

If authentication is successful, the server returns a successful authentication message to the terminal, and the terminal displays the main menu.

Player Selection

Step 1:

The user selects the "Select Player" option from the main menu.

Step 2:

The device will display the player list screen, and the user can tap on the player they want to chat with.

Step 3:

The device sends the player ID to the server.

Step 4:

The server retrieves the player's profile information from the database and returns it to the device.

Step 5:

The device will display the player's profile information received to the user.

Start chat with an AI character

Step 1:

The user enters a message in the chat input field and presses the send button.

Step 2:

The device sends the user's message to the server.

Step 3:

The server passes the message to the AI chatbot.

Step 4:

The AI chatbot analyzes the messages it receives and generates responses in the style of a player.

Step 5:

The server returns the generated response to the device, which displays the response on the chat screen.

Quick match results notifications

Step 1:

The server retrieves match results in real time.

Step 2:

The server that obtains the match results will send a push notification to the user's device.

Step 3:

The device will receive a notification and display the match results to the user.

Distribution of original content

Step 1:

The user selects the "Original Content" option from the main menu.

Step 2:

The device requests a content list from the server.

Step 3:

The server retrieves a list of original content from the content database and returns it to the device.

Step 4:

The device displays a content list and the user selects specific content.

Step 5:

The device requests the selected content data from the server, and the server streams the data.

AR photo taking and sharing

Step 1:

The user selects the "Take AR Photo" option from the menu.

Step 2:

The device's camera function will be activated, and you can use the AR function to take a photo with the player.

Step 3:

Once the user has finished taking a photo, the device uploads the photo data to the server.

Step 4:

The server stores the photo data, generates a sharing link, and returns it to the device.

Step 5:

Users can use the link to share photos on social media etc.

Purchase recommended gourmet foods and merchandise

Step 1:

The user selects the "Recommended Gourmet & Goods" option from the main menu.

Step 2:

The device sends a request to the server, which retrieves information from the database.

Step 3:

The server returns a list of recommended gourmet foods and goods to the device.

Step 4:

The device displays a list and the user selects a specific item.

Step 5:

The device sends a purchase request to the server, and the server processes the purchase.

Step 6:

The server handles purchase confirmation and shipping arrangements.

(Example 1)

Next, Example 1 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 will be referred to as the "terminal."

Traditional sports fan engagement systems were limited to providing athlete information and content distribution, and lacked the means for fans to interact one-on-one with athletes, receive real-time match results, take photos using augmented reality features, or purchase recommended meals or official support merchandise. This made it difficult to increase user satisfaction and engagement.

The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

In this invention, the server includes a means for users to chat one-on-one with a specific avatar, a means for providing match results and content in real time, a means for users to take and share photos with the avatar using augmented reality functions, a means for users to purchase recommended meals and official support merchandise, a means for users to enter login authentication information and be authenticated by the server, a means for providing information about the avatar selected by the user, a means for the avatar to generate a response to the user's message, and a means for displaying the generated response to the user. This allows users to enjoy multifaceted engagement with athletes, improving system usage satisfaction.

"User" refers to an individual or organization that uses this system.

An "avatar" is a virtual character based on a specific athlete that is designed to interact one-on-one with users.

"Server" refers to a computer system used to manage and provide user authentication information, avatar data, match results, and other content.

"Database" refers to a system for storing and managing data used in the system, such as athlete profile information, match results, and content.

"Response" refers to the answer or reaction generated by an avatar in response to a message from a user.

"Match Results" refers to the results data of ongoing or completed sports matches.

"Content" refers to media information provided to users, such as original videos, articles, and images.

"Augmented reality (AR)" refers to technology that uses a device's camera to overlay virtual objects onto real-world images.

"Recommended Meals" refers to diet-related products or services recommended by an athlete or the System to a user.

"Official support merchandise" refers to official goods and merchandise related to an athlete's team or brand.

"Login credentials" refers to the ID and password combination required by a user to access the system.

"Authentication" refers to the process by which the server verifies that the login credentials provided by the user are accurate.

This invention provides a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized through the following specific hardware and software configuration and processing.

First, the user accesses the system using a device (smartphone, tablet, PC, etc.) and goes to the login screen. The user enters their ID and password and attempts to log in. The device sends the entered authentication information to the server. The server compares the received information with a database (e.g., MySQL) for authentication, and if authentication is successful, the user proceeds to the main menu.

When a user selects the "Select Player" option from the main menu, the device requests a list of players from the server. The server retrieves the list of players from the database and sends it to the device. The user can then tap or click to select a specific player and view their profile information.

Once a player is selected, the user can begin chatting with the AI character. When the user enters a message and presses the send button, the device sends the message to the server, which then passes it to an AI chatbot (such as GPT-3 as a generative AI model). The AI chatbot analyzes the message and generates a response in the style of the player, which the server then sends back to the device and displays on the user's chat screen.

Also, while the match is in progress, the server obtains match results in real time via external APIs such as sports data APIs. When new match results become available, the server sends them to the user's device via push notification, which then receives the notification and displays it to the user.

Furthermore, if the user selects the "Original Content" option, the device will request a content list from the server. The server will retrieve the content data from the database and send it to the device. When the user selects specific content, the server will provide that content in streaming format.

When a user selects "AR Photo Shooting" in the AR photo option, the device's camera function and AR library (e.g., ARKit) are activated to take a photo with the player's virtual character. After taking the photo, the device uploads the photo data to the server, which saves the photo and generates a sharing link that is returned to the device. The user can then use this link to share the photo on social media, etc.

Finally, when the user selects the "Recommended Gourmet/Goods" option, the device sends a request to the server, which retrieves information about recommended meals and official support products from its database and returns it to the device. When the user selects a specific item, a purchase request is sent to the server, which then processes the purchase and arranges for delivery.

Example prompt

Please tell us your enthusiasm before the match.

What are your goals this season?

What do you think about the next match?

In this way, this system allows users to enjoy private communication with athletes while receiving match results and original content in real time. Furthermore, by using the AR and merchandise purchasing functions, it is possible to increase engagement with fans and promote contributions to the local economy.

The flow of the identification process in Example 1 will be explained using Figure 11.

Step 1:

The user uses a terminal to navigate to the login screen and enter their ID and password. Input: User's ID and password. The terminal sends this authentication information to the server. The server compares the received information with the database for authentication. If authentication is successful, Output: An instruction to proceed to the main menu is returned. Specific operation: The server uses an SQL query to search the database for authentication information, and returns success if it matches, or an error message if it does not match.

Step 2:

The user selects the "Select Player" option from the main menu. Input: The user requests to select a player. The device requests a list of players from the server. The server retrieves the list of players from the database and returns it to the device. Output: The player list is displayed on the device. Specific behavior: The server retrieves player information using an SQL query and returns it to the device in JSON format.

Step 3:

The user selects a specific player and starts a chat with that player. Input: User's player selection and message. When the user enters a message and presses the send button, the device sends the message to the server. The server passes the message to the AI chatbot. Output: The response generated by the chatbot. Specific operation: The server invokes an AI model (e.g., GPT-3) to analyze the message and generate a response. The response is returned to the device in JSON format and displayed on the chat screen.

Step 4:

As the match progresses, the server retrieves match results in real time from an external API (e.g., a sports data API). Input: Updated match status data. If there are new match results, the server sends them to the user's device via push notification. Output: Push notification of match results. Specific operation: The server periodically calls the API and notifies the user via WebSocket or Firebase Cloud Messaging if there is new data.

Step 5:

The user selects the "Original Content" option from the main menu. Input: The user requests content. The device sends a request to the server, which retrieves the content data from the database and sends it to the device. Output: A content list is displayed on the device. When the user selects specific content, the server provides it in streaming format. Specific behavior: The server provides media files in HLS format, and the device plays them in the appropriate player.

Step 6:

When a user selects the "AR Photo Shoot" option, the device activates the camera function and AR library (e.g., ARKit). Input: User's photo request. A photo is taken with the player's virtual character. After the photo is taken, the device uploads the photo data to the server, which saves the photo and generates a sharing link that is returned to the device. Output: Shared link. Specific operation: A photo is taken using the device's camera and AR library, and uploaded to the server via REST API. The server generates a link and sends it back.

Step 7:

When the user selects the "Recommended Food & Goods" option, the device sends a request to the server. Input: User's item selection request. The server retrieves information about recommended meals and official support products from the database and returns it to the device. Output: A product list is displayed on the device. When the user selects a specific item, a purchase request is sent to the server, which completes the purchase and arranges for delivery. Specific operation: The server retrieves the product information, completes the purchase through a payment gateway (e.g., Stripe), and notifies the user of the order information.

(Application Example 1)

Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 will be referred to as the "terminal."

Today's sports fans want to interact more closely with their favorite athletes, receive real-time game information, and watch original content. However, conventional systems have difficulty providing these services comprehensively, limiting the means to increase fan engagement. This has created a growing need for systems that provide virtual communication with athletes, real-time game information notifications, AR photography, the distribution of original content, and the ability to purchase recommended products.

The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

In this invention, the server includes: a means for allowing users to chat one-on-one with an AI character of a specific athlete; a means for providing real-time game results and original video content; a means for users to take and share photos with the athlete using AR functions; a means for users to purchase food and drink recommended by the athlete and official support merchandise; a means for users to log in from their device, select a specific athlete, and use a generative AI model to generate and display athlete-style responses; a means for obtaining game progress in real time and notifying the user; and a means for users to view original content via their device. This enables deep engagement with athletes, allowing fans to enjoy game information and original content in real time, and further increasing satisfaction through AR functions and recommended merchandise.

An "athlete" is a person who competes in a particular sport, and is virtually reproduced as an AI character within the system.

"One-on-one chat" means that users can engage in individual, two-way messaging with an AI character of a specific athlete.

"Live Match Results" means the latest match status and results provided to users in real time for ongoing or completed sports matches.

"Original video content" refers to independently created video data about athletes and related events that is distributed to users.

The "AR function" uses augmented reality technology to allow users to synthesize and photograph virtual images of athletes in real-world scenes.

"Athlete-recommended foods, beverages, and official support products" refer to foods and beverages recommended by athletes and products officially approved for support, which can be purchased by users.

"Generative AI model" refers to artificial intelligence technology that generates athlete-style responses based on a user's message.

"Get in real time" means continuously monitoring the progress of the match and notifying the user immediately.

"Terminal" refers to a device that a user uses to access and operate the system, such as a smartphone or tablet.

This invention relates to a system that increases fan engagement by allowing users to communicate with AI characters of athletes. This system is realized by the following programs and processes.

First, a user must log in to access the system using a terminal. The user enters their ID and password on the login screen and sends the authentication information to the server. The server authenticates the received authentication information by comparing it with a database, and if authentication is successful, the user can proceed to the main menu. The hardware used is a smartphone, and the software used is a back-end server and database management system.

The user then selects the "Select Player" option from the main menu, and the device displays a list of players. The user taps on the specific athlete they want to chat with and sends the athlete ID to the server. The server retrieves the athlete's profile information from the database and returns it to the device, which then displays it, allowing the user to view information about the athlete. The hardware used is a smartphone, and the software used is a back-end server and database management system.

Once a specific athlete is selected, a chat screen appears, allowing the user to enter a message. When the user presses the send button, the device sends the message to the server, which uses the generative AI model to analyze the message and generate a response in the style of the athlete. This response is returned from the server to the device, which displays it on the chat screen. The hardware used is a smartphone, and the software used is the generative AI model and back-end server.

Also, while a match is in progress, the server obtains the match status in real time and sends it to the user's device via push notification. The device receives the notification and displays the match results to the user. The hardware used is a smartphone, and the software used is a server with real-time data acquisition capabilities.

Furthermore, when the user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves a list of original video content from the content database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format. The hardware used is a smartphone, and the software used is a streaming server.

When a user selects the "AR Photo Shooting" option, the device's camera function is activated, allowing them to take a photo with the athlete using AR functionality. Once the user has finished taking the photo, the device uploads the photo data to the server. The server saves the photo, generates a sharing link, and returns it to the device. The user can then use the link to share the photo on social media, etc. The hardware used is a smartphone (camera function), and the software used is an application using AR technology and a back-end server.

For example, a user can generate an athlete-like response using the following prompt: "What are your thoughts before the game?" If the user sends a message, the generative AI model can generate a response such as "My goal this season is to win!" and display it in the user's chat screen.

In this way, a system will be created that enables deep engagement with athletes, allows fans to enjoy real-time game information and original content, and further enhances satisfaction through AR functions and recommended products.

The flow of the specific processing in Application Example 1 will be explained using Figure 12.

Step 1:

A user accesses the system using a terminal. The user enters their ID and password on the login screen and sends the input data to the terminal. The terminal sends the authentication information to the server, which then compares it with a database for authentication. The server returns the authentication result to the terminal, and the terminal displays the main menu if authentication is successful, or an error message if authentication is unsuccessful.

Enter: User ID, Password

Data processing: Sending authentication information and database verification

Output: Authentication result (success/failure)

Step 2:

The user selects the "Select Player" option from the main menu. The device sends a request for a player list to the server, which retrieves the player list from the database and returns it to the device. The device displays the player list, and when the user taps on a specific athlete, the player ID is sent to the server. The server retrieves the player's profile information and returns it to the device, which displays it.

Input: Player selection request, player ID

Data processing: Obtaining player lists and profile information

Output: Player list, player profile information

Step 3:

When the user selects a player, a chat screen is displayed. When the user enters a message and presses the send button, the device sends the message to the server. The server analyzes the message using a generative AI model, generates an athlete-style response, and returns the response to the device. The device displays the athlete-style response on the chat screen.

Input: User message

Data processing: Message analysis and response generation using generative AI models

Output: Athlete-like response

Step 4:

When a match is in progress, the server continues to obtain the match status in real time. Every time the server detects new match status, it pushes the match results to the user's device. The device receives the notification and displays the match results to the user.

Input: Real-time match status data

Data processing: Monitoring match conditions

Output: Match results via push notification

Step 5:

When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves a list of original video content from the database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format.

Input: Original content request

Data processing: Obtaining content lists and content data

Output: Original content list, streaming content

Step 6:

When a user selects the "AR Photo Shoot" option, the device's camera function will activate and use the AR function to take a photo with the athlete. Once the user has finished taking the photo, the device will upload the photo data to the server. The server will save the photo and generate a sharing link that will be returned to the device. The user can then use the link to share the photo on social media, etc.

Input: Photo request, photo data

Data processing: Upload and save photo data, generate sharing links

Output: Shared link

It is also possible to further combine an emotion engine that estimates the user's emotion. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

This invention achieves even higher levels of fan engagement by combining an emotion engine with a system in which users communicate with AI athlete characters. This system is realized through the following programs and processes.

User server connection and authentication

When a user uses a terminal to access the system, they first go to the login screen. They enter their ID and password and attempt to log in. The terminal sends the entered authentication information to the server, which then compares the received information with a database to authenticate the user. If authentication is successful, the user proceeds to the main menu.

Player Selection

When a user selects the "Select Player" option from the main menu, the device displays a list of players and the user taps on the specific player they want to chat with. The device sends the player ID to the server, which retrieves the player's profile information from its database and returns it to the device. The device displays this, allowing the user to view information about that player.

Start chat with an AI character

Once a specific player is selected, a chat screen appears and the user can enter a message. When the user presses the send button, the device sends the message to the server, which then passes it on to the AI chatbot. The AI chatbot analyzes the received message and uses an emotion engine to generate a player-like response. The emotion engine analyzes the emotion from the user's message and generates an optimal response based on that emotion. The server returns the generated response to the device, which then displays it on the chat screen.

The role of the emotional engine

The emotion engine analyzes the messages and actions entered by the user and recognizes their emotions. For example, if a user enters, "I had so much fun today!", the emotion engine will recognize the user's emotion as "joy." Based on this information, the AI chatbot will generate a response that corresponds to joy, such as, "That's great! Please come again!"

Quick match results notifications

As the match progresses, the server retrieves match results in real time. When the server retrieves new match results, it sends them to the user's device via push notification. The device receives the notification and displays the match results to the user. The emotion engine analyzes the user's emotions and can optimize responses to match results.

Distribution of original content

When a user selects the "Original Content" option from the main menu, the device requests a content list from the server. The server retrieves the list of original content from the content database and returns it to the device. The device displays the list, and when the user selects specific content, the server provides that content to the device in streaming format. The emotion engine can also recommend appropriate content based on the user's emotions.

AR photo taking and sharing

When a user selects the "AR Photo Taking" option, the device's camera function will be activated, allowing them to take a photo with the player using the AR function. Once the user has finished taking the photo, the device will upload the photo data to the server. The server will save the photo, generate a sharing link, and return it to the device. The user can then use the link to share the photo on social media, etc.

Purchase recommended gourmet foods and merchandise

When a user selects the "Recommended Food and Goods" option from the menu, the device sends a request to the server, which retrieves recommended food and goods information from a database and returns it to the device. The device displays a list, and when the user selects a specific item, a purchase request is sent to the server. The server completes the purchase process and arranges for delivery. The emotion engine can present recommended items taking into account the user's emotional state.

Specific examples

For example, suppose a user logs in, selects a specific athlete (Athlete A), and sends a message on the chat screen saying, "I'm so happy today!" The server receives this message, and the emotion engine analyzes the emotion of "joy." Based on this information, the AI chatbot generates a response such as, "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. If a game is in progress, real-time game results are sent to the user's device via push notification. Users can also watch original content from the main menu and take photos with players using the AR function.

By incorporating an emotion engine, the system can provide flexible and personalized responses based on user emotions, further increasing engagement. This improves the fan experience and drives more traffic to stadiums and related facilities.

The processing flow is explained below.

Program processing steps

User server connection and authentication

Step 1:

The user launches the Hawks Connection app and goes to the login screen.

Step 2:

The user enters their ID and password on the login screen and clicks the login button.

Step 3:

The device sends ID and password authentication information to the server.

Step 4:

The server compares the received ID and password with the database and performs authentication.

Step 5:

If authentication is successful, the server returns a successful authentication message to the terminal, and the terminal displays the main menu.

Player Selection

Step 1:

The user selects the "Select Player" option from the main menu.

Step 2:

The device will display the player list screen, and the user can tap on the player they want to chat with.

Step 3:

The device sends the player ID to the server.

Step 4:

The server retrieves the player's profile information from the database and returns it to the device.

Step 5:

The device will display the player's profile information received to the user.

Start chat with an AI character

Step 1:

The user enters a message in the chat input field and presses the send button.

Step 2:

The device sends the user's message to the server.

Step 3:

The server sends the message to the emotion engine, which analyzes the user's emotions.

Step 4:

The server passes the analysis results to the AI chatbot.

Step 5:

The AI chatbot generates appropriate responses based on the results of emotion analysis.

Step 6:

The server returns the generated response to the device, which displays the response on the chat screen.

Quick match results notifications

Step 1:

The server retrieves match results in real time.

Step 2:

The server will send the match results to the user's device via push notification.

Step 3:

The device will receive a notification and display the match results to the user.

Distribution of original content

Step 1:

The user selects the "Original Content" option from the main menu.

Step 2:

The device requests a content list from the server.

Step 3:

The server retrieves a list of original content from the content database and returns it to the device.

Step 4:

The device displays a content list and the user selects specific content.

Step 5:

The device requests the selected content data from the server, and the server streams the data.

AR photo taking and sharing

Step 1:

The user selects the "Take AR Photo" option from the menu.

Step 2:

The device's camera function will be activated, and you can use the AR function to take a photo with the player.

Step 3:

Once the user has finished taking a photo, the device uploads the photo data to the server.

Step 4:

The server stores the photo data, generates a sharing link, and returns it to the device.

Step 5:

Users can use the link to share photos on social media etc.

Purchase recommended gourmet foods and merchandise

Step 1:

The user selects the "Recommended Gourmet & Goods" option from the main menu.

Step 2:

The device sends a request to the server, which retrieves information from the database.

Step 3:

The server returns a list of recommended gourmet foods and goods to the device.

Step 4:

The device displays a list and the user selects a specific item.

Step 5:

The device sends a purchase request to the server, and the server processes the purchase.

Step 6:

The server handles purchase confirmation and shipping arrangements.

Using the Emotion Engine

Step 1:

When a user sends a message, the server receives the message and sends it to the emotion engine.

Step 2:

The emotion engine analyzes messages and recognizes the user's emotions.

Step 3:

The emotion engine returns the recognized emotion to the server.

Step 4:

The server communicates the emotion analysis results to the AI chatbot.

Step 5:

The AI chatbot generates appropriate responses based on the results of sentiment analysis.

Step 6:

The server returns the generated response to the terminal, which displays the response to the user.

Specific examples

For example, suppose a user logs in, selects a specific athlete (Athlete A), and sends a message on the chat screen saying, "I'm so happy today!" The server receives this message, and the emotion engine analyzes the emotion of "joy." Based on this information, the AI chatbot generates a response such as, "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. While a game is in progress, real-time game results are sent to the user's device via push notification. Users can also watch original content from the main menu and take photos with players using the AR function. With the introduction of the emotion engine, the system can provide flexible and personalized responses based on the user's emotions, further increasing engagement. This improves the fan experience and encourages more people to visit stadiums and related facilities.

(Example 2)

Next, Example 2 will be described. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

The problem this invention aims to solve is to achieve more natural and emotional dialogue in a system that increases fan engagement between users and athletes, and to respond to users' real-time and individual needs. Conventional systems do not provide responses that reflect the user's emotions, and do not adequately provide real-time game results or distribute original content. Furthermore, the user experience is limited, such as the ability to take photos using AR functions or purchase recommended gourmet food or merchandise. It is necessary to solve these problems and improve user satisfaction.

The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

In this invention, the server includes: means for allowing a user to chat one-on-one with an AI character of a specific athlete; means for authenticating the ID and password entered by the user on the login screen; means for providing profile information of the athlete selected by the user; means for the AI character to receive the user's message, analyze emotions using an emotion engine, and generate a response based on those emotions; means for displaying the generated response to the user; means for providing real-time game results and original content; means for the user to take and share photos with the athlete using an AR function; means for the user to purchase gourmet food recommended by the athlete and official cheering merchandise; means for the emotion engine to analyze the user's message and recognize emotions; means for the AI chatbot to generate an optimal response based on the recognized emotions; and means for the server to obtain game results in real time while the game is in progress and send them to the device via push notification. This allows users to receive personalized responses based on emotions, providing real-time information and a diverse entertainment experience.

"AI Athlete Characters" are virtual characters created using artificial intelligence to mimic athletes and can chat one-on-one with users.

"Users" refer to people who use this system and communicate with the athlete's AI character within the system.

An "emotion engine" is a software component that analyzes emotions from messages entered by users and generates responses based on those emotions.

An "AI chatbot" is an artificial intelligence program that receives messages from users, analyzes them, and generates appropriate responses.

An "ID" is identification information used to identify a user, and is usually composed of a unique string of characters or numbers.

A "password" is a secret string of characters used in combination with an ID to authenticate a user.

"Authentication information" refers to the ID and password combination entered by the user when logging in.

A "database" is a collection of electronically managed data that stores user information, athlete profile information, etc.

The "Main Menu" is the screen that serves as the gateway to the system's main functions, which users can access after successful authentication.

"Profile information" refers to detailed data about a specific athlete, including the athlete's background, performance, characteristics, etc.

"Real-time" means that data is generated and transmitted immediately, without delay.

"Match Results Updates" is a means of providing information to users quickly and effectively regarding the results of ongoing or completed matches.

"Original content" refers to original digital content such as video, audio, and text that the system provides to users.

"AR function" is an augmented reality technology that overlays digital information onto real-world scenery.

"Means for taking photos" refers to the method by which a user generates image data using the device's camera function.

"Sharing methods" are the ways in which users can share photos they take and content they generate with other users online.

"Gourmet" refers to high-quality foods and beverages recommended by athletes.

"Official cheering merchandise" refers to cheering items and accessories officially approved by athletes or organizations.

"Means of purchase" refers to the mechanism by which users order and pay for gourmet food and official support merchandise through the system.

"Push notifications" are a method by which a server sends important information to a user's device in real time.

The system of the present invention is an advanced fan engagement system that combines multiple technologies to enable users to communicate with AI athlete characters. The system includes hardware and software to implement specific methods.

System Configuration

This system mainly consists of the following components:

(Server): Database server, AI chatbot, emotion engine, push notification system

(Device): A device (smartphone, tablet, PC, etc.) that accepts user operations and displays information accordingly.

(User): The person who operates the system and communicates with the athlete AI character.

Key technical components and processing overview

User authentication and login

When a user accesses the system using a terminal, they first go to a login screen. They enter their ID and password, and if authentication is successful, they proceed to the main menu. Databases such as MySQL and PostgreSQL are used here.

Select a player and view their profile

The user selects the "Select Player" option from the main menu and chooses a specific player from the displayed list of players. The device sends the player ID to the server, which retrieves the player's profile information from the database and returns it to the device, allowing the user to view the player's details.

Chat with AI characters

When a user wants to chat with a selected player, they enter a message on the chat screen and press the send button. The device sends the message to the server, which then forwards it to the AI chatbot. The AI chatbot uses a generative AI model (e.g., GPT-4) and an emotion engine to analyze the sentiment of the message. Based on the results of this analysis, it generates an optimal response and returns it to the device. The device then displays the generated response on the chat screen.

Match result notification

As the match progresses, the server retrieves the match results in real time, and when important results are obtained, they are sent to the user's device via push notification. This notification function uses push notification services such as Firebase Cloud Messaging (FCM).

Distribution of original content

When a user selects the "Original Content" option, the device requests a content list from the server. The server retrieves the list from the content database and returns it to the device, providing the user's selected content in streaming format.

AR photo taking and sharing

When a user selects the "AR Photo Shoot" option, the device's camera function will be activated, allowing the user to take a photo with the player using the AR function. After the photo is taken, the device will upload the photo data to the server, which will then generate a sharing link and return it to the device. The user can then share the link on social media, etc.

Purchase recommended gourmet foods and merchandise

When a user selects the "Recommended Food and Goods" option, the device sends a request to the server, which retrieves information about recommended food and goods from a database and returns it to the device. When the user selects a specific item and sends a purchase request to the server, the server completes the purchase process and arranges for delivery.

Specific examples

For example, the following shows the process flow when a user logs in, selects a specific athlete (Athlete A), and sends the message "I'm so happy today!" on the chat screen. The server receives this message, and the emotion engine analyzes the "joy." Based on this information, the AI chatbot generates a response such as "That's great! I'll do my best in the next game!" This response is then displayed on the user's chat screen. Additionally, if a game is in progress, real-time game results are sent to the user's device via push notification. Furthermore, users can view original content from the main menu and take photos with players using the AR function.

Example prompt

"I want to send a message to a specific athlete (Athlete A) and get an emotional response. For example, if I send the message 'I'm really happy today!', please generate an appropriate reply."

By implementing this invention, users can receive personalized responses based on their emotions, enabling real-time information provision and diverse entertainment experiences.

The flow of the identification process in Example 2 will be explained using Figure 13.

Step 1:

The user boots up using a terminal and accesses the system login screen.

Step 2:

The user enters their ID and password on the login screen. This input information is sent to the server by the device. The input data is sent to the server in the form of "user ID" and "password."

Step 3:

The server compares the received ID and password with a database, which stores pre-registered user information. The result of the comparison determines whether authentication was successful.

Step 4:

The server sends the authentication result to the terminal. If authentication is successful, a success message is sent along with access information to the main menu. If authentication fails, an authentication error message is sent.

Step 5:

Based on the authentication results received by the device from the server, if authentication is successful, the main menu screen will be displayed, allowing the user to select their next action.

Step 6:

The user selects the "Select Player" option from the main menu. A request for a player list is sent from the device to the server.

Step 7:

The server retrieves the player list from the database and returns the data to the device. Player names, profile photos, etc. are retrieved from the database.

Step 8:

The device displays the player list received from the server to the user. The user selects the specific player they want to chat with from the list.

Step 9:

When a user selects a specific player, the player's ID is sent by the device to the server, which retrieves the player's details from the database and returns them to the device.

Step 10:

The device displays the player's detailed profile received from the server to the user. The user is then taken to a screen where they can start chatting with the player.

Step 11:

The user enters a message on the chat screen and presses the send button. The entered message is sent from the device to the server.

Step 12:

The server forwards the received message to the AI chatbot, which analyzes the message using a generative AI model (e.g., GPT-4).

Step 13:

The AI chatbot analyzes the content of the message and recognizes emotions using an emotion engine. Emotion-analyzed data is obtained in the form of "joy" or "sadness," etc.

Step 14:

The AI chatbot generates a response message based on the analysis results of the emotion engine. For example, if the emotion "joy" is recognized, the response message generated will be "That's wonderful!"

Step 15:

The server sends the generated response message to the terminal.

Step 16:

The device will display the response message on the chat screen so that the user can view it.

Step 17:

While a match is in progress, the server obtains match results in real time. For example, it uses an API to obtain match status data.

Step 18:

When the server obtains new match results, they are sent to the user's device via push notification.

Step 19:

The device receives the notification and displays the match results to the user. At the same time, the emotion engine analyzes the user's reaction and provides optimal feedback.

Step 20:

If the user selects the "Original Content" option, the device will request a content list from the server.

Step 20:

The server retrieves a list of original content from the content database and returns it to the device. The retrieved data includes video thumbnails and titles.

Step 21:

The device displays the received list to the user, allowing them to select content.

Step 22:

When a user selects the content they want to watch, the server provides that content in streaming format.

Step 23:

The device receives the streaming data and the user can watch the content.

Step 24:

When a user selects the "AR Photo Taken" option, the device's camera function will be activated. The AR function will be enabled, allowing the user to take photos with the players.

Step 25:

Once the user has taken a photo, the device uploads the photo data to the server.

Step 26:

The server stores the uploaded photos and generates a sharing link that is returned to the device.

Step 27:

The device displays the received link information to the user, who can then use the link to share the photo on social media, etc.

Step 28:

The user selects the "Recommended Food and Goods" option. The device sends a request to the server, which retrieves information about recommended food and goods from the database and returns it to the device.

Step 29:

The device displays the received list to the user and allows them to select a specific item.

Step 30:

When a user selects a specific item, a purchase request is sent from the device to the server. The purchase request includes user information and details of the selected item.

Step 31:

The server processes the purchase request and the purchase is completed through the payment system. Delivery arrangements are then made.

Step 32:

The emotion engine analyzes the user's emotional state and recommends appropriate items based on that state. For example, if the user is in a "joy" state, it will recommend related fun goods.

Step 33:

Recommended items will be displayed on the device, allowing the user to start the purchase process again.

The above are the specific processing steps of this system.

(Application Example 2)

Next, we will explain Application Example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 will be referred to as the "terminal."

Traditional methods of interaction between athletes and fans make it difficult to respond flexibly to fans' emotions, and the provision of personalized content is limited. Furthermore, notifications of match results and recommendations of related content are not optimized to take user emotions into account. Under these circumstances, there are challenges in not being able to fully improve fan engagement or deepen the fan experience.

The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for allowing a user to have a one-on-one conversation with an AI character of a specific athlete; means for providing real-time game progress updates and unique content; means for users to take and share photos with athletes using an augmented reality function; means for users to purchase athlete-recommended food and beverages and official support merchandise; means for recognizing a user's emotions using an emotion analysis engine and personalizing and recommending content based on those emotions; means for authenticating identification information and a password entered by the user on the login screen; means for providing profile information of an athlete selected by the user; means for recommending and delivering personalized sports-related content based on the user's emotions; means for an AI character to generate a response to a user's message; means for displaying the generated response; and means for obtaining game results in real time and generating and notifying a response based on emotions. This enables the provision of personalized content based on the user's emotions, improving fan engagement and deepening the fan experience.

"AI character of a specific athlete" refers to a virtual character with artificial intelligence created to imitate a specific athlete, which communicates with users.

"User" refers to an individual, fan, or user who uses this system.

"Means for dialogue" refers to a mechanism that allows users to exchange messages with a specific athlete's AI character and for them to respond to each other.

"Match progress updates" refers to information provided in real time about the progress and results of a match.

"Original Content" refers to videos, articles, interviews, behind-the-scenes footage, and other information specifically created and provided by the System.

"Means of providing information in real time" refers to technologies and mechanisms that deliver information to users instantly.

"Augmented reality" refers to technology that overlays digital information onto the real world, for example, by synthesizing virtual characters onto the scenery seen through a camera.

An "emotion analysis engine" refers to an algorithm or software that analyzes messages and actions entered by users and recognizes their emotions.

"Personalized content" refers to information that is optimized and customized based on a user's interests and emotional state.

"Identification information" refers to information that uniquely identifies a user, and typically refers to a user ID and password.

"Encryption" means secret information used to protect identifying information, including passwords and PIN codes.

"Profile information" refers to detailed information about an athlete, such as their name, biography, statistics, and photo.

A "generated response" is a reply created by an AI character based on the user's message.

"Means of notification" refers to the technology or mechanism used to notify users of new information, such as push notifications or email.

"Food and drink" refers to food and drink recommended by the competitor.

"Official support merchandise" refers to support goods and related products authorized by an athlete or team.

This invention is a system that allows users to have one-on-one conversations with an AI character of a specific athlete, and includes features such as providing real-time updates on match progress and original content, using augmented reality to take and share photos with athletes, purchasing food and drink and official support merchandise, and using an emotion analysis engine to recognize users' emotions and personalize and recommend content based on those emotions. Each element of the system and its functions are explained below.

Overall structure

The system consists of a user's device, a central server, a database, an AI character, an emotion analysis engine, and various software that integrates them. Users access the system using a smartphone application.

Authentication Process

The user enters their identification information (ID) and password on the login screen. This information is sent from the device to a central server, which then compares it with a database for authentication. This process authenticates the user.

Player selection and profile information

When a user selects a specific athlete, the selected athlete's profile information is retrieved from the database and displayed on the user's device. This information includes the athlete's name, biography, photo, statistical data, etc.

Interactive features

Users interact with the AI character of the contestant they have selected. When the user presses the send button, a message is sent to a central server, which analyzes the message using an emotion analysis engine. Based on the emotional information analyzed by the emotion analysis engine, the AI character generates an appropriate response, which is then displayed on the user's device.

Match progress notifications and content distribution

Game progress and results are obtained in real time by a central server and pushed to the user's device. In addition, personalized sports-related content is recommended and delivered based on the results of user sentiment analysis.

Augmented reality features

Users can use the augmented reality function to take photos with athletes. By activating the device's camera function, they can take a photo in which the virtual athlete is superimposed on the real-world scenery. The captured photo is uploaded to a central server and a sharing link is generated. This link can be used to share the photo on social media, etc.

Product purchase function

When a user purchases athlete-recommended food and drink or official support merchandise, the device sends a request to the server and retrieves product information from the database. When the user selects a specific item and submits a purchase request, the server completes the purchase process and arranges for delivery.

Hardware and software used

Hardware: Smartphone (iOS or Android)

Software: Python, emotion analysis engine (EmotionAnalyzer), content database (ContentDatabase)

Server: Cloud service (AWS, Azure, etc.)

Specific examples and prompt sentence examples

For example, if a user logs in, selects a specific athlete, and sends a message saying, "I'm so happy today!", the emotion analysis engine will analyze the emotion as "joy." As a result, the AI character will generate a response such as, "That's great! I'll do my best in the next game!" This response will then be displayed on the user's chat screen.

Example prompt:

I'm really happy today!

The flow of the specific processing in Application Example 2 will be explained using Figure 14.

Step 1:

The user enters identification information (ID) and password into a login screen on their device. The device sends this to a central server, which then checks it against a database for authentication. This process authenticates the user. The input is identification information and password, and the output is the authentication result. The process includes querying the database and analyzing the results.

Step 2:

When a user selects a specific athlete, the selected athlete's profile information is retrieved from the database and displayed on the device. The input is the athlete ID, and the output is the athlete's profile information. As part of the process, the server queries the database and returns the results to the device.

Step 3:

The user begins a conversation with an AI character. When the user enters a message and presses the send button, the device sends the message to the server. The server analyzes this message using an emotion analysis engine (EmotionAnalyzer). The input is the user's message, and the output is the analyzed emotion. As part of the process, the server calls the emotion analysis engine and analyzes the message.

Step 4:

Based on the emotional information analyzed by the emotion analysis engine, the AI character generates an appropriate response. The server sends the generated response to the device, which then displays it to the user. The input is the analyzed emotion, and the output is the generated response. As part of the processing, the AI character's response generation algorithm is executed.

Step 5:

Match progress and results are obtained in real time by the server and pushed to the user's device. The input is real-time match data, and the output is notification messages. As part of the process, the server obtains data from an external match data provider and sends it to the user's device as a push notification.

Step 6:

Personalized sports-related content is recommended and delivered based on the results of user emotion analysis. The server retrieves content related to the user's emotions from a database and sends it to the device for display. The input is the user's emotion analysis results, and the output is the recommended content. As part of the process, the server queries the content database based on the emotion analysis results, retrieves appropriate content, and sends it to the user's device.

Step 7:

The user uses the augmented reality function to take a photo with the competitor, and the device uploads the photo to the server. The server saves the photo, generates a sharing link, and returns it to the device. The input is the AR photo, and the output is the sharing link. As part of the process, the device collects camera data and uploads it to the server, which then saves it in a storage service and generates a link.

Step 8:

When a user purchases athlete-recommended food and drink or official support merchandise, the terminal sends a request to the server, which retrieves product information from the database. When the user selects a specific item and submits a purchase request, the server processes the purchase and arranges for delivery. The input is the purchase request, and the output is a notification that the purchase is complete. As part of the process, the server processes the order information, checks inventory, and arranges for delivery.

In this way, each step works together to create a system that provides users with an advanced and personalized fan engagement experience.

The specific processing unit 290 transmits the results of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the results of the specific processing. The microphone 238 acquires audio indicating the user input regarding the results of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

Data generation model 58 is what is known as generative AI (artificial intelligence). Examples of data generation model 58 include generative AI such as ChatGPT (Internet search <URL: https://openai.com/blog/chatgpt>) and Gemini (Internet search <URL: https://gemini.google.com/?hl=ja>). Data generation model 58 is obtained by performing deep learning on a neural network. A prompt containing an instruction is input to data generation model 58, and inference data such as voice data indicating speech, text data indicating text, and image data indicating an image is also input. Data generation model 58 performs inference on the input inference data in accordance with the instructions indicated by the prompt, and outputs the inference results in the form of data such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and/or summarization.

In the above embodiment, an example was given in which the specific processing was performed by the data processing device 12, but the technology disclosed herein is not limited to this, and the specific processing may also be performed by the robot 414.

The emotion identification model 59, which serves as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see Figure 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

Figure 9 shows an emotion map 400 on which multiple emotions are mapped. In emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both emotions and mental states. Emotions that are generally generated from reactions that occur in the brain are arranged on the left side of the concentric circles. Emotions that are generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions that are generally generated from reactions that occur in the brain and are induced by situational judgment are arranged above and below the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the top side of the concentric circles, and the emotion of "discomfort" is arranged on the bottom side. In this way, emotion map 400 maps multiple emotions based on the structure by which emotions are generated, with emotions that tend to occur simultaneously being mapped close together.

These emotions are distributed in the 3 o'clock direction on emotion map 400, and usually fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness takes precedence over internal sensations, resulting in a sense of calm.

The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further out you go on emotion map 400, the more visible (expressed in behavior) the emotion becomes.

Here, human emotions are based on various balances such as posture and blood sugar levels, and when these balances deviate from the ideal, it indicates discomfort, and when they approach the ideal, it indicates pleasure. Emotions can also be created for robots, cars, motorcycles, etc., based on various balances such as posture and remaining battery life, so that when these balances deviate from the ideal, it indicates discomfort, and when they approach the ideal, it indicates pleasure. Emotion maps may be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on speech emotion recognition and emotional brain physiological signal analysis systems, Tokushima University, doctoral dissertation: https://ci.nii.ac.jp/naid/500000375379). The left half of the emotion map is lined with emotions belonging to an area called "reaction," where sensation is dominant. The right half of the emotion map is lined with emotions belonging to an area called "situation," where situational awareness is dominant.

The emotion map defines two emotions that encourage learning. One is the negative emotion around the middle of "repentance" or "reflection" on the situation side. In other words, this is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the positive emotion around "desire" on the response side. In other words, this is when the robot experiences positive feelings such as "I want more" or "I want to know more."

The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are close to each other have similar values, as in the emotion map 900 shown in Figure 10. Figure 10 shows an example in which multiple emotions, such as "relieved," "calm," and "reassuring," have similar emotion values.

The system according to the present disclosure has been described above primarily in terms of the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may also be implemented as a general information processing system. The present disclosure may also be implemented, for example, as a software program that runs on a personal computer or an application that runs on a smartphone, etc. The method according to the present disclosure may also be provided to users in the form of SaaS (Software as a Service).

In the above embodiment, an example was given in which a specific process was performed by a single computer 22, but the technology of the present disclosure is not limited to this, and distributed processing of the specific process may be performed by multiple computers, including the computer 22. For example, the data generation model 58 may be provided in a device external to the data processing device 12, and data may be generated in that external device in response to input data.

In the above embodiment, an example was described in which the specific processing program 56 is stored in the storage 32, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

It is not necessary to store the entire specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entire specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

The following types of processors can be used as hardware resources for executing specific processes. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource for executing specific processes by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which are processors with a circuit configuration designed specifically for executing specific processes. All processors have built-in or connected memory, and all use the memory to execute specific processes.

The hardware resource that executes the specific processing may be composed of one of these various processors, or may be composed of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). The hardware resource that executes the specific processing may also be a single processor.

As an example of a configuration using a single processor, first, there is a configuration in which one processor is configured using a combination of one or more CPUs and software, and this processor functions as a hardware resource that executes specific processing. Second, there is a configuration in which a processor is used to realize the functions of an entire system, including multiple hardware resources that execute specific processing, on a single IC chip, as typified by SoC (System-on-a-chip). In this way, specific processing is realized using one or more of the various processors listed above as hardware resources.

More specifically, the hardware structure of these various processors can be an electrical circuit that combines circuit elements such as semiconductor devices. Furthermore, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps can be added, or the processing order can be rearranged, all within the scope of the spirit of the invention.

The above-described written content and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above explanation of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or substitutions may be made to the above-described written content and illustrations, as long as they do not deviate from the spirit of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described written content and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

All publications, patent applications, and technical standards mentioned in this specification are incorporated by reference herein to the same extent as if each individual publication, patent application, and technical standard was specifically and individually indicated to be incorporated by reference.

The following is further disclosed regarding the above embodiments.

(Claim 1)

A way for users to chat one-on-one with AI characters of specific athletes,

A means to provide real-time game results and original content,

Users can take and share photos with athletes using the AR feature,

A system that includes a means for users to purchase gourmet food recommended by athletes and official support merchandise.

(Claim 2)

A means of authenticating the ID and password entered by the user on the login screen,

The system of claim 1, further comprising means for providing profile information for an athlete selected by the user.

(Claim 3)

A way for AI characters to generate responses to user messages,

The system of claim 1, further comprising means for displaying the generated response to the user.

"Example 1"

(Claim 1)

A way for users to chat one-on-one with specific avatars,

Means of providing match results and content in real time,

A way for users to take and share photos with their avatars using augmented reality features,

Users will have a way to purchase recommended meals and official support products,

A means by which users enter their login credentials and are authenticated by the server,

A means for users to provide information about their selected avatar,

A means for the avatar to generate a response to the user's message,

A system that includes a means for displaying the generated response to the user.

(Claim 2)

The system of claim 1 further includes means for the server to retrieve a list of players from a database based on authenticated information and display it to the user.

(Claim 3)

The system described in claim 1, characterized in that it receives a user's message, analyzes it using an AI model, and generates a response.

"Application Example 1"

(Claim 1)

A means for users to chat one-on-one with AI characters of specific athletes,

A means to provide real-time game results and original video content,

Users can take and share photos with athletes using the AR feature,

A way for users to purchase food and drink recommended by athletes and official support merchandise,

A means for users to log in from their device, select a specific athlete, and use a generative AI model to generate and display athlete-like responses;

A means to obtain real-time game progress and notify users,

A means for users to watch original content via their devices,

...

A system including

(Claim 2)

A means of authenticating the ID and password entered by the user on the login screen,

The system of claim 1, further comprising means for providing profile information for an athlete selected by the user.

(Claim 3)

A way for AI characters to generate athletic responses to user messages,

The system of claim 1, further comprising means for displaying the generated response to the user.

"Example 2: Combining Emotion Engines"

(Claim 1)

A way for users to chat one-on-one with AI characters of specific athletes,

A means of authenticating the ID and password entered by the user on the login screen,

A means for users to provide profile information for selected athletes,

The AI character receives the user's message, analyzes the emotion using an emotion engine, and generates a response based on that emotion.

A means to display the generated response to the user,

A means to provide real-time game results and original content,

Users can take and share photos with athletes using the AR feature,

A system that includes a means for users to purchase gourmet food recommended by athletes and official support merchandise.

(Claim 2)

The emotion engine analyzes user messages and recognizes their emotions,

The system of claim 1, further comprising means for the AI chatbot to generate an optimal response based on the recognized emotion.

(Claim 3)

The system of claim 1 further includes a means for the server to obtain match results in real time while the match is in progress and send them to the terminal via push notification.

"Application Example 2: Combining Emotion Engines"

(Claim 1)

A means for users to have one-on-one conversations with specific athlete AI characters,

A means to provide real-time game updates and unique content,

Users can take and share photos with athletes using augmented reality features,

A means for users to purchase food and drink recommended by athletes and official support merchandise,

A system that uses an emotion analysis engine to recognize a user's emotions and includes a means to personalize and recommend content based on those emotions.

(Claim 2)

A means to authenticate the identification information and password entered by the user on the login screen,

A means for users to provide profile information about selected athletes;

The system of claim 1, further comprising means for recommending and delivering personalized sports-related content based on user sentiment.

(Claim 3)

A means for the AI character to generate a response to the user's message,

A means to display the generated response,

The system described in claim 1 includes means for obtaining match results in real time and generating and notifying responses according to emotions.

10, 210, 310, 410 Data processing system 12 Data processing device 14 Smart device 214 Smart glasses 314 Headset type terminal 414 Robot

Claims (3)

A means for users to chat one-on-one with AI characters of specific athletes,
A means to provide real-time game results and original content,
Users can take and share photos with athletes using the AR feature,
The system includes a means for users to purchase athlete-recommended gourmet food and official support merchandise. A means to authenticate the ID and password entered by the user on the login screen,
10. The system of claim 1, further comprising means for providing profile information for a user-selected athlete. A means for the AI character to generate responses to user messages;
10. The system of claim 1, further comprising means for displaying the generated response to a user.