TWI871253B - Interactive narrative system - Google Patents

Abstract

The disclosure provides an interactive narrative system including a story script management module, an interactive storytelling module, and a storytelling agent. The story script management module includes a sheet-based script editor configured to edit multiple story scripts of a complete script. The interactive storytelling module is configured to design multiple dynamic story frameworks, a concatenation of the multiple dynamic story frameworks, and each of each story script corresponding to which dynamic story framework. The storytelling agent is configured to play, from one of the nodes of the multiple dynamic story frameworks, a story element of each node following a story workflow of the dynamic story framework that the node belongs to, and determine a next node according to a sensing signal, where the story scrip that the next node belongs to is the same or different from that of a current node.

Description

Interactive narrative system

This case is about a narrative system and an interactive narrative system.

The human brain has infinite creativity and can create infinite possible story plots. As the story plot continues to develop, the writing of the script becomes more complicated. In order to fully present the plot in the mind, the screenwriter needs to fully describe all the details such as the environment or characters in the text script. However, simple text description tests the reader's imagination. As each person's life and education conditions are different, each person's experience after reading the script will also be different.

In order to improve the completeness of the script, the screenwriter can attach pictures or photos to supplement the deficiencies in the text description. However, there is still a considerable gap between all the collected text and picture materials and the presentation of a complete script. The screenwriter's expertise lies in script writing, and the current script editing software requires advanced operating skills. If the screenwriter wants to use the software program to write a complete script from all the materials, the current editing software requires the editor to spend a considerable amount of time on program operation. The more complex the complete script is, such as the interaction with the audience during the story performance, the more time the screenwriter needs to spend to confirm the correctness of the story structure in the software. In addition, if the story structure goes wrong due to software operation, it will cause the audience to have a poor experience in watching the narrative system.

Therefore, how to provide a narrative system that is easy to use and does not require a lot of time to operate the program is a technical problem that needs to be solved urgently.

The case provides an interactive narrative system, including a story script management module, an interactive narrative module, an object integration module and a narrative agent module. The story script management module includes a tab script editor, which is configured to edit multiple story scripts of a complete script. Each story script includes multiple story elements for presenting the content of the story. The interactive narrative module is connected to the story script management module and is configured to design multiple dynamic story frameworks, the connection between multiple dynamic story frameworks and each dynamic story framework corresponding to each story script. Each dynamic story framework includes multiple nodes with a serial relationship, and each node is configured to include multiple story elements for presenting the content of the story. The object integration module is connected to the interactive narrative module and is configured to receive multiple sensing signals from multiple sensors. The narrative agent module is connected to the object integration module and is configured to start from one of the multiple nodes of the multiple dynamic story structures, follow the story line of each dynamic story structure to which each node belongs to play each story element of each node, and determine the next node according to each sensing signal, so that the story script to which the next node belongs is the same as or different from the story script to which the current node belongs.

100:Interactive narrative system

110: Story script management module

112: Authorization tool interface

114: Tab Script Editor

116a: First story script

116b: Second story script

116n: Nth story script

116: Story Script

120:Interactive Narrative Module

130: Object integration module

140: Narrative Agent Module

261: Story setting

263: Main story content

265:Multimedia content

410~440: Dynamic story structure

510: Theme settings

520: Linear storyline

530: Non-linear storyline

540: Role settings

550: Text script analyzer

560:Multimedia content configurator

570:Interactive Narrative Scheduler

580: Story content expressor

600: Node

611~618: Channel

711, 721, 731, 741, 781: Display

712, 722, 732, 742: Arms

Figure 1 is a block diagram of an interactive narrative system according to an embodiment of the present invention.

Figure 2 is a block diagram of a story script management module according to an embodiment of the present invention.

Figure 3 is a content structure diagram of a story script drawn according to an embodiment of this case.

Figures 4(a) to 4(d) are node connection structure diagrams of a dynamic story framework according to an embodiment of the present invention.

FIG5 is a block diagram of an interactive narrative module according to an embodiment of the present invention.

Figure 6 shows the data format of the node according to an embodiment of the present invention.

Figures 7(a) to 7(d) are schematic diagrams showing the interactive narrative system according to an embodiment of the present invention.

The following further describes the case with the help of diagrams and examples, so that relevant personnel in the technical field to which the present invention belongs can better understand the present invention and implement it accordingly, but the examples are not intended to limit the present invention.

This case provides an interactive narrative system that is configured to be used in any device including a processor, display, speaker, input/output interface (such as a keyboard, mouse or touch screen), sensor (such as a touch sensor, temperature sensor, humidity sensor, carbon dioxide sensor or light sensor, etc.) and mechanical structure. The interactive narrative system is used to edit multiple story scripts and integrate them into a complete script. The audience can operate the interactive narrative system to watch and listen to the story narration, and feedback information to the interactive narrative system during the development of the story, so that the story plot has different follow-up developments.

In one embodiment, the interactive narrative system is a robot.

Figure 1 is a block diagram of an interactive narrative system according to an embodiment of the present invention.

The interactive narrative system 100 includes a story script management module 110, an interactive narrative module 120, an object integration module 130 and a narrative agent module 140. The story script management module 110 is connected to the interactive narrative module 120. The interactive narrative module 120 is connected to the object integration module 130. The object integration module 130 is connected to the narrative agent module 140.

The story script management module 110 is used to provide users with functions related to writing and editing story scripts. For example, the story script management module 110 allows users to create multiple story elements, such as characters, settings, conflicts, plots, events, themes, and multimedia context. Multimedia content is, for example, text scripts (context script), pictures, images, animations, videos, audio, etc. The story script management module 110 can also allow users to use multiple story elements to edit scripts and create a complete script in the user's mind.

The interactive narrative module 120 is used to provide users with a flexible storyline design to connect multiple story elements and enable different characters in the story to interact with each other. In addition, the interactive narrative module 120 can establish a plot path and design an interactive mechanism between the user and the interactive narrative system 100 (to be explained later).

In one embodiment, the interactive narrative module 120 is configured to design multiple dynamic story frameworks, connections between multiple dynamic story frameworks, and a dynamic story framework corresponding to each story script. Each dynamic story framework includes multiple nodes with a connection relationship. Each node includes multiple story elements for presenting story content.

The object integration module 130 is connected to multiple sensors (not shown) by wire or wireless. Wireless communication mechanisms include Bluetooth, Wireless Fidelity (Wi-Fi), infrared communication (IrDA), analog input, digital input, analog output, digital output, two-dimensional barcode (QR code) mechanism (for example, the robot moves to the location of the two-dimensional barcode and automatically reads the barcode content to perform related operations), etc. The object integration module 130 uses the input signal or output signal of the sensor as one of the factors for determining the plot route of the subsequent story.

The narrative agent module 140 is used to play the complete script designed by the user. In one embodiment, the narrative agent module 140 is configured to start from one of the multiple nodes of the multiple dynamic story frameworks and play the story elements of each node according to the story line of the dynamic story framework to which each node belongs. In addition, in the process of playing the story stream according to the dynamic story framework, the narrative agent module 140 determines the next node according to the trigger mechanism of the node and the sensing signal, so that the story script to which the next node belongs is the same or different from the story script to which the current node belongs. For example, when the user encounters a trigger condition in the plot while watching the story, the user can choose different responses, which may keep the story plot in the existing scene or jump to a different scene.

In one embodiment, the story script management module 110, the interactive narrative module 120 and the object integration module 130 are software modules composed of program codes, which are configured to be stored in a storage medium (not shown) and loaded by a processor (not shown) to execute all operations mentioned in this article.

In one embodiment, the narrative agent module 140 includes a processor, a storage medium, a display, a speaker, an input/output interface, a sensor, a mechanical structure, an actuator (such as a motor) and/or a lamp.

Figure 2 is a block diagram of a story script management module according to an embodiment of the present invention.

The story script management module 110 includes an authorization tool interface 112 and a tab script editor 114.

In one embodiment, the authorization tool interface 112 is configured to provide a tabbed script editor 114 for editing a plurality of story scripts. For example, the authorization tool interface 112 provides an execution environment that can create, edit, store and delete files in the format of Extensible Markup Language (XML, such as *.xml files), Comma-Separated Values (CSV, such as *.csv files) or text files (such as *.txt).

The tab script editor 114 is configured to edit multiple story scripts of a complete script (such as the first story script 116a, the second story script 116b, ..., the Nth story script 116n in FIG. 2). Each story script includes multiple story elements for presenting the story content. The user can design different story scripts according to the development of the plot.

In one embodiment, the story script management module 110 is designed based on the architecture of the Entity-Relation Model of the database. Each element, role, and event of the story setting in the story script can be designed as an entity in the entity-relation model. The story script management module 110 designs different story scripts through the relationship between entities.

To facilitate understanding of the content of the story script, please refer to Figure 3. Figure 3 is a content structure diagram of the story script drawn according to an embodiment of the present case.

The story script 116 includes a story setting 261, a main story content 263, and multimedia content 265. The story setting 261 includes multiple elements and multiple characters used in the complete script. The main story content 263 includes a plot set and an event set used in the linear plot and the non-linear plot. The multimedia content 265 includes a text script, pictures, images, animations, videos, and audio. For example, the name of the complete script is "The Three Little Pigs", the elements of the story setting 261 include a thatched house, a wooden house, and a brick house, and the characters include Big Brother Pig, Second Brother Pig, and Little Brother Pig. The text scripts, pictures, images, animations, videos and audios of the multimedia content 265 are the story data and character data used in the plot of the three little pigs. In one embodiment, the robot's actions, the story scenes presented by the display, the pictures, the speech content, the background, and the voice content and sound effects played are all obtained from the multimedia content 265. In other words, this case integrates multiple different data types through a multimodal model, so that the robot combines multiple data such as text, pictures, and images to enrich the presentation of the story.

The plot set of the main story content 263 includes multiple plots and the event set includes multiple events. Each plot includes one or more story data. Each event includes one or more plot triggering conditions.

In one embodiment, the linear plot and non-linear plot of the main story content 263 can be obtained through different connection states between all nodes of the dynamic story framework. The dynamic story framework has many different forms, and with different types of nodes, the direction of the plot is more diverse.

In one embodiment, a node may be a plot node or a decision node. A plot node, for example, carries story elements related to the plot. A decision node, for example, carries plot triggering conditions related to the plot. The dynamic story framework includes multiple plot nodes or multiple plot nodes and at least one decision node.

To facilitate understanding of the dynamic story structure of this case, please refer to Figures 4(a) to 4(d). Figures 4(a) to 4(d) are node connection structure diagrams of the dynamic story structure of this case according to an embodiment. In Figures 4(a) to 4(d), the node coded P refers to the plot node, and the node coded D refers to the decision node.

The dynamic story structure 410 of FIG. 4(a) is a link sequence type. The dynamic story structure 410 takes three nodes P1, P2 and P3 as an example, and the starting node is node P1. Node P1 is connected to node P2 and node P2 is connected to node P3. This dynamic story structure is a single linear story presentation.

The dynamic story structure 420 of FIG. 4(b) is a circular link sequence type. The dynamic story structure 420 takes six nodes P1 to P6 as an example, and the starting node is node P1. Node P1 is connected to node P2, node P2 is connected to node P3, ..., node P6 is connected to node P1. This dynamic story structure is a cyclical story presentation, that is, after node P6, the plot will return to node P1.

The dynamic story structure 430 in Figure 4(c) is a tree structure. The dynamic story structure 430 starts with node P1 and is connected to node D2. Since node D2 is a decision node, the plot can branch to node P2 and node P3. Node P3 is connected to node D2. Similarly, node D2 is a decision node, and the plot can branch to node P6 and node P7.

The dynamic story framework 440 of FIG. 4(d) is a network structure. The dynamic story framework 440 is an example of 12 nodes. Node P1 is the starting node, and is connected to the next node according to the serial relationship. The next node is a plot node or a decision node to generate a divergence, and a linear plot and a non-linear plot are designed accordingly.

In one embodiment, when the narrative agent module 140 reads a plot node, the story elements of the plot node are played. When the narrative agent module 140 reads a decision node, the next node of the decision node is determined according to the user's choice and/or the content of the sensing signal. For example, the next node of the decision node D2 in FIG4(d) is node P3 or node P5, depending on the user's choice and/or the content of the sensing signal.

It is worth mentioning that the number of nodes and the connection method between nodes in Figures 4(a) to 4(d) are only examples for the description of the embodiments. The connection method of Figures 4(a) to 4(d) with the same logic can be simply changed within the scope of this case. For example, after node D2 in Figure 4(c) (i.e. after the user makes a decision), there is node P6. After node P6 is executed, it jumps to node P4 of the dynamic story framework 440 in Figure 4(d), thereby providing a flexible design of the story framework.

FIG5 is a block diagram of an interactive narrative module according to an embodiment of the present invention.

The interactive narrative module 120 includes theme settings 510, linear story lines 520, non-linear story lines 530, character settings 540, text script analyzer 550, multimedia content configurator 560 and interactive narrative scheduler 570.

Theme setting 510 is used to set the theme of the complete script, including subtitles, pictures, images, animations, videos and audio.

The linear storyline 520 and the non-linear storyline 530 are formed by using one or more designed dynamic story structures in combination with multiple story elements. The linear storyline 520 is, for example, a single linear dynamic story structure 410 as shown in FIG. 4(a), or a circular dynamic story structure 420 as shown in FIG. 4(b). The non-linear storyline 530 is, for example, a tree-structured dynamic story structure 430 as shown in FIG. 4(c) or a network-structured dynamic story structure 440 as shown in FIG. 4(d), that is, the story structure can jump out of the original linear story and branch the plot to other linear story nodes through decision nodes. In one embodiment, all story lines other than the linear storyline 520 are non-linear storylines 530.

The character settings 540 are used to set the character pictures, character animations, character voices, character emotions and character behaviors that are unique to each character in the script.

The interactive narrative module 120 associates the subtitles, pictures, images, animations, videos and audios of the theme settings and the character pictures, character animations, character voices, character emotions and character behaviors of the character settings with all the text scripts.

The text script analyzer 550 receives multiple text scripts and analyzes them for processing by the story content expressor 580.

The multimedia content configurator 560 is used to parse and configure the multimedia content used by the linear story line 520 and the non-linear story line 530 to provide the story content expressor 580 for processing.

The interactive narrative scheduler 570 is used to schedule the story elements used in the plot according to the timeline based on the nodes connected to the dynamic story framework that associates the linear story line 520 with the non-linear story line 530, so as to provide the story content expressor 580 for processing.

After the story content expressor 580 receives the parsed text script, configured multimedia content and scheduled story elements, it organizes them to obtain the story content that can be expressed.

Figure 6 shows the data format of the node according to an embodiment of the present invention.

In one embodiment, node 600 is a sheet of an XML file.

Node 600 includes multiple channels, each of which carries multimedia content corresponding to a timeline. For example, channel 611 carrying a video corresponds to video timeline 612, which is used to calibrate the time when the video is played; channel 613 carrying synthesized speech corresponds to synthesized speech timeline 614, which is used to calibrate the time when the synthesized speech is played; channel 615 carrying subtitles corresponds to subtitle timeline 616, which is used to calibrate the time when the subtitles are played; channel 617 for controlling robot actions corresponds to action timeline 618, which is used to calibrate the time when the robot actions are executed.

The video of channel 611 can be the facial expression of the character.

The content of the synthesized voice of channel 613 can be the lines narrated by the character due to the plot requirements, or the lines required for the plot narration.

The subtitles of channel 615 can be text displayed as required by the plot.

The action of channel 617 can be the coded value of the machine, which is used to control the action of the robot.

The content of the channel (unnumbered) carrying voice can be the sound or voice spoken by the character due to the plot requirements.

In one embodiment, multiple channels can be coordinated with the timeline to present multimedia content. For example, the subtitles of channel 615 can be played synchronously with the video of channel 611 and the synthesized speech of channel 613, and the mechanical movements of the robot can be displayed in conjunction with the movements of channel 617.

Figures 7(a) to 7(d) are schematic diagrams showing the interactive narrative system according to an embodiment of the present invention.

The robot includes displays 711, 721 and 781 for displaying relevant story images on the robot.

In one embodiment, as the story script progresses, the robot's display screen will show the facial expressions of different characters or environmental images. For example, the display screen of Figure 7(c) can be a segmented screen of different scenes in the scene or plot.

In another embodiment, the screen of the display 781 is when the story script advances to a decision node and stops at a selection list. After the user selects one of the items (for example, the touch display receives a sensor signal indicating that the user has selected an item), the interactive narrative system 100 will determine the next node based on the result of the selection to continue to advance the next content of the story script. For example, the screen of the display 781 is the following prompt text: "Brother Pig looks very scared and plans to:

A. Escape.

B. Pick up the weapon at hand.

C.Standing there in a daze."

Users can make selections based on the above options. Different options affect the development of the story line, allowing the story to develop in a diverse way.

In one embodiment, the robot includes arms 712 and 722. In one embodiment, as the story script progresses, the coding values of the robot's arms correspond to the movements of the arms (such as waving or clenching fists), allowing the user to be more involved in the story.

In one embodiment, the interactive narrative system of the present case can be applied to multiple electronic devices (such as the same or similar robots or IoT devices). Each electronic device is configured with a role in the complete script and performs all the aforementioned operations. The electronic device can play a role in the plot, and based on the advancement of the plot, multiple electronic devices can perform interactive demonstrations along with the plot. Take the story of "Three Little Pigs" as an example. The first electronic device plays the role of "Big Brother Pig", the second electronic device plays the role of "Second Brother Pig", the third electronic device plays the role of "Little Brother Pig", and the fourth electronic device plays the role of "Big Bad Wolf". These four electronic devices play the written story scripts and move the robots along with the story plot, combined with stage props and sound and light effects, allowing the audience to experience the enjoyment of a diversified story performance.

In summary, the interactive narrative system proposed in this case provides a simple editing interface, making programming simpler and reducing the burden on editors in creating story plots. In addition, the dynamic story structure of the interactive narrative system is a node design, which provides users with a variety of story scripts through the connection of multiple nodes, allowing users to further create large story structures and simplify the complexity of creating large story structures. Furthermore, the node is a multimodal data model architecture that integrates a large amount of data to enhance the visual and auditory richness of the narrative story. The multi-channel design of the node can also increase the flexibility of data expansion and reduction. Based on this, the interactive narrative system in this case can simplify the complexity of editing a complete story while also increasing the audience's enjoyment of a diverse and interactive storyline.

The above is only a specific example of this case, and does not limit the scope of the patent application of this case. Therefore, all equivalent changes made by applying the content of this case are also included in the scope of this case and should be stated.

100:Interactive narrative system

110: Story script management module

120:Interactive Narrative Module

130: Object integration module

140: Narrative Agent Module

Claims (10)

An interactive narrative system includes: a story script management module, including: a tab script editor, configured to edit multiple story scripts of a complete script, wherein each story script includes multiple story elements for presenting story content; an interactive narrative module, connected to the story script management module, and configured to design multiple dynamic story frameworks, the series connection between the multiple dynamic story frameworks, and each dynamic story framework corresponding to each story script, wherein each dynamic story framework includes multiple nodes with a series connection relationship, and each node is configured to include a multiple story elements for presenting story content; a plurality of story elements of the story content; an object integration module connected to the interactive narrative module and configured to receive a plurality of sensing signals from a plurality of sensors; and a narrative agent module connected to the object integration module and configured to start from one of the plurality of nodes of the plurality of dynamic story structures, follow the story line of each of the dynamic story structures to which each of the nodes belongs to play each of the story elements of each of the nodes, and determine the next node according to each of the sensing signals, so that the story script to which the next node belongs is the same as or different from the story script to which the current node belongs. An interactive narrative system as described in claim 1, wherein each node is a plot node or a decision node, and the narrative agent module is configured to play each story element of the plot node when the plot node is read, and to determine the next node of the decision node according to the content of each sensing signal when the decision node is read. An interactive narrative system as described in claim 2, wherein each of the dynamic story structures includes a plurality of the plot nodes or a plurality of the plot nodes and at least one decision node. An interactive narrative system as described in claim 1, wherein each of the story elements includes characters, settings, turning points, plots, events, themes, and multimedia content, and the multimedia content includes text scripts, pictures, images, animations, videos, and audio. An interactive narrative system as described in claim 4, wherein each of the nodes includes a plurality of channels, each of the channels carrying the multimedia content corresponding to a timeline. An interactive narrative system as described in claim 5, wherein the multiple channels are coordinated with the timeline to present the multimedia content. An interactive narrative system as described in claim 1, wherein each of the dynamic story structures is a link sequence type, a ring link sequence type, a tree structure type, or a network structure type. An interactive narrative system as described in claim 1, wherein each story script includes the story settings of the elements and characters in the complete script, a plot set and an event set for a linear plot or a non-linear plot, and a multimedia content including text scripts, pictures, images, animations, videos and audio. An interactive narrative system as described in claim 1, wherein the interactive narrative module includes theme settings, linear story lines, non-linear story lines, character settings, text script analyzer, multimedia content configurator and interactive narrative scheduler. An interactive narrative system as described in claim 1, wherein the story script management module further includes an authorization tool interface configured to provide the tab script editor with an execution environment for editing the multiple story scripts.

Images