CN109918646B - Method, system and device for judging causality of text - Google Patents
Method, system and device for judging causality of text Download PDFInfo
- Publication number
- CN109918646B CN109918646B CN201910089352.1A CN201910089352A CN109918646B CN 109918646 B CN109918646 B CN 109918646B CN 201910089352 A CN201910089352 A CN 201910089352A CN 109918646 B CN109918646 B CN 109918646B
- Authority
- CN
- China
- Prior art keywords
- target text
- causal relationship
- obj
- experience
- registration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Machine Translation (AREA)
Abstract
本发明属于自然语言处理技术领域,具体涉及一种篇章因果关系判断方法、系统、装置,旨在为了解决机器人交互中的篇章因果关系判断问题。本发明方法包括:基于语言激活模型,对输入的目标文本对中每条目标文本分别获取匹配度最高的注册事件;基于每条目标文本对应的注册事件,依据所存储的各场景中注册事件序列,计算两个注册事件的相关性;基于所述目标文本对、两个注册事件的相关性,计算所述目标文本对的因果关系。本发明可以对输入的目标文本对进行因果关系的准确判断。
The invention belongs to the technical field of natural language processing, and in particular relates to a method, system and device for judging causality of texts, and aims to solve the problem of judging causality of texts in robot interaction. The method of the invention includes: based on the language activation model, obtaining the registration event with the highest matching degree for each target text in the input target text pair; based on the registration event corresponding to each target text, according to the stored registration event sequence in each scene , calculate the correlation of the two registered events; based on the target text pair and the correlation of the two registered events, calculate the causal relationship of the target text pair. The present invention can accurately judge the causal relationship of the input target text pair.
Description
技术领域technical field
本发明属于自然语言处理技术领域,具体涉及一种篇章因果关系判断方法、系统、装置。The invention belongs to the technical field of natural language processing, and in particular relates to a method, system and device for judging causal relationship of a text.
背景技术Background technique
篇章与人们的日常交流几乎是密不可分的。人们更是会频繁使用篇章关系来表述和传达上下文之间的语义关系(例如:因果关系,递进关系,转折关系等)。同时,随着机器人逐步在人们的日常生活中扮演一个越来越重要的角色,如何让机器人理解人们的日常表达中的篇章关系成为了一个不可回避的问题。但是,这个问题的难点在于并没有一个很好的理论以及模型框架,而现有的方法又局限在文本层面并且很难获取文本内在的语义这导致现有的方法依然存在很多问题。Chapters are almost inseparable from people's daily communication. People often use discourse relations to express and convey the semantic relations between contexts (for example: causal relations, progressive relations, transition relations, etc.). At the same time, as robots gradually play an increasingly important role in people's daily life, how to make robots understand the textual relationship in people's daily expressions has become an unavoidable problem. However, the difficulty of this problem is that there is no good theory and model framework, and the existing methods are limited to the text level and it is difficult to obtain the intrinsic semantics of the text, which leads to many problems in the existing methods.
最近,在人工智能领域有研究人员提出了一种成为情景化语言学习的思路,这种思路认为“语言的语义主要来自于环境”,根据这种思路若希望机器能够理解语言,这台机器应该是可感知的,具有交互能力的,其中篇章因果关系的判断在机器人的交互中具有重要作用。Recently, some researchers in the field of artificial intelligence have proposed an idea to become contextualized language learning. This idea believes that "the semantics of language mainly comes from the environment". According to this idea, if you want a machine to understand language, the machine should It is perceptible and interactive, and the judgment of textual causality plays an important role in the interaction of robots.
发明内容SUMMARY OF THE INVENTION
为了解决现有技术中的上述问题,即为了解决机器人交互中的篇章因果关系判断问题,本发明的第一方面,提出了一种篇章因果关系判断方法,该方法包括:In order to solve the above problems in the prior art, that is, in order to solve the problem of judging the causal relationship of texts in robot interaction, the first aspect of the present invention proposes a method for judging the causal relationship of texts, and the method includes:
步骤S10,基于语言激活模型,对输入的目标文本对中每条目标文本分别获取匹配度最高的注册事件;所述目标文本对为输入两条目标文本;Step S10, based on the language activation model, obtain the registration event with the highest matching degree for each target text in the input target text pair; the target text pair is two input target texts;
步骤S20,基于每条目标文本对应的注册事件,依据所存储的各场景中注册事件序列,计算两个注册事件的相关性;所述场景中注册事件序列为基于场景结构化的经验信息构建的具有布尔时序特征的注册事件序列;Step S20, based on the registration event corresponding to each target text, according to the stored registration event sequence in each scene, calculate the correlation of the two registered events; the registered event sequence in the scene is constructed based on the empirical information of the scene structure. A sequence of registered events with Boolean timing characteristics;
步骤S30,基于所述目标文本对、步骤S20得到的两个注册事件的相关性,计算所述目标文本对的因果关系;Step S30, based on the target text pair and the correlation of the two registration events obtained in step S20, calculate the causal relationship of the target text pair;
其中,所述语言激活模型通过经验-语言激活训练语料对机器翻译模型进行训练得到;所述经验-语言激活训练语料基于机器人经验中的注册事件构建。Wherein, the language activation model is obtained by training the machine translation model through experience-language activation training corpus; the experience-language activation training corpus is constructed based on registration events in robot experience.
在一些优选实施方式中,步骤S30中“计算所述目标文本对的因果关系”,其方法为:In some preferred embodiments, in step S30, "calculate the causal relationship of the target text pair", and the method is:
fr=softmax(tanh(Wc*[s1;s2]+Wt*feat+b))f r =softmax(tanh(W c *[s 1 ; s 2 ]+W t *fea t +b))
其中,fr为因果关系概率值,包括因果关系概率、非因果关系概率;s1、s2是目标文本对中两个目标文本通过文本编码模型获得的句子向量;Wc为预设的文本向量的参数矩阵;Wt为预设的布尔时序特征的参数矩阵;b为预设的偏置量。Among them, f r is the causal relationship probability value, including causal relationship probability and non-causal relationship probability; s 1 and s 2 are the sentence vectors obtained by the text encoding model of the two target texts in the target text pair; W c is the preset text The parameter matrix of the vector; W t is the parameter matrix of the preset Boolean timing characteristics; b is the preset offset.
在一些优选实施方式中,步骤S20“计算两个注册事件的相关性”,其方法为:In some preferred embodiments, step S20 "calculates the correlation of two registration events", and the method is as follows:
其中,feat为所计算的相关性;e1、e2分别为目标文本对中第一目标文本、第二目标文本匹配到的注册事件;P(e1)为所存储全部场景结构化的经验信息中e1出现的概率;P(e2|e1)为出现e1的结构化的经验信息中e2的出现概率。Among them, fea t is the calculated correlation; e 1 , e 2 are the registration events matched by the first target text and the second target text in the target text pair, respectively; P(e 1 ) is the stored structure of all scenes The probability of e 1 appearing in empirical information; P(e 2 |e 1 ) is the appearance probability of e 2 in the structured empirical information of e 1 .
在一些优选实施方式中,所述注册事件,In some preferred embodiments, the registration event,
ei={obji},i∈Ri e i ={obj i }, i∈R i
其中,ei为第i个注册事件;obji为该注册事件中处于激活状态的对象;Ri为该注册事件中的对象符号在语言激活模型全部对象的编号。Among them, e i is the ith registration event; obj i is the object in the active state in the registration event; R i is the number of all objects in the language activation model of the object symbol in the registration event.
在一些优选实施方式中,所述经验-语言激活训练语料,其表达式为In some preferred embodiments, the experience-linguistic activation training corpus is expressed as
Ej={obji}:{LSi},i∈Ri E j = {obj i }: {LS i }, i∈R i
其中,Ej为第j个经验-语言激活训练语料;LSi为对象obji对应的语言字符。Among them, E j is the jth experience-language activation training corpus; LS i is the language character corresponding to the object obj i .
在一些优选实施方式中,步骤S20所述各场景中注册事件序列,其获取方法包括:In some preferred embodiments, the sequence of events registered in each scenario described in step S20, the acquisition method thereof includes:
步骤A10,在机器人的工作环境中,通过机器人自身的感知装置获取的机器人与对象交互得到的对象信息;所述对象信息包括机器人与对象交互得到的对象属性、对象状态信息;Step A10, in the working environment of the robot, the object information obtained by the interaction between the robot and the object obtained by the robot's own sensing device; the object information includes the object attribute and object state information obtained by the interaction between the robot and the object;
步骤A20,对步骤A10中获取的对象信息进行结构化处理,并按照时间顺序进行组织和存储,作为机器人的运行工作环境得到的结构化的经验信息。In step A20, the object information obtained in step A10 is subjected to structured processing, and is organized and stored in chronological order, as structured experience information obtained from the operating working environment of the robot.
步骤A30,去除所述结构化的经验信息中处于未激活状态的对象,得到对应场景中注册事件序列。Step A30, remove the objects in the inactive state in the structured experience information, and obtain the registration event sequence in the corresponding scene.
在一些优选实施方式中,所述结构化的经验信息,其表达式为In some preferred embodiments, the structured empirical information is expressed as
E0-t={f0,f1,f2,…,ft}E 0-t ={f 0 ,f 1 ,f 2 ,...,f t }
ft={obj1:a1;…obji:ai;…objn:an;}f t ={obj 1 :a 1 ;...obj i :a i ;...obj n :a n ;}
其中,E0-t为从0时刻到t时刻的所有经验;ft为第t时刻输入的所有对象信息;obji为第i个对象,ai为对象obji的激活状态,ai=1时表示第i个对象被激活,ai=0时表示第i个对象未被激活,i∈[1,n]。Among them, E 0-t is all experience from time 0 to time t; f t is all object information input at time t; obj i is the ith object, a i is the activation state of object obj i , a i = When it is 1, it means that the ith object is activated, and when a i =0, it means that the ith object is not activated, i∈[1,n].
本发明的第二方面,提出了一种篇章因果关系判断系统,该系统包括注册事件匹配模块、相关性计算模块、因果关系计算模块;In a second aspect of the present invention, a system for judging a causal relationship of a text is proposed, which includes a registration event matching module, a correlation computing module, and a causal relationship computing module;
所述注册事件匹配模块,配置为基于语言激活模型,对输入的目标文本对中每条目标文本分别获取匹配度最高的注册事件;所述目标文本对为输入两条目标文本;The registration event matching module is configured to obtain the registration event with the highest matching degree for each target text in the input target text pair based on the language activation model; the target text pair is two input target texts;
所述相关性计算模块,配置为基于每条目标文本对应的注册事件,依据所存储的各场景中注册事件序列,计算两个注册事件的相关性;所述场景中注册事件序列为基于场景结构化的经验信息构建的具有布尔时序特征的注册事件序列;The correlation calculation module is configured to calculate the correlation of two registered events based on the registered event corresponding to each target text and according to the stored registered event sequence in each scene; the registered event sequence in the scene is based on the scene structure A registration event sequence with Boolean timing characteristics constructed from the transformed empirical information;
所述因果关系计算模块,配置为基于所述目标文本对、步骤S20得到的两个注册事件的相关性,计算所述目标文本对的因果关系;The causal relationship calculation module is configured to calculate the causal relationship of the target text pair based on the target text pair and the correlation of the two registered events obtained in step S20;
其中,所述语言激活模型通过经验-语言激活训练语料对机器翻译模型进行训练得到;所述经验-语言激活训练语料基于机器人经验中的注册事件构建。Wherein, the language activation model is obtained by training the machine translation model through experience-language activation training corpus; the experience-language activation training corpus is constructed based on registration events in robot experience.
本发明第三方面,提出了一种存储装置,其中存储有多条程序,所述程序适于由处理器加载并执行以实现上述篇章因果关系判断方法。In a third aspect of the present invention, a storage device is provided, in which a plurality of programs are stored, and the programs are adapted to be loaded and executed by a processor to realize the above-mentioned method for judging the causality of a chapter.
本发明的第四方面,提出了一种处理装置,包括处理器、存储装置;处理器,适于执行各条程序;存储装置,适于存储多条程序;所述程序适于由处理器加载并执行以实现上述篇章因果关系判断方法。In a fourth aspect of the present invention, a processing device is provided, including a processor and a storage device; the processor is adapted to execute various programs; the storage device is adapted to store multiple programs; the programs are adapted to be loaded by the processor And execute it to realize the above article causality judgment method.
本发明的有益效果:Beneficial effects of the present invention:
通过本发明中场景的注册事件序列进行相关性计算,并进一步结合目标文本对的注册事件,进行目标文本对的因果关系计算,可以得到准确的因果关系判断结果。An accurate causal relationship judgment result can be obtained by performing correlation calculation through the registration event sequence of the scene in the present invention, and further combining the registration events of the target text pair to perform the causal relationship calculation of the target text pair.
附图说明Description of drawings
通过阅读参照以下附图所作的对非限制性实施例所作的详细描述,本申请的其它特征、目的和优点将会变得更明显:Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:
图1是本发明一种实施例的篇章因果关系判断方法流程示意图;1 is a schematic flowchart of a method for judging a causal relationship of a text according to an embodiment of the present invention;
图2是本发明一种实施例的篇章因果关系判断示例。FIG. 2 is an example of judging the causal relationship of a text according to an embodiment of the present invention.
具体实施方式Detailed ways
为使本发明的目的、技术方案和优点更加清楚,下面将结合附图对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the objectives, technical solutions and advantages of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not All examples. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
下面结合附图和实施例对本申请作进一步的详细说明。可以理解的是,此处所描述的具体实施例仅仅用于解释相关发明,而非对该发明的限定。另外还需要说明的是,为了便于描述,附图中仅示出了与有关发明相关的部分。The present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the related invention, but not to limit the invention. In addition, it should be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings.
需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。It should be noted that the embodiments in the present application and the features of the embodiments may be combined with each other in the case of no conflict.
本发明的基本思想是利用机器人工作平台的信号输入,针对机器人构建固化网络,再利用深度神经网络技术实现对文本语义更好地建模以达到最后因果关系判断的目的。The basic idea of the invention is to use the signal input of the robot working platform to build a solidified network for the robot, and then use the deep neural network technology to achieve better modeling of text semantics to achieve the purpose of final causal relationship judgment.
本发明的一种篇章因果关系判断方法,如图1所示,该方法包括:A method for judging the causal relationship of a text of the present invention, as shown in Figure 1, the method includes:
步骤S10,基于语言激活模型,对输入的目标文本对中每条目标文本分别获取匹配度最高的注册事件;所述目标文本对为输入两条目标文本;Step S10, based on the language activation model, obtain the registration event with the highest matching degree for each target text in the input target text pair; the target text pair is two input target texts;
步骤S20,基于每条目标文本对应的注册事件,依据所存储的各场景中注册事件序列,计算两个注册事件的相关性;所述场景中注册事件序列为基于场景结构化的经验信息构建的具有布尔时序特征的注册事件序列;Step S20, based on the registration event corresponding to each target text, according to the stored registration event sequence in each scene, calculate the correlation of the two registered events; the registered event sequence in the scene is constructed based on the empirical information of the scene structure. A sequence of registered events with Boolean timing characteristics;
步骤S30,基于所述目标文本对、步骤S20得到的两个注册事件的相关性,计算所述目标文本对的因果关系;Step S30, based on the target text pair and the correlation of the two registration events obtained in step S20, calculate the causal relationship of the target text pair;
其中,所述语言激活模型通过经验-语言激活训练语料对机器翻译模型进行训练得到;所述经验-语言激活训练语料基于机器人经验中的注册事件构建。Wherein, the language activation model is obtained by training the machine translation model through experience-language activation training corpus; the experience-language activation training corpus is constructed based on registration events in robot experience.
为了更清晰地对本发明篇章因果关系判断方法进行说明,下面分别从三个方面进行性展开详述:1、各场景中注册事件序列的构建;2、语言激活模型的构建;3、篇章因果关系判断。In order to more clearly describe the method for judging the causality of the text of the present invention, the following is a detailed description from three aspects: 1. The construction of the registered event sequence in each scene; 2. The construction of the language activation model; 3. The textual causality judge.
1、各场景中注册事件序列的构建1. Construction of registered event sequences in each scene
步骤A10,在机器人的工作环境中,通过机器人自身的感知装置获取的机器人与对象交互得到的对象信息;所述对象信息包括机器人与对象交互得到的对象属性、对象状态信息。In step A10, in the working environment of the robot, the object information obtained by the interaction between the robot and the object obtained by the robot's own perception device; the object information includes object attributes and object state information obtained by the interaction between the robot and the object.
将机器人放置于工作环境中,利用机器人的感知装置接收环境中的信号(即机器人与对象交互得到的对象信息)。通过机器人在工作环境中的不断交互动作,不断更新的获取的信息。例如,在场景中,有大量的对象与机器人进行交互。这些对象本身就具有属性,同时这些属性具有对应的状态。特别是,机器人与对象进行交互之后,对象的状态就会发生变化。机器人则需要感知这些属性以及状态来获得这些对象的信息。如机器人面的对象“牛”的属性和状态被显示表现出来,该对象记为obj2,name=cow)。The robot is placed in the working environment, and the sensing device of the robot is used to receive the signals in the environment (that is, the object information obtained by the interaction between the robot and the object). The information obtained is continuously updated through the continuous interaction of the robot in the working environment. For example, in a scene, there are a large number of objects interacting with the robot. These objects themselves have properties, and these properties have corresponding states. In particular, after the robot interacts with the object, the state of the object changes. Robots need to perceive these properties and states to obtain information about these objects. For example, the attributes and states of the object "cow" on the robot face are displayed, and the object is denoted as obj2, with name=cow).
步骤A20,对步骤A10中获取的对象信息进行结构化处理,并按照时间顺序进行组织和存储,作为机器人的运行工作环境得到的结构化的经验信息。In step A20, the object information obtained in step A10 is subjected to structured processing, and is organized and stored in chronological order, as structured experience information obtained from the operating working environment of the robot.
将来自步骤A10的机器人与对象交互得到的对象信息存储在机器人的长期记忆中。其具体的实施方法为:机器人将这些收集到的对象属性状态信息存储在长期记忆中。在长期记忆中,我们为不同的对象的属性以及状态保留了相应的布尔型结点。The object information obtained from the interaction between the robot and the object from step A10 is stored in the long-term memory of the robot. The specific implementation method is as follows: the robot stores the collected object attribute state information in the long-term memory. In long-term memory, we keep corresponding boolean nodes for the properties and states of different objects.
结构化过程将这些信号进行结构化处理并保存;具体实施方案为:在机器人内部为这些信息布尔型结点保留结构点,以保存信息。并且,这些信息将按照时间顺序进行组织并保存下来。也就是说,令一个时刻t的输入为ft,那么结构化的经验信息的表达式为:In the structuring process, these signals are processed and stored in a structured manner; the specific implementation is as follows: structure points are reserved for these information Boolean nodes inside the robot, so as to save the information. And, the information will be organized and saved in chronological order. That is to say, let the input of a time t be f t , then the expression of structured empirical information is:
E0-t={f0,f1,f2,…,ft}E 0-t ={f 0 ,f 1 ,f 2 ,...,f t }
其中,E0-t为从0时刻到t时刻的所有经验;ft为第t时刻输入的所有对象信息(属性,状态)。Among them, E 0-t is all experience from time 0 to time t; f t is all the object information (attribute, state) input at time t.
同时,每一个时刻的经验中,包含了所有对象的激活信息(通过布尔值表示),其形式表达式子为:At the same time, the experience at each moment contains the activation information of all objects (represented by Boolean values), and its formal expression is:
ft={obj1:a1;…obji:ai;…objn:an}f t ={obj 1 :a 1 ;...obj i :a i ;...obj n :a n }
其中,obji为第i个对象,ai为对象obji的激活状态,ai=1时表示第i个对象被激活,ai=0时表示第i个对象未被激活,i∈[1,n]。Among them, obj i is the ith object, a i is the activation state of the object obj i , when a i = 1, it means that the ith object is activated, when a i = 0, it means that the ith object is not activated, i∈[ 1,n].
例如,第5时刻下f5={obj1:0;obj2:1;obj3:1;obj4:1},则表示该时刻所有对象中obj2、obj3、obj4处于激活状态,obj1处于非激活状态。For example, at the fifth moment f 5 ={obj 1 :0;obj 2 :1;obj 3 :1;obj 4 :1}, it means that obj 2 , obj 3 , and obj 4 in all objects at this moment are in the active state, obj 1 is inactive.
步骤A30,去除所述结构化的经验信息中处于未激活状态的对象,得到对应场景中注册事件序列。Step A30, remove the objects in the inactive state in the structured experience information, and obtain the registration event sequence in the corresponding scene.
例如,上述的f5,其对应的该场景中注册序列为T5={obj2;obj3;obj4;}。For example, for the above f 5 , the corresponding registration sequence in the scene is T 5 ={obj 2 ; obj 3 ; obj 4 ;}.
2、语言激活模型的构建。2. The construction of language activation model.
(1)构造机器人经验中的注册事件。(1) Construct the registration event in the robot experience.
根据机器人的经验,这些对象表现为一个布尔值的状态,如果机器人在工作环境中接受到了相应的信号,那么相应的对象就会被激活。当属于一个事件的对象都被激活的情况下,这个事件就是一个被激活的状态。其中,注册事件表达式为:According to the experience of the robot, these objects represent a state of a boolean value, and if the robot receives the corresponding signal in the working environment, the corresponding object will be activated. An event is an activated state when all objects belonging to it are activated. Among them, the registration event expression is:
ei={obji},i∈Ri e i ={obj i }, i∈R i
其中,ei为第i个注册事件;obji为该注册事件中处于激活状态的对象;Ri为该注册事件中的对象符号在语言激活模型全部对象的编号。Among them, e i is the ith registration event; obj i is the object in the active state in the registration event; R i is the number of all objects in the language activation model of the object symbol in the registration event.
例如,基于上述的f5得到的注册事件为e5={obj2;obj3;obj4},此时Ri=[2,3,4]。当e5被激活时,可以表示为e5:1={obj2:1;obj3:1;obj4:1;}。For example, the registration event obtained based on the above f 5 is e 5 ={obj 2 ; obj 3 ; obj 4 }, at this time R i =[2,3,4]. When e5 is activated, it can be expressed as e5:1={obj2: 1 ;obj3: 1 ; obj4 : 1 ;}.
(2)基于所构造的注册事件,构造经验-语言激活训练语料。(2) Based on the constructed registration events, construct an experience-language activation training corpus.
该步骤可以看做一个符号翻译过程,因此,训练语料形式为平行语料。具体将其操作为:另经验内部对象固化为一个符号序列,例如,obj15=Obj_15。当文本提及的内容与这个符号有关时,这个符号以及相关的概念则会被激活。例如,在我们实际的实验中,obj15(即Obj_15)表示的就是中文中的“牛”,以及英语中的“cow”。该步骤构建一个这样的语言符号对应经验内部符号的平行语料,如下所示:This step can be regarded as a symbol translation process, therefore, the training corpus is in the form of parallel corpus. Specifically, the operation is as follows: another internal object of experience is solidified into a sequence of symbols, for example, obj 15 =Obj_15. When the text refers to the symbol, the symbol and related concepts are activated. For example, in our actual experiment, obj 15 (ie Obj_15) means "cow" in Chinese and "cow" in English. This step constructs a parallel corpus of such linguistic symbols corresponding to empirical internal symbols, as follows:
Ej={obji}:{LSi},i∈Ri E j = {obj i }: {LS i }, i∈R i
其中,Ej为第j个经验-语言激活训练语料;LSi为对象obj对应的语言字符。Among them, E j is the jth experience-language activation training corpus; LS i is the language character corresponding to the object obj j .
例如,若对象obj2、obj5、obj15分别对应的语言字符为Adam、attack、cow,则该训练语聊可以表示为For example, if the language characters corresponding to the objects obj 2 , obj 5 , and obj 15 are Adam, attack, and cow, respectively, the training language chat can be expressed as
obj2,obj5,obj15∶Adam attack cowobj 2 , obj 5 , obj 15 : Adam attack cow
(3)通过经验-语言激活训练语料对机器翻译模型进行训练得到语言激活模型。(3) The language activation model is obtained by training the machine translation model through the experience-language activation training corpus.
根据经验-语言激活训练语料,训练基于机器翻译模型。本实施例中采用了序列到序列的神经网络机器翻译模型,当然,还可以采用其他机器翻译模型。According to the experience-language activation training corpus, the training is based on the machine translation model. In this embodiment, a sequence-to-sequence neural network machine translation model is used, of course, other machine translation models may also be used.
3、篇章因果关系判断3. Discourse causality judgment
步骤S10,基于语言激活模型,对输入的目标文本对中每条目标文本分别获取匹配度最高的注册事件;所述目标文本对为输入两条目标文本。Step S10, based on the language activation model, obtain the registration event with the highest matching degree for each target text in the input target text pair; the target text pair is two input target texts.
上面已经详细描述了语言激活模型的构建过程,此处可以直接通过改模型获取对应的注册事件,下面可以对该模型处理文本的关键过程进行展示。The construction process of the language activation model has been described in detail above. Here, the corresponding registration event can be obtained directly by changing the model. The key process of text processing by the model can be shown below.
(1)通过语言激活模型将输入的文本翻译成注册事件的符号序列,即机器人内部的注册事件中所包含的对象符号。其公式如下所示:(1) Translate the input text into the symbol sequence of the registration event through the language activation model, that is, the object symbol contained in the registration event inside the robot. Its formula is as follows:
y1,y2,y3,…,yj=P(yi|x1,x2,x3,…,xn)y 1 , y 2 , y 3 ,...,y j =P(y i |x 1 ,x 2 ,x 3 ,...,x n )
其中,y1,y2,y3,…,yj为对象符号序列;x1,x2,x3,…,xn为语言符号序列;P(yi|x1,x2,x3,…,xn)为根据语言符号序列对对象符号进行解码(即翻译)。Among them, y 1 , y 2 , y 3 ,…,y j is the object symbol sequence; x 1 ,x 2 ,x 3 ,…,x n is the language symbol sequence; P(y i |x 1 ,x 2 ,x 3 ,...,x n ) is to decode (ie translate) the object symbols according to the language symbol sequence.
在一些实施例中,可以为语言端和经验符号端分别构造了两个词向量集合Embl和Embe。In some embodiments, two word vector sets Embl and Embe may be constructed for the linguistic side and the empirical symbol side, respectively.
(2)语言激活模型根据输入的目标文本激活机器人相应的经验信息。根据翻译得到的对象符号序列,对所有机器人内部所保存的注册事件进行匹配,挑选匹配度最高的事件作为被激活的事件。其中,可以采用一个长短时记忆模型LSTM来作为符号序列向量生成的工具来生成对象符号的序列向量,如下式所示(2) The language activation model activates the corresponding experience information of the robot according to the input target text. According to the translated object symbol sequence, all registered events stored in the robot are matched, and the event with the highest matching degree is selected as the activated event. Among them, a long and short-term memory model LSTM can be used as a tool for generating symbol sequence vectors to generate sequence vectors of object symbols, as shown in the following formula
LSTM(Embe[obj1],Embe[obj2],…,Embe[obj])=ve LSTM(Emb e [obj 1 ],Emb e [obj 2 ],...,Emb e [obj 1 ]) = ve
然后,根据向量的余弦相似度来获取最高匹配度的事件。Then, based on the cosine similarity of the vectors, the event with the highest matching degree is obtained.
其中,ve为目标文本翻译后的对象符号序列通过LSTM网络和Embe得到的向量;vi为语言激活模型中第i个注册事件通过LSTM网络和Embe得到的向量;sim(vi,ve)为这两个向量之间的余弦相似度。Among them, v e is the vector obtained by the LSTM network and Emb e of the object symbol sequence after translation of the target text; v i is the vector obtained by the ith registration event in the language activation model through the LSTM network and Emb e ; sim(vi , v e ) is the cosine similarity between these two vectors.
选择余弦相似度最高的注册事件作为激活事件,即输入目标文本对应的注册事件。The registration event with the highest cosine similarity is selected as the activation event, that is, the registration event corresponding to the input target text.
步骤S20,基于每条目标文本对应的注册事件,依据所存储的各场景中注册事件序列,计算两个注册事件的相关性;所述场景中注册事件序列为基于场景结构化的经验信息构建的具有布尔时序特征的注册事件序列。Step S20, based on the registration event corresponding to each target text, according to the stored registration event sequence in each scene, calculate the correlation of the two registered events; the registered event sequence in the scene is constructed based on the empirical information of the scene structure. A sequence of registered events with Boolean timing characteristics.
去除所述结构化的经验信息中处于未激活状态的对象,得到对应场景中注册事件序列Remove the objects in the inactive state in the structured experience information, and obtain the registered event sequence in the corresponding scene
在进行因果关系判断的时候,每一次输入的句子为两个,因此,我们需要一次性寻找两个注册事件。同时根据得到的事件e1、e2,需要在机器人所存储的各场景中注册事件序列中得到这两个事件的相应的布尔时序特征,从而计算两个注册事件的相关性。When judging causality, there are two sentences entered each time. Therefore, we need to find two registration events at one time. At the same time, according to the obtained events e 1 , e 2 , it is necessary to obtain the corresponding Boolean timing characteristics of the two events in the sequence of registered events in each scene stored by the robot, so as to calculate the correlation of the two registered events.
两个注册事件的相关性的计算方法为:The correlation of two registered events is calculated as:
其中,feat为所计算的相关性;e1、e2分别为目标文本对中第一目标文本、第二目标文本匹配到的注册事件;P(e1)为所存储全部场景结构化的经验信息中e1出现的概率;P(e2|e1)为出现e1的结构化的经验信息中e2的出现概率。Among them, fea t is the calculated correlation; e 1 , e 2 are the registration events matched by the first target text and the second target text in the target text pair, respectively; P(e 1 ) is the structure of all the stored scenes The probability of e 1 appearing in empirical information; P(e 2 |e 1 ) is the appearance probability of e 2 in the structured empirical information of e 1 .
步骤S30,基于所述目标文本对、步骤S20得到的两个注册事件的相关性,计算所述目标文本对的因果关系。Step S30: Calculate the causal relationship of the target text pair based on the target text pair and the correlation between the two registered events obtained in step S20.
计算所述目标文本对的因果关系的方法为:The method for calculating the causal relationship of the target text pair is:
fr=softmax(tanh(Wc*[s1;s2]+Wt*feat+b))f r =softmax(tanh(W c *[s 1 ; s 2 ]+W t *fea t +b))
其中,fr为因果关系概率值,包括因果关系概率Cause、非因果关系概率Non-Cause;s1、s2是目标文本对中两个目标文本通过文本编码模型获得的句子向量;Wc为预设的文本向量的参数矩阵;Wt为预设的布尔时序特征的参数矩阵;b为预设的偏置量。Among them, f r is the causal relationship probability value, including the causal relationship probability Cause and the non-causal relationship probability Non-Cause; s 1 and s 2 are the sentence vectors obtained by the two target texts in the target text pair through the text encoding model; W c is The parameter matrix of the preset text vector; W t is the parameter matrix of the preset Boolean time series feature; b is the preset offset.
本实施例中采用softmax的分类模型,softmax函数会输出二类分类中两种分类的概率值,取最大的作为输出。比如:softmax会输出一个概率值Cause:0.7、Non-Cause:0.3,这时我们选Cause作为输出。In this embodiment, the classification model of softmax is used, and the softmax function will output the probability values of the two classifications in the two-class classification, and take the largest one as the output. For example: softmax will output a probability value Cause: 0.7, Non-Cause: 0.3, then we choose Cause as the output.
文本编码模型可以采用LSTM(长短时记忆模型)、BOW(基于词向量的平均值词袋模型)、CNN(卷积神经网络模型),还可以采用其他模型。The text encoding model can use LSTM (Long Short Term Memory Model), BOW (Bag of Words Model Based on Word Vectors), CNN (Convolutional Neural Network Model), and other models.
如图2所示,该示例输入的目标文本对为S1:Adam attacks the cow with sword,S2:and Adam gains some beef。在Part1中通过语言激活模型获取所述的目标文本对的注册事件e1:Adam attacks cow sword,e2:Adam gains some beef。在Part2中,基于各场景中机器人接受到的感知信号序列(S加数字表述的是第i个场景,每一个场景由很多连续的时刻组成,例如T9-T10-T11等,每一个时刻中包含了大量的事件),寻找到e1在场景S87、S72中出现、e2在场景S54、S87、S72中出现,并在图中通过箭头定位到出现的那个时刻(即事件定位到机器人记忆中的感知信号序列中),e1定位到场景S87的时刻T0、S72的时刻T1,e2定位到场景S54的时刻T11、S87的时刻T2、S72的时刻T3,并计算两个注册事件的相关性;在Part3分别对目标文本S1、S2进行文本编码得到句子向量;在Part4基于Part2得到的相关性、Part3得到的两个句子向量进行因果判断,并输出判断结果。As shown in Figure 2, the target text pair input in this example is S1: Adam attacks the cow with sword, S2: and Adam gains some beef. In Part1, the registration events e1: Adam attacks cow sword, e2: Adam gains some beef are obtained through the language activation model. In Part2, based on the perception signal sequence received by the robot in each scene (S plus a number represents the ith scene, each scene consists of many consecutive moments, such as T9-T10-T11, etc., each moment contains A large number of events), find that e1 appears in scenes S87, S72, and e2 appears in scenes S54, S87, S72, and locate the moment of appearance by arrows in the figure (that is, the event locates the perception in the robot's memory In the signal sequence), e1 is located at time T0 of scene S87, time T1 of S72, e2 is located to time T11 of scene S54, time T2 of S87, time T3 of S72, and calculate the correlation of the two registered events; in Part3 Perform text encoding on the target texts S1 and S2 respectively to obtain sentence vectors; in Part4, perform causal judgment based on the correlation obtained in Part2 and the two sentence vectors obtained in Part3, and output the judgment result.
本发明代码实现可以采用python编程语言以及TensorFlow深度学习框架实现完成,开发平台是Ubuntu Linux 16.04。同时,本发明也可以依赖微软发布的通用人工智能平台Malmo作为机器人的工作环境。由于所写程序没有用到任何平台相关的代码,因此所述的系统实现也可以运行于Windows操作系统上。The code realization of the present invention can be realized by using the python programming language and the TensorFlow deep learning framework, and the development platform is Ubuntu Linux 16.04. At the same time, the present invention can also rely on the general artificial intelligence platform Malmo released by Microsoft as the working environment of the robot. Since the written program does not use any platform-dependent code, the described system implementation can also run on the Windows operating system.
本发明一种实施例的篇章因果关系判断系统,该系统包括注册事件匹配模块、相关性计算模块、因果关系计算模块;A text causality judgment system according to an embodiment of the present invention includes a registration event matching module, a correlation calculation module, and a causal relationship calculation module;
所述注册事件匹配模块,配置为基于语言激活模型,对输入的目标文本对中每条目标文本分别获取匹配度最高的注册事件;所述目标文本对为输入两条目标文本;The registration event matching module is configured to obtain the registration event with the highest matching degree for each target text in the input target text pair based on the language activation model; the target text pair is two input target texts;
所述相关性计算模块,配置为基于每条目标文本对应的注册事件,依据所存储的各场景中注册事件序列,计算两个注册事件的相关性;所述场景中注册事件序列为基于场景结构化的经验信息构建的具有布尔时序特征的注册事件序列;The correlation calculation module is configured to calculate the correlation of two registered events based on the registered event corresponding to each target text and according to the stored registered event sequence in each scene; the registered event sequence in the scene is based on the scene structure A registration event sequence with Boolean timing characteristics constructed from the transformed empirical information;
所述因果关系计算模块,配置为基于所述目标文本对、步骤S20得到的两个注册事件的相关性,计算所述目标文本对的因果关系;The causal relationship calculation module is configured to calculate the causal relationship of the target text pair based on the target text pair and the correlation of the two registered events obtained in step S20;
其中,所述语言激活模型通过经验-语言激活训练语料对机器翻译模型进行训练得到;所述经验-语言激活训练语料基于机器人经验中的注册事件构建。Wherein, the language activation model is obtained by training the machine translation model through experience-language activation training corpus; the experience-language activation training corpus is constructed based on registration events in robot experience.
所属技术领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统的具体工作过程及有关说明,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that, for the convenience and brevity of description, for the specific working process and related description of the system described above, reference may be made to the corresponding process in the foregoing method embodiments, which will not be repeated here.
需要说明的是,上述实施例提供的篇章因果关系判断系统,仅以上述各功能模块的划分进行举例说明,在实际应用中,可以根据需要而将上述功能分配由不同的功能模块来完成,即将本发明实施例中的模块或者步骤再分解或者组合,例如,上述实施例的模块可以合并为一个模块,也可以进一步拆分成多个子模块,以完成以上描述的全部或者部分功能。对于本发明实施例中涉及的模块、步骤的名称,仅仅是为了区分各个模块或者步骤,不视为对本发明的不当限定。It should be noted that, the system for judging the causality of the text provided by the above-mentioned embodiment is only illustrated by the division of the above-mentioned functional modules. The modules or steps in the embodiments of the present invention are further decomposed or combined. For example, the modules in the above embodiments may be combined into one module, or may be further split into multiple sub-modules to complete all or part of the functions described above. The names of the modules and steps involved in the embodiments of the present invention are only for distinguishing each module or step, and should not be regarded as an improper limitation of the present invention.
本发明一种实施例的存储装置,其中存储有多条程序,所述程序适于由处理器加载并执行以实现上述篇章因果关系判断方法。In the storage device according to an embodiment of the present invention, a plurality of programs are stored therein, and the programs are adapted to be loaded and executed by a processor to implement the above-mentioned method for judging the causal relationship of a chapter.
本发明一种实施例的处理装置,包括处理器、存储装置;处理器,适于执行各条程序;存储装置,适于存储多条程序;所述程序适于由处理器加载并执行以实现上述篇章因果关系判断方法。A processing device according to an embodiment of the present invention includes a processor and a storage device; the processor is adapted to execute various programs; the storage device is adapted to store multiple programs; the programs are adapted to be loaded and executed by the processor to realize The above chapter causality judgment method.
所属技术领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的存储装置、处理装置的具体工作过程及有关说明,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process and relevant description of the storage device and processing device described above can refer to the corresponding process in the foregoing method embodiments, which is not repeated here. Repeat.
实验验证:Experimental verification:
在实验中所构造的训练语料中,每一个例子都是由两个句子组成,每一个句子描述的都是一个单独的事件。通过在这个语料上进行训练,将本发明方法与传统的基于纯文本的方法进行对比。表格1为本实验所构造的篇章因果关系的语料基本统计情况。In the training corpus constructed in the experiments, each example consists of two sentences, each describing a separate event. By training on this corpus, the method of the present invention is compared with traditional plain text-based methods. Table 1 shows the basic statistics of the corpus of textual causality constructed in this experiment.
附表1
附表2给出了本发明与几种现有篇章因果关系判别方法的结果。其中,在表格的上半部分表达的是目前主流的三种处理句子信息的神经网络方法(BOW,CNN,LSTM)。实验将两个句子作为输入,考察目标模型是否有能力判别这个句对是否是因果关系。可以看到本发明(Our model)在数据集上的表现要明显好于传统文本方法,其中表2中Model+BOW、Model+CNN、Model+LSTM分别表示本发明方法的步骤S30中采用BOW、CNN、LSTM文本编码模型。Attached table 2 presents the results of the present invention and several existing methods for discriminating the causal relationship of the chapters. Among them, the upper part of the table expresses the three current mainstream neural network methods (BOW, CNN, LSTM) for processing sentence information. The experiment takes two sentences as input and examines whether the target model has the ability to discriminate whether the sentence pair is a causal relationship. It can be seen that the performance of the present invention (Our model) on the data set is significantly better than that of the traditional text method, wherein Model+BOW, Model+CNN, Model+LSTM in Table 2 respectively indicate that BOW, CNN, LSTM text encoding model.
与传统文本方法具有的明显区别是,本发明使用了从机器人平台中收集到的经验信息。这个过程与人类非常类似,因此本发明的关键在于提出了一种区别于传统思路的新的方法,它强调了与文本相关的经验的重要性。A distinct difference from traditional textual methods is that the present invention uses empirical information gathered from a robotic platform. This process is very similar to that of humans, so the key to the present invention is to propose a new method that is different from traditional thinking, which emphasizes the importance of text-related experience.
附表2
本领域技术人员应该能够意识到,结合本文中所公开的实施例描述的各示例的模块、方法步骤,能够以电子硬件、计算机软件或者二者的结合来实现,软件模块、方法步骤对应的程序可以置于随机存储器(RAM)、内存、只读存储器(ROM)、电可编程ROM、电可擦除可编程ROM、寄存器、硬盘、可移动磁盘、CD-ROM、或技术领域内所公知的任意其它形式的存储介质中。为了清楚地说明电子硬件和软件的可互换性,在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以电子硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。本领域技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明的范围。Those skilled in the art should be aware that the modules and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software or a combination of the two, and the programs corresponding to the software modules and method steps Can be placed in random access memory (RAM), internal memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or as known in the art in any other form of storage medium. In order to clearly illustrate the interchangeability of electronic hardware and software, the components and steps of each example have been described generally in terms of functionality in the foregoing description. Whether these functions are performed in electronic hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may use different methods of implementing the described functionality for each particular application, but such implementations should not be considered beyond the scope of the present invention.
术语“第一”、“第二”等是用于区别类似的对象,而不是用于描述或表示特定的顺序或先后次序。The terms "first," "second," etc. are used to distinguish between similar objects, and are not used to describe or indicate a particular order or sequence.
术语“包括”或者任何其它类似用语旨在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备/装置不仅包括那些要素,而且还包括没有明确列出的其它要素,或者还包括这些过程、方法、物品或者设备/装置所固有的要素。The term "comprising" or any other similar term is intended to encompass a non-exclusive inclusion such that a process, method, article or device/means comprising a list of elements includes not only those elements but also other elements not expressly listed, or Also included are elements inherent to these processes, methods, articles or devices/devices.
至此,已经结合附图所示的优选实施方式描述了本发明的技术方案,但是,本领域技术人员容易理解的是,本发明的保护范围显然不局限于这些具体实施方式。在不偏离本发明的原理的前提下,本领域技术人员可以对相关技术特征作出等同的更改或替换,这些更改或替换之后的技术方案都将落入本发明的保护范围之内。So far, the technical solutions of the present invention have been described with reference to the preferred embodiments shown in the accompanying drawings, however, those skilled in the art can easily understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910089352.1A CN109918646B (en) | 2019-01-30 | 2019-01-30 | Method, system and device for judging causality of text |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910089352.1A CN109918646B (en) | 2019-01-30 | 2019-01-30 | Method, system and device for judging causality of text |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109918646A CN109918646A (en) | 2019-06-21 |
CN109918646B true CN109918646B (en) | 2020-08-11 |
Family
ID=66961026
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910089352.1A Active CN109918646B (en) | 2019-01-30 | 2019-01-30 | Method, system and device for judging causality of text |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109918646B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113408730B (en) * | 2020-03-17 | 2024-04-26 | 北京达佳互联信息技术有限公司 | Causal relationship generation method and device and electronic equipment |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6993535B2 (en) * | 2001-06-18 | 2006-01-31 | International Business Machines Corporation | Business method and apparatus for employing induced multimedia classifiers based on unified representation of features reflecting disparate modalities |
US7685099B2 (en) * | 2007-06-28 | 2010-03-23 | Microsoft Corporation | Forecasting time-independent search queries |
US8793715B1 (en) * | 2007-12-18 | 2014-07-29 | The Nielsen Company (Us), Llc | Identifying key media events and modeling causal relationships between key events and reported feelings |
CN104298225A (en) * | 2014-09-25 | 2015-01-21 | 中国石油化工股份有限公司 | Modeling and graphical displaying method for causal relationship reasoning model of unusual working conditions of chemical process |
CN104462229A (en) * | 2014-11-13 | 2015-03-25 | 苏州大学 | Event classification method and device |
CN108228158A (en) * | 2018-01-18 | 2018-06-29 | 东南大学 | A kind of framework behavior pattern recognition method based on ontology |
CN108920473A (en) * | 2018-07-04 | 2018-11-30 | 中译语通科技股份有限公司 | A kind of data enhancing machine translation method based on similar word and synonym replacement |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070094219A1 (en) * | 2005-07-14 | 2007-04-26 | The Boeing Company | System, method, and computer program to predict the likelihood, the extent, and the time of an event or change occurrence using a combination of cognitive causal models with reasoning and text processing for knowledge driven decision support |
US8423346B2 (en) * | 2007-09-05 | 2013-04-16 | Electronics And Telecommunications Research Institute | Device and method for interactive machine translation |
JP5100445B2 (en) * | 2008-02-28 | 2012-12-19 | 株式会社東芝 | Machine translation apparatus and method |
CN104268133B (en) * | 2014-09-11 | 2018-02-13 | 北京交通大学 | machine translation method and system |
CN107944027B (en) * | 2017-12-12 | 2020-03-31 | 苏州思必驰信息科技有限公司 | Method and system for creating semantic key index |
CN108959651A (en) * | 2018-08-03 | 2018-12-07 | 北京捷易迅信息技术有限公司 | A method of user's intention assessment based on transfer learning |
-
2019
- 2019-01-30 CN CN201910089352.1A patent/CN109918646B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6993535B2 (en) * | 2001-06-18 | 2006-01-31 | International Business Machines Corporation | Business method and apparatus for employing induced multimedia classifiers based on unified representation of features reflecting disparate modalities |
US7685099B2 (en) * | 2007-06-28 | 2010-03-23 | Microsoft Corporation | Forecasting time-independent search queries |
US8793715B1 (en) * | 2007-12-18 | 2014-07-29 | The Nielsen Company (Us), Llc | Identifying key media events and modeling causal relationships between key events and reported feelings |
CN104298225A (en) * | 2014-09-25 | 2015-01-21 | 中国石油化工股份有限公司 | Modeling and graphical displaying method for causal relationship reasoning model of unusual working conditions of chemical process |
CN104462229A (en) * | 2014-11-13 | 2015-03-25 | 苏州大学 | Event classification method and device |
CN108228158A (en) * | 2018-01-18 | 2018-06-29 | 东南大学 | A kind of framework behavior pattern recognition method based on ontology |
CN108920473A (en) * | 2018-07-04 | 2018-11-30 | 中译语通科技股份有限公司 | A kind of data enhancing machine translation method based on similar word and synonym replacement |
Non-Patent Citations (3)
Title |
---|
基于短语的统计机器翻译模型训练中若干关键问题的研究;梁华参;《中国博士学位论文全文数据库 信息科技辑》;20140115;I138-75 * |
基于神经网络的自然语言语义表达及推理方法研究;刘权;《中国博士学位论文全文数据库 信息科技辑》;20170915;I138-77 * |
维吾尔语事件间因果关系抽取;周兴发;《中国优秀硕士学位论文全文数据库 信息科技辑》;20190115;I138-4494 * |
Also Published As
Publication number | Publication date |
---|---|
CN109918646A (en) | 2019-06-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Zhou et al. | End-to-end learning of semantic role labeling using recurrent neural networks | |
CN108920445B (en) | A Named Entity Recognition Method and Device Based on Bi-LSTM-CRF Model | |
CN111078836B (en) | Machine reading comprehension method, system and device based on external knowledge enhancement | |
CN110427461B (en) | Intelligent question and answer information processing method, electronic equipment and computer readable storage medium | |
Sukthankar et al. | Plan, activity, and intent recognition: Theory and practice | |
CN111259144A (en) | Multi-model fusion text matching method, device, equipment and storage medium | |
US10747961B2 (en) | Method and device for identifying a sentence | |
CN113011689B (en) | Evaluation method and device for software development workload and computing equipment | |
US11170169B2 (en) | System and method for language-independent contextual embedding | |
Das et al. | Determining accuracy of chatbot by applying algorithm design and defined process | |
CN112507124B (en) | Chapter level event causality extraction method based on graph model | |
CN114004283A (en) | Text adversarial attack method, apparatus, device and storage medium | |
CN115238026A (en) | Medical text subject segmentation method and device based on deep learning | |
CN113705207A (en) | Grammar error recognition method and device | |
CN115879450B (en) | Gradual text generation method, system, computer equipment and storage medium | |
CN109977194B (en) | Text similarity calculation method, system, device and medium based on unsupervised learning | |
CN109918646B (en) | Method, system and device for judging causality of text | |
JP2018041300A (en) | Machine learning model generation device and program | |
CN114265943A (en) | A method and system for extracting causal relation event pairs | |
CN110188181B (en) | Method and device for determining domain keywords, electronic equipment and storage medium | |
Jafarlou et al. | Reducing Labeling Costs in Sentiment Analysis via Semi-Supervised Learning | |
JP7024262B2 (en) | Learning methods, how to use learning results, learning programs and learning devices | |
CN111507098B (en) | Ambiguous word recognition method and device, electronic equipment and computer-readable storage medium | |
JP5829471B2 (en) | Semantic analyzer and program thereof | |
Valenzuela-Escárcega et al. | SnapToGrid: From statistical to interpretable models for biomedical information extraction |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |