CN115470256A - System and method for managing, tracing and checking trace data - Google Patents
System and method for managing, tracing and checking trace data Download PDFInfo
- Publication number
- CN115470256A CN115470256A CN202211192553.2A CN202211192553A CN115470256A CN 115470256 A CN115470256 A CN 115470256A CN 202211192553 A CN202211192553 A CN 202211192553A CN 115470256 A CN115470256 A CN 115470256A
- Authority
- CN
- China
- Prior art keywords
- trace data
- data
- trace
- module
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2462—Approximate or statistical queries
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Probability & Statistics with Applications (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Fuzzy Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
技术领域technical field
本申请涉及留痕数据处理领域,特别是涉及一种留痕数据管理、追溯、稽查系统和方法。This application relates to the field of trace data processing, in particular to a trace data management, traceability, auditing system and method.
背景技术Background technique
证监部门要求证券行业的服务机构在开展业务时,记录与客户沟通服务过程中的信息,该信息也称为留痕数据,留痕数据可以包括电话录音、APP聊天记录等,这些数据分散在不同的终端或系统上。The securities regulatory department requires service agencies in the securities industry to record the information in the process of communicating with customers when conducting business. This information is also called trace data. The trace data can include telephone recordings, APP chat records, etc. on the terminal or system.
在相关技术中,通过从不同通信设备上采集电话录音和APP聊天记录的方式记录留痕数据并基于这些留痕数据进行合规稽查。该种方式下,各项留痕数据互相孤立分散,难以反映完整的客户沟通情况,且数据采集手段单一且数据完整性较差。监管部门查询过程不仅复杂困难,而且也难以全面地获取实际情况,进而准确的以确定服务机构(人员)是否存在违规问题。In the related technology, the trace data is recorded by collecting telephone recordings and APP chat records from different communication devices, and compliance inspection is performed based on these trace data. In this way, all trace data are isolated and scattered, it is difficult to reflect the complete customer communication situation, and the data collection method is single and the data integrity is poor. The inquiry process of the supervisory department is not only complicated and difficult, but also difficult to obtain the actual situation comprehensively, and then accurately determine whether the service organization (personnel) has violations.
发明内容Contents of the invention
本申请实施例提供了一种留痕数据管理、追溯、稽查系统、方法、电子设备和存储介质,以至少解决相关技术中留痕数据管理系统,难以便捷高效地满足监管部门稽核需求的问题。The embodiment of the present application provides a trace data management, traceability, and audit system, method, electronic device and storage medium, so as to at least solve the problem that the trace data management system in the related technology is difficult to meet the audit requirements of the supervision department conveniently and efficiently.
第一方面,本申请实施例提供了一种留痕数据管理、追溯和稽查系统,所述系统包括:留痕数据采集模块和留痕数据管理模块,其中;In the first aspect, the embodiment of the present application provides a trace data management, traceability and inspection system, the system includes: a trace data collection module and a trace data management module, wherein;
所述留痕数据采集模块,用于采集各个终端设备的留痕数据,其中,所述留痕数据是在线服务沟通过程中产生,包括:终端资源数据和IM软件数据;The trace data collection module is used to collect trace data of each terminal device, wherein the trace data is generated during online service communication, including: terminal resource data and IM software data;
所述留痕数据管理模块,用于获取所述留痕数据,并对其进行加工处理以生成多维度留痕数据库,其中,所述多维度留痕数据库中,按照网状关系结构保存各项留痕数据,所述网状关系结构中聚合定义各项留痕数据之间的逻辑关联关系。The trace data management module is used to obtain the trace data, and process it to generate a multi-dimensional trace database, wherein, in the multi-dimensional trace database, items are stored according to a network relationship structure. For trace data, the aggregation defines the logical association relationship between various trace data in the network relationship structure.
在其中一些实施例中,所述留痕数据采集模块包括:终端资源数据采集模块、IM软件数据采集模块,其中;In some of these embodiments, the trace data collection module includes: a terminal resource data collection module, and an IM software data collection module, wherein;
所述终端资源数据采集模块,用于采集所述终端资源数据,其中,所述终端资源数据包括:通话记录、通讯录、短信记录、位置记录、终端标识和终端IP;The terminal resource data collection module is used to collect the terminal resource data, wherein the terminal resource data includes: call records, address book, short message records, location records, terminal identification and terminal IP;
所述IM软件数据采集模块,用于采集所述IM软件数据,其中,所述IM软件数据是即时通讯软件产生的聊天记录,所述聊天记录包括:文字、语音、图片和视频。The IM software data collection module is used to collect the IM software data, wherein the IM software data is chat records generated by instant messaging software, and the chat records include: text, voice, pictures and videos.
在其中一些实施例中,所述留痕数据采集模块还包括加密模块,其中:In some of these embodiments, the trace data collection module also includes an encryption module, wherein:
所述加密模块,用于将所述留痕数据进行加密,并将加密之后的留痕数据发送至第三方可信平台存证。The encryption module is configured to encrypt the trace data, and send the encrypted trace data to a third-party trusted platform for certificate storage.
在其中一些实施例中,所述留痕数据管理模块包括数据处理模块和数据存储模块,其中;In some of these embodiments, the trace data management module includes a data processing module and a data storage module, wherein;
所述数据处理模块,获取各项留痕数据对应的属性信息,并基于所述属性信息发现挖掘各项留痕数据之间的逻辑关联信息,其中,所述属性信息包括:时间信息、用户信息、事件信息、位置信息、终端信息、行为信息、自定义标签信息、和关键词信息,The data processing module acquires the attribute information corresponding to each trace data, and discovers and mines logical association information between each trace data based on the attribute information, wherein the attribute information includes: time information, user information , event information, location information, terminal information, behavior information, custom label information, and keyword information,
以及,按照所述属性信息对各项留痕数据进行分类归属;And, according to the attribute information, classify and attribute the trace data;
所述数据存储模块,用于根据所述逻辑关联信息构建网状结构,并将所述分类归属之后的留痕数据,按照网状结构保存在所述留痕数据库。The data storage module is configured to construct a network structure according to the logical association information, and store the trace data after the classification and attribution in the trace database according to the network structure.
在其中一些实施例中,所述数据处理模块还用于:In some of these embodiments, the data processing module is also used for:
基于所述属性信息,以时间维度还原与任一用户相关的留痕数据记录,所述留痕数据记录包括:所述用户自身产生的留痕数据以及与所述用户具备逻辑关联关系的留痕数据。Based on the attribute information, restore the trace data records related to any user in the time dimension, and the trace data records include: the trace data generated by the user itself and the traces that have a logical relationship with the user data.
在其中一些实施例中,所述留痕数据管理模块还包括查询模块,其中,所述查询模块用于:In some of these embodiments, the trace data management module further includes a query module, wherein the query module is used for:
接收用户输入的查询语句,并根据所述查询语句,在所述多维度留痕数据库中获取对应的留痕数据,并将其返回至用户终端,receiving the query statement input by the user, and according to the query statement, obtaining the corresponding trace data in the multi-dimensional trace database, and returning it to the user terminal,
其中,所述查询语句基于至少一组属性信息生成,包括:时间维度查询语句、用户维度查询语句、事件维度查询语句、位置维度查询语句、终端维度查询语句、行为维度查询语句、标签维度查询语句和关键词维度查询语句中的一种或多种的组合。Wherein, the query statement is generated based on at least one set of attribute information, including: time dimension query statement, user dimension query statement, event dimension query statement, location dimension query statement, terminal dimension query statement, behavior dimension query statement, label dimension query statement A combination of one or more of keyword dimension query statements.
在其中一些实施例中,所述系统还包括关键信息记录模块,所述关键信息记录模块用于:In some of these embodiments, the system also includes a key information recording module, and the key information recording module is used for:
基于所述关键词维度查询语句获取所述关键信息记录,并基于所述关键信息记录生成稽核档案,其中,所述关键信息记录是在线服务行业沟通过程中违规的数据记录,所述稽核档案作为违规事件的判定依据。Obtain the key information record based on the keyword dimension query statement, and generate an audit file based on the key information record, wherein the key information record is a data record that violates regulations in the communication process of the online service industry, and the audit file serves as Judgment basis for violations.
第二方面,本申请实施例提供了一种留痕数据管理、追溯和稽查方法,所述方法包括:In the second aspect, the embodiment of the present application provides a method for management, traceability and inspection of trace data, the method includes:
采集各个终端设备的留痕数据,其中,所述留痕数据是在线服务沟通过程中产生,包括:终端资源数据和IM软件数据;Collect trace data of each terminal device, wherein the trace data is generated during online service communication, including: terminal resource data and IM software data;
获取所述留痕数据,并对其进行加工处理以生成多维度留痕数据库,其中,所述多维度留痕数据库中,按照网状结构保存各项留痕数据,所述网状关系结构中聚合定义各项留痕数据之间的逻辑关联关系。Obtain the trace data, and process it to generate a multi-dimensional trace database, wherein, in the multi-dimensional trace database, store various trace data according to a network structure, and in the network relationship structure Aggregation defines the logical relationship between various trace data.
第三方面,本申请实施例提供了一种计算机设备,包括存储器、处理器以及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现如上述第二方面所述的方法。In a third aspect, the embodiment of the present application provides a computer device, including a memory, a processor, and a computer program stored on the memory and operable on the processor. When the processor executes the computer program, Implement the method as described in the second aspect above.
第四方面,本申请实施例提供了一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现如上述第二方面所述的方法。In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the method described in the above-mentioned second aspect is implemented.
相比于相关技术,本申请实施例提供的留痕数据管理、追溯和稽查系统,包括:留痕数据采集模块和留痕数据管理模块,其中,留痕数据采集模块,用于采集各个终端设备的留痕数据,其中,留痕数据是在线服务沟通过程中产生,包括:终端资源数据和IM软件数据;留痕数据管理模块,用于获取留痕数据,并对其进行加工处理以生成多维度留痕数据库,多维度留痕数据库中,按照网状关系结构保存各项留痕数据,网状关系结构中聚合定义各项留痕数据之间的逻辑关联关系。通过本系统,解决了相关技术中合规系统难以高效完整反映客户沟通情况的问题,本系统能够从多个维度,完整便捷的展示整个事件记录,从而更加全面地展示沟通过程中的信息,方便用户的查询和稽核。Compared with related technologies, the trace data management, traceability and inspection system provided by the embodiment of the present application includes: a trace data collection module and a trace data management module, wherein the trace data collection module is used to collect data from each terminal device The trace data, wherein the trace data is generated during the online service communication process, including: terminal resource data and IM software data; the trace data management module is used to obtain the trace data and process it to generate multiple Dimensional trace database, in the multi-dimensional trace database, each trace data is saved according to the network relationship structure, and the logical association relationship between each trace data is aggregated and defined in the network relationship structure. Through this system, the problem that the compliance system in related technologies is difficult to efficiently and completely reflect the communication situation of customers is solved. This system can display the entire event record in a complete and convenient manner from multiple dimensions, so as to more comprehensively display the information in the communication process, which is convenient User inquiries and audits.
附图说明Description of drawings
此处所说明的附图用来提供对本申请的进一步理解,构成本申请的一部分,本申请的示意性实施例及其说明用于解释本申请,并不构成对本申请的不当限定。在附图中:The drawings described here are used to provide a further understanding of the application and constitute a part of the application. The schematic embodiments and descriptions of the application are used to explain the application and do not constitute an improper limitation to the application. In the attached picture:
图1是根据本申请实施例的一种留痕数据管理、追溯和稽查系统的结构框图;Fig. 1 is a structural block diagram of a trace data management, traceability and inspection system according to an embodiment of the present application;
图2是根据本申请实施例的一种留痕数据管理、追溯和稽查方法的流程图;Fig. 2 is a flow chart of a trace data management, traceability and inspection method according to an embodiment of the present application;
图3是根据本申请实施例的电子设备的内部结构示意图。Fig. 3 is a schematic diagram of an internal structure of an electronic device according to an embodiment of the present application.
具体实施方式detailed description
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行描述和说明。应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。基于本申请提供的实施例,本领域普通技术人员在没有作出创造性劳动的前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be described and illustrated below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application. Based on the embodiments provided in the present application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.
显而易见地,下面描述中的附图仅仅是本申请的一些示例或实施例,对于本领域的普通技术人员而言,在不付出创造性劳动的前提下,还可以根据这些附图将本申请应用于其他类似情景。此外,还可以理解的是,虽然这种开发过程中所作出的努力可能是复杂并且冗长的,然而对于与本申请公开的内容相关的本领域的普通技术人员而言,在本申请揭露的技术内容的基础上进行的一些设计,制造或者生产等变更只是常规的技术手段,不应当理解为本申请公开的内容不充分。Obviously, the accompanying drawings in the following description are only some examples or embodiments of the present application, and those skilled in the art can also apply the present application to other similar scenarios. In addition, it can also be understood that although such development efforts may be complex and lengthy, for those of ordinary skill in the art relevant to the content disclosed in this application, the technology disclosed in this application Some design, manufacturing or production changes based on the content are just conventional technical means, and should not be understood as insufficient content disclosed in this application.
在本申请中提及“实施例”意味着,结合实施例描述的特定特征、结构或特性可以包含在本申请的至少一个实施例中。在说明书中的各个位置出现该短语并不一定均是指相同的实施例,也不是与其它实施例互斥的独立的或备选的实施例。本领域普通技术人员显式地和隐式地理解的是,本申请所描述的实施例在不冲突的情况下,可以与其它实施例相结合。Reference in this application to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The occurrences of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is understood explicitly and implicitly by those of ordinary skill in the art that the embodiments described in this application can be combined with other embodiments without conflict.
除非另作定义,本申请所涉及的技术术语或者科学术语应当为本申请所属技术领域内具有一般技能的人士所理解的通常意义。本申请所涉及的“一”、“一个”、“一种”、“该”等类似词语并不表示数量限制,可表示单数或复数。本申请所涉及的术语“包括”、“包含”、“具有”以及它们任何变形,意图在于覆盖不排他的包含;例如包含了一系列步骤或模块(单元)的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元,而是可以还包括没有列出的步骤或单元,或可以还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。本申请所涉及的“连接”、“相连”、“耦接”等类似的词语并非限定于物理的或者机械的连接,而是可以包括电气的连接,不管是直接的还是间接的。本申请所涉及的“多个”是指两个或两个以上。“和/或”描述关联对象的关联关系,表示可以存在三种关系,例如,“A和/或B”可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。本申请所涉及的术语“第一”、“第二”、“第三”等仅仅是区别类似的对象,不代表针对对象的特定排序。Unless otherwise defined, the technical terms or scientific terms involved in the application shall have the usual meanings understood by those with ordinary skill in the technical field to which the application belongs. Words such as "a", "an", "an" and "the" involved in this application do not indicate a limitation on quantity, and may indicate singular or plural numbers. The terms "comprising", "comprising", "having" and any variations thereof involved in this application are intended to cover non-exclusive inclusion; for example, a process, method, system, product or process that includes a series of steps or modules (units). The apparatus is not limited to the listed steps or units, but may further include steps or units not listed, or may further include other steps or units inherent to the process, method, product or apparatus. The words "connected", "connected", "coupled" and similar words mentioned in this application are not limited to physical or mechanical connection, but may include electrical connection, no matter it is direct or indirect. The "plurality" involved in this application refers to two or more than two. "And/or" describes the association relationship of associated objects, indicating that there may be three types of relationships. For example, "A and/or B" may indicate: A exists alone, A and B exist simultaneously, and B exists independently. The character "/" generally indicates that the contextual objects are an "or" relationship. The terms "first", "second", "third" and the like involved in this application are only used to distinguish similar objects, and do not represent a specific ordering of objects.
图1是根据本申请实施例的一种留痕数据管理、追溯和稽查系统的结构框图,如图1所示,该系统包括:留痕数据采集模块10和留痕数据管理模块11,其中;Fig. 1 is a structural block diagram of a trace data management, traceability and inspection system according to an embodiment of the present application. As shown in Fig. 1, the system includes: a trace
留痕数据采集模块10,用于采集各个终端设备的留痕数据,其中,留痕数据是在线服务沟通过程中产生,包括:终端资源数据和IM软件数据;The trace
需要说明的是,证券、金融、电商、教培等行业等在线服务机构在开展业务时,与客户沟通服务的过程中会产生各种记录,这种记录在本实施例中称为留痕数据。It should be noted that when online service organizations in industries such as securities, finance, e-commerce, and education and training conduct business, they will generate various records in the process of communicating with customers. Such records are called traces in this embodiment. data.
具体的,该留痕数据可以是服务机构人员使用的终端资源数据,其包括但不限于是:与客户沟通的电话录音、通讯录、短信记录、GPS定位信息、终端唯一标识和终端的ID地址等;Specifically, the trace data may be the terminal resource data used by service agency personnel, including but not limited to: telephone recordings communicated with customers, address books, SMS records, GPS positioning information, terminal unique identifiers and terminal ID addresses Wait;
可以理解,留痕数据采集模块从终端设备上采集获取上述数据,该终端设备可以是手机、PC电脑,或其他定制的通讯设备等;It can be understood that the trace data collection module collects and obtains the above data from the terminal equipment, and the terminal equipment can be a mobile phone, a PC computer, or other customized communication equipment, etc.;
该留痕数据也可以是IM软件数据,其包括但不限于是:与客户沟通过程中的软件聊天记录,包括:语音、文字、图片和视频等。进一步需要说明的是,上述IM软件为即时通讯软件,其可以是常见的微信、QQ和企业微信等,也可以是第三方定制的其他通讯软件。The trace data can also be IM software data, which includes but is not limited to: software chat records in the process of communicating with customers, including: voice, text, pictures and videos. It should be further explained that the above-mentioned IM software is instant messaging software, which may be common WeChat, QQ and Enterprise WeChat, etc., or other communication software customized by a third party.
留痕数据管理模块11,用于获取留痕数据,并对其进行加工处理以生成多维度留痕数据库,其中,多维度留痕数据库中,按照网状结构保存各项留痕数据,网状关系结构中聚合定义各项留痕数据之间的逻辑关联关系。The left trace
本实施例中,在采集模块获取到多项留痕数据之后,留痕管理模块主要用于对这些数据进行加工处理,并将处理之后的数据,按照网状结构保存在多维度留痕数据库中。In this embodiment, after the acquisition module acquires a number of trace data, the trace management module is mainly used to process these data, and save the processed data in the multi-dimensional trace database according to the network structure .
留痕数据的加工处理所可以采用多种方式,包括数据清洗、数据加工、数据抽取、数据转换和数据计算等,具体的:There are many ways to process the trace data, including data cleaning, data processing, data extraction, data conversion and data calculation, etc. Specifically:
数据加工,可以是简单的EXCEL处理,也可以采用大数据分析、结合算法模型等技术进行大批量的数据加工;数据抽取,指对数据库中现有字段进行整合加工,这样就能够形成分析需要的数据;数据转换,指将数据转换成规范、清晰、又易于分析的结构,它又分为结构转换、行列转换和逻辑转换。数据计算指对数据根据需要进行继续加工,以便得到直观的、可供分析的决策数据。分类归属,即按照不同分类将上述处理之后的数据划分到不同类别区域。Data processing can be simple EXCEL processing, or use big data analysis, combined with algorithm models and other technologies for large-scale data processing; data extraction refers to the integration and processing of existing fields in the database, so that the analysis needs can be formed Data; data conversion refers to converting data into a standardized, clear, and easy-to-analyze structure, which is further divided into structure conversion, row-column conversion, and logic conversion. Data calculation refers to the continuous processing of data as needed in order to obtain intuitive and analytical decision-making data. Classification and attribution, that is, to divide the above-mentioned processed data into different categories according to different classifications.
本实施例中,采用上述方式对留痕数据进行处理的目的在于:按照用户、时间、位置等多个维度对这些留痕数据进行分类归属,并进一步挖掘获取些数据存在之间的关联关系,从而构建出能够全面反映留痕数据关系的网状结构关系,并基于该网状关系结构建多维度留痕数据库。In this embodiment, the purpose of using the above method to process the trace data is to classify and attribute these trace data according to multiple dimensions such as user, time, and location, and to further mine and obtain the association between these data. In this way, a network structure relationship that can fully reflect the relationship of the trace data is constructed, and a multi-dimensional trace database is built based on the network relationship structure.
进一步的,该留痕数据管理模块,基于上述特定的网状关系结构,还可以以用户为对象,以时间线为维度还原该用户所有相关的记录信息,其中,既包含了用户自己产生的信息,也包含与该用户有关联关系的对象和对此用户产生影响的信息。Furthermore, the trace data management module, based on the above-mentioned specific network relationship structure, can also take the user as the object and restore all relevant record information of the user with the timeline as the dimension, which includes information generated by the user himself , which also contains information about objects associated with the user and information that affects the user.
通过本系统,相比较于现有技术中具备如下有益效果:Compared with the prior art, this system has the following beneficial effects:
1.现有技术的留痕数据都散落在各个独立系统中,而现实中用户产生数据是基于多系统终端的,各系统终端形成信息孤岛,无法综合使用全程还原一个用户行为的完整路径。本发明可以采集各种系统终端的用户数据,随着数据终端的接入更多,能够更加全貌的还原用户的记录信息。1. The trace data of the existing technology are scattered in various independent systems, but in reality, the data generated by users is based on multi-system terminals, and the terminals of each system form an information island, and it is impossible to comprehensively use the complete path to restore a user's behavior. The present invention can collect user data of various system terminals, and can more comprehensively restore user record information as more data terminals are connected.
2.通过本申请提供的技术方案,能够以人的时间线还原用户的多种记录信息,并且将该用户的关联影响信息对应的记录,使得信息更加全面。2. Through the technical solution provided by this application, it is possible to restore a variety of recorded information of a user with a human timeline, and the user's association affects the corresponding records of the information, making the information more comprehensive.
在其中一些实施例中,由于留痕数据来源于多种不同的硬件和软件载体,为了方便后续的数据处理,本实施例中,留痕数据管理模块通过不同子模块进行分别进行数据收集,留痕数据采集模块包括:终端资源数据采集模块、IM软件数据采集模块,其中;In some of these embodiments, since the trace data comes from a variety of different hardware and software carriers, in order to facilitate subsequent data processing, in this embodiment, the trace data management module separately collects data through different sub-modules, leaving The trace data collection module includes: terminal resource data collection module, IM software data collection module, wherein;
终端资源数据采集模块,用于采集终端资源数据,其中,终端资源数据包括:通话记录、通讯录、短信记录、位置记录、终端标识和终端IP等;The terminal resource data collection module is used to collect terminal resource data, wherein the terminal resource data includes: call records, address book, SMS records, location records, terminal identification and terminal IP, etc.;
IM软件数据采集模块,用于采集IM软件数据,其中,IM软件数据是即时通讯软件的聊天记录,聊天记录包括:文字、语音、图片和视频等。The IM software data collection module is used to collect IM software data, wherein the IM software data is the chat records of the instant messaging software, and the chat records include text, voice, pictures and videos.
在其中一些实施例中,为了防止留痕数据被单方面篡改,该留痕数据采集模块还包括加密模块,其中,该加密模块用于:将采集到的留痕数据进行加密,并将加密之后的留痕数据上传至第三方可信平台进行存证。In some of these embodiments, in order to prevent the trace data from being unilaterally tampered with, the trace data collection module further includes an encryption module, wherein the encryption module is used to: encrypt the collected trace data, and encrypt the encrypted The trace data is uploaded to a third-party trusted platform for evidence storage.
若后续出现数据异常情况,可以将风险数据与第三方可信平台中保存的备份数据进行比对,以验证数据是否被篡改过。If data abnormalities occur later, the risk data can be compared with the backup data stored in the third-party trusted platform to verify whether the data has been tampered with.
需要说明的是,本实施例中,用于存储备份数据的第三方可信平台可以是阿里云、百度云等云计算存储平台,本实施例中对此不作具体限定,进一步的,加密数据的方式可以采用常规的对称或非对称加密方法,本实施例中也可以灵活选择。It should be noted that in this embodiment, the third-party trusted platform for storing backup data may be cloud computing storage platforms such as Alibaba Cloud and Baidu Cloud, which is not specifically limited in this embodiment. Further, the encrypted data The method can adopt a conventional symmetric or asymmetric encryption method, and it can also be flexibly selected in this embodiment.
另外,考虑到提升系统整体的安全性,在本系统中,留痕数据的的采集、传输、本地存储和使用都应用进行加密处理,从而更大程度的保障用户数据安全。当然,这种加密方式也可以灵活选择,对此本实施例中也不再赘述。In addition, in consideration of improving the overall security of the system, in this system, the collection, transmission, local storage and use of trace data should be encrypted, so as to ensure the security of user data to a greater extent. Of course, this encryption method can also be selected flexibly, which will not be repeated in this embodiment.
在其中一些实施例中,留痕数据管理模块包括数据处理模块和数据存储模块,其中;In some of these embodiments, the trace data management module includes a data processing module and a data storage module, wherein;
数据处理模块,获取各项留痕数据对应的属性信息,并基于属性信息发现挖掘各项留痕数据的逻辑关联信息,其中,属性信息包括:时间信息、用户信息、事件信息、位置信息、终端信息、行为信息、自定义标签信息、和关键词信息,以及,按照属性信息对各项留痕数据进行分类归属;The data processing module obtains the attribute information corresponding to each trace data, and discovers and mines the logical association information of each trace data based on the attribute information. Among them, the attribute information includes: time information, user information, event information, location information, terminal Information, behavior information, custom label information, and keyword information, and classify and attribute various trace data according to attribute information;
数据存储模块,用于根据逻辑关联信息构建网状结构,并将分类归属之后的留痕数据,按照网状结构保存在留痕数据库。The data storage module is used to construct a network structure according to the logical association information, and store the trace data after classification and attribution in the trace database according to the network structure.
其中,例如:一个员工可能会和多个客户有沟通记录、一个客户也可能会和多个员工有过沟通记录、一个事件发生过程中有多个事件会关联和相互影响。从而需要发现各项数据元素之间的关联关系,并基于这种关联关系形成网状关系结构。本实施例提供的留痕数据管理系统会记录、聚合和定义数据元素的逻辑关系,并且提取数据特征值,标签化行为数据,并最终构建出能够反映数据之间关联关系,同时能够支持从各个维度查询的多维度留痕数据库。Among them, for example: an employee may have communication records with multiple customers, a customer may also have communication records with multiple employees, and multiple events will be related and affect each other during the occurrence of an event. Therefore, it is necessary to discover the association relationship between various data elements, and form a network relationship structure based on this association relationship. The trace data management system provided in this embodiment will record, aggregate and define the logical relationship of data elements, extract data feature values, label behavior data, and finally build a system that can reflect the relationship between data and support data from various A multi-dimensional trace database for dimensional queries.
另外,留痕数据管理模块还包括查询模块,其中,查询模块用于:接收用户输入的查询语句,并根据查询语句,在多维度留痕数据库中获取对应的留痕数据,并将其返回至用户终端,In addition, the trace data management module also includes a query module, wherein the query module is used to: receive the query statement input by the user, and according to the query statement, obtain the corresponding trace data in the multi-dimensional trace database, and return it to user terminal,
其中,查询语句基于至少一组属性信息生成,包括:时间维度查询语句、用户维度查询语句、事件维度查询语句、位置维度查询语句、终端维度查询语句、行为维度查询语句、标签维度查询语句和关键词维度查询语句中的一种或多种的组合。其中,上述用户维度查询语句可以是针对某一个用户或者具备特殊标识的某一批用户的查询语句,具体的,该特殊标识可以是基于数据固有属性生成,也可以由运维人员自定义设置。Among them, the query statement is generated based on at least one set of attribute information, including: time dimension query statement, user dimension query statement, event dimension query statement, location dimension query statement, terminal dimension query statement, behavior dimension query statement, label dimension query statement and key One or more combinations of word dimension query statements. Wherein, the above-mentioned user dimension query statement may be a query statement for a certain user or a certain group of users with a special identifier. Specifically, the special identifier may be generated based on the inherent attributes of the data, or it may be customized by the operation and maintenance personnel.
进一步的,通过上述实施例,用户不仅可以从一个维度查询获取对应的留痕数据,例如,获取一个用户的所有留痕记录;也可以从多个维度查询获取对应的留痕数据,例如,一个用户在某一时间段内(例如第三季度)下的留痕记录。Further, through the above-mentioned embodiments, users can not only query and obtain corresponding trace data from one dimension, for example, obtain all trace records of a user; they can also query and obtain corresponding trace data from multiple dimensions, for example, a The records left by users in a certain period of time (for example, the third quarter).
通过本系统,支持从多个维度去查询某个或者有关联关系的用户及其关联用户和相关记录信息,从而可以更加方便且高效的了解某件事情产生的时间、场所、人物、原因、经过、结果等。Through this system, it is supported to query a certain or associated user and its associated user and related record information from multiple dimensions, so that it is more convenient and efficient to understand the time, place, person, reason, and process of an event. , results, etc.
具体的:本系统可以按照以用户为对象,以时间线为维度还原用户所有相关的记录信息,其中包含了用户自己产生的信息,以及与用户有关联的对象,和对此用户产生影响的信息记录;Specifically: the system can restore all relevant record information of the user according to the user as the object and the timeline as the dimension, which includes the information generated by the user himself, the objects associated with the user, and the information that affects the user Record;
当然,也可以时间线为维度,还原某个用户在这段时间内发生了什么事情的场景。Of course, the timeline can also be used as a dimension to restore the scene of what happened to a certain user during this period.
也可以以人物关系、时间、事件及关键词等信息稽查留痕信息,快速查找出某件事情发生的时间和前后事件,还原当时某件事发生的过程。You can also check the trace information based on information such as character relationship, time, events, and keywords, quickly find out the time and events before and after a certain event, and restore the process of a certain event at that time.
在其中一些实施例中,系统还包括关键信息记录模块,关键信息记录模块用于:In some of these embodiments, the system also includes a key information recording module, and the key information recording module is used for:
基于关键词维度查询语句获取关键信息记录,并基于关键信息记录生成稽核档案,其中,关键信息记录在线服务行业交互沟通违规的数据记录,该在线服务行业可以但不限于是证券、金融、电商、教培等行业。Obtain key information records based on keyword dimension query statements, and generate audit files based on key information records. Among them, the key information records data records of interactive communication violations in the online service industry. The online service industry can be but not limited to securities, finance, and e-commerce. , education and training industries.
稽核档案用于违规事件的判定依据,例如:证券行业中,某员工在电话沟通中过度承诺客户,造成客户资金损失,后期发生投诉,此通电话录音作为员工违规证据。Audit files are used to judge violations. For example, in the securities industry, an employee over-promises customers during telephone communication, resulting in the loss of customer funds. Later, a complaint occurs. The recording of the phone call is used as evidence of employee violations.
在一些实施例中,本申请还提供了一种留痕数据管理、追溯和稽查方法,图2是根据本申请实施例的一种留痕数据管理、追溯和稽查方法的流程图,如图2所示,该方法包括如下步骤:In some embodiments, the present application also provides a method for trace data management, traceability and auditing. FIG. 2 is a flow chart of a traceable data management, traceability and audit method according to an embodiment of the present application, as shown in FIG. 2 As shown, the method includes the following steps:
S201,采集各个终端设备的留痕数据,其中,留痕数据是在线服务沟通过程中产生,包括:终端资源数据和IM软件数据;S201. Collect trace data of each terminal device, wherein the trace data is generated during online service communication, including: terminal resource data and IM software data;
具体的,该留痕数据可以是服务机构人员使用的终端资源数据,其包括但不限于是:与客户沟通的电话录音、通讯录、短信记录、GPS定位信息、终端唯一标识和终端的IP地址等;可以理解,留痕数据采集模块从终端设备上采集上述数据,该终端设备可以是用户手机、PC电脑,或其他定制的通讯设备等;Specifically, the trace data may be terminal resource data used by service agency personnel, including but not limited to: telephone recordings communicated with customers, address books, SMS records, GPS positioning information, terminal unique identifiers, and terminal IP addresses etc.; it can be understood that the trace data collection module collects the above-mentioned data from the terminal device, which can be the user's mobile phone, PC computer, or other customized communication devices, etc.;
该留痕数据也可以是IM软件数据,其包括但不限于是:与客户沟通过程中的软件聊天记录,包括:语音、文字、图片和视频等。进一步需要说明的是,上述Im软件为即时通讯软件,其可以是常见的微信、QQ和企业微信等,也可以是第三方定制的其他通讯软件。The trace data can also be IM software data, which includes but is not limited to: software chat records in the process of communicating with customers, including: voice, text, pictures and videos. It should be further explained that the above-mentioned Im software is an instant messaging software, which may be common WeChat, QQ, and Enterprise WeChat, etc., or other communication software customized by a third party.
S202,获取留痕数据,并对其进行加工处理以生成多维度留痕数据库,其中,多维度留痕数据库中,按照网状结构保存各项留痕数据,网状关系结构中聚合定义各项留痕数据之间的逻辑关联。S202, acquire trace data, and process it to generate a multi-dimensional trace database, wherein, in the multi-dimensional trace database, various trace data are stored according to a network structure, and each item is aggregated and defined in the network relationship structure Logical associations between trace data.
本实施例中,留痕数据的加工处理所可以采用多种方式,包括数据清洗、数据加工、数据抽取、数据转换和数据计算等采用上述方式的对留痕数据进行处理的目的在于:分别按照用户、时间、位置等多个维度对这些留痕数据进行分类归属,并进一步挖掘获取些数据存在之间的关联关系,从而将构建出能够全面反映留痕数据关系的网状结构,并基于该网状关系结构构建多维度留痕数据库。In this embodiment, various methods can be used for processing the trace data, including data cleaning, data processing, data extraction, data conversion, and data calculation. The purpose of processing the trace data in the above-mentioned manner is to: Classify and attribute these trace data in multiple dimensions such as user, time, and location, and further mine and obtain the association relationship between these data, so as to construct a network structure that can fully reflect the relationship of trace data, and based on this A network-like relational structure builds a multi-dimensional trace database.
在一个实施例中,提供了一种计算机设备,该计算机设备可以是终端。该计算机设备包括通过系统总线连接的处理器、存储器、网络接口、显示屏和输入装置。其中,该计算机设备的处理器用于提供计算和控制能力。该计算机设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作系统和计算机程序。该内存储器为非易失性存储介质中的操作系统和计算机程序的运行提供环境。该计算机设备的网络接口用于与外部的终端通过网络连接通信。该计算机程序被处理器执行时以实现一种留痕数据的管理及合规稽查方法。该计算机设备的显示屏可以是液晶显示屏或者电子墨水显示屏,该计算机设备的输入装置可以是显示屏上覆盖的触摸层,也可以是计算机设备外壳上设置的按键、轨迹球或触控板,还可以是外接的键盘、触控板或鼠标等。In one embodiment, a computer device is provided, and the computer device may be a terminal. The computer device includes a processor, a memory, a network interface, a display screen and an input device connected through a system bus. Wherein, the processor of the computer device is used to provide calculation and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, a management and compliance inspection method of trace data is realized. The display screen of the computer device may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device may be a touch layer covered on the display screen, or a button, a trackball or a touch pad provided on the casing of the computer device , and can also be an external keyboard, touchpad, or mouse.
在一个实施例中,图3是根据本申请实施例的电子设备的内部结构示意图,如图3所示,提供了一种电子设备,该电子设备可以是服务器,其内部结构图可以如图3所示。该电子设备包括通过内部总线连接的处理器、网络接口、内存储器和非易失性存储器,其中,该非易失性存储器存储有操作系统、计算机程序和数据库。处理器用于提供计算和控制能力,网络接口用于与外部的终端通过网络连接通信,内存储器用于为操作系统和计算机程序的运行提供环境,计算机程序被处理器执行时以实现一种留痕数据的管理及合规稽查方法,数据库用于存储数据。In one embodiment, FIG. 3 is a schematic diagram of the internal structure of an electronic device according to an embodiment of the present application. As shown in FIG. shown. The electronic device includes a processor connected through an internal bus, a network interface, an internal memory and a non-volatile memory, wherein the non-volatile memory stores an operating system, a computer program and a database. The processor is used to provide computing and control capabilities, the network interface is used to communicate with external terminals through a network connection, and the internal memory is used to provide an environment for the operation of the operating system and computer programs. When the computer program is executed by the processor, a trace is realized. Data management and compliance audit methods, the database is used to store data.
本领域技术人员可以理解,图3中示出的结构,仅仅是与本申请方案相关的部分结构的框图,并不构成对本申请方案所应用于其上的电子设备的限定,具体的电子设备可以包括比图中所示更多或更少的部件,或者组合某些部件,或者具有不同的部件布置。Those skilled in the art can understand that the structure shown in Figure 3 is only a block diagram of a part of the structure related to the solution of this application, and does not constitute a limitation on the electronic equipment to which the solution of this application is applied. The specific electronic equipment can be More or fewer components than shown in the figures may be included, or some components may be combined, or have a different arrangement of components.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,该计算机程序可存储于一非易失性计算机可读取存储介质中,该计算机程序在执行时,可包括如上述各方法的实施例的流程。其中,本申请所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用,均可包括非易失性和/或易失性存储器。非易失性存储器可包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦除可编程ROM(EEPROM)或闪存。易失性存储器可包括随机存取存储器(RAM)或者外部高速缓冲存储器。作为说明而非局限,RAM以多种形式可得,诸如静态RAM(SRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双数据率SDRAM(DDRSDRAM)、增强型SDRAM(ESDRAM)、同步链路(Synchlink)DRAM(SLDRAM)、存储器总线(Rambus)直接RAM(RDRAM)、直接存储器总线动态RAM(DRDRAM)、以及存储器总线动态RAM(RDRAM)等。Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be realized by instructing related hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium , when the computer program is executed, it may include the procedures of the embodiments of the above-mentioned methods. Wherein, any references to memory, storage, database or other media used in the various embodiments provided in the present application may include non-volatile and/or volatile memory. Nonvolatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Chain Synchlink DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.
以上实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请专利的保护范围应以所附权利要求为准。The above examples only express several implementation modes of the present application, and the description thereof is relatively specific and detailed, but should not be construed as limiting the scope of the patent for the invention. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the scope of protection of the patent application should be based on the appended claims.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211192553.2A CN115470256A (en) | 2022-09-28 | 2022-09-28 | System and method for managing, tracing and checking trace data |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211192553.2A CN115470256A (en) | 2022-09-28 | 2022-09-28 | System and method for managing, tracing and checking trace data |
Publications (1)
Publication Number | Publication Date |
---|---|
CN115470256A true CN115470256A (en) | 2022-12-13 |
Family
ID=84334236
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202211192553.2A Pending CN115470256A (en) | 2022-09-28 | 2022-09-28 | System and method for managing, tracing and checking trace data |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115470256A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116389451A (en) * | 2023-02-27 | 2023-07-04 | 青岛民航凯亚系统集成有限公司 | Airport transportation management commission operation coordination information release system and operation method |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103744846A (en) * | 2013-08-13 | 2014-04-23 | 北京航空航天大学 | Multidimensional dynamic local knowledge map and constructing method thereof |
CN110866017A (en) * | 2019-11-27 | 2020-03-06 | 郭学森 | Tax handling operation mark leaving system for visual retrieval and implementation method thereof |
CN111831715A (en) * | 2020-05-25 | 2020-10-27 | 闽侯县人民检察院 | Intelligent access and certificate storage system and method based on artificial intelligence big data |
WO2021202491A1 (en) * | 2019-04-05 | 2021-10-07 | Translational Imaging Innovations, Inc. | Methods, systems and computer program products for retrospective data mining |
-
2022
- 2022-09-28 CN CN202211192553.2A patent/CN115470256A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103744846A (en) * | 2013-08-13 | 2014-04-23 | 北京航空航天大学 | Multidimensional dynamic local knowledge map and constructing method thereof |
WO2021202491A1 (en) * | 2019-04-05 | 2021-10-07 | Translational Imaging Innovations, Inc. | Methods, systems and computer program products for retrospective data mining |
CN110866017A (en) * | 2019-11-27 | 2020-03-06 | 郭学森 | Tax handling operation mark leaving system for visual retrieval and implementation method thereof |
CN111831715A (en) * | 2020-05-25 | 2020-10-27 | 闽侯县人民检察院 | Intelligent access and certificate storage system and method based on artificial intelligence big data |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116389451A (en) * | 2023-02-27 | 2023-07-04 | 青岛民航凯亚系统集成有限公司 | Airport transportation management commission operation coordination information release system and operation method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109522746B (en) | A data processing method, electronic device and computer storage medium | |
US20210112101A1 (en) | Data set and algorithm validation, bias characterization, and valuation | |
US20180191759A1 (en) | Systems and methods for modeling and monitoring data access behavior | |
CN106296445A (en) | A kind of power customer label construction method | |
CN113779609B (en) | Data management method, device, electronic equipment and storage medium | |
CN109120428B (en) | Method and system for wind control analysis | |
CN111666298B (en) | User service category detection method, device, and computer equipment based on Flink | |
US20190050435A1 (en) | Object data association index system and methods for the construction and applications thereof | |
US20180139220A1 (en) | Shared capability system | |
CN114840519A (en) | Data labeling method, equipment and storage medium | |
CN112862598B (en) | Channel information management method, device, electronic equipment and medium | |
US20230396640A1 (en) | Security event management system and associated method | |
CN115982158B (en) | Supervision data processing method, device, equipment and medium based on data marts | |
CN115168400A (en) | External data management system and method | |
CN115470256A (en) | System and method for managing, tracing and checking trace data | |
CN112835863A (en) | Processing method and processing device of operation log | |
US20220028008A1 (en) | Signals-based data syndication and collaboration | |
CN114153860A (en) | Business data management method and device, electronic device, and storage medium | |
CN118860771A (en) | Method, device, computer equipment, readable storage medium and program product based on microservice instance number and call chain inspection | |
CN118170804A (en) | Supervision report data processing method and device and computer equipment | |
CN118365125A (en) | Business risk identification method, device, computer equipment, storage medium and product | |
CN117891882A (en) | Data management system, method, equipment and storage medium based on blockchain | |
US20150100515A1 (en) | Customer data unification | |
CN117061560A (en) | Audit method, audit device, electronic equipment and readable storage medium | |
CN116910114A (en) | Data monitoring method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |