CN114661942A - Streaming data processing method, apparatus, electronic device, and computer-readable medium - Google Patents

Abstract

The present disclosure relates to a method, an apparatus, an electronic device and a computer-readable medium for processing stream modulation data, and belongs to the technical field of data processing. The method includes: acquiring audio stream tune data of a target object from a mobile terminal with a recording function, and storing the audio stream tune data; performing speech recognition on the audio stream tune data through a speech recognition service, obtaining the voice-text data flow-tune and flow-tune corresponding to the audio flow-tune data; performing structured processing on the voice-text data to obtain the structured flow-tune information of the target object; obtaining a pre-configured flow-tune report template, and A flow report of the target object is generated according to the flow report template and the structured flow information. The present disclosure can improve the efficiency of data flow adjustment, research and judgment by processing flow adjustment data and generating flow adjustment reports in a digital and automated form.

Description

Streaming data processing method, apparatus, electronic device, and computer-readable medium

technical field

The present disclosure relates to the technical field of data processing, and in particular, to a method for processing streaming data, an apparatus for processing streaming data, an electronic device, and a computer-readable medium.

Background technique

Through epidemiological epidemiological surveys, relevant information on confirmed cases of infectious diseases can be obtained, and corresponding epidemiological investigation reports can be generated.

At present, there is no digital or informatization plan for epidemiological investigations. Epidemiological reports mainly rely on manual on-site records and post-event writing. The analysis and judgment of epidemiological reports are mainly conducted manually, so the overall efficiency and accuracy are relatively poor.

In view of this, there is an urgent need in the art for a method that can improve the efficiency and accuracy of data flow reconciliation and data research and judgment.

It should be noted that the information disclosed in the above Background section is only for enhancement of understanding of the background of the present disclosure, and therefore may contain information that does not form the prior art that is already known to a person of ordinary skill in the art.

SUMMARY OF THE INVENTION

The purpose of the present disclosure is to provide a flow adjustment data processing method, a flow adjustment data processing device, an electronic device and a computer-readable medium, thereby improving the efficiency of data flow adjustment and data research and judgment at least to a certain extent.

According to a first aspect of the present disclosure, a method for processing streaming data is provided, including:

Obtain the audio stream tone data of the target object from a mobile terminal with a recording function, and store the audio stream tone data;

Perform speech recognition on the audio stream tone data through a speech recognition service to obtain speech text data corresponding to the audio stream tone data;

Structural processing is performed on the voice and text data to obtain the structured flow tone information of the target object;

Acquire a preconfigured flow adjustment report template, and generate a flow adjustment report of the target object according to the flow adjustment report template and the structured flow adjustment information.

In an exemplary embodiment of the present disclosure, after obtaining the structured flow tone information of the target object, the method further includes:

Sending the structured flow adjustment information of the target object to a display terminal for display, and judging whether the structured flow adjustment information is complete;

If the structured stream tone information is incomplete, determine the target information that needs to be supplemented in the structured stream tone information, determine the target audio segment in the audio stream tone data according to the target information, and determine the target audio segment in the audio stream tone data according to the target information. The audio segment obtains the complete structured stream tone information;

If the structured flow adjustment information is complete, continue to perform subsequent steps to generate a flow adjustment report of the target object.

In an exemplary embodiment of the present disclosure, the determining a target audio segment in the audio stream tone data according to the target information includes:

Determine a target voice-text segment in the voice-text data according to the target information, and obtain a text generation timestamp corresponding to the target voice-text segment;

The audio time stamp corresponding to the target audio segment is determined according to the text generation time stamp, and the target audio segment in the audio stream tone data is acquired according to the audio time stamp.

In an exemplary embodiment of the present disclosure, performing structured processing on the speech and text data to obtain structured flow tone information of the target object includes:

The speech and text data are structured through regular expressions to obtain structured flow tone information of the target object.

In an exemplary embodiment of the present disclosure, performing structured processing on the speech and text data to obtain structured flow tone information of the target object includes:

The speech and text data are structured through a pre-trained language representation model to obtain structured flow tone information of the target object.

In an exemplary embodiment of the present disclosure, after the flow adjustment report of the target object is generated according to the flow adjustment report template and the structured flow adjustment information, the method further includes:

According to the flow report of the target object, a target coping strategy related to the flow report is determined.

In an exemplary embodiment of the present disclosure, the determining, according to the flow report of the target object, the target response strategy related to the flow report includes:

Obtain the trajectory data of the target object from the flow report of the target object, and obtain the location data of the target location related to the trajectory data according to the trajectory data of the target object;

The risk level of the target site is determined according to site data of the target site, and a target coping strategy for the target site is determined according to the risk level of the target site.

In an exemplary embodiment of the present disclosure, the determining, according to the flow report of the target object, the target response strategy related to the flow report includes:

Obtain the trajectory data and status data of the target object from the flow report of the target object;

The object type of the target object is determined according to the trajectory data and state data of the target object, and a target coping strategy for the target object is determined according to the object type of the target object.

In an exemplary embodiment of the present disclosure, the determining, according to the flow report of the target object, the target response strategy related to the flow report includes:

Obtain the contact object information of the target object from the flow report of the target object, and obtain the risk level corresponding to the contact object of the target object according to the contact object information;

A target coping strategy for the contact object is determined according to the risk level corresponding to the contact object.

According to a second aspect of the present disclosure, a method for processing streaming data is provided, including:

The mobile terminal with the recording function obtains the audio stream modulation data of the target object, and transmits the audio stream modulation data from the mobile terminal to the server;

The server side stores the audio stream tone data, and performs speech recognition on the audio stream tone data in the server side through a speech recognition service to obtain speech text data corresponding to the audio stream tone data;

The server side performs structured processing on the voice and text data to obtain the structured flow tone information of the target object;

The server side sends the structured flow adjustment information of the target object to the display terminal for display, and when the structured flow adjustment information is incomplete, adjusts the structured flow adjustment information to obtain the complete information. Describe structured flow adjustment information;

The server side obtains a preconfigured flow adjustment report template, and generates a flow adjustment report of the target object according to the flow adjustment report template and the complete structured flow adjustment information.

According to a third aspect of the present disclosure, a device for processing streaming data is provided, comprising:

an audio data acquisition module, used for acquiring the audio stream modulation data of the target object from a mobile terminal with a recording function, and storing the audio stream modulation data;

A speech-text recognition module, configured to perform speech recognition on the audio stream tone data through a speech recognition service, to obtain speech-text data corresponding to the audio stream tone data;

A phonetic text structuring module, configured to perform structured processing on the phonetic text data to obtain structured flow tone information of the target object;

The flow adjustment report generating module is configured to obtain a preconfigured flow adjustment report template, and generate the flow adjustment report of the target object according to the flow adjustment report template and the structured flow adjustment information.

According to a fourth aspect of the present disclosure, a device for processing streaming data is provided, comprising:

an audio data acquisition module, configured to acquire the audio stream modulation data of the target object through a mobile terminal with a recording function, and transmit the audio stream modulation data from the mobile terminal to the server;

A speech text recognition module is used to store the audio stream tone data through the server side, and perform speech recognition on the audio stream tone data in the server side through a speech recognition service to obtain the corresponding audio stream tone data. speech text data;

A phonetic text structuring module, configured to perform structured processing on the phonetic text data through the server side to obtain structured stream tone information of the target object;

The information integrity processing module is used to send the structured streaming information of the target object to the display terminal for display through the server side, and when the structured streaming information is incomplete, Adjust the adjustment information to obtain the complete structured flow adjustment information;

A flow adjustment report generating module, configured to obtain a pre-configured flow adjustment report template through the server, and generate a flow adjustment report of the target object according to the flow adjustment report template and the complete structured flow adjustment information.

According to a fifth aspect of the present disclosure, there is provided an electronic device comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute the executable instructions to Execute the method for processing streaming data described in any one of the above.

According to a sixth aspect of the present disclosure, there is provided a computer-readable medium on which a computer program is stored, and when the computer program is executed by a processor, implements the method for processing stream modulation data described in any one of the above.

Exemplary embodiments of the present disclosure may have the following beneficial effects:

In the method for processing stream tone data in the exemplary embodiment of the present disclosure, the audio stream tone data of the target object is acquired from a mobile terminal with a recording function, and the audio stream tone data is transmitted from the mobile terminal to the server, and then the voice recognition service is used Perform speech recognition on the audio stream tone data in the server, and perform structured processing on the speech and text data, and finally generate a stream tone report of the target object according to the structured stream tone information of the target object. In the method for processing flow adjustment data in the exemplary embodiment of the present disclosure, by introducing a computer-aided method, the entire process of data flow adjustment and processing is performed in a digital manner. On the one hand, the efficiency and accuracy of generating flow adjustment reports can be improved, and On the other hand, it has improved the speed of subsequent infectious disease research and judgment based on the epidemiological report, and bought more time for the prevention and control of infectious diseases.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and for those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort.

FIG. 1 shows a schematic diagram of an exemplary system architecture of a method and apparatus for processing stream modulation data to which an embodiment of the present invention can be applied;

FIG. 2 shows a schematic flowchart of a method for processing stream modulation data according to an exemplary embodiment of the present disclosure;

FIG. 3 shows a schematic flow chart of file integrity checking and voice playback according to an exemplary embodiment of the present disclosure;

FIG. 4 shows a schematic flowchart of determining a target coping strategy for a target site according to an example embodiment of the present disclosure;

5 shows a schematic flowchart of determining a target coping strategy for a target object according to an exemplary embodiment of the present disclosure;

6 shows a schematic flowchart of determining a target coping strategy for a contact object according to an example embodiment of the present disclosure;

FIG. 7 shows a schematic flowchart of a method for processing stream modulation data according to another exemplary embodiment of the present disclosure;

FIG. 8 schematically shows an architecture diagram of a system for processing streaming data in a specific embodiment of the present disclosure;

FIG. 9 shows a block diagram of an apparatus for processing stream modulation data according to an exemplary embodiment of the present disclosure;

FIG. 10 shows a block diagram of an apparatus for processing stream modulation data according to another exemplary embodiment of the present disclosure;

FIG. 11 shows a schematic structural diagram of a computer system suitable for implementing an electronic device according to an embodiment of the present disclosure.

Detailed ways

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments, however, can be embodied in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be employed. In other instances, well-known solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.

Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repeated descriptions will be omitted. Some of the block diagrams shown in the figures are functional entities that do not necessarily necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.

FIG. 1 shows a schematic diagram of a system architecture of an exemplary application environment to which a method and apparatus for processing stream modulation data according to an embodiment of the present invention can be applied.

As shown in FIG. 1 , the system architecture 100 may include a plurality of mobile terminals 101 , 102 , 103 , a network 104 and a server 105 . The network 104 is a medium used to provide a communication link between the mobile terminals 101 , 102 , 103 and the server 105 . Network 104 may include various connection types, such as wireless communication links, and the like.

It should be understood that the numbers of mobile terminals, networks and servers in FIG. 1 are merely illustrative. There can be any number of mobile terminals, networks and servers according to implementation needs. For example, the server 105 may be a server cluster composed of multiple servers, or the like.

The mobile terminals 101, 102, 103 may be various electronic devices having processors, including but not limited to smartphones, tablet computers, portable computers, and the like. The server 105 may be a server that provides various services. For example, the mobile terminals 101 , 102 and 103 may acquire the audio stream tone data of the target object through the processor, and transmit the audio stream tone data to the server 105 . The server 105 can perform speech recognition on the audio stream tone data in the server through the speech recognition service, obtain the voice text data corresponding to the audio stream tone data, and then perform structured processing on the voice text data to obtain the structured stream tone information of the target object , obtains a preconfigured flow report template, and generates a flow report for the target object based on the flow report template and structured flow report information.

Epidemiological investigation report is the abbreviation of epidemiological investigation report, which is generally written by the CDC of the government health department. Information situation, family situation, work situation, close contact situation (referred to as close contact), places visited in the past few days (usually 7 days, 14 days or longer) (trajectory situation) and other information, and organize it into a flow report .

At present, there is no digital or informatization plan for epidemiological investigations, and epidemiological reports mainly rely on manual on-site records and post-event writing, which is very inefficient. The analysis and judgment of the flow report are mainly carried out manually, and computer assistance is rarely introduced, and the overall efficiency and accuracy are relatively poor.

This exemplary embodiment first provides a method for processing stream adjustment data, which is applied to the server side. Referring to Fig. 2, the above-mentioned method for processing stream modulation data may include the following steps:

Step S210. Acquire the audio stream tone data of the target object from the mobile terminal with the recording function, and store the audio stream tone data.

Step S220. Perform speech recognition on the audio stream tone data through a speech recognition service to obtain speech text data corresponding to the audio stream tone data.

Step S230. Perform structured processing on the speech and text data to obtain structured flow tone information of the target object.

Step S240. Obtain a preconfigured flow adjustment report template, and generate a flow adjustment report of the target object according to the flow adjustment report template and the structured flow adjustment information.

In the method for processing stream tone data in the exemplary embodiment of the present disclosure, the audio stream tone data of the target object is acquired from a mobile terminal with a recording function, and the audio stream tone data is transmitted from the mobile terminal to the server, and then the voice recognition service is used Perform speech recognition on the audio stream tone data in the server, and perform structured processing on the speech and text data, and finally generate a stream tone report of the target object according to the structured stream tone information of the target object. In the method for processing flow adjustment data in the exemplary embodiment of the present disclosure, by introducing a computer-aided method, the entire process of data flow adjustment and processing is performed in a digital manner. On the one hand, the efficiency and accuracy of generating flow adjustment reports can be improved, and On the other hand, it has improved the speed of subsequent infectious disease research and judgment based on the epidemiological report, and bought more time for the prevention and control of infectious diseases.

Hereinafter, the above steps of this exemplary embodiment will be described in more detail with reference to FIGS. 3 to 6 .

In step S210, the audio stream tone data of the target object is acquired from the mobile terminal with the recording function, and the audio stream tone data is stored.

In this example implementation, a mobile terminal with a recording function, such as an App on a mobile phone or a tablet terminal, can be used to perform audio recording and video recording, or a far-field sound pickup device can be used for wireless control to obtain the audio stream data of the target object, where the target object is The target audience, such as confirmed patients with infectious diseases, etc. After acquiring the audio stream tone data of the target object through the mobile terminal, the audio stream tone data is transmitted from the mobile terminal to the server side for further storage and processing.

The recording process of audio streaming data may be completed through various media, such as mobile phones, tablets, computers, and other devices with microphones.

In practical applications, taking the epidemiological report as an example, when a confirmed case of an infectious disease occurs in a certain place, the staff of the epidemiological team will first log in to the epidemiological system after receiving the notification, and create a new stream in the epidemiological system. Adjustment tasks, enter basic flow adjustment information, including time, location, basic information of diagnosed people, handlers, and investigators. The stream modulation system described above is a stream modulation system composed of a mobile terminal with a recording function, a server and a display terminal according to the method for processing stream modulation data in the exemplary embodiment of the present disclosure.

After the task handler receives the task, he will immediately carry out the flow adjustment work. First of all, the confirmed patients are transported to a safe place by means of safe transportation, and after wearing protective equipment, the transfer staff will enter the transfer room for transfer work. The flow adjustment staff will carry the mobile terminals in this system, such as mobile phones and far-field recording equipment. When conducting flow adjustment with confirmed patients, they will use the mobile phone App or far-field recording equipment to record the whole conversation. The recording data is sent back to the backend server in real time.

In step S220, speech recognition is performed on the audio stream tone data through a speech recognition service to obtain speech text data corresponding to the audio stream tone data.

In this example implementation, when the back-end server receives the audio stream tune data, in addition to storing the audio stream tune data, it also sends it to the speech recognition service, and the speech recognition service performs speech recognition in real time and receives the speech From the recognized text result, the speech text data corresponding to the audio stream tone data is obtained, and the speech recognition result is sent to the queue inside the back-end server.

In this example implementation, if a real-time connection is established between the display terminal and the back-end server, the user can also receive the audio data in the streaming project and the corresponding speech recognition result in real time on the display terminal. The above-mentioned protocol for real-time data connection and transmission may use protocols such as WebSocket, wherein the WebSocket protocol is a network communication protocol used for real-time data transmission on the Internet.

In step S230, structured processing is performed on the speech and text data to obtain structured flow tone information of the target object.

After the user receives the text data of speech recognition, he can perform structured processing on the speech and text data to obtain the structured flow tone information of the target object. Among them, structuring refers to the process of extracting valuable information from manually written report texts and organizing them into formatted texts that can be read, recognized and processed by computers.

The structured process can be completed in the back-end server. Taking the flow report as an example, the structured content includes but is not limited to the basic information of diagnosed patients (name, gender, age, residential address, work unit, vaccination status, etc.) , medical treatment information (onset time, diagnosis time, symptoms, presence or absence of underlying diseases, inspection status, etc.), activity track information (date, time, location, travel mode, whether to wear a mask, stay time, contacts, etc.), close contact information (date, contact person's name, contact person relationship, contact person's mobile phone number, contact person's ID card, etc.), the above information can be sent to the user's display terminal for display through the structured flow adjustment information obtained after structured processing.

In this example implementation, the structured flow and tone information of the target object can be obtained by performing structured processing on the speech and text data through a regular expression.

For example, for the information extraction of clinical classification of infectious diseases, the regular expression that can be used is as follows: "(Infectious disease A|Full name of infectious disease A)?.{0,2}(Confirmed cases|Clinical classification)?. {0,2}((light|normal|severe|critical)|asymptomatic)". Use the above regular expression as a template to match the strings in the searched voice text data. If the above regular expression matches the strings in the voice text data successfully, the third capture group can be obtained to extract the specific clinical classification.

In this exemplary embodiment, the speech and text data can also be structured through a pre-trained language representation model to obtain structured flow tone information of the target object.

For example, for address and person name type information extraction, a deep learning-based model can be used. Among them, the open source BERT (Bidirectional Encoder Representation from Transformer) pre-training model can be used, and the NER (Named Entity Recognition, Named Entity Recognition) task based on the Python-based FastHan (Chinese Natural Language Processing Tool) open source library. For the place names extracted by NER, if the place name locations are connected to each other, or the distance between the place name locations is short (for example, no more than 5 characters), it can be processed as an address. In addition, if some disclosed place names are involved, if they are not identified, they can be supplemented by means of a dictionary. For place names that are incorrectly recognized by the model, a dictionary can also be established to filter and exclude.

After the structured flow key information of the target object is obtained, the flow key data processing method in this exemplary embodiment may further perform file integrity check and voice playback to ensure the accuracy and integrity of the flow key information. As shown in FIG. 3 , the above-mentioned method for integrity checking and voice playback may specifically include the following steps:

Step S310. Send the structured stream tone information of the target object to the display terminal for display, and judge whether the structured stream tone information is complete.

First, the structured streaming information of the target object is sent to the display terminal for display, and the user determines whether the structured streaming information is complete and accurate.

Step S320. If the structured flow regulation information is incomplete, then determine the target information that needs to be supplemented in the structured flow regulation information, determine the target audio clip in the audio flow regulation data according to the target information, and obtain complete structured according to the target audio clip. flow information.

In the present exemplary embodiment, when determining the target audio segment in the audio stream tone data according to the target information, the target speech-text segment in the speech-text data can be determined according to the target information, and the text generation timestamp corresponding to the target speech-text segment is obtained, Then, the audio timestamp corresponding to the target audio segment is determined according to the text generation timestamp, and the target audio segment in the audio stream tone data is obtained according to the audio timestamp.

The user can re-obtain part of the target information that needs to be supplemented in the structured stream tone information by listening back to the target audio segment, so as to obtain the complete structured stream tone information.

Step S330. If the structured flow adjustment information is complete, continue to perform subsequent steps to generate a flow adjustment report of the target object.

In addition, the user can manually supplement the missing information in the process based on the completeness of the structured information on the display terminal, or ask the on-site flow adjustment staff to make supplementary questions, so as to obtain complete and accurate structured flow adjustment information.

In step S240, a preconfigured flow adjustment report template is obtained, and a flow adjustment report of the target object is generated according to the flow adjustment report template and the structured flow adjustment information.

After the structured flow adjustment information is complete, users can generate flow adjustment reports of unified specifications according to the pre-configured flow adjustment report templates at any time, and the generated reports can be published directly on the platform. The published flow report supports modification and can be republished after completing the supplementary information. The whole process is completed automatically with the aid of computer, and there is basically no need to manually record and write reports.

In this example embodiment, after the flow report of the target object is generated, the target response strategy related to the flow report may also be determined according to the flow report of the target object. Specifically, coping strategies can be determined according to the following methods.

In this example implementation, as shown in FIG. 4 , according to the flow report of the target object, the target response strategy related to the flow report is determined, which may specifically include the following steps:

Step S410. Acquire the track data of the target object from the flow report of the target object, and obtain the site data of the target site related to the track data according to the track data of the target object.

Step S420. Determine the risk level of the target site according to the site data of the target site, and determine the target response strategy for the target site according to the risk level of the target site.

By combining the trajectory data of the target object and the relevant venue data of the target venue involved in the trajectory, such as venue type, average flow of people, ventilation, protection, visit time, etc., the risk level of the target venue can be calculated, and then Determine the target response strategy for the target site according to the risk level of the target site. If the risk of the target site is very high, the high-risk site can be closed according to the research and judgment results, or other necessary administrative measures can be taken to intervene and control.

In this example implementation, as shown in FIG. 5 , according to the flow report of the target object, the target response strategy related to the flow report is determined, which may further include the following steps:

Step S510. Acquire the trajectory data and state data of the target object from the flow report of the target object.

Step S520. Determine the object type of the target object according to the trajectory data and state data of the target object, and determine the target coping strategy for the target object according to the object type of the target object.

Based on the time and space trajectory, onset time and other information of the target object, it can automatically trace the source, calculate the probability that the confirmed patient is the zero patient, guide the disease control personnel in a clear direction of operation, and implement corresponding measures according to the type of patient.

In this example implementation, as shown in FIG. 6 , according to the flow report of the target object, the target response strategy related to the flow report is determined, which may further include the following steps:

Step S610. Acquire the contact object information of the target object from the flow report of the target object, and obtain the risk level corresponding to the contact object of the target object according to the contact object information.

Step S620. Determine a target coping strategy for the contact object according to the risk level corresponding to the contact object.

The system can automatically deduce the close relationship based on the contact information of the target object, and remind the disease control personnel to pay attention to which people are high-risk groups, so as to improve the efficiency of prevention and control and interception.

Due to the different implementation measures of flow scheduling tasks in different cities, usually the business processes involved in the system need to be flexible and configurable. Generally, BPMN (Business Process Modeling Notation, business process modeling notation) process engine support (included in the back-end server) is used. ), the system designs the BPMN process according to different processes, submits the design results to the process engine, and the process engine performs flexible scheduling of the workflow according to the design, so as to meet the complex business logic process conditions. Among them, BPMN is a general and standard language for process modeling, which is used to draw business process diagrams in order to better understand business processes and interrelationships among various departments.

In addition, this exemplary embodiment also provides a method for processing stream modulation data, which is applied to the entire stream modulation system. Referring to FIG. 7 , the above-mentioned processing method of streaming data may include the following steps:

Step S710. The mobile terminal with the recording function acquires the audio stream tone data of the target object, and transmits the audio stream tone data from the mobile terminal to the server.

Step S720. The server stores the audio stream tone data, and performs speech recognition on the audio stream tone data in the server through a speech recognition service, to obtain speech text data corresponding to the audio stream tone data.

Step S730. The server side performs structured processing on the voice and text data to obtain structured stream tone information of the target object.

Step S740. The server sends the structured flow adjustment information of the target object to the display terminal for display, and adjusts the structured flow adjustment information when the structured flow adjustment information is incomplete to obtain complete structured flow adjustment information.

Step S750. The server obtains a preconfigured flow adjustment report template, and generates a flow adjustment report of the target object according to the flow adjustment report template and the complete structured flow adjustment information.

The specific steps in the above-mentioned flow modulation data processing method applied to the flow modulation system are similar to the specific steps in FIG. 2 , and will not be repeated here.

FIG. 8 schematically shows an architecture diagram of a flow modulation data processing system according to a specific embodiment of the present disclosure, which is an example of the above steps in this exemplary embodiment. The architecture diagram may specifically include the following parts:

1. Mobile phone or tablet app: mainly used for audio and video recording, wireless control of far-field sound pickup equipment, and transmission of audio and video data with the back-end server. The audio and video data can also be stored on the mobile phone or tablet synchronously. If the data received by the server is incomplete due to network transmission problems, the complete audio and video data can be obtained from the mobile phone or tablet again.

2. Server: The central control component of the system, which is mainly used to receive, process, and store audio and video data, communicate with the speech recognition service, receive the results of speech recognition, and send the results of speech recognition to the user's browser; Business logic process processing and data storage are also completed by the back-end server; the structuring of text and speech recognition results, as well as the calculation and judgment of structured data, are also mainly completed in the back-end server.

3. Speech recognition service: It is used to recognize the text from the speech data provided by the server, and transmit the result back to the server.

4. User browser side: display terminal, used to provide an interface used by the user, obtain data from the server, and display it to the user.

5. Far-field sound pickup device: a portable device used to enhance the recording effect, including a microphone array, which is remotely controlled by the mobile phone App through wireless technologies such as Bluetooth or Wifi direct connection, and can send high-quality voice data back to the Mobile phone; this device is optional, and the recording function can also be replaced by a mobile phone.

The above solution only includes the core links. In the case of real scene landing, the general function requirements are more. For example, the above solution may also include user management, authority management, organizational structure management, workflow configuration management, flow adjustment report template configuration, text and voice playback, voice recognition by role, flow adjustment report release, case information database, flow adjustment report Adjust material database, search function, statistical analysis, management cockpit, etc.

It should be noted that although the various steps of the methods of the present disclosure are depicted in the figures in a particular order, this does not require or imply that the steps must be performed in that particular order, or that all illustrated steps must be performed to achieve the desired the result of. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step for execution, and/or one step may be decomposed into multiple steps for execution, and the like.

Further, the present disclosure also provides an apparatus for processing stream modulation data. Referring to FIG. 9 , the device for processing stream tone data may include an audio data acquisition module 910 , a speech-text recognition module 920 , a speech-text structuring module 930 , and a stream tone report generating module 940 . in:

The audio data acquisition module 910 can be used to acquire the audio stream tone data of the target object from the mobile terminal with the recording function, and store the audio stream tone data;

The speech-text recognition module 920 can be used to perform speech recognition on the audio stream tone data through the speech recognition service, and obtain the speech-text data corresponding to the audio stream tone data;

The phonetic text structuring module 930 can be used to perform structured processing on the phonetic text data to obtain the structured flow tone information of the target object;

The flow adjustment report generating module 940 may be configured to obtain a preconfigured flow adjustment report template, and generate a flow adjustment report of the target object according to the flow adjustment report template and the structured flow adjustment information.

In some exemplary embodiments of the present disclosure, the apparatus for processing stream tone data provided by the present disclosure may further include an information integrity processing module, and the information integrity processing module may include a stream tone information display unit and a target segment determination unit , an audio segment playback unit, and an information integrity determination unit. in:

The flow adjustment information display unit can be used to send the structured flow adjustment information of the target object to the display terminal for display, and judge whether the structured flow adjustment information is complete;

The target segment determination unit can be used to determine the target information that needs to be supplemented in the structured stream tone information if the structured stream tone information is incomplete, determine the target audio segment in the audio stream tone data according to the target information, and obtain according to the target audio segment. Complete structured flow adjustment information;

The information integrity judging unit can be configured to continue to perform subsequent steps if the structured flow adjustment information is complete, to generate a flow adjustment report of the target object.

In some exemplary embodiments of the present disclosure, the target segment determination unit may include a text timestamp determination unit and an audio timestamp determination unit. in:

The text timestamp determination unit can be used to determine the target voice text segment in the voice text data according to the target information, and obtain the text generation timestamp corresponding to the target voice text segment;

The audio timestamp determining unit may be configured to determine the audio timestamp corresponding to the target audio segment according to the text generation timestamp, and obtain the target audio segment in the audio stream tone data according to the audio timestamp.

In some exemplary embodiments of the present disclosure, the phonetic text structuring module 930 may include a regular expression structuring unit, which may be used to perform structured processing on the phonetic text data through regular expressions to obtain the structured flow pattern of the target object. information.

In some exemplary embodiments of the present disclosure, the speech-text structuring module 930 may further include a language model structuring unit, which may be used to structure the speech-text data by using a pre-trained language representation model to obtain the structure of the target object flow adjustment information.

In some exemplary embodiments of the present disclosure, the apparatus for processing flow adjustment data provided by the present disclosure may further include a response strategy determination module, which may be configured to determine a target related to the flow adjustment report according to the flow adjustment report of the target object preventive solution.

In some exemplary embodiments of the present disclosure, the coping strategy determination module may include a venue data acquisition unit and a venue coping strategy determination unit. in:

The location data acquisition unit can be used to acquire the trajectory data of the target object from the flow report of the target object, and obtain the location data of the target location related to the trajectory data according to the trajectory data of the target object;

The site coping strategy determining unit may be configured to determine a risk level of the target site according to site data of the target site, and determine a target coping strategy for the target site according to the risk level of the target site.

In some exemplary embodiments of the present disclosure, the coping strategy determination module may further include a state data acquisition unit and a target object coping strategy determination unit. in:

The state data acquisition unit can be used to acquire the trajectory data and state data of the target object from the flow report of the target object;

The target object coping strategy determining unit may be configured to determine the object type of the target object according to the trajectory data and state data of the target object, and determine the target coping strategy for the target object according to the object type of the target object.

In some exemplary embodiments of the present disclosure, the coping strategy determination module may further include a contact object risk level determination unit and a contact object coping strategy determination unit. in:

The contact object risk level determination unit can be used to obtain contact object information of the target object from the flow adjustment report of the target object, and obtain the risk level corresponding to the contact object of the target object according to the contact object information;

The contact object coping strategy determining unit may be configured to determine a target coping strategy for the contact object according to the risk level corresponding to the contact object.

Further, the present disclosure also provides an apparatus for processing stream modulation data. Referring to FIG. 10 , the flow tuning data processing apparatus may include an audio data acquisition module 1010 , a speech text recognition module 1020 , a speech text structuring module 1030 , an information integrity processing module 1040 and a flow tuning report generation module 1050 . in:

The audio data acquisition module 1010 can be used to acquire the audio stream data of the target object through a mobile terminal with a recording function, and transmit the audio stream data from the mobile terminal to the server;

The speech text recognition module 1020 can be used to store the audio stream tone data through the server, and perform speech recognition on the audio stream tone data in the server through a speech recognition service to obtain the audio stream tone data. Corresponding voice text data;

The phonetic text structuring module 1030 can be used to perform structured processing on the phonetic text data through the server to obtain the structured flow tone information of the target object;

The information integrity processing module 1040 can be used to send the structured flow adjustment information of the target object to the display terminal for display through the server side, and when the structured flow adjustment information is incomplete, adjust the structured flow adjustment information to obtain the complete flow adjustment information. structured flow adjustment information;

The flow adjustment report generation module 1050 can be configured to obtain a pre-configured flow adjustment report template through the server, and generate a flow adjustment report of the target object according to the flow adjustment report template and the complete structured flow adjustment information .

The specific details of each module/unit in the above stream modulation data processing apparatus have been described in detail in the corresponding method embodiment section, and will not be repeated here.

FIG. 11 shows a schematic structural diagram of a computer system suitable for implementing an electronic device according to an embodiment of the present invention.

It should be noted that the computer system 1100 of the electronic device shown in FIG. 11 is only an example, and should not impose any limitations on the functions and scope of use of the embodiments of the present invention.

As shown in FIG. 11, a computer system 1100 includes a central processing unit (CPU) 1101, which can be loaded into a random access memory (RAM) 1103 according to a program stored in a read only memory (ROM) 1102 or a program from a storage section 1108 Instead, various appropriate actions and processes are performed. In the RAM 1103, various programs and data necessary for system operation are also stored. The CPU 1101 , the ROM 1102 , and the RAM 1103 are connected to each other through a bus 1104 . An input/output (I/O) interface 1105 is also connected to the bus 1104 .

The following components are connected to the I/O interface 1105: an input section 1106 including a keyboard, a mouse, etc.; an output section 1107 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1108 including a hard disk, etc. ; and a communication section 1109 including a network interface card such as a LAN card, a modem, and the like. The communication section 1109 performs communication processing via a network such as the Internet. Drivers 1110 are also connected to I/O interface 1105 as needed. A removable medium 1111, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is mounted on the drive 1110 as needed so that a computer program read therefrom is installed into the storage section 1108 as needed.

In particular, the processes described above with reference to the flowcharts may be implemented as computer software programs according to embodiments of the present invention. For example, embodiments of the present invention include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In such an embodiment, the computer program may be downloaded and installed from the network via the communication portion 1109, and/or installed from the removable medium 1111. When the computer program is executed by the central processing unit (CPU) 1101, various functions defined in the system of the present application are executed.

It should be noted that the computer-readable medium shown in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples of computer readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), fiber optics, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing. In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device . Program code embodied on a computer readable medium may be transmitted using any suitable medium including, but not limited to, wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more logical functions for implementing the specified functions executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams or flowchart illustrations, and combinations of blocks in the block diagrams or flowchart illustrations, can be implemented in special purpose hardware-based systems that perform the specified functions or operations, or can be implemented using A combination of dedicated hardware and computer instructions is implemented.

As another aspect, the present application also provides a computer-readable medium. The computer-readable medium may be included in the electronic device described in the above embodiments; it may also exist alone without being assembled into the electronic device. middle. The above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by an electronic device, causes the electronic device to implement the methods described in the above-mentioned embodiments.

It should be noted that although several modules of the apparatus for action performance are mentioned in the above detailed description, this division is not mandatory. Indeed, in accordance with embodiments of the present disclosure, the features and functions of two or more modules described above may be embodied in one module. Conversely, the features and functions of one module described above can be further divided into multiple modules to be embodied.

Other embodiments of the present disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or techniques in the technical field not disclosed by the present disclosure .

It is to be understood that the present disclosure is not limited to the precise structures described above and illustrated in the accompanying drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (14)

1. A method for processing stream modulation data is characterized by comprising the following steps:

acquiring audio stream modulation data of a target object from a mobile terminal with a recording function, and storing the audio stream modulation data;

performing voice recognition on the audio tone streaming data through voice recognition service to obtain voice text data corresponding to the audio tone streaming data;

carrying out structuralization processing on the voice text data to obtain structuralization streaming information of the target object;

and acquiring a preset flow modulation report template, and generating a flow modulation report of the target object according to the flow modulation report template and the structured flow modulation information.

2. The method for processing streaming data according to claim 1, wherein after the obtaining of the structured streaming information of the target object, the method further comprises:

sending the structured flow modulation information of the target object to a display terminal for displaying, and judging whether the structured flow modulation information is complete or not;

if the structured stream modulation information is incomplete, determining target information needing to be supplemented in the structured stream modulation information, determining a target audio fragment in the audio stream modulation data according to the target information, and obtaining the complete structured stream modulation information according to the target audio fragment;

and if the structured flow adjustment information is complete, continuing to execute the subsequent steps to generate a flow adjustment report of the target object.

3. The method for processing the tone data according to claim 2, wherein the determining the target audio segment in the audio tone data according to the target information comprises:

determining a target voice text segment in the voice text data according to the target information, and acquiring a text generation timestamp corresponding to the target voice text segment;

and determining an audio time stamp corresponding to the target audio clip according to the text generation time stamp, and acquiring the target audio clip in the audio stream modulation data according to the audio time stamp.

4. The method for processing the caption data according to claim 1, wherein the performing the structuring process on the speech text data to obtain the structured caption information of the target object includes:

and carrying out structural processing on the voice text data through a regular expression to obtain structural flow modulation information of the target object.

5. The method for processing the caption data according to claim 1, wherein the performing the structuring process on the speech text data to obtain the structured caption information of the target object includes:

and carrying out structural processing on the voice text data through a pre-trained language representation model to obtain structural flow modulation information of the target object.

6. The method of processing the flow modulation data according to claim 1, wherein after the generating the flow modulation report of the target object according to the flow modulation report template and the structured flow modulation information, the method further comprises:

and determining a target coping strategy related to the flow regulation report according to the flow regulation report of the target object.

7. The method for processing flow modulation data according to claim 6, wherein the determining a target coping strategy related to the flow modulation report according to the flow modulation report of the target object comprises:

acquiring track data of the target object from the flow regulation report of the target object, and acquiring site data of a target site related to the track data according to the track data of the target object;

and determining a risk level of the target place according to the place data of the target place, and determining an objective coping strategy aiming at the target place according to the risk level of the target place.

8. The method for processing flow modulation data according to claim 6, wherein the determining a target coping strategy related to the flow modulation report according to the flow modulation report of the target object comprises:

acquiring track data and state data of the target object from the flow regulation report of the target object;

determining the object type of the target object according to the trajectory data and the state data of the target object, and determining a target coping strategy aiming at the target object according to the object type of the target object.

9. The method for processing flow modulation data according to claim 6, wherein the determining a target coping strategy related to the flow modulation report according to the flow modulation report of the target object comprises:

acquiring contact object information of the target object from the flow regulation report of the target object, and obtaining a risk level corresponding to the contact object of the target object according to the contact object information;

and determining a target coping strategy aiming at the contact object according to the risk level corresponding to the contact object.

10. A method for processing stream modulation data is characterized by comprising the following steps:

the method comprises the steps that a mobile terminal with a recording function obtains audio stream tone data of a target object and transmits the audio stream tone data to a server side from the mobile terminal;

the server side stores the audio frequency stream modulation data, and carries out voice recognition on the audio frequency stream modulation data in the server side through a voice recognition service to obtain voice text data corresponding to the audio frequency stream modulation data;

the server carries out structuralization processing on the voice text data to obtain structuralization streaming information of the target object;

the server side sends the structured stream modulation information of the target object to a display terminal for displaying, and adjusts the structured stream modulation information when the structured stream modulation information is incomplete to obtain the complete structured stream modulation information;

and the server side acquires a preset flow regulation report template and generates a flow regulation report of the target object according to the flow regulation report template and the complete structured flow regulation information.

11. An apparatus for processing streaming data, comprising:

the audio data acquisition module is used for acquiring audio stream modulation data of a target object from a mobile terminal with a recording function and storing the audio stream modulation data;

the voice text recognition module is used for carrying out voice recognition on the audio frequency flow modulation data through voice recognition service to obtain voice text data corresponding to the audio frequency flow modulation data;

the voice text structuring module is used for carrying out structuring processing on the voice text data to obtain the structured flow modulation information of the target object;

and the flow modulation report generating module is used for acquiring a pre-configured flow modulation report template and generating a flow modulation report of the target object according to the flow modulation report template and the structured flow modulation information.

12. An apparatus for processing streaming data, comprising:

the audio data acquisition module is used for acquiring audio stream modulation data of a target object through a mobile terminal with a recording function and transmitting the audio stream modulation data to a server side from the mobile terminal;

the voice text recognition module is used for storing the audio frequency flow modulation data through the server side and carrying out voice recognition on the audio frequency flow modulation data in the server side through a voice recognition service to obtain voice text data corresponding to the audio frequency flow modulation data;

the voice text structuring module is used for carrying out structuring processing on the voice text data through the server end to obtain the structured flow regulation information of the target object;

the information integrity processing module is used for sending the structured flow modulation information of the target object to a display terminal through the server terminal for displaying, and adjusting the structured flow modulation information when the structured flow modulation information is incomplete to obtain the complete structured flow modulation information;

and the flow regulation report generation module is used for acquiring a pre-configured flow regulation report template through the server side and generating a flow regulation report of the target object according to the flow regulation report template and the complete structural flow regulation information.

13. An electronic device, comprising:

a processor; and

a memory for storing one or more programs which, when executed by the processor, cause the processor to implement the method of processing of streaming data according to any of claims 1 to 10.

14. A computer-readable medium, on which a computer program is stored, which program, when being executed by a processor, is characterized by carrying out the method of processing the streamed tone data as claimed in any one of claims 1 to 10.

Images