CN120639733A - Data processing method, device, equipment and storage medium for communication tools - Google Patents
Data processing method, device, equipment and storage medium for communication toolsInfo
- Publication number
- CN120639733A CN120639733A CN202510931643.6A CN202510931643A CN120639733A CN 120639733 A CN120639733 A CN 120639733A CN 202510931643 A CN202510931643 A CN 202510931643A CN 120639733 A CN120639733 A CN 120639733A
- Authority
- CN
- China
- Prior art keywords
- user
- message
- data
- batch
- group chat
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The application discloses a data processing method, a device, equipment and a storage medium of a communication tool, which relate to the technical field of communication, and the method comprises the steps of receiving real-time data streams consumed by a user in the communication tool; the method comprises the steps of carrying out batch processing on real-time data streams to obtain batch target data, storing the batch target data in a preset storage system, carrying out batch processing including stream processing and batch processing, pulling the batch target data from the preset storage system based on a preset user list, carrying out message comparison to determine the number of unread messages, sending the number of unread messages to a client, and updating the number of unread messages by the client according to real-time message events and user superior operation. The application adopts batch processing data processing mode for the real-time data flow consumed by the user in the communication tool, and combines the client to update the number of the unread messages, thereby realizing the functions of message receiving and transmitting from the upper level of the user to the user and updating the number of the unread messages and reducing the cost of real-time statistics of the unread messages of the interface.
Description
Technical Field
The present application relates to the field of communications technologies, and in particular, to a data processing method, apparatus, device, and storage medium for a communications tool.
Background
The instant messaging tool is used as real-time online communication software, has the functions of text, voice, video, file transmission and the like, is widely applied to scenes such as personal communication, team cooperation, remote work, online education, customer service, game communication and the like, promotes quick information transmission, promotes development of remote cooperation and social network, and becomes an indispensable communication mode in modern society.
The current mainstream B-terminal application scene instant messaging tool in the market is mainly developed and realized by adopting a C/S architecture, but has long iteration period, needs to adapt to different systems, has single message processing function of a server, and is difficult to adapt to service scenes with fast iteration rhythm and complex service logic on a client line.
Disclosure of Invention
The application mainly aims to provide a data processing method, a device, equipment and a storage medium of a communication tool, and aims to solve the technical problems that the current instant communication tool has a single message processing function of a server side, and is difficult to adapt to a service scene with fast iteration rhythm and complex business logic on a client line.
In order to achieve the above object, the present application provides a data processing method of a communication tool, the method comprising:
Receiving a real-time data stream consumed by a user in a communication tool;
Carrying out batch processing on the real-time data stream to obtain batch target data, and storing the batch target data into a preset storage system, wherein the batch processing comprises stream processing and batch processing;
Pulling batch flow target data from a preset storage system based on a preset user list to carry out message comparison, and determining the number of unread messages;
and sending the unread message number to a client, and updating the unread message number by the client according to the real-time message event and the user superior operation.
In one embodiment, when the batch processing is streaming processing, the step of performing batch processing on the real-time data stream to obtain batch target data and storing the batch target data in a preset storage system includes:
the Flink frame is utilized to conduct streaming processing on the real-time data stream, and a group chat user list, a user notification event and a message record are obtained;
carrying out information association according to the group chat user list, the user notification event and the message record to obtain group chat user result data;
filtering uplink data of the message record to obtain uplink message result data of a user;
And storing the group chat user result data and the user uplink message result data into a first storage system.
In an embodiment, the step of obtaining the group chat user result data by performing information association according to the group chat user list, the user notification event and the message record includes:
Extracting a temporary group chat user list and a formal group chat user list from the group chat user list;
ID conversion is carried out on the temporary group chat user list, and a temporary group chat user list intermediate result is obtained;
Associating the temporary group chat user list intermediate result and the formal group chat user list with user basic information to obtain initial result data;
and adding the user notification event and the message record into the initial result data to generate group chat user result data.
In an embodiment, when the batch processing is batch processing, the step of performing batch processing on the real-time data stream to obtain batch target data and storing the batch target data in a preset storage system further includes:
offline processing is carried out on the real-time data stream at a preset time point, so that an uplink message result of a day end user and a chat user result of a day end group are obtained;
Carrying out unread pretreatment according to the uplink message result of the day end user and the chat user result of the day end group, and determining the number of unread messages in the previous day;
batch updating is carried out on the daily terminal group chat user result and the user basic information, and the updating result is added into the previous daily unread message number to determine second group chat user result data;
and storing the second group chat user result data into a second storage system.
In an embodiment, the step of pulling the batch target data from the preset storage system based on the preset user list to perform message comparison and determining the number of unread messages includes:
Pulling batch flow target data from the preset storage system, and judging whether the user sends a message or not according to the batch flow target data;
when the user sends the message, judging whether the message sending time of the user is later than the message reading time of the upper level of the user;
And when the message sending time is later than the message reading time, determining the number of unread messages according to the previous day reading time of the user and the previous day sending time of the user, wherein the number of unread messages is the number of the messages sent by the user on the current day when the current day reading time is longer than the previous day reading time, and the number of unread messages is the sum of the number of unread messages on the current day and the number of unread messages on the previous day when the current day sending time is longer than the previous day sending time.
In one embodiment, the step of updating the unread message number by the client according to the real-time message event and the user superior operation includes:
the client is used for acquiring a real-time message event and user superior operation;
The client is used for updating the number of unread messages to zero when a superior read notification exists in the real-time message event or a selected user operation exists in the superior operation of the user;
And the client is used for updating the unread message number when the user newly sends a message in the real-time message event and the selected user operation does not exist in the user superior operation.
In one embodiment, before the step of receiving the real-time data stream consumed by the user in the communication tool, the method further includes:
storing micro-application information to a configuration table, wherein the micro-application information comprises registration logic and loading and unloading logic of a micro-application;
loading the micro application based on a micro front end framework according to the loading and unloading logic;
And accessing the micro application into the communication tool to perform data communication according to the registration logic, wherein the micro application receives the state data of the communication tool through splitting fine granularity.
In addition, to achieve the above object, the present application also provides a data processing device of a communication tool, the device including:
the data stream receiving module is used for receiving real-time data streams consumed by a user in the communication tool;
the batch flow processing module is used for carrying out batch flow processing on the real-time data flow to obtain batch flow target data, and storing the batch flow target data into a preset storage system, wherein the batch flow processing comprises flow processing and batch processing;
The message comparison module is used for pulling batch flow target data from the preset storage system based on a preset user list to carry out message comparison and determining the number of unread messages;
and the message updating module is used for sending the unread message number to a client, and the client updates the unread message number according to the real-time message event and the user superior operation.
In addition, in order to achieve the above object, the application also proposes a data processing device of a communication tool, the device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program being configured to implement the steps of the data processing method of a communication tool as described above.
In addition, to achieve the above object, the present application also proposes a storage medium, which is a computer-readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, implements the steps of the data processing method of the communication tool as described above.
The data processing method of the communication tool at least has the following technical effects that the data processing method of the communication tool comprises the steps of receiving real-time data streams consumed by users in the communication tool, conducting batch processing on the real-time data streams to obtain batch target data, storing the batch target data into a preset storage system, wherein the batch processing comprises stream processing and batch processing, pulling the batch target data from the preset storage system based on a preset user list to conduct message comparison, determining the number of unread messages, and sending the number of unread messages to a client, wherein the client updates the number of unread messages according to real-time message events and user superior operation.
The application adopts batch processing data processing mode for the real-time data flow consumed by the user in the communication tool, and combines the client to update the number of the unread messages, thereby realizing the functions of message receiving and transmitting from the upper level of the user to the user and updating the number of the unread messages and reducing the cost of real-time statistics of the unread messages of the interface.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following description will briefly explain the drawings required in the embodiments or the prior art, and it will be obvious to those skilled in the art that other drawings can be obtained according to these drawings without inventive effort.
FIG. 1 is a flow chart of a data processing method of a communication tool according to an embodiment of the present application;
FIG. 2 is a flow chart of a streaming process according to a first embodiment of the present application;
FIG. 3 is a flow chart of a batch process according to a first embodiment of the present application;
FIG. 4 is a flow chart of an unread message count process according to a first embodiment of the present application;
FIG. 5 is a flowchart of an update of the number of unread messages of a client according to an embodiment of the present application;
FIG. 6 is a flowchart of a second embodiment of a data processing method of a communication tool according to the present application;
fig. 7 is a schematic flow chart of a micro-application access provided in a second embodiment of the present application;
FIG. 8 is a schematic block diagram illustrating a data processing apparatus of a communication tool according to an embodiment of the present application;
Fig. 9 is a schematic device structure diagram of a hardware operating environment related to a data processing method of a communication tool according to an embodiment of the present application.
The achievement of the objects, functional features and advantages of the present application will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the technical solution of the present application and are not intended to limit the present application.
For a better understanding of the technical solution of the present application, the following detailed description will be given with reference to the drawings and the specific embodiments.
It should be noted that, the execution body of the present embodiment may be a computing service device having functions of data receiving, batch processing, and updating the number of unread messages, such as a personal computer, a mobile phone, or an electronic device capable of implementing the above functions, a data processing device (abbreviated as a data processing device) of a communication tool for executing the data processing method of the communication tool of the present application, and the like, which is not limited in this embodiment. The present embodiment and the following embodiments will be described below by taking a data processing apparatus as an example.
Based on this, a first embodiment of the present application is presented. Referring to fig. 1, fig. 1 is a schematic flow chart of an embodiment of a data processing method of a communication tool according to the present application.
In this embodiment, the data processing method of the communication tool includes steps S10 to S40:
and step S10, receiving a real-time data stream consumed by the user in the communication tool.
The communication tool is software for realizing information exchange between people or between people and machines. Common communication tools may include instant messaging software, email, video conferencing software, and the like.
The instant messaging tool software can be divided into two architecture modes, namely C/S (client/server) and B/S (browser/server). The B/S architecture does not need to install a client and adapt to different systems, and has the advantages of low development cost, flexible and changeable adaptation, capability of quickly iterating service scenes and the like. The embodiment constructs a lightweight communication tool of a B/S architecture based on data of an in-line basic communication platform and Web SDK (Web Software Development Kit, network software development kit), and by the scheme of the embodiment, the lightweight communication tool can be decoupled from the basic communication platform, and the functions of real-time messaging and unread message count statistics and update between a user upper level and a user are realized.
It is understood that the real-time data stream is a communication message that is converted for transmission when the user sends the message in the consumption scenario of the communication tool. User information and communication information are stored in the server, so that timeliness, accuracy and inquiry performance of data can be guaranteed.
And step S20, carrying out batch processing on the real-time data stream to obtain batch target data, and storing the batch target data into a preset storage system, wherein the batch processing comprises stream processing and batch processing.
The batch processing is a means for combining the flow processing and the batch processing. The streaming processing focuses on performing instant and data element-by-data element processing on a continuously generated data stream in a real-time data stream, and emphasizes the real-time performance and low delay performance of the data. The batch processing is to accumulate a large amount of data and process the data once again, so that the periodic data can be analyzed in a large scale.
It is understood that the batch target data is a data result obtained after a combined operation (e.g., cleaning, aggregation, etc.) by a stream process and a batch process.
It should be understood that the preset storage system is a preset system for storing batch target data obtained through batch processing, for example, a database management system (such as a relational database MySQL, oracle, etc.), a distributed file system, etc., so as to facilitate subsequent query and call.
In a specific implementation, the data processing device first receives a real-time data stream consumed by a user in the communication tool. And meanwhile, after a certain amount of data is accumulated, starting batch processing, and integrating the processing results of the two to obtain batch target data. And finally, storing the batch flow target data into a preset storage system.
Through the operation of combining stream processing and batch processing, the data with high real-time requirements can be processed in time, and batch operation can be performed on a large amount of accumulated data, so that the computing resources are fully utilized to perform large-scale complex analysis, and the overall data processing efficiency can be improved.
In a possible implementation manner, when the batch flow processing is a flow processing, step S20 of this embodiment may include the steps of performing flow processing on the real-time data flow by using a link frame to obtain a group chat user list, a user notification event and a message record, performing information association according to the group chat user list, the user notification event and the message record to obtain group chat user result data, performing uplink data filtering on the message record to obtain user uplink message result data, and storing the group chat user result data and the user uplink message result data in a first storage system.
It should be noted that the Flink framework is an open source stream processing framework that can efficiently process unbounded and bounded data streams. When the real-time data stream is processed, the Flink framework can process the inflow data in real time, such as data conversion, filtering, aggregation and other operations, and can automatically adjust processing resources according to the flow condition of the data.
It may be understood that the group chat user list refers to a set of identification information of all users participating in the group chat scene of the communication tool. The user notification event is notification information related to the user that occurs in the communication tool, such as a new member joining a group chat notification, a message read notification, etc. A message record is a collection of information content sent and received between users in a group chat, including various types of messages, related metadata for each message, and so forth.
It can be understood that the group chat user result data is data obtained by information correlating the group chat user list, the user notification event, and the message record (e.g., matching the user sending the notification event with a member in the group chat user list by the user ID).
In a possible implementation manner, the step of obtaining group chat user result data according to the group chat user list, the user notification event and the message record in the embodiment includes the steps of extracting a temporary group chat user list and a formal group chat user list from the group chat user list, performing ID conversion on the temporary group chat user list to obtain a temporary group chat user list intermediate result, associating the temporary group chat user list intermediate result and the formal group chat user list with user basic information to obtain initial result data, and adding the user notification event and the message record into the initial result data to generate group chat user result data.
The temporary group chat user list is a group chat user list added to the group chat for temporary purposes. The formal group chat user list is a set of user identifiers that stably belong to a group chat for a long time in the communication tool. The intermediate result of the temporary group chat user list is that after ID conversion is carried out on the temporary group chat user list, the data of the attribute identification information of the temporary group chat user is reserved. For example, in some group chat related activities, a person joining the group chat with a temporarily invited guest may have a certain timeliness of participation in the group chat, as distinguished from a formal member who is stably participating in the group chat for a long period of time.
It should be understood that the user basic information is basic attribute data about the user, such as information of age, sex, region, registration time, etc. of the user.
In a specific implementation, the temporary group chat user list can be subjected to ID conversion, and then the intermediate result of the temporary group chat user list obtained through conversion and the formal group chat user list are unified to be related to user basic information, so that the identification information of the temporary group chat user is reserved, and the data can be more comprehensive.
It should be noted that, the uplink message result data of the user is data obtained by filtering uplink data of the message record, and includes data related to the message actively sent by the user, such as message content, sending time, sender and other information, and reflects active interaction behavior of the user in group chat.
It will be appreciated that the first storage system is a predetermined system for storing group chat user result data and user upstream message result data.
For an exemplary purpose of facilitating an understanding of the above-described streaming process, reference is made to fig. 2, and fig. 2 is a flowchart of streaming process according to a first embodiment of the present application. After the flow processing is performed by utilizing the Flink framework to obtain a group chat user list (comprising a temporary group chat user list and a formal group chat user list), a user notification event (such as a user read notification and a user upper-level read notification) and a message record, data can be acquired from the temporary group chat user list first, and conversion of a client ID is performed to obtain an intermediate result of the temporary group chat user list. And then acquiring data from the formal group chat user list, uniformly associating user basic information with the intermediate result of the temporary group chat user list, and processing part of data serving as group chat user result data. And then, the latest read message records (such as latest messages and message reading time) of the user and the upper level of the user are updated in the data and message records obtained from the read notification of the user and the upper level read notification of the user, and the other part of the data serving as the result data of the group chat user is processed. And then, acquiring data from the message record, and filtering uplink data of the user to obtain uplink message result data of the user. Finally, the group chat user result data and the user uplink message result data which are obtained by the processing are stored in a first storage system so as to support complex inquiry and searching scenes;
In the embodiment, the data from different sources can be integrated through information association, so that more comprehensive group chat user result data is obtained. Meanwhile, the uplink data filtering can focus on the active message sending behavior of the user to obtain the uplink message result data of the user.
In another possible implementation manner, when the batch processing is batch processing, the step S20 of this embodiment may include the steps of performing offline processing on the real-time data stream at a preset time point to obtain a daily end user uplink message result and a daily end group chat user result, performing unread preprocessing according to the daily end user uplink message result and the daily end group chat user result to determine a previous unread message number, performing batch updating on the daily end group chat user result and user base information, adding an updated result to the previous unread message number to determine second group chat user result data, and storing the second group chat user result data in a second storage system.
The preset time point is a preset time point for performing offline processing on the real-time data stream. For example, 2 a.m. every day, the inflow of response data is not needed immediately, the business peak period can be avoided, and the data processing is ensured not to interfere with normal real-time business.
It can be understood that the daily end user uplink message result is a processing result of the user uplink message (the message actively sent by the user) in one day, which is obtained by offline processing the real-time data stream at a preset time point. The daily end user uplink message result can comprise the number of the daily end user uplink messages, the distribution of the sending users, the statistical information of the message content and the like.
The result of the group chat user at the end of the day is a related result of the group chat user in one day, which is obtained after offline processing of the real-time data stream at a preset time point. The results of the group chat user on the day may include information such as the activity of the users in the group chat on the day (e.g., the number of active users, the distribution of users with different activities, etc.), the situation that the users enter and exit the group chat, etc.
It should be appreciated that the number of unread messages on the previous day is the number of messages that were not read by the user in the group chat on the previous day, reflecting the user's attention to the messages.
The second group chat user result data is data integrating the current situation of the group chat user, the updating of the basic information and the unread message situation, and can describe the group chat user information more fully. The second group chat user result data is only distinguished from the group chat user result data and does not represent a precedence relationship.
The second storage system is a predetermined system for storing second group chat user result data obtained after batch processing. The second storage system is only distinguished from the first storage system and does not represent a precedence relationship.
For an exemplary purpose of facilitating an understanding of the above-described batch processing procedure, reference is made to fig. 3, and fig. 3 is a flowchart of a batch processing provided in accordance with an embodiment of the present application. And extracting the user list and the user uplink message from the real-time data stream at the end of each day, and then carrying out batch processing by offline operation to obtain a result of the user uplink message of the end-of-day and a result of the chat user of the end-of-day group. And then calculating unread user information in the previous day according to the uplink information result of the day end user and the chat user result of the day end group, so that the cost of real-time statistics of unread information of the interface is reduced. And then updating the results of the group chat users together with the user basic information according to the final day, taking the results together with unread user information of the previous day as second group chat user result data, and storing the second group chat user result data into a second storage system.
In the embodiment, through offline processing, the overhead of real-time statistics of unread messages of an interface can be reduced, and the problem that data loading is blocked after a user logs in a client next time due to too much backlog of offline messages is avoided.
And step S30, pulling batch stream target data from the preset storage system based on a preset user list to perform message comparison, and determining the number of unread messages.
It should be noted that the user list is a set of predetermined user identities (such as user names, user IDs, etc.). The unread message number is the number of messages that each user in the user list does not read, reflecting the user's attention to the message and the effectiveness of the message delivery.
In a possible implementation manner, the step S30 of this embodiment may include the steps of pulling batch target data from the preset storage system, and judging whether the user has sent a message according to the batch target data, judging whether the message sending time of the user is later than the message reading time of a user upper level when the user has sent the message, and determining the number of unread messages according to the current day reading time of the user upper level and the current day sending time of the user when the message sending time is later than the message reading time, wherein the number of unread messages is the number of message sending of the user on the current day when the current day reading time is greater than the previous day reading time, and the number of unread messages is the sum of the number of unread messages on the current day and the number of unread messages on the previous day when the current day sending time is greater than the previous day sending time.
For an exemplary, to facilitate understanding of the above-mentioned processing procedure of the unread message count, referring to fig. 4, fig. 4 is a flowchart of the unread message count processing provided in the first embodiment of the present application. At the beginning of the process, it is first determined whether the user has transmitted a message, and if not, the unread message number=0. If the user sends the message, comparing the latest message sending time uT of the user with the latest message reading time mT of the upper level of the user, judging whether uT is more than or equal to mT, and if uT is less than mT, the unread message number=0. If uT is greater than or equal to mT, it is again determined whether the user has a reading record on the previous day (i.e. determined according to the previous day reading time mT-1 and the latest message reading time mT, and if mT is inconsistent with mT-1, it indicates that there is a reading record), and if there is a reading record, the number of unread messages=the number of messages sent by the user after mT. If the record is not read, it is again determined whether the user has a message to send on the same day (i.e. it is determined according to the previous day sending time uT-1 and the latest message sending time uT, and it is determined whether uT is greater than uT-1, if uT is less than or equal to uT-1, it indicates that the user has not sent a message on the same day), and if the user has not sent a message on the same day, the unread message number=the previous day unread message number. If the user sends the message on the same day, the number of unread messages=the sum of the number of unread messages on the same day and the number of unread messages on the previous day, and finally the processing of the number of unread messages is finished.
In this embodiment, in combination with the message sending time of the user and the latest message reading time of the user, it can be quickly determined whether the number of unread messages can be directly calculated based on the data of the group chat user on the previous day, if the user uplink message needs to be relied on, the data is pulled from the storage system, and finally the actual number of unread messages of the user is calculated, without the need of the server to calculate and update the total number of unread messages of the user in real time.
And step S40, the unread message number is sent to a client, and the client updates the unread message number according to the real-time message event and the user superior operation.
The real-time message event is a message-related situation that occurs in real time in the communication tool, for example, whether the user sends a message, whether the user has read a notification, etc.
It is understood that the user-level operation is a message-related operation performed by the user's level in the communication tool. For example, the user selects the user to forward, reply, etc. the message.
In a specific implementation, after determining the number of unread messages, the number of unread messages is sent to the client. After receiving the unread message number, the client starts to acquire the real-time message event, and simultaneously pays attention to the superior operation of the user. For the upper operation of the user, if the user forwards new information to the user, the client increases the number of unread information, and if the user withdraws a certain unread information, the number of unread information is reduced to continuously update the number of unread information according to the real-time situation.
In another possible implementation manner, the step S40 of this embodiment may include a step of the client obtaining a real-time message event and a user upper operation, a step of the client updating the number of unread messages to zero when there is a read notification of an upper level in the real-time message event or a selected user operation in the user upper operation, and a step of the client updating the number of unread messages when there is a new user message in the real-time message event and there is no selected user operation in the user upper operation.
For an exemplary, to facilitate understanding of the processing procedure of the client, referring to fig. 5, fig. 5 is a flowchart of updating the number of unread messages of the client according to the first embodiment of the present application. The client terminal obtains the focus according to the obtained real-time message event (such as whether the user sends a message, a read notification of the upper level of the user and the like) and the upper level operation of the user (such as whether the user is selected to operate, whether the client terminal is triggered to obtain the focus and the like). If the read notification of the upper level exists in the real-time message event, the selected user operation exists in the upper level operation of the user or one of the user operation and the trigger client side acquisition focus exists in the acquisition focus, the number of the unread messages is updated to be 0. If a new message sent by the user exists in the real-time message event, judging whether the client acquires the focus, and if the client acquires the focus and selects the user, not reading = 0. And if the client does not acquire the focus unread message number +1, the client finishes the updating process of the unread message number.
In this embodiment, the statistics of the number of unread messages combines the operations of server initialization and client update, and when the user list is loaded to the client list for the first time, the number of unread messages is calculated by the server, and the user updates the unread messages in the use process to be uniformly processed by the client. By means of the hierarchical processing mode, the situation that work is delayed due to unclear message states can be reduced.
In the technical solution provided in this embodiment, the data processing device receives, in the communication tool, the real-time data stream consumed by the user. And meanwhile, after a certain amount of data is accumulated, starting batch processing, and integrating the processing results of the two to obtain batch target data. And finally, storing the batch flow target data into a preset storage system. And then pulling batch stream target data from a preset storage system based on a preset user list to carry out message comparison, determining the number of unread messages of the user, and sending the number of unread messages to the client. After receiving the unread message number, the client starts to acquire the real-time message event, and simultaneously pays attention to the superior operation of the user. For the upper operation of the user, if the user forwards new information to the user, the client increases the number of unread information, and if the user withdraws a certain unread information, the number of unread information is reduced to continuously update the number of unread information according to the real-time situation. The embodiment adopts a batch processing data processing mode for the real-time data flow consumed by the user in the communication tool, and combines the client to update the number of the unread messages, so that the functions of message receiving and transmitting between the upper level of the user and updating the number of the unread messages can be realized, and the cost of real-time statistics of the unread messages of the interface is reduced.
Based on the first embodiment of the present application, a second embodiment of the present application is provided. In the second embodiment of the present application, the same or similar contents as those of the first embodiment can be referred to the description above, and the description is omitted. On this basis, please refer to fig. 6, fig. 6 is a flowchart of a data processing method of the communication tool according to a second embodiment of the present application.
Before step S10 in this example, the data processing method of the communication tool further includes steps S01 to S03:
and step S01, storing micro-application information into a configuration table, wherein the micro-application information comprises registration logic and loading and unloading logic of the micro-application.
It should be noted that, the micro-application information is a set of various setting information about the micro-application, and is a key basis for the interaction between the micro-application and other system components.
The loading and unloading logic is divided into loading logic and unloading logic. The load logic defines how the micro-application is introduced into the runtime environment based on the steps and rules of the particular micro-front-end framework, e.g., determining the order of loading, dependencies, etc. The offload logic specifies the operational flow under which conditions and how the micro-application is removed from the runtime environment. Registration logic then specifies rules and procedures for how the micro-application registers in the communication tool.
It can be appreciated that the configuration table is a data storage structure for storing information of the micro-applications, and important information such as registration logic, loading and unloading logic of the micro-applications can be orderly stored for subsequent corresponding operations on the micro-applications.
And step S02, loading the micro application based on the micro front end framework according to the loading and unloading logic.
The micro front-end framework is used to construct a large front-end application composed of a plurality of small, independent and interoperable front-end applications (i.e., micro applications).
And S03, accessing the micro application into the communication tool to perform data communication according to the registration logic, wherein the micro application receives the state data of the communication tool through splitting fine granularity.
It should be noted that the status data is related data that the communication tool reflects its own status during the operation. Such as the connection status of the communication tool, the user login status, the message activity status of the user, etc.
Referring to fig. 7, fig. 7 is a schematic flow chart of a micro-application access according to a second embodiment of the present application. The micro-application information and the user behavior event are respectively configured and input into a main application of the communication tool, wherein the main application logic receives the user behavior event through user behavior event management. Calls responsible for sub-application loading and unloading are managed by the sub-application. Multiple micro-applications (e.g., smart phone, business assistant, AI helpers, etc. micro-applications) may be loaded simultaneously by the sub-application loader and unloader. And then, communication with the micro-application is managed through application communication management, and state data is obtained through splitting fine granularity, wherein the state data comprise selected client information, user information, call state information and the like, and the method is applicable to a scene of frequent communication between applications.
Meanwhile, besides the communication through the state data, the communication management module also expands and supports the active definition and registration basic function methods of each application, and other applications can call the registered methods through the communication management module, so that the function multiplexing and direct data communication among the applications are realized. The main application provides registration of the micro application, realizes loading and unloading logic of the micro application, manages common data, methods and event communication, has low access modification cost for the sub application, and only needs to pay attention to continuous iterative upgrade of the service after the sub application is modified.
In the technical scheme provided by the embodiment, the micro application of the third party tool, such as an AI assistant, an operation assistant, an intelligent electric visit and the like, can be adapted to fast and changeable business scenes. The adaptation problem of different terminal devices and operating systems is not needed to be considered, most of scenes can be decoupled from a basic communication platform, and the quick iteration of the client operation scene functions can be supported.
It should be noted that the foregoing examples are only for understanding the present application, and are not meant to limit the data processing method of the communication tool of the present application, and more forms of simple transformation based on the technical concept are all within the scope of the present application.
The application further provides a data processing device of a communication tool, please refer to fig. 8, fig. 8 is a schematic block diagram of the data processing device of the communication tool according to an embodiment of the application, wherein the data processing device of the communication tool comprises:
A data stream receiving module 801, configured to receive a real-time data stream consumed by a user in a communication tool;
The batch processing module 802 is configured to perform batch processing on the real-time data stream to obtain batch target data, and store the batch target data into a preset storage system, where the batch processing includes streaming processing and batch processing;
Message comparison module 803, configured to pull batch stream target data from the preset storage system based on a preset user list to perform message comparison, and determine an unread message number;
And the message updating module 804 is configured to send the number of unread messages to a client, where the client updates the number of unread messages according to a real-time message event and a user-level operation.
When the batch processing is a streaming processing, the batch processing module 802 is further configured to perform streaming processing on the real-time data stream by using a link frame to obtain a group chat user list, a user notification event, and a message record, perform information association according to the group chat user list, the user notification event, and the message record to obtain group chat user result data, perform uplink data filtering on the message record to obtain user uplink message result data, and store the group chat user result data and the user uplink message result data in a first storage system.
As one implementation, the batch processing module 802 is further configured to extract a temporary group chat user list and a formal group chat user list from the group chat user list, perform ID conversion on the temporary group chat user list to obtain a temporary group chat user list intermediate result, associate the temporary group chat user list intermediate result and the formal group chat user list with user basic information to obtain initial result data, and add the user notification event and the message record to the initial result data to generate group chat user result data.
As one implementation, when the batch processing is batch processing, the batch processing module 802 is further configured to perform offline processing on the real-time data stream at a preset time point to obtain a day end user uplink message result and a day end group chat user result, perform unread preprocessing according to the day end user uplink message result and the day end group chat user result to determine a previous unread message number, perform batch updating on the day end group chat user result and user base information, add an update result to the previous unread message number to determine second group chat user result data, and store the second group chat user result data in a second storage system.
As one implementation, the message comparison module 803 is further configured to pull batch target data from the preset storage system, determine whether the user has sent a message according to the batch target data, determine whether the message sending time of the user is later than the message reading time of a user upper level when the user has sent the message, determine the number of unread messages according to the current day reading time of the user upper level and the current day sending time of the user when the message sending time is later than the message reading time, wherein the number of unread messages is the number of message sending of the user on the current day when the current day reading time is greater than the previous day reading time, and the number of unread messages is the sum of the number of unread messages on the current day and the number of unread messages on the previous day when the current day sending time is greater than the previous day sending time.
In one embodiment, the message updating module 804 is configured to obtain a real-time message event and a user upper operation, update the number of unread messages to zero when there is a read notification at an upper level in the real-time message event or there is a selected user operation in the user upper operation, and update the number of unread messages when there is a new message sent by a user in the real-time message event and there is no selected user operation in the user upper operation.
The data processing device of the communication tool is further used for storing micro-application information to a configuration table, wherein the micro-application information comprises registration logic and loading and unloading logic of the micro-application, the micro-application is loaded based on a micro-front-end framework according to the loading and unloading logic, the micro-application is accessed to the communication tool for data communication according to the registration logic, and the micro-application receives state data of the communication tool through splitting fine granularity.
Other embodiments or specific implementations of the data processing device of the communication tool of the present application may refer to the above method embodiments, and will not be described herein.
The data processing device of the communication tool provided by the application can solve the technical problems that the current instant communication tool has single message processing function of a server side, and is difficult to adapt to service scenes with fast iteration rhythm and complex business logic on a client line by adopting the data processing method of the communication tool in the embodiment. Compared with the prior art, the beneficial effects of the data processing device of the communication tool provided by the application are the same as those of the data processing method of the communication tool provided by the embodiment, and other technical features of the data processing device of the communication tool are the same as those disclosed by the method of the embodiment, so that the description is omitted herein.
The application provides data processing equipment of a communication tool, which comprises at least one processor and a memory in communication connection with the at least one processor, wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the data processing method of the communication tool in the first embodiment.
With reference now to FIG. 9, FIG. 9 is a schematic diagram illustrating a hardware operating environment for a data processing method of a communication tool according to an embodiment of the present application, wherein the schematic diagram is shown for a data processing apparatus suitable for implementing a communication tool according to an embodiment of the present application. The data processing device of the communication tool in the embodiment of the present application may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (Personal DIGITAL ASSISTANT: personal digital assistant), a PAD (Portable Application Description: tablet), a PMP (Portable MEDIA PLAYER: portable multimedia player), a car-mounted terminal (e.g., car navigation terminal), etc., and a fixed terminal such as a digital TV, a desktop computer, etc. The data processing device of the communication tool shown in fig. 9 is only an example, and should not be construed as limiting the function and scope of use of the embodiment of the present application.
As shown in fig. 9, the data processing apparatus of the communication tool may include a processing device 1001 (e.g., a central processing unit, a graphic processor, etc.), which may perform various appropriate actions and processes according to a program stored in a read only memory 1002 or a program loaded from a storage device 1003 into a random access memory 1004. In the random access memory 1004, various programs and data required for the operation of the data processing apparatus of the communication means are also stored. The processing device 1001, the read only memory 1002, and the random access memory 1004 are connected to each other by a bus 1005. An input/output interface 1006 is also connected to the bus. In general, a system including an input device 1007 such as a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc., an output device 1008 including a Liquid crystal display (LCD: liquid CRYSTAL DISPLAY), a speaker, a vibrator, etc., a storage device 1003 including a magnetic tape, a hard disk, etc., and a communication device 1009 may be connected to the input/output interface 1006. The communication means 1009 may allow the data processing device of the communication tool to communicate with other devices wirelessly or by wire to exchange data. While a data processing apparatus is shown having communication means for various systems, it is to be understood that not all illustrated systems are required to be implemented or provided. More or fewer systems may alternatively be implemented or provided.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via a communication device, or installed from the storage device 1003, or installed from the read only memory 1002. The above-described functions defined in the method of the disclosed embodiment of the application are performed when the computer program is executed by the processing device 1001.
The data processing equipment of the communication tool provided by the application adopts the data processing method of the communication tool in the embodiment, and can solve the technical problems that the current instant communication tool has single message processing function of a server side, and is difficult to adapt to service scenes with fast iteration rhythm and complex business logic on a client line. Compared with the prior art, the beneficial effects of the data processing device of the communication tool provided by the application are the same as those of the data processing method of the communication tool provided by the embodiment, and other technical features of the data processing device of the communication tool are the same as those disclosed in the method of the previous embodiment, so that the description is omitted herein.
It is to be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the description of the above embodiments, particular features, structures, materials, or characteristics may be combined in any suitable manner in any one or more embodiments or examples.
The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
The present application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon for performing the data processing method of the communication tool in the above-described embodiments.
The computer readable storage medium provided by the present application may be, for example, a USB flash disk, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system or device, or a combination of any of the foregoing. More specific examples of a computer-readable storage medium may include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access Memory (RAM: random Access Memory), a Read-Only Memory (ROM), an erasable programmable Read-Only Memory (EPROM: erasable Programmable Read Only Memory or flash Memory), an optical fiber, a portable compact disc Read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this embodiment, the computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system or device. Program code embodied on a computer readable storage medium may be transmitted using any appropriate medium, including but not limited to electrical wiring, fiber optic cable, RF (Radio Frequency) and the like, or any suitable combination of the foregoing.
The computer readable storage medium may be included in the data processing apparatus of the communication means or may exist alone without being incorporated in the data processing apparatus of the communication means.
The computer readable storage medium is loaded with one or more programs, when the one or more programs are executed by data processing equipment of the communication tool, the data processing equipment of the communication tool is used for receiving real-time data streams consumed by users in the communication tool, carrying out batch processing on the real-time data streams to obtain batch target data, storing the batch target data into a preset storage system, carrying out stream processing and batch processing, pulling the batch target data from the preset storage system based on a preset user list to carry out message comparison, determining the number of unread messages, and sending the number of unread messages to a client, wherein the client updates the number of unread messages according to real-time message events and user superior operation.
Computer program code for carrying out operations of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of remote computers, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN: local Area Network) or a wide area network (WAN: wide Area Network), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules involved in the embodiments of the present application may be implemented in software or in hardware. Wherein the name of the module does not constitute a limitation of the unit itself in some cases.
The readable storage medium provided by the application is a computer readable storage medium, and the computer readable storage medium stores computer readable program instructions (namely computer programs) for executing the data processing method of the communication tool, so that the technical problems that the current instant communication tool, the message processing function of a server side is single, and the service scenario with fast iteration rhythm and complex business logic on a client line is difficult to adapt can be solved. Compared with the prior art, the beneficial effects of the computer readable storage medium provided by the application are the same as those of the data processing method of the communication tool provided by the above embodiment, and are not described herein.
The application also provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of a data processing method of a communication tool as described above.
The computer program product provided by the application can solve the technical problems that the current instant messaging tool has single message processing function of a server side, and is difficult to adapt to service scenes with fast iteration rhythm and complex service logic on a client line. Compared with the prior art, the beneficial effects of the computer program product provided by the application are the same as those of the data processing method of the communication tool provided by the above embodiment, and are not described herein.
The foregoing description is only a partial embodiment of the present application, and is not intended to limit the scope of the present application, and all the equivalent structural changes made by the description and the drawings of the present application or the direct/indirect application in other related technical fields are included in the scope of the present application.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202510931643.6A CN120639733A (en) | 2025-07-07 | 2025-07-07 | Data processing method, device, equipment and storage medium for communication tools |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202510931643.6A CN120639733A (en) | 2025-07-07 | 2025-07-07 | Data processing method, device, equipment and storage medium for communication tools |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN120639733A true CN120639733A (en) | 2025-09-12 |
Family
ID=96971334
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202510931643.6A Pending CN120639733A (en) | 2025-07-07 | 2025-07-07 | Data processing method, device, equipment and storage medium for communication tools |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN120639733A (en) |
-
2025
- 2025-07-07 CN CN202510931643.6A patent/CN120639733A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109582310B (en) | Data processing method and device, electronic equipment and computer readable storage medium | |
| US11165742B1 (en) | Unified communication | |
| CN112311656B (en) | Message aggregation and display method and device, electronic equipment and computer readable medium | |
| US9992291B2 (en) | Updating time-related information in post to make it more relevant for the requester on subsequent retrieval of post | |
| CN112765166A (en) | Data processing method, device and computer readable storage medium | |
| CN110781373B (en) | List updating method and device, readable medium and electronic equipment | |
| CN109446204B (en) | Data storage method and device for instant messaging, electronic equipment and medium | |
| CN110098998B (en) | Method and apparatus for processing information | |
| US11758087B2 (en) | Multimedia conference data processing method and apparatus, and electronic device | |
| CN110795446A (en) | List updating method and device, readable medium and electronic equipment | |
| CN112367241A (en) | Message generation and message transmission method, device, equipment and computer readable medium | |
| CN111258670A (en) | Management method and device of component data, electronic equipment and storage medium | |
| CN113127225A (en) | Method, device and system for scheduling data processing tasks | |
| CN113556279A (en) | Message sending method, apparatus, device and storage medium | |
| CN107391274A (en) | The processing method and processing device of deferred information | |
| CN111382039A (en) | Method, device, electronic equipment and storage medium for reporting user behavior event | |
| CN120639733A (en) | Data processing method, device, equipment and storage medium for communication tools | |
| CN112131832A (en) | Method, device and electronic device for reminding task status of online document | |
| CN116185665A (en) | Message processing method, device, equipment and medium | |
| US20150120607A1 (en) | System and method for customer event email consolidation and delivery | |
| CN111818293B (en) | Communication method and device and electronic equipment | |
| US11277300B2 (en) | Method and apparatus for outputting information | |
| CN110061907B (en) | Method and device for receiving and allocating resources | |
| CN111291254A (en) | Information processing method and device | |
| CN113163154B (en) | Information processing method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination |