TWI789868B - System and method for suggesting associated operations - Google Patents

Abstract

A system and method for suggesting associated operations is provided. The system includes a server, at least one first client electronic device and a second client electronic device. In response to receiving a first operation, the at least one first client electronic device records an associated operation set associated with the first operation in at least one log file, and transmits the at least one log file to the server. The server analyzes the at least one log file to obtain an associated operation suggestion file. The server recommends an associated operation for the second client electronic device according to the associated operation suggestion file.

Description

Systems and methods suitable for suggesting associated operations

The present disclosure relates to a system and method for suggesting associated operations.

When a user wants to operate a specific application program interface or function that he is not familiar with, once the user encounters a problem in operation, it is usually difficult to efficiently obtain assistance from other users, thus spending more time exploring. Based on this, it is necessary to propose an improved system and method suitable for suggesting associated operations.

The present disclosure provides a system and method suitable for suggesting associated operations, allowing the user to obtain suggested associated operations when operation assistance is needed.

The disclosed system suitable for suggesting associated operations includes a server, at least one first user-end electronic device, and a second user-end electronic device. At least one first client electronic device is communicatively connected to the server. The second client electronic device is communicatively connected to the server, wherein: at least one first client electronic device records an associated operation set associated with the first operation in at least one record file in response to receiving the first operation, and transmits at least one The log file is sent to the server; the server analyzes at least one log file to obtain an associated operation suggestion file; the server suggests an associated operation for the second client electronic device according to the associated operation suggestion file.

The method for suggesting an associated operation of the present disclosure includes: by at least one first client electronic device in response to receiving the first operation, recording an associated operation set associated with the first operation in at least one record file, and transmitting the at least one record file to The server; the server analyzes at least one record file to obtain an associated operation suggestion file; the server suggests an associated operation for the second client electronic device according to the associated operation suggestion file.

Based on the above, the disclosed system and method for suggesting associated operations can analyze (different) user operations on a specific application to obtain associated operation suggestions, and can provide associated operation suggestions to users who are less familiar with the application. Based on this, users can get suggestions for associated operations when they need assistance with operations.

In order to make the above-mentioned features and advantages of the present disclosure more comprehensible, the following specific embodiments are described in detail together with the accompanying drawings.

FIG. 1 is a schematic diagram of a system 10 suitable for suggesting association operations according to an exemplary embodiment of the present disclosure. Referring to FIG. 1 , the system 10 includes a server 100 , a first client electronic device 200 a and a second client electronic device 300 . The first client electronic device 200a is communicatively connected (for example, via a wired or wireless network) to the server 100 . The second client electronic device 300 is communicatively connected (for example, via a wired or wireless network) to the server 100 .

The server 100 , the first client electronic device 200 a and the second client electronic device 300 are, for example, personal computers, smart phones, tablet computers or other similar devices. The server 100, the first client electronic device 200a and the second client electronic device 300 can all include a communication chip (not shown in the figure), a storage device (not shown in the figure) and a processing module (not shown in the figure) shown in the figure).

The communication chip can support global mobile communication (GSM, Global System for Mobile communication), personal hand-held telephone system (PHS, Personal Handy-phone System), code multiple acquisition (CDMA, Code Division Multiple Access) system, broadband code division Multiple Access (WCDMA, Wideband Code Division Multiple Access) system, Long Term Evolution (LTE, Long Term Evolution) system, Worldwide Interoperability Microwave Access (WiMAX, Worldwide interoperability for Microwave Access) system, Wireless Fidelity (Wi-Fi, Wireless Fidelity) ) system, the fifth generation mobile communication network (5G, 5 ^th Generation Mobile Network) system, or components of Bluetooth signal transmission.

The storage device can be any type of fixed or removable random access memory (RAM, Random Access Memory), read-only memory (ROM, Read-Only Memory), flash memory (flash memory), hard disk ( HDD, Hard Disk Drive), Solid State Drive (SSD, Solid State Drive) or similar components or a combination of the above components.

The processing module can be a central processing unit (CPU, Central Processing Unit), or other programmable general-purpose or special-purpose microprocessor (Microprocessor), digital signal processor (DSP, Digital Signal Processor), programmable Controller, Application Specific Integrated Circuit (ASIC, Application Specific Integrated Circuit) or other similar components or a combination of the above components.

In this embodiment, the so-called "associated operation" refers to other operations performed by the user after performing a specific operation on the first client electronic device 200a. For example, this specific action can be a text search operation (such as searching for a specific keyword on a web page), and the "associated action" of this specific action can be clicking on a website related to this specific keyword.

In another embodiment, the specific operation may be performed by the user on the application program interface of the first client electronic device 200a, and the "associated operation" of the specific operation may be executed after the specific operation is performed. Other API operations.

2A-2C are schematic diagrams of API operations according to an exemplary embodiment of the present disclosure.

Please refer to FIG. 2A, after the user opens the application program on the first client electronic device 200a, the first client electronic device 200a can provide a screen image 201a as shown in FIG. 2A (the screen image 201a includes API 1~API 8).

Assuming that the user selects API 4 (chart), the first client electronic device 200a may provide a screen image 201b as shown in FIG. 2B (the screen image 201b includes API 1-API 8 in the original FIG. API 41~API 43, API 411~API 417, API 421~API 423, API 431 and API 432). Assuming that the user selects the API 413 (circle diagram) at this time, the first client electronic device 200a may provide a screen image 201c as shown in FIG. 2C (the screen image 201c includes API 4131~API 4132, ~ API 41314 and API 41321 and API 41322). Finally, the user can select the API 4132 (3D circular image).

When the user performs the above selection operations in sequence, the first client electronic device 200a can use an optical character recognition application (OCR, Optical Character Recognition) to recognize the specific operation and the associated operations associated with the specific operation.

For example, the first client electronic device 200a can use a process automation application program (RPA, Robotic Process Automation) to obtain the screen image 201a when the user selects the application program interface 4 (chart), and use the optical character recognition application program to recognize The operation performed by the user is "Select API 4 (Graph)". In one embodiment, the process automation application program may be a screen recording software on the first client electronic device 200a, but the present disclosure is not limited thereto.

The first client electronic device 200a can also identify the screen image 201b and the screen image 201c in this way, so as to identify the associated operation of "select API 4 (diagram)" as "select API 413 (circle graph)" and " Select Application Programming Interface 4132 (Stereo Circular Chart)", and add these two operations to the associated operation set of "Select Application Programming Interface 4 (Graph)".

In another embodiment, the associated operation set of "select API 4 (chart)" may include the screen image 201b and each API in the screen image 201c. In other words, although the user's operation sequence in the above embodiment is "select API 4 (chart)", "select API 413 (circle graph)" and "select API 4132 (three-dimensional circular graph)" , since the first client electronic device 200a provides each API in the screen image 201b and the screen image 201c after executing "select API 4 (chart)", the first client electronic device 200a can display the screen image Each API of 201b and screen image 201c is added to the associated operation set of "Select API 4 (Graph)", that is, the associated operation set may include the user may continue after "Select API 4 (Graph)" The associated operation to perform.

The first user-end electronic device 200a can record the set of associated operations in a record file. The record file is, for example, a file in the operating system of the first client electronic device 200a. For example, the first client electronic device 200a may record the operation in the log file after recognizing the operation as "select API 4 (diagram)". Then, as the first client electronic device 200a recognizes the associated operation as "select API 413 (circular diagram)" and "select API 4132 (three-dimensional circular diagram)", the first client electronic device 200a These two operations can also be recorded in this log file.

The first client electronic device 200a can transmit the record file to the server 100 .

The server 100 can analyze the log file to obtain the associated operation suggestion file. The associated operation suggestion file is, for example, a file in the operating system of the server 100 . The server 100 can analyze the aforementioned record files obtained through the API operations in FIGS. 2A-2C . The associated operation suggestion file can indicate, for example, "Select API 4 (Chart) before selecting API 413 (circle graph)" and "Select application program before selecting API 4132 (Circular graph) Interface 4 (Chart) and API 413 (Circle Chart)". In other words, the server 100 can obtain the associated operation suggestion file based on the user operation (using the first client electronic device 200 a ).

In one embodiment, the server 100 can use a neural network model to analyze the recorded files to obtain associated operation suggestion files. For example, the server 100 can use the knowledge graph technology to extract important words in the record file and mark the relationship between words in the record file, so as to obtain the associated operation suggestion file. For example, the server 100 can use the neural network to convert the text content (such as "chart", "circle chart", "three-dimensional circular chart" and other texts) of the APIs in Fig. 2A to Fig. 2C in the record file. Model, knowledge map technology and/or natural language and other technologies to obtain associated operation suggestion files.

After obtaining the associated operation suggestion file, the server 100 may suggest an associated operation for the second client electronic device 300 according to the associated operation suggestion file.

Please refer to Figure 1 and Figure 2A ~ Figure C at the same time. When the user using the second client electronic device 300 needs operation assistance, the second client electronic device 300 may send an associated operation query request to the server 100 . The associated operation query request may include, for example, the desired query operation "to select a three-dimensional circular graph". Since the above-mentioned associated operation suggestion file indicates that "the API 4 (chart) and the API 413 (circular graph) must be selected before selecting the API 4132 (circular graph)", the server 100 can set "selection API 4 (diagram) and API 413 (circle graph)" are used as suggested operations, and an associated operation suggestion message including the suggested operations is sent to the second client electronic device 300 .

FIG. 3 is a schematic diagram of a system 20 suitable for suggesting association operations according to another exemplary embodiment of the present disclosure. The difference between FIG. 3 and FIG. 1 is that the number of first user-side electronic devices in the system 20 may be multiple (first user-side electronic device 200a, first user-side electronic device 200b, and first user-side electronic device 200c ). The quantity of the first user-side electronic devices shown in FIG. 3 is only for illustration, and the present disclosure is not limited thereto.

The first client electronic device 200b and the first client electronic device 200c may have the same components and functions as the first client electronic device 200a, and details will not be repeated here.

Each of the first client electronic devices (the first client electronic device 200 a , the first client electronic device 200 b , and the first client electronic device 200 c ) can be respectively communicatively connected to the server 100 .

In the embodiment shown in FIG. 3 , each first client electronic device can transmit the record file to the server 100 respectively. The server 100 can analyze each record file to obtain an associated operation suggestion file as in the foregoing embodiment. The server 100 can suggest an associated operation for the second client electronic device 300 according to the associated operation suggestion file.

In other words, by analyzing the log files received from the first client electronic devices (used by different users), the server 100 can collect and analyze the log files received from different users to obtain associated operation suggestions files to suggest associated operations for the second client electronic device 300 .

FIG. 4 is a flowchart of a method for suggesting associated operations according to an exemplary embodiment of the present disclosure.

In step S401 , in response to receiving the first operation, at least one first user-end electronic device records an associated operation set associated with the first operation in at least one record file, and transmits the at least one record file to the server.

In step S402, the server analyzes at least one record file to obtain an associated operation suggestion file.

In step S403, the server suggests an associated operation for the second client electronic device according to the associated operation suggestion file.

To sum up, the disclosed system and method for suggesting associated operations can analyze (different) user operations on a specific application to obtain associated operation suggestions, and can provide associated operation suggestions to those who are less familiar with the application user. Based on this, users can get suggestions for associated operations when they need assistance with operations.

Although the present disclosure has been disclosed above with the embodiments, it is not intended to limit the present disclosure. Anyone with ordinary knowledge in the technical field may make some changes and modifications without departing from the spirit and scope of the present disclosure. The scope of protection of this disclosure should be defined by the scope of the appended patent application.

10, 20: A system suitable for suggesting associated operations 100: server 200a~200c, 300: User-side electronic devices 1~8, 41~43, 411~417, 421~423, 431, 432, 4131, 4132, 41311~41314, 41321, 41322: API 201a~201c: screen images S401~S403: steps

FIG. 1 is a schematic diagram of a system suitable for suggesting associated operations according to an exemplary embodiment of the present disclosure. 2A-2C are schematic diagrams of API operations according to an exemplary embodiment of the present disclosure. FIG. 3 is a schematic diagram of a system suitable for suggesting associated operations according to another exemplary embodiment of the present disclosure. FIG. 4 is a flowchart of a method for suggesting associated operations according to an exemplary embodiment of the present disclosure.

S401~S403: steps

Claims (16)

A system adapted to suggest associated operations, comprising: a server; at least one first client electronic device communicatively connected to the server; and a second client electronic device communicatively connected to the server, wherein: The at least one first client electronic device records a set of associated operations associated with the first operation in at least one log file in response to receiving a first operation, and transmits the at least one log file to the server wherein the at least one first client electronic device displays a second screen in response to receiving the first operation on a first screen, wherein the second screen includes a plurality of APIs, and the at least one first client electronic device receives a second operation on the second screen, wherein the first client electronic associates the plurality of APIs and the second operation with the An associated operation of the first operation, and adding the associated operation to the associated operation set; the server analyzes the at least one record file to obtain an associated operation suggestion file; the server according to the The associated operation suggestion file suggests an associated operation for the second client electronic device. In the system suitable for suggesting associated operations as claimed in claim 1, wherein the first operation includes an application programming interface operation and a text search operation. A system adapted to suggest associated operations as recited in claim 1, wherein: The at least one first client electronic device recognizes the first operation using an OCR application in response to receiving the first operation on the first screen image. The system adapted to suggest associated operations as recited in Claim 3, wherein: said at least one first client electronic device utilizes said optical character in response to receiving said second operation on said second screen frame The recognition application program recognizes the second operation. In the system suitable for suggesting associated operations as claimed in claim 4, wherein the at least one first client electronic device utilizes a process automation application program to obtain the first screen image and the second screen image. The system suitable for suggesting associated operations as claimed in claim 1, wherein: the server uses a neural network model to analyze the at least one record file to obtain the associated operation suggestion file. The system suitable for suggesting associated operations as described in Claim 1, wherein: the second client electronic device transmits an associated operation query request to the server, wherein the associated operation query request includes an operation to be queried; In response to receiving the association operation query request, the server generates an association operation suggestion message according to the association operation suggestion file, and sends the association operation suggestion message to the second client electronic device, wherein the association The operation suggestion message includes a suggested operation. The system suitable for suggesting associated operations as described in claim 1, wherein the number of the at least one first user-side electronic device is multiple, and the at least one record The number of record files is multiple, wherein the first user-end electronic devices are respectively connected to the server by communication, wherein: the first user-end electronic devices respectively transmit the record files to the server; The server analyzes the log files to obtain the associated operation suggestion files. A method for suggesting an associated operation, comprising: by at least one first client electronic device in response to receiving a first operation, recording an associated operation set associated with the first operation in at least one record file, and transmitting the at least one log file to a server, wherein said at least one first client electronic device displays a second screen in response to receiving said first operation on a first screen, wherein said second screen including a plurality of APIs, and the at least one first client electronic device receives a second operation on the second screen, wherein the first client electronic uses the plurality of APIs and the The second operation is used as an associated operation associated with the first operation, and the associated operation is added to the associated operation set; the server analyzes the at least one record file to obtain an associated operation suggestion file ; Suggesting an associated operation for a second client electronic device according to the associated operation suggestion file by the server. In the method for suggesting associated operations as claimed in item 9, wherein the first operation includes an application programming interface operation and a text search operation. The method for suggesting associated operations as described in claim item 9 further includes: The first operation is recognized by the at least one first client electronic device using an OCR application in response to receiving the first operation on the first screen. The method for suggesting an associated operation as claimed in claim 11, further comprising: using the optical character by the at least one first client electronic device in response to receiving the second operation on the second screen The recognition application program recognizes the second operation. The method for suggesting associated operations as claimed in claim 12 further includes: obtaining the first screen image and the second screen image by the at least one first client electronic device using a process automation application program. The method for suggesting an associated operation as described in Claim 9, wherein the step of analyzing the at least one record file by the server to obtain the suggested associated operation file further includes: using a neural network model by the server Analyzing the at least one log file to obtain the associated operation suggestion file. The method for suggesting an associated operation as described in claim 9, wherein the step of suggesting an associated operation for the second client electronic device according to the associated operation suggestion file by the server further includes: by the second client The electronic device sends an associated operation query request to the server, wherein the associated operation query request includes an operation to be queried; In response to receiving the association operation query request, the server generates an association operation suggestion message according to the association operation suggestion file, and sends the association operation suggestion message to the second client electronic device, wherein the The associated operation suggestion message includes a suggested operation. The method for suggesting an associated operation as described in Claim 9, wherein the number of the at least one first client electronic device is multiple, and the number of the at least one record file is multiple, and the number of the first client terminals The electronic devices are communicatively connected to the server respectively, wherein the method further includes: sending the log files to the server from the first client electronic devices respectively; analyzing the log files by the server to The associated operation suggestion file is obtained.

Images