CN114912932A - Method and device for improving user state and electronic equipment - Google Patents

Abstract

The present disclosure provides a method, device, and electronic device for improving user status. The method includes: acquiring a behavior code used to represent an escalation behavior, and a desired reward used to represent each escalation behavior; and acquiring an upgrade of a target user data; according to the upgrade data, the behavior code of the upgrade behavior and the corresponding expected reward, obtain the behavior strategy of the target user from the initial state to the target state within a set number of behavior cycles; Provide upgrade suggestions to the target user according to the behavior policy, so as to guide the target user to upgrade the state according to the behavior policy.

Description

A method, device and electronic device for improving user status

technical field

The present disclosure relates to the technical field of data processing, and more particularly, to a method for improving user status, a method for improving user points, a device for improving user status, an electronic device, and a computer-readable storage medium .

Background technique

In recent years, live broadcast technology and business have grown rapidly, quickly becoming a new basic technical capability. Whether it is education, entertainment or e-commerce, live broadcast is actively introduced to refresh the business model while improving business scale and business efficiency.

In order to manage the ecological quality of the platform and promote the overall growth of the ecology, the live broadcast platform will create a set of anchor rating standards and corresponding point strategies based on the business rules of the market. For the growing anchors, the platform will also give corresponding rewards and policies. Therefore, The growth of anchors benefits both the platform and the anchors themselves.

In the current live broadcast industry, the anchor's understanding of the platform's level-setting rules and what actions should be taken to complete the level advancement basically depend on the anchor's actual combat and exploration. However, in this ecology, there will be the following two problems:

The first question is that the understanding of platform rules has a high threshold for the anchor crowd. Understanding various proper nouns, being familiar with various rules, and following up on the update and iteration of various rules is undoubtedly a challenge for the original anchor who has a very tight working time.

The second question is, in the face of complex platform rules, combined with your own actual situation and future upgrade demands, how can you easily make the right decision every time, and after the decision is executed, you can perform targeted actions based on platform data. Optimize subsequent behavioral strategies to achieve the original goals.

Therefore, it is necessary to come up with a method that can help streamers grow in a targeted and step-by-step manner.

SUMMARY OF THE INVENTION

An object of the present disclosure is to provide a new technical solution for helping users improve their status.

According to a first aspect of the present disclosure, a method for improving user status is provided, including:

Get the behavior code used to represent the upgrade behavior, and the expected reward used to represent each upgrade behavior;

Acquire the upgrade data of the target user; wherein, the upgrade data includes the current initial state, the target state to be achieved, and the behavior cycle that represents the behavior cycle required for the target user to be upgraded from the initial state to the target state. set quantity;

According to the upgrade data, the behavior code of the upgrade behavior, and the corresponding expected reward, obtain a behavior strategy for the target user to upgrade from the initial state to the target state within a set number of behavior cycles; wherein, The behavior strategy includes the escalation behavior to be executed in each behavior cycle and the corresponding time series;

Provide upgrade advice to the target user according to the behavioral policy.

Optionally, the method further includes:

The preset upgrade rules are analyzed to obtain the behavior code of the upgrade behavior and the corresponding expected reward.

Optionally, the method further includes:

Detecting whether the upgrade rule is updated;

When the upgrade rule is updated, a new upgrade rule is acquired, and the new upgrade rule is parsed again, and the behavior code of the upgrade behavior and the corresponding expected reward are updated.

Optionally, according to the upgrade data, the behavior code of the upgrade behavior, and the corresponding expected reward, it is obtained that the target user is upgraded from the initial state to the target state within a set number of behavior cycles. Behavioral strategies include:

The upgrade data, the behavior code of the upgrade behavior and the corresponding expected reward are input into a preset model to obtain the behavior strategy output by the preset model.

Optionally, the providing an upgrade suggestion to the target user according to the behavior policy includes:

According to the behavior strategy, determine the target escalation behavior that the target user needs to perform within the target behavior cycle;

determining the target expected reward corresponding to the target upgrade behavior;

According to the target upgrade behavior, the target expected reward and a preset text template, obtain the upgrade suggestion of the target user within the target behavior cycle;

The upgrade suggestion is pushed to the target user.

Optionally, the method further includes:

Detect whether the event that pushes the upgrade proposal occurs;

When the event occurs, the step of pushing the upgrade suggestion to the target user is performed.

Optionally, the events include:

A preset push time is reached; and/or,

It is detected that the target user performs a specified operation in a previous behavior cycle of the target behavior cycle.

Optionally, the method further includes:

monitoring the actual state of the target user after the target behavior cycle;

According to the initial state, the actual state, and the target expected reward, determine whether the target user completes the upgrade task within the target behavior cycle;

In the case that the target user has not completed the upgrade task, the behavior policy is adjusted.

Optionally, the method further includes:

When the target user completes the upgrade task, continue to provide upgrade suggestions to the target user according to the behavior policy.

According to a second aspect of the present disclosure, a method for increasing user points is provided, including:

Get the behavior code used to represent the upgrade behavior, and the point reward used to represent each upgrade behavior;

Acquire the upgrade data of the target user; wherein the upgrade data includes the initial points currently possessed, the target points to be possessed, and an indicator indicating the behavior period required for the target user to upgrade from the initial points to the target points. set quantity;

According to the upgrade data, the behavior code of the upgrade behavior, and the corresponding point reward, obtain the behavior strategy for the target user to upgrade from the initial points to the target points within a set number of behavior cycles; wherein, The behavior strategy includes the escalation behavior to be executed in each behavior cycle and the corresponding time series;

Provide upgrade advice to the target user according to the behavioral policy.

According to a third aspect of the present disclosure, an apparatus for improving user status is provided, comprising:

The first acquisition module is used to acquire the behavior code used to represent the upgrade behavior, and used to represent the expected reward corresponding to each upgrade behavior;

The second acquisition module is used to acquire the upgrade data of the target user; wherein, the upgrade data includes the current initial state, the target state to be reached, and the target user being upgraded from the initial state to the target The set number of behavior cycles required by the state;

The strategy obtaining module is used to obtain the target user's promotion from the initial state to the target state within a set number of behavior cycles according to the upgrade data, the behavior code of the upgrade behavior and the corresponding expected reward The behavior strategy; wherein, the behavior strategy includes the escalation behavior to be executed in each behavior cycle and the corresponding time series;

An upgrade suggestion module, configured to provide upgrade suggestions to the target user according to the behavior policy.

According to a fourth aspect of the present disclosure, there is provided an electronic device, comprising:

A processor and a memory for storing instructions for controlling the processor to perform the method according to the first aspect or the second aspect of the present disclosure.

According to a fifth aspect of the present disclosure, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method according to the first or second aspect of the present disclosure .

In the embodiment of the present disclosure, according to the upgrade data of the target user, the behavior code of the upgrade behavior and the corresponding expected reward, the behavior strategy of the target user to upgrade from the initial state to the target state within a set number of behavior cycles is obtained, and according to The behavior strategy provides upgrade suggestions to the target users to guide the target users to improve their status according to the behavior strategy, so that the target users can be upgraded to the target state after a set number of behavior cycles. In this way, it can help the target users have goals and steps. to grow, and play a positive role in promoting the development of target users.

Other features of the present disclosure and advantages thereof will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the disclosure and together with the description serve to explain the principles of the disclosure.

FIG. 1 shows a schematic diagram of an application scenario of an embodiment of the present disclosure.

Fig. 2a is a schematic diagram of a hardware structure of an electronic device according to the first embodiment of the present disclosure.

FIG. 2b is a schematic diagram of a hardware structure of an electronic device according to a second embodiment of the present disclosure.

FIG. 3 shows a flowchart of a method for improving user status according to an embodiment of the present disclosure.

FIG. 4 shows a flowchart of an example of a method for improving a user state according to an embodiment of the present disclosure.

FIG. 5 shows a flowchart of a method for increasing user points according to an embodiment of the present disclosure.

FIG. 6 shows a functional block diagram of an apparatus for improving user status according to an embodiment of the present disclosure.

FIG. 7 shows a functional block diagram of an electronic device according to a third embodiment of the present disclosure.

Detailed ways

Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of the components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application or uses in any way.

Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, such techniques, methods, and apparatus should be considered part of the specification.

In all examples shown and discussed herein, any specific values should be construed as illustrative only and not limiting. Accordingly, other instances of the exemplary embodiment may have different values.

It should be noted that like numerals and letters refer to like items in the following figures, so once an item is defined in one figure, it does not require further discussion in subsequent figures.

In recent years, live broadcast technology and business have grown rapidly, quickly becoming a new basic technical capability. Whether it is education, entertainment or e-commerce, live broadcast is actively introduced to refresh the business model while improving business scale and business efficiency.

In order to manage the ecological quality of the platform and promote the overall growth of the ecology, the live broadcast platform will create a set of anchor rating standards and corresponding point strategies based on the business rules of the market. For the growing anchors, the platform will also give corresponding rewards and policies. Therefore, The growth of anchors benefits both the platform and the anchors themselves.

In the current live broadcast industry, the anchor's understanding of the platform's level-setting rules and what actions should be taken to complete the level advancement basically depend on the anchor's actual combat and exploration. However, in this ecology, there will be the following two problems:

The first question is that the understanding of platform rules has a high threshold for the anchor crowd. Understanding various proper nouns, being familiar with various rules, and following up on the update and iteration of various rules is undoubtedly a challenge for the original anchor who has a very tight working time.

The second question is, in the face of complex platform rules, combined with your own actual situation and future upgrade demands, how can you easily make the right decision every time, and after the decision is executed, you can perform targeted actions based on platform data. Optimize subsequent behavioral strategies to achieve the original goals.

In addition to the field of live broadcasting, in other fields that provide user behavior guidance to improve user status, such as education, fitness, reading, games, shopping, etc., there are also mechanisms to reward and enhance users' behavior to improve users' willingness to use and retention requirements. Specifically, in the fields of education, fitness, reading, games, shopping, etc., users' understanding of the platform's level-setting rules and what actions should be taken to complete the level advancement also need to rely on users' actual combat and exploration. Platforms in these fields are also unable to provide correct behavioral strategies based on users' actual conditions and upgrade demands, so that users can achieve upgrade goals.

Therefore, in order to solve the problem of not being able to accurately provide users with what kind of behavior strategy to take to achieve a certain state in various fields such as live broadcasting, education, fitness, reading, games, shopping, etc., the embodiments of the present disclosure provide a A way to improve user status to help users grow with goals and steps.

FIG. 1 shows a schematic diagram of an application scenario of the method of this embodiment. As shown in FIG. 1 , the terminal device 2000 used by the target user can obtain the initial state of the target user in the application platform 3000 from the corresponding application platform 3000 and display it for the target user to know. The target user may set its own target state through the terminal device 2000 used by the target user according to their actual needs, and represent the set number of behavior cycles required for the target user to upgrade from the initial state to the target state. The electronic device 1000 may obtain the target state of the target user from the terminal device 2000 and the set number of behavior cycles that represent the target user's promotion from the initial state to the target state, and obtain the initial target user's initial state from the corresponding application platform 3000 . state.

The electronic device 1000 may pre-store the behavior codes and corresponding expected rewards of the escalation behaviors obtained according to the escalation rules, specifically the behavior codes and corresponding expected rewards of all escalation behaviors mentioned in the escalation rules.

The electronic device 1000 obtains the target user's promotion from the initial state to the target state within the set number of behavior cycles according to the initial state of the target user, the target state, the set number of behavior cycles, the behavior code of the upgraded behavior, and the corresponding expected reward. Behavior strategy; and provide upgrade suggestions to target users according to the behavior strategy, so as to guide the target users to upgrade according to the behavior strategy.

The state in this embodiment may be points. Then, the points currently possessed by the user may be used as the initial state, the points expected by the target user after a set number of behavior cycles have passed as the target state, and the user performs any task as the target state. The point reward that may be obtained by an upgrade behavior is regarded as the expected reward, and then according to the method of this embodiment, an upgrade suggestion for improving points is provided to the target user.

In this embodiment, by providing an upgrade suggestion to the target user, the target user can execute the target upgrade behavior within the target behavior cycle according to the upgrade suggestion, so that after a set number of behavior cycles, the target user can be upgraded to the target state. In this way, the target user can be helped. Users grow in a targeted and step-by-step manner, which plays a positive role in promoting the development of target users.

Figures 2a and 2b are block diagrams of a hardware configuration of an electronic device 1000 that may be used to implement the method of any embodiment of the present disclosure. The electronic device 1000 of this embodiment may be applied to the above application scenarios.

In one embodiment, as shown in FIG. 2a , the electronic device 1000 may be the server 1100 .

Server 1100 provides a computer for processing, database, and communication facilities. Server 1100 may be a monolithic server or a distributed server across multiple computers or computer data centers. Servers may be of various types, such as, but not limited to, web servers, news servers, mail servers, messaging servers, advertising servers, file servers, application servers, interactive servers, database servers, or proxy servers. In some embodiments, each server may include hardware, software, or embedded logical components or a combination of two or more such components for performing the appropriate functions supported or implemented by the server. For example, a server such as a blade server, a cloud server, etc., or a server group composed of multiple servers, may include one or more of the above-mentioned types of servers, and so on.

In this embodiment, the server 1100 may include a processor 1110 , a memory 1120 , an interface device 1130 , a communication device 1140 , a display device 1150 , and an input device 1160 , as shown in FIG. 2 a .

In this embodiment, the server 1100 may further include a speaker, a microphone, etc., which are not limited herein.

The processor 1110 may be a dedicated server processor, or may be a desktop processor, a mobile version processor, or the like that meets performance requirements, which is not limited herein. The memory 1120 includes, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), a nonvolatile memory such as a hard disk, and the like. The interface device 1130 includes, for example, various bus interfaces, such as a serial bus interface (including a USB interface), a parallel bus interface, and the like. The communication device 1140 is capable of wired or wireless communication, for example. The display device 1150 is, for example, a liquid crystal display screen, an LED display screen and a touch display screen. The input device 1160 may include, for example, a touch screen, a keyboard, and the like.

In this embodiment, the memory 1120 of the server 1100 is used to store instructions for controlling the operation of the processor 1110 to perform at least a method according to any embodiment of the present disclosure. A skilled person can design instructions according to the solutions disclosed in the present disclosure. How the instruction controls the processor to operate is well known in the art, so it will not be described in detail here.

Although a plurality of devices of the server 1100 are shown in FIG. 2 a , the present disclosure may only relate to some of the devices, for example, the server 1100 only relates to the memory 1120 and the processor 1110 .

In one embodiment, the electronic device 1000 may be a terminal device 1200 such as a PC, a notebook computer, etc. used by an operator, which is not limited herein.

In this embodiment, as shown in FIG. 2b, the terminal device 1200 may include a processor 1210, a memory 1220, an interface device 1230, a communication device 1240, a display device 1250, an input device 1260, a speaker 1270, a microphone 1280, and the like.

The processor 1210 may be a mobile version of the processor. The memory 1220 includes, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), a nonvolatile memory such as a hard disk, and the like. The interface device 1230 includes, for example, a USB interface, an earphone interface, and the like. The communication device 1240 is capable of, for example, wired or wireless communication, and the communication device 1240 may include a short-range communication device, such as based on Hilink protocol, WiFi (IEEE 802.11 protocol), Bluetooth, ZigBee, Thread, Z-Wave, NFC, UWB, LiFi, etc. The short-range wireless communication protocol is any device that performs short-range wireless communication. The communication device 1240 may also include a long-distance communication device, such as any device that performs WLAN, GPRS, 2G/3G/4G/5G long-distance communication. The display device 1250 is, for example, a liquid crystal display, a touch display, or the like. The input device 1260 may include, for example, a touch screen, a keyboard, and the like. The user can input/output voice information through the speaker 1270 and the microphone 1280 .

In this embodiment, the memory 1220 of the terminal device 1200 is used to store instructions for controlling the processor 1210 to operate to at least perform the method according to any embodiment of the present disclosure. A skilled person can design instructions according to the solutions disclosed in the present disclosure. How the instruction controls the processor to operate is well known in the art, so it will not be described in detail here.

Although multiple devices of the terminal device 1200 are shown in FIG. 2 b , the present disclosure may only relate to some of the devices. For example, the terminal device 1200 only relates to the memory 1220 , the processor 1210 and the display device 1250 .

FIG. 3 provides an embodiment of a method for improving user status. The method may be implemented by an electronic device. The electronic device may be the server 1100 as shown in FIG. 2a, or the terminal device 1200 as shown in FIG. 2b.

As shown in FIG. 3 , the method for improving user status in this embodiment may include the following steps S3100 to S3400:

Step S3100: Obtain a behavior code for representing an upgrade behavior, and a desired reward for representing each upgrade behavior.

In an embodiment of the present disclosure, the behavior code of the upgrade behavior and the expected reward may be obtained by parsing the latest upgrade rule in advance, and stored in the electronic device 1000 . When step S3100 is performed, the behavior code and expected reward of the upgrade behavior can be directly acquired from the storage device of the electronic device 1000 .

On the basis of this embodiment, before performing the step S3100, the method may further include:

Detect whether the upgrade rule has been updated; in the case of an upgrade rule update, obtain a new upgrade rule, and re-parse the new upgrade rule to update the behavior code and expected reward of the upgrade behavior.

Specifically, by analyzing the new upgrade rule, the behavior code of the new upgrade behavior and the corresponding expected reward can be obtained; the behavior code of the new upgrade behavior and the corresponding new expected reward can be used to replace the behavior of the pre-stored upgrade behavior Encoding and expecting rewards, complete behavioral encoding of escalating behaviors and updating of expected rewards.

In another embodiment of the present disclosure, in the case that the behavior code of the upgrade behavior and the expected reward are not stored in the electronic device 1000, the method may further include: acquiring the latest upgrade rule, and parsing the latest upgrade rule , get the behavioral encoding and expected reward of escalating behavior.

In the embodiment of the present disclosure, the upgrade rule may be an explanatory document published by the application platform on how the user upgrades his/her state. The upgrade rules describe in detail the upgrade behaviors that the user can perform, as well as the text description of the expected rewards that the user can get by performing each upgrade behavior.

In this embodiment, the electronic device 1000 needs to read and understand the upgrade rule based on the machine reading technology in advance, that is, to parse the upgrade rule to obtain a behavior code used to indicate the upgrade behavior that the user can perform, and a behavior code used to indicate that the user performs the upgrade. The expected reward for each level-up behavior.

Step S3200, acquiring the upgrade data of the target user. The upgrade data includes the current initial state, the target state to be reached, and the set number of behavior cycles required for the target user to upgrade from the initial state to the target state.

Specifically, the current actual state of the target user may be the initial state, and the state that the target user needs to achieve by performing a series of upgrade behaviors may be the target state.

In the embodiment of the present disclosure, the initial state and the target state may be states representing user levels or states representing user points.

In this embodiment, the durations of the set number of behavior cycles may be the same or different. For each behavior cycle, the duration may be pre-set or selected by the target user according to the application scenario or specific needs, or may be obtained by the electronic device 1000 in this embodiment according to the historical behavior data of the target user. For example, one behavior cycle may be one day long, or two behavior cycles may be one week long.

Further, the initial state of the target user may be obtained from the application platform. The target state of the target user may be set by the target user according to their own needs. Specifically, the terminal device used by the target user provides an input box for inputting the target state, the target user can input the target state through the input box, and the terminal device can provide the target state to the electronic device 1000 .

Step S3300, according to the upgrade data, the behavior code of the upgrade behavior, and the expected reward, obtain a behavior strategy for the target user to upgrade from the initial state to the target state within a set number of behavior cycles.

Wherein, the behavior policy may include the escalation behavior to be executed in each behavior cycle and the corresponding time series.

In one embodiment of the present disclosure, according to the upgrade data, the behavior code of the upgrade behavior, and the expected reward, obtaining a behavior strategy for the target user to upgrade from an initial state to a target state within a set number of behavior cycles may include:

The upgrade data, the behavior code of the upgrade behavior and the corresponding expected reward are input into the preset model, and the behavior policy output by the preset model is obtained.

Specifically, in an implementation manner of this embodiment, the preset model may be a Markov model. Take the state that the user can reach as the state of the Markov model, the upgrade behavior that can be performed in each behavior cycle as the action of the Markov model, and the expectation corresponding to the upgrade behavior that can be performed in each behavior cycle The reward is used as the reward function of the Markov model, and the model parameters of the Markov model are obtained, and based on the Bellman equation, the behavior policy is obtained according to the model parameters and upgrade data. Among them, the model parameters include probability matrix and damping coefficient.

A Markov decision process is a quintuple <S, A, P, R, γ> consisting of 5 elements. where S is a finite set containing all states and A is a finite set containing all actions. P is a probability matrix, for any state s, it takes a certain behavior a, and then converts to another state s' occurrence probability P _SS' , R indicates that it can be obtained when transitioning from one state s to another state s' the reward function. γ is the damping coefficient, which measures the discounting of rewards over time in the decision-making process, thereby accelerating the convergence of the decision.

In an implementation of this embodiment, the Markov decision process is adopted, all states that the user can reach are regarded as the states of the Markov model, and the upgrade behaviors that can be performed in each behavior cycle are regarded as the Markov model. The action of the model takes the expected reward corresponding to the upgrade behavior that can be performed in each behavior cycle as the reward function of the Markov model, and obtains the model parameters of the Markov model - the probability matrix P and the damping coefficient γ.

In one implementation of this embodiment, the optimization strategy may be derived based on the Bellman equation. The solution of the optimization strategy is usually based on the value iteration method. First, an initial behavior strategy π is defined. Starting from any state s, the cumulative return after a set number of behavior cycles is not lower than that of general decision-making. Then, on the basis of cumulative returns, the initial iterative optimization is continuously performed to obtain the final behavior strategy.

where π is the behavioral policy. R _s is the reward function of the initial state s, and v(s) is the cumulative reward after starting from the initial state s and setting a number of behavioral cycles. v(s'|π) is the cumulative return after a set number of behavior cycles starting from the initial state s'. S _a is the behavior-encoded set of escalation behaviors proposed by policy π in any next behavior cycle.

Step S3400, providing upgrade suggestions to the target user according to the behavior policy.

In this embodiment, by providing an upgrade suggestion to the target user, the target user can be guided to upgrade according to the behavior policy, so that the target user can improve his state according to the upgrade suggestion within the target behavior cycle.

In an embodiment of the present disclosure, providing an upgrade suggestion to a target user according to the behavior policy may include steps S3410-S3440 as shown below:

Step S3410, according to the behavior policy, determine the target escalation behavior that the target user needs to perform within the target behavior cycle.

The target behavior cycle may be pre-set according to application scenarios or specific requirements. For example, the target behavior period may be the earliest behavior period after the current moment at which step S3400 is performed, or may be the behavior period at the current moment. For example, if the duration of each behavior cycle is one day, and the current time is 8:00 on October 1, then, in the embodiment in which the target behavior cycle is the earliest behavior cycle after the current time, the target behavior cycle It may be October 2; in an embodiment where the target behavior period is the behavior period at which the current moment is located, the target behavior period may be October 1.

Further, the target behavior cycle may change with the change of the behavior cycle at the current moment. For example, if the duration of each behavior cycle is one day, the current time is 8:00 on October 1st, the behavior cycle at the current time is October 1st, and the target behavior cycle is the earliest behavior after the current time. The cycle is October 2nd, then, if the behavior cycle at the current moment becomes October 2nd, the target behavior cycle will become October 3rd.

Specifically, the behavior strategy includes behavior codes of escalation behaviors to be executed in each behavior cycle. According to the behavior codes corresponding to the target behavior cycle, the target escalation behaviors to be executed by the target user in the target behavior cycle can be obtained.

Step S3420: Determine the target expected reward corresponding to the target upgrade behavior.

In an embodiment of the present disclosure, a comparison table reflecting the expected reward corresponding to each upgrade behavior may be pre-stored in the electronic device, and by searching the comparison table, the expected reward corresponding to the target upgrade behavior can be obtained as Goals expect rewards.

Step S3430, according to the target upgrade behavior, the target expected reward and the preset text template, obtain the upgrade suggestion of the target user within the target behavior cycle.

In this embodiment, the target upgrade behavior and the target expected reward can be filled in the corresponding positions in the preset text template, so that the target user's upgrade suggestion within the target behavior cycle can be obtained.

In an embodiment of the present disclosure, the electronic device 1000 may pre-store multiple text templates. When step S3430 is performed, a text template matching the target user may be selected from a plurality of text templates, so as to generate an upgrade suggestion for the target user within the target behavior cycle.

In one example, the user tag of the target user and the style of each text template can be obtained, and the matching degree between the user tag and the style of each text template can be calculated, and a text template with the highest matching degree is selected as the matching degree. A text template that matches the target user.

In another example, a plurality of text templates (or styles of text templates) may be provided to the target user in advance, and the target user may select a text template (or style of text template) that meets his own needs according to his own needs, to execute In step S3430, the text target selected by the target user (or the text template of the style selected by the target user) is directly used to generate the upgrade suggestion for the target user in the target behavior cycle.

Through this embodiment, selecting a text template that matches the target user from multiple text templates to generate an upgrade suggestion for the target user within the target behavior cycle, which can make the upgrade suggestion more personalized and improve user experience.

Step S3440, push the upgrade suggestion to the target user.

In an embodiment of the present disclosure, the method may further include: detecting whether an event for pushing an upgrade suggestion occurs; and in the case that the event for pushing an upgrade suggestion occurs, performing the foregoing step S3440.

In an embodiment of the present disclosure, the event for pushing an upgrade suggestion may include:

A preset push time is reached; and/or,

It is detected that the target user performs a specified operation in a previous behavior cycle of the target behavior cycle.

In the embodiment where the event of pushing the upgrade suggestion includes reaching the preset push time, the preset push time may be set in advance according to the application scenario or specific requirements, or may be determined according to the behavior time of the target user . The time to push upgrade recommendations to different users can be the same or different.

In the embodiment where the event of pushing the upgrade suggestion includes detecting that the target user performs a specified operation in the previous behavior cycle of the target behavior cycle, the previous behavior cycle of the target behavior cycle may be before the target behavior cycle, Behavior cycles adjacent to the target behavior cycle. The specified operation may be set in advance according to the application scenario or specific requirements. For example, the specified operation may be ending the live broadcast or logging into the application for the first time.

In the event of an event of pushing an upgrade suggestion, provide an upgrade suggestion to the target user, and the target user can follow the upgrade suggestion and execute the target upgrade behavior within the target behavior cycle, so as to be able to upgrade to the target after a set number of behavior cycles In this way, it can help target users grow in a targeted and step-by-step manner, and play a positive role in promoting the development of target users.

On the basis of this embodiment, the method may further include steps S3500 to S3800 as shown below:

Step S3500, monitoring the actual state of the target user after the target behavior cycle has passed.

In one embodiment of the present disclosure, the electronic device 1000 may adjust the state of the user according to the user's escalation behavior within the target behavior period when the target behavior period ends. Therefore, after the target behavior cycle ends, the state of the target user, that is, the actual state, can be obtained again.

Step S3600, according to the initial state, the actual state, and the target expected reward, determine whether the target user has completed the upgrade task within the target behavior cycle.

In this embodiment, the desired state can be obtained by superimposing the target expected reward on the basis of the initial state. By comparing the desired state with the actual state, it can be determined whether the target user has completed the upgrade task within the target behavior cycle.

Specifically, if the expected state does not exceed the actual state, it may be determined that the target user has not completed the upgrade task within the target behavior period; otherwise, it may be determined that the target user has completed the upgrade task within the target behavior period.

In the case where the status in this embodiment is user points, it may be to determine whether the points corresponding to the desired status are greater than or equal to the points corresponding to the actual status, and the points corresponding to the expected status are greater than or equal to the points corresponding to the actual status In the case of , it can be determined that the target user has completed the upgrade task within the target behavior period; when the points corresponding to the desired state are less than the points corresponding to the actual state, it can be determined that the target user has not completed the upgrade task within the target behavior period.

Step S3700, in the case that the target user has not completed the upgrade task, adjust the behavior policy.

In this embodiment, the manner of adjusting the behavior policy may include: reacquiring the user's upgrade data, and obtaining a new behavior policy according to the new upgrade data.

Specifically, re-acquiring the user's upgrade data may include: taking the actual state obtained in step S3500 as the initial state in the new upgrade data; changing the set number of behavior cycles obtained in step S3200 according to the target behavior cycle to obtain The new set quantity; the target state obtained in step S3200 is still used as the target state in the new upgrade data.

Obtaining a new behavior strategy according to the new upgrade data may include: based on the machine learning model, behavior code and corresponding reward code, and according to the new upgrade data, obtaining the target user's actual state improvement within a new set number of behavior cycles Behavioral strategy to the target state. For a specific manner, reference may be made to the aforementioned step S3300, which will not be repeated here.

Step S3800, when the target user completes the upgrade task, continue to provide upgrade suggestions to the target user according to the behavior policy.

Specifically, when the target user completes the upgrade task, and the current behavior cycle changes, the target behavior cycle may be re-determined, and the foregoing steps S3410 to S3440 are performed.

This embodiment monitors whether the user implements the upgrade suggestion and the actual effect within the target behavior period, to monitor whether the user completes the upgrade task within the target behavior period, and continues to provide the target user with the upgrade according to the behavior policy according to the monitoring result. It is recommended or adjusted to the behavior policy, so as to ensure that the target user can reach the target state after a set number of behavior cycles when the target user performs the upgrade behavior according to the upgrade suggestion. In this way, it can play a positive role in promoting the development of target users.

FIG. 4 is a flowchart of an example of a method for improving user status according to an embodiment of the present disclosure.

As shown in FIG. 4 , the method may include steps S4001 to S400 as shown below

Step S4001, acquiring the latest upgrade rule.

Step S4002, parse the latest upgrade rules to obtain behavior codes and expected rewards of the upgrade behavior.

In step S4003, it is detected whether the upgrade rule is updated. If the upgrade rule is not updated, step S4004 is executed; if the upgrade rule is updated, step S4001 is executed again.

Step S4004: Acquire the upgrade data of the target user, wherein the upgrade data includes the current initial state, the target state to be reached, and the set number of behavior cycles required for the target user to upgrade from the initial state to the target state.

Step S4005, according to the upgrade data, the behavior code of the upgrade behavior, and the expected reward, obtain a behavior strategy for the target user to upgrade from the initial state to the target state within a set number of behavior cycles.

Step S4006, providing an upgrade suggestion to the target user according to the behavior policy, so as to guide the target user to upgrade according to the behavior policy.

Step S4007, monitoring the actual state of the target user after the target behavior cycle has passed.

Step S4008, according to the initial state, the actual state, and the target expected reward, determine whether the target user has completed the upgrade task within the target behavior cycle, and if the target user has not completed the upgrade task, perform step S4009; In this case, continue to step S4006.

Step S4009, when the target user has not completed the upgrade task, adjust the behavior policy.

In this embodiment, a method for increasing user points is provided. The method may be implemented by an electronic device. The electronic device may be the server 1100 as shown in FIG. 2a, or the terminal device 1200 as shown in FIG. 2b.

The method for increasing user points in this embodiment may be as shown in FIG. 5 , and includes the following steps S5100 to S5400:

Step S5100: Obtain a behavior code used to represent an upgrade behavior, and a point reward used to represent each upgrade behavior.

For this step S5100, reference may be made to the step S3100 in the foregoing first method embodiment, which will not be repeated here.

Step S5200: Acquire the upgrade data of the target user; wherein the upgrade data includes the initial points currently possessed, the expected target points, and a set number representing the behavior period required for the target user to upgrade from the initial points to the target points.

For this step S5200, reference may be made to the step S3200 in the foregoing first method embodiment, which will not be repeated here.

Step S5300, according to the upgrade data, the behavior code of the upgrade behavior, and the corresponding point reward, obtain a behavior strategy for the target user to increase from the initial points to the target points within a set number of behavior cycles.

For this step S5300, reference may be made to the step S3300 in the foregoing first method embodiment, which will not be repeated here.

Among them, the behavior policy includes the escalation behavior to be executed in each behavior cycle and the corresponding time series.

Step S5400, providing upgrade suggestions to the target user according to the behavior policy.

For this step S5400, reference may be made to the step S3400 in the foregoing first method embodiment, which will not be repeated here.

In this embodiment, an apparatus 6000 for improving user status is provided, as shown in FIG. The first acquisition module 6100 is used to acquire the behavior code used to represent the upgrade behavior, and to represent the expected reward corresponding to each upgrade behavior; the second acquisition module 6200 is used to acquire the upgrade data of the target user; wherein, the upgrade The data includes the current initial state, the target state to be achieved, and the set number of behavior cycles that represent the target user's promotion from the initial state to the target state; Behavior codes and corresponding expected rewards, to obtain the behavior strategy of the target user from the initial state to the target state within a set number of behavior cycles; the behavior strategy includes the upgrade behavior and the corresponding time to be executed in each behavior cycle sequence; the upgrade suggestion module 6400 is used to provide upgrade suggestions to target users according to the behavior policy.

In an embodiment of the present disclosure, the apparatus 6000 for improving user status may further include:

A module used to parse the preset upgrade rules to obtain the behavior code of the upgrade behavior and the corresponding expected reward.

In an embodiment of the present disclosure, the apparatus 6000 for improving user status may further include:

A module for detecting whether an upgrade rule has been updated;

A module used to obtain a new upgrade rule when the upgrade rule is updated, parse the new upgrade rule again, and update the behavior code of the upgrade behavior and the corresponding expected reward.

In one embodiment of the present disclosure, the policy obtaining module 6300 may also be used to:

The upgrade data, the behavior code of the upgrade behavior and the corresponding expected reward are input into the preset model, and the behavior strategy output by the preset model is obtained.

In one embodiment of the present disclosure, providing upgrade suggestions to target users according to the behavior policy includes:

According to the behavior strategy, determine the target escalation behavior that the target user needs to perform in the target behavior cycle;

Determine the target expected reward corresponding to the target upgrade behavior;

According to the target upgrade behavior, the target expected reward and the preset text template, get the target user's upgrade suggestion within the target behavior cycle;

Push upgrade recommendations to target users.

In an embodiment of the present disclosure, the apparatus 6000 for improving user status may further include:

A module for detecting whether an event that pushes an upgrade proposal has occurred;

When the event occurs, the upgrade suggestion module 6400 performs the step of pushing the upgrade suggestion to the target user.

In one embodiment of the present disclosure, the event includes:

A preset push time is reached; and/or,

The target user is detected to perform the specified action in the previous behavior cycle of the target behavior cycle.

In an embodiment of the present disclosure, the apparatus 6000 for improving user status may further include:

A module for monitoring the actual state of the target user after the target behavior cycle;

A module for determining whether the target user completes the upgrade task within the target behavior cycle according to the initial state, the actual state, and the target expected reward;

A module for adjusting the behavior policy when the target user has not completed the upgrade task.

In an embodiment of the present disclosure, the upgrade suggestion module 6400 may also be used to: continue to provide upgrade suggestions to the target user according to the behavior policy when the target user completes the upgrade task.

Those skilled in the art should understand that the apparatus 6000 for improving user status can be implemented in various ways. For example, the apparatus 6000 for improving user state may be implemented by configuring a processor with instructions. For example, the instructions may be stored in ROM and read from the ROM into the programmable device when the device is started to implement the apparatus 6000 for promoting user state. For example, the apparatus 6000 for enhancing user state can be built into a dedicated device (eg, an ASIC). The apparatus 6000 for improving user status may be divided into mutually independent units, or they may be implemented by combining them together. The apparatus 6000 for improving a user state may be implemented by one of the above various implementation manners, or may be implemented by a combination of two or more of the above various implementation manners.

In this embodiment, the apparatus 6000 for improving user status may have various implementation forms. For example, the apparatus 6000 for improving user status may be any software product that provides user status management services or a functional module running in an application program, or a The peripheral embedded parts, plug-ins, patches, etc. of these software products or application programs can also be these software products or application programs themselves.

In the embodiment of the present disclosure, according to the upgrade data of the target user, the behavior code of the upgrade behavior and the corresponding expected reward, the behavior strategy of the target user to upgrade from the initial state to the target state within a set number of behavior cycles is obtained, and according to The behavior strategy provides upgrade suggestions to the target users to guide the target users to improve their status according to the behavior strategy, so that the target users can be upgraded to the target state after a set number of behavior cycles. In this way, it can help the target users have goals and steps. to grow, and play a positive role in promoting the development of target users.

FIG. 7 provides an embodiment of an electronic device 1000 . The electronic device 1000 may be the server 1100 shown in FIG. 2 or the terminal device 1200 shown in FIG. 2 .

As shown in FIG. 7 , the electronic device 1000 may further include a processor 1300 and a memory 1400, where the memory 1400 is used to store executable instructions; the processor 1300 is used to run the electronic device 1000 according to the control of the instructions to execute any implementation according to the present disclosure Examples of methods to improve user status, or methods to improve user points.

For example, the electronic device 1000 may be a computer cluster capable of providing services that enhance the user's status.

In the embodiment of the present disclosure, according to the upgrade data of the target user, the behavior code of the upgrade behavior and the corresponding expected reward, the behavior strategy of the target user to upgrade from the initial state to the target state within a set number of behavior cycles is obtained, and according to The behavior strategy provides upgrade suggestions to the target users to guide the target users to improve their status according to the behavior strategy, so that the target users can be upgraded to the target state after a set number of behavior cycles. In this way, it can help the target users have goals and steps. to grow, and play a positive role in promoting the development of target users.

The present disclosure also provides an embodiment of a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, implements the method for improving user status or the method for improving user points according to any embodiment of the present disclosure. method.

The present disclosure may be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the present disclosure.

A computer-readable storage medium may be a tangible device that can hold and store instructions for use by the instruction execution device. The computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (non-exhaustive list) of computer readable storage media include: portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM) or flash memory), static random access memory (SRAM), portable compact disk read only memory (CD-ROM), digital versatile disk (DVD), memory sticks, floppy disks, mechanically coded devices, such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above. Computer-readable storage media, as used herein, are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (eg, light pulses through fiber optic cables), or through electrical wires transmitted electrical signals.

The computer readable program instructions described herein may be downloaded to various computing/processing devices from a computer readable storage medium, or to an external computer or external storage device over a network such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer-readable program instructions from a network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .

Computer program instructions for carrying out operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or instructions in one or more programming languages. Source or object code, written in any combination, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as the "C" language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through the Internet connect). In some embodiments, custom electronic circuits, such as programmable logic circuits, field programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), can be personalized by utilizing state information of computer readable program instructions. Computer readable program instructions are executed to implement various aspects of the present disclosure.

Aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.

These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer or other programmable data processing apparatus to produce a machine that causes the instructions when executed by the processor of the computer or other programmable data processing apparatus , resulting in means for implementing the functions/acts specified in one or more blocks of the flowchart and/or block diagrams. These computer readable program instructions can also be stored in a computer readable storage medium, these instructions cause a computer, programmable data processing apparatus and/or other equipment to operate in a specific manner, so that the computer readable medium on which the instructions are stored includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.

Computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other equipment to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other equipment to produce a computer-implemented process , thereby causing instructions executing on a computer, other programmable data processing apparatus, or other device to implement the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more functions for implementing the specified logical function(s) executable instructions. In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that implementation in hardware, implementation in software, and implementation in a combination of software and hardware are all equivalent.

Various embodiments of the present disclosure have been described above, and the foregoing descriptions are exemplary, not exhaustive, and not limiting of the disclosed embodiments. Numerous modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen to best explain the principles of the embodiments, the practical application or technical improvement in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the present disclosure is defined by the appended claims.

Claims (13)

1. A method for improving user status, comprising: Get the behavior code used to represent the upgrade behavior, and the expected reward used to represent each upgrade behavior; Acquire the upgrade data of the target user; wherein, the upgrade data includes the current initial state, the target state to be achieved, and the behavior cycle that represents the behavior cycle required for the target user to be upgraded from the initial state to the target state. set quantity; According to the upgrade data, the behavior code of the upgrade behavior, and the corresponding expected reward, obtain a behavior strategy for the target user to upgrade from the initial state to the target state within a set number of behavior cycles; wherein, The behavior strategy includes the escalation behavior to be executed in each behavior cycle and the corresponding time series; Provide upgrade advice to the target user according to the behavioral policy. 2. The method of claim 1, further comprising: The preset upgrade rules are analyzed to obtain the behavior code of the upgrade behavior and the corresponding expected reward. 3. The method of claim 2, further comprising: Detecting whether the upgrade rule is updated; When the upgrade rule is updated, a new upgrade rule is acquired, and the new upgrade rule is parsed again, and the behavior code of the upgrade behavior and the corresponding expected reward are updated. 4. The method according to claim 2, wherein according to the upgrade data, the behavior code of the upgrade behavior and the corresponding expected reward, the target user is obtained within a set number of behavior cycles by the initial value. Behavioral strategies for state promotion to the target state include: The upgrade data, the behavior code of the upgrade behavior and the corresponding expected reward are input into a preset model to obtain the behavior strategy output by the preset model. 5. The method of claim 1, wherein providing upgrade advice to the target user according to the behavioral policy comprises: According to the behavior strategy, determine the target escalation behavior that the target user needs to perform within the target behavior cycle; determining the target expected reward corresponding to the target upgrade behavior; According to the target upgrade behavior, the target expected reward and a preset text template, obtain the upgrade suggestion of the target user within the target behavior cycle; The upgrade suggestion is pushed to the target user. 6. The method of claim 5, further comprising: Detect whether the event that pushes the upgrade proposal occurs; When the event occurs, the step of pushing the upgrade suggestion to the target user is performed. 7. The method of claim 6, the event comprising: A preset push time is reached; and/or, It is detected that the target user performs a specified operation in a previous behavior cycle of the target behavior cycle. 8. The method of claim 5, further comprising: monitoring the actual state of the target user after the target behavior cycle; According to the initial state, the actual state, and the target expected reward, determine whether the target user completes the upgrade task within the target behavior cycle; In the case that the target user has not completed the upgrade task, the behavior policy is adjusted. 9. The method of claim 8, further comprising: When the target user completes the upgrade task, continue to provide upgrade suggestions to the target user according to the behavior policy. 10. A method for increasing user points, comprising: Get the behavior code used to represent the upgrade behavior, and the point reward used to represent each upgrade behavior; Acquire the upgrade data of the target user; wherein the upgrade data includes the initial points currently possessed, the target points to be possessed, and an indicator indicating the behavior period required for the target user to upgrade from the initial points to the target points. set quantity; According to the upgrade data, the behavior code of the upgrade behavior, and the corresponding point reward, obtain the behavior strategy for the target user to upgrade from the initial points to the target points within a set number of behavior cycles; wherein, The behavior strategy includes the escalation behavior to be executed in each behavior cycle and the corresponding time series; Provide upgrade advice to the target user according to the behavioral policy. 11. An apparatus for improving user status, comprising: The first acquisition module is used to acquire the behavior code used to represent the upgrade behavior, and used to represent the expected reward corresponding to each upgrade behavior; The second acquisition module is used to acquire the upgrade data of the target user; wherein, the upgrade data includes the current initial state, the target state to be reached, and the target user being upgraded from the initial state to the target The set number of behavior cycles required by the state; The strategy obtaining module is used to obtain the target user's promotion from the initial state to the target state within a set number of behavior cycles according to the upgrade data, the behavior code of the upgrade behavior and the corresponding expected reward The behavior strategy; wherein, the behavior strategy includes the escalation behavior to be executed in each behavior cycle and the corresponding time series; An upgrade suggestion module, configured to provide upgrade suggestions to the target user according to the behavior policy. 12. An electronic device comprising: A processor and a memory for storing instructions for controlling the processor to perform the method of any one of claims 1 to 10. 13. A computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of any one of claims 1 to 10.

Images