CN110807150B - Information processing method and device, electronic equipment and computer readable storage medium - Google Patents
Information processing method and device, electronic equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN110807150B CN110807150B CN201910973476.6A CN201910973476A CN110807150B CN 110807150 B CN110807150 B CN 110807150B CN 201910973476 A CN201910973476 A CN 201910973476A CN 110807150 B CN110807150 B CN 110807150B
- Authority
- CN
- China
- Prior art keywords
- item
- vector
- neural network
- role
- attribute information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9535—Search customisation based on user profiles and personalisation
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/70—Game security or game management aspects
- A63F13/79—Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/80—Special adaptations for executing a specific game genre or game mode
- A63F13/822—Strategy games; Role-playing games
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0631—Recommending goods or services
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Computational Linguistics (AREA)
- Biophysics (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- Computing Systems (AREA)
- Molecular Biology (AREA)
- Finance (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- Biomedical Technology (AREA)
- General Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Computer Security & Cryptography (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
技术领域Technical Field
本发明涉及计算机和通信技术领域,具体而言,涉及一种信息处理方法及装置、电子设备和计算机可读存储介质。The present invention relates to the field of computer and communication technology, and in particular to an information processing method and device, an electronic device, and a computer-readable storage medium.
背景技术Background technique
近年来,网页游戏发展迅速,已成为一种重要的娱乐活动。游戏不仅能供玩家参与,还能通过售卖虚拟商品(例如道具)来增强游戏趣味性、提升用户体验、增强用户粘性以及增加游戏平台的收益。In recent years, web games have developed rapidly and have become an important entertainment activity. Games can not only provide players with opportunities to participate, but also enhance the fun of games, improve user experience, enhance user stickiness, and increase the revenue of game platforms by selling virtual goods (such as props).
游戏中的虚拟商品往往种类繁多,同时,游戏对实时性要求较高,用户有快速找到其想要的目标道具的需求,因此,游戏平台是否能为用户提供高效、精准的信息筛选系统至为重要。There are often many types of virtual goods in games. At the same time, games have high real-time requirements, and users need to quickly find the target props they want. Therefore, it is very important for the game platform to provide users with an efficient and accurate information screening system.
需要说明的是,在上述背景技术部分公开的信息仅用于加强对本发明的背景的理解,因此可以包括不构成对本领域普通技术人员已知的现有技术的信息。It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present invention, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field.
发明内容Summary of the invention
本发明实施例提供一种信息处理方法及装置、电子设备和计算机可读存储介质,能够提升待推荐物的个性化推荐的准确度。Embodiments of the present invention provide an information processing method and device, an electronic device, and a computer-readable storage medium, which can improve the accuracy of personalized recommendations for items to be recommended.
本发明的其他特性和优点将通过下面的详细描述变得显然,或部分地通过本发明的实践而习得。Other features and advantages of the present invention will become apparent from the following detailed description, or may be learned in part by practice of the present invention.
本发明实施例提供了一种信息处理方法,所述方法包括:确定目标对象的第一角色;根据所述第一角色的第一角色属性信息,获得所述目标对象的第一对象数据;获得待推荐物的物品属性信息;通过神经网络模型对所述第一对象数据和所述物品属性信息进行处理,从所述待推荐物中确定向所述目标对象的第一角色推荐的第一目标物品。An embodiment of the present invention provides an information processing method, which includes: determining a first role of a target object; obtaining first object data of the target object based on first role attribute information of the first role; obtaining item attribute information of an object to be recommended; processing the first object data and the item attribute information through a neural network model, and determining a first target item recommended to the first role of the target object from the objects to be recommended.
本发明实施例提供了一种信息处理装置,所述装置包括:第一对象角色确定模块,配置为确定目标对象的第一角色;第一对象数据获得模块,配置为根据所述第一角色的第一角色属性信息,获得所述目标对象的第一对象数据;物品属性信息获得模块,配置为获得待推荐物的物品属性信息;第一目标物品确定模块,配置为通过神经网络模型对所述第一对象数据和所述物品属性信息进行处理,从所述待推荐物中确定向所述目标对象的第一角色推荐的第一目标物品。An embodiment of the present invention provides an information processing device, which includes: a first object role determination module, configured to determine a first role of a target object; a first object data acquisition module, configured to obtain first object data of the target object based on first role attribute information of the first role; an item attribute information acquisition module, configured to obtain item attribute information of an item to be recommended; and a first target item determination module, configured to process the first object data and the item attribute information through a neural network model, and determine a first target item recommended to the first role of the target object from the items to be recommended.
本发明实施例提供了一种计算机可读存储介质,其上存储有计算机程序,所述程序被处理器执行时实现如上述实施例中所述的信息处理方法。An embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the information processing method described in the above embodiment is implemented.
本发明实施例提供了一种电子设备,包括:一个或多个处理器;存储装置,配置为存储一个或多个程序,当所述一个或多个程序被所述一个或多个处理器执行时,使得所述一个或多个处理器实现如上述实施例中所述的信息处理方法。An embodiment of the present invention provides an electronic device, comprising: one or more processors; a storage device configured to store one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the information processing method as described in the above embodiments.
在本发明的一些实施例所提供的技术方案中,通过确定目标对象的第一角色,并根据所述第一角色的第一角色属性信息,获得所述目标对象的第一对象数据,还获得待推荐物的物品属性信息,从而可以通过神经网络模型对所述第一对象数据和所述物品属性信息进行处理,从所述待推荐物中确定向所述目标对象的第一角色推荐的第一目标物品。一方面,通过综合考虑目标对象的丰富的角色属性信息和待推荐物的丰富的物品属性信息,来进行待推荐物中的目标物品的确定,可以提升物品的个性化推荐的精准度;另一方面,通过非线性的神经网络模型来刻画目标对象与待推荐物之间复杂的交互作用,可以达到增强模型可解释性及提升推荐效果的目的。In the technical solutions provided by some embodiments of the present invention, by determining the first role of the target object, and according to the first role attribute information of the first role, obtaining the first object data of the target object, and also obtaining the item attribute information of the object to be recommended, the first object data and the item attribute information can be processed by a neural network model, and the first target item recommended to the first role of the target object can be determined from the objects to be recommended. On the one hand, by comprehensively considering the rich role attribute information of the target object and the rich item attribute information of the object to be recommended to determine the target item among the objects to be recommended, the accuracy of personalized recommendation of the items can be improved; on the other hand, by using a nonlinear neural network model to characterize the complex interaction between the target object and the object to be recommended, the purpose of enhancing the model interpretability and improving the recommendation effect can be achieved.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本发明。It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本发明的实施例,并与说明书一起用于解释本发明的原理。显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。在附图中:The drawings herein are incorporated into and constitute a part of the specification, showing embodiments consistent with the present invention, and together with the specification, are used to explain the principles of the present invention. Obviously, the drawings described below are only some embodiments of the present invention, and for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work. In the drawings:
图1示出了可以应用本发明实施例的信息处理方法或信息处理装置的示例性系统架构的示意图;FIG1 is a schematic diagram showing an exemplary system architecture to which an information processing method or an information processing device according to an embodiment of the present invention can be applied;
图2示出了适于用来实现本发明实施例的电子设备的计算机系统的结构示意图;FIG2 is a schematic diagram showing the structure of a computer system of an electronic device suitable for implementing an embodiment of the present invention;
图3示意性示出了根据本发明的一实施例的信息处理方法的流程图;FIG3 schematically shows a flow chart of an information processing method according to an embodiment of the present invention;
图4示意性示出了根据本发明的另一实施例的信息处理方法的流程图;FIG4 schematically shows a flow chart of an information processing method according to another embodiment of the present invention;
图5示意性示出了根据本发明的又一实施例的信息处理方法的流程图;FIG5 schematically shows a flow chart of an information processing method according to another embodiment of the present invention;
图6示出了图3中所示的步骤S320在一实施例中的处理过程示意图;FIG6 is a schematic diagram showing the processing process of step S320 shown in FIG3 in one embodiment;
图7示出了图3中所示的步骤S340在一实施例中的处理过程示意图;FIG. 7 is a schematic diagram showing the processing process of step S340 shown in FIG. 3 in one embodiment;
图8示出了图7中所示的步骤S341在一实施例中的处理过程示意图;FIG8 is a schematic diagram showing the processing process of step S341 shown in FIG7 in one embodiment;
图9示意性示出了根据本发明的一实施例的第一嵌入子模型的示意图;FIG9 schematically shows a schematic diagram of a first embedding sub-model according to an embodiment of the present invention;
图10示出了图7中所示的步骤S342在一实施例中的处理过程示意图;FIG10 is a schematic diagram showing the processing process of step S342 shown in FIG7 in one embodiment;
图11示意性示出了根据本发明的一实施例的第二嵌入子模型的示意图;FIG11 schematically shows a schematic diagram of a second embedding sub-model according to an embodiment of the present invention;
图12示意性示出了根据本发明的一实施例的神经网络模型的结构示意图;FIG12 schematically shows a structural diagram of a neural network model according to an embodiment of the present invention;
图13示出了图7中所示的步骤S343在一实施例中的处理过程示意图;FIG13 is a schematic diagram showing the processing process of step S343 shown in FIG7 in one embodiment;
图14示意性示出了根据本发明的一实施例的第一神经网络子模型的结构示意图;FIG14 schematically shows a schematic structural diagram of a first neural network sub-model according to an embodiment of the present invention;
图15示出了图7中所示的步骤S344在一实施例中的处理过程示意图;FIG. 15 is a schematic diagram showing the processing process of step S344 shown in FIG. 7 in one embodiment;
图16示意性示出了根据本发明的一实施例的第二神经网络子模型的结构示意图;FIG16 schematically shows a schematic diagram of the structure of a second neural network sub-model according to an embodiment of the present invention;
图17示出了图7中所示的步骤S345在一实施例中的处理过程示意图;FIG. 17 is a schematic diagram showing the processing process of step S345 shown in FIG. 7 in one embodiment;
图18示意性示出了根据本发明的一实施例的门派介绍的界面示意图;FIG18 schematically shows a schematic diagram of an interface for introducing martial arts schools according to an embodiment of the present invention;
图19和20示意性示出了根据本发明的一实施例的角色细节定制的界面示意图;19 and 20 schematically show a schematic diagram of an interface for customizing character details according to an embodiment of the present invention;
图21示意性示出了根据本发明的一实施例的角色创建完成的界面示意图;FIG21 schematically shows a schematic diagram of an interface after character creation is completed according to an embodiment of the present invention;
图22示意性示出了根据本发明的一实施例的游戏界面示意图;FIG22 schematically shows a schematic diagram of a game interface according to an embodiment of the present invention;
图23示意性示出了根据本发明的一实施例的角色属性的界面示意图;FIG23 schematically shows a schematic diagram of an interface of role attributes according to an embodiment of the present invention;
图24示意性示出了根据本发明的一实施例的游戏商城的界面示意图;FIG24 schematically shows a schematic diagram of an interface of a game mall according to an embodiment of the present invention;
图25示意性示出了根据本发明的一实施例的信息处理装置的框图。FIG. 25 schematically shows a block diagram of an information processing device according to an embodiment of the present invention.
具体实施方式Detailed ways
现在将参考附图更全面地描述示例实施方式。然而,示例实施方式能够以多种形式实施,且不应被理解为限于在此阐述的范例;相反,提供这些实施方式使得本发明将更加全面和完整,并将示例实施方式的构思全面地传达给本领域的技术人员。Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the present invention will be more comprehensive and complete and fully convey the concept of the example embodiments to those skilled in the art.
此外,所描述的特征、结构或特性可以以任何合适的方式结合在一个或更多实施例中。在下面的描述中,提供许多具体细节从而给出对本发明的实施例的充分理解。然而,本领域技术人员将意识到,可以实践本发明的技术方案而没有特定细节中的一个或更多,或者可以采用其它的方法、组元、装置、步骤等。在其它情况下,不详细示出或描述公知方法、装置、实现或者操作以避免模糊本发明的各方面。In addition, the described features, structures or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present invention. However, those skilled in the art will appreciate that the technical solution of the present invention may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known methods, devices, implementations or operations are not shown or described in detail to avoid blurring various aspects of the present invention.
附图中所示的方框图仅仅是功能实体,不一定必须与物理上独立的实体相对应。即,可以采用软件形式来实现这些功能实体,或在一个或多个硬件模块或集成电路中实现这些功能实体,或在不同网络和/或处理器装置和/或微控制器装置中实现这些功能实体。The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
附图中所示的流程图仅是示例性说明,不是必须包括所有的内容和操作/步骤,也不是必须按所描述的顺序执行。例如,有的操作/步骤还可以分解,而有的操作/步骤可以合并或部分合并,因此实际执行的顺序有可能根据实际情况改变。The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations/steps, nor must they be executed in the order described. For example, some operations/steps can be decomposed, and some operations/steps can be combined or partially combined, so the actual execution order may change according to actual conditions.
图1示出了可以应用本发明实施例的信息处理方法或信息处理装置的示例性系统架构100的示意图。FIG. 1 is a schematic diagram showing an exemplary system architecture 100 to which an information processing method or an information processing device according to an embodiment of the present invention may be applied.
如图1所示,系统架构100可以包括终端设备101、102、103中的一种或多种,网络104和服务器105。网络104用以在终端设备101、102、103和服务器105之间提供通信链路的介质。网络104可以包括各种连接类型,例如有线、无线通信链路或者光纤电缆等等。As shown in Fig. 1, the system architecture 100 may include one or more of terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.
应该理解,图1中的终端设备、网络和服务器的数目仅仅是示意性的。根据实现需要,可以具有任意数目的终端设备、网络和服务器。比如服务器105可以是多个服务器组成的服务器集群等。It should be understood that the number of terminal devices, networks and servers in FIG1 is only illustrative. According to implementation requirements, there may be any number of terminal devices, networks and servers. For example, the server 105 may be a server cluster composed of multiple servers.
用户可以使用终端设备101、102、103通过网络104与服务器105交互,以接收或发送消息等。终端设备101、102、103可以是具有显示屏并且支持网页浏览的各种电子设备,包括但不限于智能手机、平板电脑、膝上型便携计算机、台式计算机、可穿戴设备、智能家居设备等等。Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Terminal devices 101, 102, 103 can be various electronic devices with display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptops, desktop computers, wearable devices, smart home devices, etc.
服务器105可以是提供各种服务的服务器。例如用户利用终端设备103(也可以是终端设备101或102)打开游戏客户端,并在所述游戏客户端上确定其在游戏中的游戏角色,向服务器105发送请求。服务器105可以基于该请求中携带的游戏角色信息,获取相应游戏角色的角色属性信息,从而获得该用户的对象数据;同时,服务器105还可以获得游戏商城中的待推荐物的物品属性信息,通过神经网络模型对该用户的对象数据和各待推荐物的物品属性信息进行处理,从这些待推荐物中确定目标物品,并将目标物品返回给终端设备103,进而用户可以在终端设备103上查看推荐给其当前所选游戏角色的目标物品。The server 105 may be a server that provides various services. For example, a user uses the terminal device 103 (or the terminal device 101 or 102) to open a game client, and determines his game character in the game on the game client, and sends a request to the server 105. The server 105 can obtain the role attribute information of the corresponding game character based on the game character information carried in the request, thereby obtaining the object data of the user; at the same time, the server 105 can also obtain the item attribute information of the items to be recommended in the game mall, process the user's object data and the item attribute information of each item to be recommended through the neural network model, determine the target item from these items to be recommended, and return the target item to the terminal device 103, so that the user can view the target item recommended to the currently selected game character on the terminal device 103.
又如终端设备103(也可以是终端设备101或102)可以是智能电视、VR(VirtualReality,虚拟现实)/AR(Augmented Reality,增强现实)头盔显示器、或者其上安装有即时通讯、导航、视频应用程序(application,APP)等的移动终端例如智能手机、平板电脑等,用户可以通过该智能电视、VR/AR头盔显示器或者该即时通讯、视频APP向服务器105发送各种请求。服务器105可以基于该请求,获取响应于所述请求的反馈信息返回给该智能电视、VR/AR头盔显示器或者该即时通讯、视频APP,进而通过该智能电视、VR/AR头盔显示器或者该即时通讯、视频APP将返回的反馈信息显示。For another example, the terminal device 103 (or the terminal device 101 or 102) may be a smart TV, a VR (Virtual Reality)/AR (Augmented Reality) helmet display, or a mobile terminal such as a smart phone, a tablet computer, etc. on which instant messaging, navigation, video applications (application, APP), etc. are installed. The user may send various requests to the server 105 through the smart TV, VR/AR helmet display, or the instant messaging, video APP. Based on the request, the server 105 may obtain feedback information in response to the request and return it to the smart TV, VR/AR helmet display, or the instant messaging, video APP, and then display the returned feedback information through the smart TV, VR/AR helmet display, or the instant messaging, video APP.
图2示出了适于用来实现本发明实施例的电子设备的计算机系统的结构示意图。FIG. 2 shows a schematic diagram of the structure of a computer system of an electronic device suitable for implementing an embodiment of the present invention.
需要说明的是,图2示出的电子设备的计算机系统200仅是一个示例,不应对本发明实施例的功能和使用范围带来任何限制。It should be noted that the computer system 200 of the electronic device shown in FIG. 2 is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.
如图2所示,计算机系统200包括中央处理单元(CPU,Central Processing Unit)201,其可以根据存储在只读存储器(ROM,Read-Only Memory)202中的程序或者从储存部分208加载到随机访问存储器(RAM,Random Access Memory)203中的程序而执行各种适当的动作和处理。在RAM 203中,还存储有系统操作所需的各种程序和数据。CPU201、ROM 202以及RAM 203通过总线204彼此相连。输入/输出(I/O)接口205也连接至总线204。As shown in FIG2 , the computer system 200 includes a central processing unit (CPU) 201, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 202 or a program loaded from a storage portion 208 to a random access memory (RAM) 203. Various programs and data required for system operation are also stored in the RAM 203. The CPU 201, the ROM 202, and the RAM 203 are connected to each other via a bus 204. An input/output (I/O) interface 205 is also connected to the bus 204.
以下部件连接至I/O接口205:包括键盘、鼠标等的输入部分206;包括诸如阴极射线管(CRT,Cathode Ray Tube)、液晶显示器(LCD,Liquid Crystal Display)等以及扬声器等的输出部分207;包括硬盘等的储存部分208;以及包括诸如LAN(Local Area Network,局域网)卡、调制解调器等的网络接口卡的通信部分209。通信部分209经由诸如因特网的网络执行通信处理。驱动器210也根据需要连接至I/O接口205。可拆卸介质211,诸如磁盘、光盘、磁光盘、半导体存储器等等,根据需要安装在驱动器210上,以便于从其上读出的计算机程序根据需要被安装入储存部分208。The following components are connected to the I/O interface 205: an input section 206 including a keyboard, a mouse, etc.; an output section 207 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 208 including a hard disk, etc.; and a communication section 209 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 209 performs communication processing via a network such as the Internet. A drive 210 is also connected to the I/O interface 205 as needed. A removable medium 211, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 210 as needed so that a computer program read therefrom is installed into the storage section 208 as needed.
特别地,根据本发明的实施例,下文参考流程图描述的过程可以被实现为计算机软件程序。例如,本发明的实施例包括一种计算机程序产品,其包括承载在计算机可读存储介质上的计算机程序,该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中,该计算机程序可以通过通信部分209从网络上被下载和安装,和/或从可拆卸介质211被安装。在该计算机程序被中央处理单元(CPU)201执行时,执行本申请的方法和/或装置中限定的各种功能。In particular, according to an embodiment of the present invention, the process described below with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present invention includes a computer program product, which includes a computer program carried on a computer-readable storage medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 209, and/or installed from the removable medium 211. When the computer program is executed by the central processing unit (CPU) 201, various functions defined in the method and/or device of the present application are executed.
需要说明的是,本发明所示的计算机可读存储介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于:具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM(Erasable Programmable Read Only Memory,可擦除可编程只读存储器)或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本发明中,计算机可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本发明中,计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式,包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可读存储介质,该计算机可读存储介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读存储介质上包含的程序代码可以用任何适当的介质传输,包括但不限于:无线、电线、光缆、RF(RadioFrequency,射频)等等,或者上述的任意合适的组合。It should be noted that the computer-readable storage medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM (Erasable Programmable Read Only Memory, Erasable Programmable Read Only Memory) or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable storage medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF (Radio Frequency), etc., or any suitable combination of the above.
附图中的流程图和框图,图示了按照本发明各种实施例的方法、装置和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分,上述模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个接连地表示的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图或流程图中的每个方框、以及框图或流程图中的方框的组合,可以用执行规定的功能或操作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the methods, devices and computer program products according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of boxes in the block diagram or flow chart, can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
描述于本发明实施例中所涉及到的模块和/或单元和/或子单元可以通过软件的方式实现,也可以通过硬件的方式来实现,所描述的模块和/或单元和/或子单元也可以设置在处理器中。其中,这些模块和/或单元和/或子单元的名称在某种情况下并不构成对该模块和/或单元和/或子单元本身的限定。The modules and/or units and/or sub-units involved in the embodiments of the present invention may be implemented by software or hardware, and the modules and/or units and/or sub-units described may also be arranged in a processor. The names of these modules and/or units and/or sub-units do not, in certain cases, limit the modules and/or units and/or sub-units themselves.
作为另一方面,本申请还提供了一种计算机可读存储介质,该计算机可读存储介质可以是上述实施例中描述的电子设备中所包含的;也可以是单独存在,而未装配入该电子设备中。上述计算机可读存储介质承载有一个或者多个程序,当上述一个或者多个程序被一个该电子设备执行时,使得该电子设备实现如下述实施例中所述的方法。例如,所述的电子设备可以实现如图3或图4或图5或图6或图7或图8或图10或图13或图15或图17所示的各个步骤。As another aspect, the present application also provides a computer-readable storage medium, which may be included in the electronic device described in the above embodiment; or it may exist independently without being assembled into the electronic device. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed by an electronic device, the electronic device implements the method described in the following embodiments. For example, the electronic device can implement the various steps shown in Figure 3 or Figure 4 or Figure 5 or Figure 6 or Figure 7 or Figure 8 or Figure 10 or Figure 13 or Figure 15 or Figure 17.
人工智能(Artificial Intelligence,AI)是利用数字计算机或者数字计算机控制的机器模拟、延伸和扩展人的智能,感知环境、获取知识并使用知识获得最佳结果的理论、方法、技术及应用系统。换句话说,人工智能是计算机科学的一个综合技术,它企图了解智能的实质,并生产出一种新的能以人类智能相似的方式做出反应的智能机器。人工智能也就是研究各种智能机器的设计原理与实现方法,使机器具有感知、推理与决策的功能。Artificial Intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a similar way to human intelligence. Artificial intelligence is to study the design principles and implementation methods of various intelligent machines so that machines have the functions of perception, reasoning and decision-making.
人工智能技术是一门综合学科,涉及领域广泛,既有硬件层面的技术也有软件层面的技术。人工智能基础技术一般包括如传感器、专用人工智能芯片、云计算、分布式存储、大数据处理技术、操作/交互系统、机电一体化等技术。人工智能软件技术主要包括计算机视觉技术、语音处理技术、自然语言处理技术以及机器学习/深度学习等几大方向。Artificial intelligence technology is a comprehensive discipline that covers a wide range of fields, including both hardware-level and software-level technologies. Basic artificial intelligence technologies generally include sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operating/interactive systems, mechatronics, and other technologies. Artificial intelligence software technologies mainly include computer vision technology, speech processing technology, natural language processing technology, and machine learning/deep learning.
机器学习(Machine Learning,ML)是一门多领域交叉学科,涉及概率论、统计学、逼近论、凸分析、算法复杂度理论等多门学科。专门研究计算机怎样模拟或实现人类的学习行为,以获取新的知识或技能,重新组织已有的知识结构使之不断改善自身的性能。机器学习是人工智能的核心,是使计算机具有智能的根本途径,其应用遍及人工智能的各个领域。机器学习和深度学习通常包括人工神经网络、置信网络、强化学习、迁移学习、归纳学习、式教学习等技术。Machine Learning (ML) is a multi-disciplinary subject that involves probability theory, statistics, approximation theory, convex analysis, algorithm complexity theory and other disciplines. It specializes in studying how computers simulate or implement human learning behavior to acquire new knowledge or skills and reorganize existing knowledge structures to continuously improve their performance. Machine learning is the core of artificial intelligence and the fundamental way to make computers intelligent. Its applications are spread across all areas of artificial intelligence. Machine learning and deep learning usually include artificial neural networks, belief networks, reinforcement learning, transfer learning, inductive learning, and self-learning.
随着人工智能技术研究和进步,人工智能技术在多个领域展开研究和应用,例如常见的智能家居、智能穿戴设备、虚拟助理、智能音箱、智能营销、无人驾驶、自动驾驶、无人机、机器人、智能医疗、智能客服等,相信随着技术的发展,人工智能技术将在更多的领域得到应用,并发挥越来越重要的价值。With the research and advancement of artificial intelligence technology, artificial intelligence technology has been studied and applied in many fields, such as common smart homes, smart wearable devices, virtual assistants, smart speakers, smart marketing, unmanned driving, automatic driving, drones, robots, smart medical care, smart customer service, etc. I believe that with the development of technology, artificial intelligence technology will be applied in more fields and play an increasingly important role.
本发明实施例提供的方案涉及人工智能的机器学习等技术,具体通过如下实施例进行说明:The solution provided by the embodiment of the present invention involves artificial intelligence machine learning and other technologies, which are specifically described by the following embodiments:
首先对下面实施例中涉及的一些术语进行解释。First, some terms involved in the following embodiments are explained.
深度学习:深度学习是基于深度神经网络,通过梯度递减等优化方式,而最终获得从输入数据和目标数据之间一对一映射函数的学习过程。例如,给定人的年龄、性别等信息,希望能够通过这些信息来预测这个人是否喜欢宠物,那么输入数据是人的年龄、性别等信息,目标数据即是“这个人是否喜欢宠物”。需要的是构建一个正确的映射函数,这个函数可以将输入数据映射为目标数据。这样,给定另一个人的信息,就能够得知这个人是否喜欢宠物。深度学习就是基于大量数据来求解这个映射函数的过程,并用深度的神经网络来模拟这个函数。Deep learning: Deep learning is a learning process based on deep neural networks, which uses optimization methods such as gradient descent to ultimately obtain a one-to-one mapping function between input data and target data. For example, given a person's age, gender and other information, we hope to use this information to predict whether the person likes pets. The input data is the person's age, gender and other information, and the target data is "whether the person likes pets." What is needed is to build a correct mapping function that can map the input data to the target data. In this way, given another person's information, we can know whether the person likes pets. Deep learning is the process of solving this mapping function based on a large amount of data, and using a deep neural network to simulate this function.
协同过滤(Collaborative Filtering,CF):协同过滤是一类用于推荐系统的模型算法,其内容核心是通过以往的数据,而推断出哪一些用户(或者商品)之间更加相像,因此,该类模型可以被简单分为“user-based(基于用户的)”和“item-based(基于物品的)”,前者寻找哪一些用户更相像,后者寻找哪一些商品更相像。对于前者,在得知了相像的用户后,即可把用户之前所购买过的商品,推荐给与该用户相像的其他用户。后者即是在得知了相像的商品后,即可通过某用户购买了这一商品,而推断该用户喜欢与该商品类似的其他商品,从而把其他类似的商品推荐给该用户。Collaborative Filtering (CF): Collaborative filtering is a type of model algorithm used in recommendation systems. The core of collaborative filtering is to infer which users (or products) are more similar through past data. Therefore, this type of model can be simply divided into "user-based" and "item-based". The former looks for which users are more similar, and the latter looks for which products are more similar. For the former, after knowing similar users, the products that the user has purchased before can be recommended to other users who are similar to the user. For the latter, after knowing similar products, it can be inferred that a user likes other products similar to the product based on the fact that the user purchased the product, and then other similar products can be recommended to the user.
度量:一个自定义的,需要符合度量所满足的4个要求的,用于测量定义域空间中任意2个点之间距离的映射函数。简单而言,即定义一个新的度量,就是定义了一个新的距离。Metric: A custom mapping function that meets the four requirements of a metric and is used to measure the distance between any two points in the domain space. In simple terms, defining a new metric is defining a new distance.
本发明实施例中,均以游戏场景为例进行举例说明,但可以理解的是,本发明实施例提供的技术方案并不限于应用于游戏场景,也可以适用于其他推荐场景。In the embodiments of the present invention, the game scenario is used as an example for illustration, but it can be understood that the technical solution provided by the embodiments of the present invention is not limited to application in the game scenario, and can also be applied to other recommendation scenarios.
其中,游戏推荐场景中的数据具有以下特点:Among them, the data in the game recommendation scenario has the following characteristics:
第一,数据大规模。游戏平台为百万至千万级别的用户提供服务,用户在玩游戏过程中,属性及行为会发生动态变化,且会随着时间的更新选择购买不同的游戏商品,导致游戏平台每日积累大规模的用户行为数据。First, the data is massive. Game platforms provide services to millions to tens of millions of users. When playing games, users’ attributes and behaviors will change dynamically, and they will choose to purchase different game products over time, which leads to the accumulation of massive user behavior data on the game platform every day.
第二,数据高维度。游戏中数据具有高维度的特点,与用户相关联的属性除了用户个人画像(例如用户本人的真实年龄、性别、所处地理位置等这些用户的真实属性信息)之外,还有用户所选择的游戏角色属性(例如这个游戏角色的名称、性别、职业等属性信息)等,同时游戏商品的类别繁多,且同样具有多维属性。Second, data is high-dimensional. The data in the game is high-dimensional. In addition to the user's personal portrait (such as the user's real age, gender, geographical location, and other real attribute information of the user), the attributes of the game character selected by the user also include the name, gender, occupation, and other attribute information of the game character. At the same time, there are many categories of game products, and they also have multi-dimensional attributes.
第三,复杂的结构关联。与电商、社交等平台相比,游戏平台中用户与其所购买的商品之间不是简单的一一对应关系,例如,一个用户在不同的时间可以使用不同的游戏角色,例如用户在使用游戏角色A时可能频繁购买游戏商品a,而在使用游戏角色B时可能不会购买游戏商品a。即在不同游戏角色的情况下,同一个用户做出的选择可能是不同的。Third, complex structural associations. Compared with e-commerce and social platforms, the relationship between users and the products they purchase on game platforms is not a simple one-to-one correspondence. For example, a user can use different game characters at different times. For example, when using game character A, the user may frequently purchase game product a, but may not purchase game product a when using game character B. That is, the choices made by the same user may be different when using different game characters.
基于以上,在设计游戏场景下的推荐方式时,需要对此场景下的数据规模及数据特性加以考虑。Based on the above, when designing the recommendation method in the game scenario, it is necessary to consider the data scale and data characteristics in this scenario.
协同过滤是相关技术中的一类推荐算法,它利用大量数据中的协同信息,基于以下两个出发点做出推荐:(1)兴趣相近的用户可能会对同样的东西感兴趣;(2)用户可能较偏爱与其已购买的东西相类似的东西。Collaborative filtering is a type of recommendation algorithm in related technologies. It uses collaborative information in large amounts of data to make recommendations based on the following two starting points: (1) users with similar interests may be interested in the same things; (2) users may prefer things that are similar to what they have already purchased.
但是,传统的基于协同过滤的推荐方法,在学习用户和商品的向量表征时,往往只对用户与商品的ID(identification,标识)及评分矩阵进行建模,忽略或未充分利用丰富的背景信息,即协同过滤中,评分矩阵中某个用户购买了某个商品,则对应的评分值为1,否则为0,但是没有考虑用户和商品的各维度的属性信息。However, traditional recommendation methods based on collaborative filtering often only model the ID (identification) and rating matrix of users and products when learning vector representations of users and products, ignoring or not fully utilizing rich background information. That is, in collaborative filtering, if a user in the rating matrix purchases a certain product, the corresponding rating value is 1, otherwise it is 0, but the attribute information of each dimension of users and products is not considered.
CTR(Click-through rate prediction,点击率预测)不仅用在点击率预估,在推荐系统的商品排序等场景中也有应用。与CF模型相比,CTR直接通过输入数据特征计算目标商品被目标用户点击的概率,其通用的公式可以表示为:CTR (Click-through rate prediction) is not only used for click-through rate estimation, but also has applications in scenarios such as product ranking in recommendation systems. Compared with the CF model, CTR directly calculates the probability of the target product being clicked by the target user through input data features. Its general formula can be expressed as:
y=f(X) (1)y=f(X) (1)
其中X为输入数据特征矩阵,y为[0,1]之间的概率值,表示输入数据被点击的概率。相关技术中可使用例如logistics regression(LR,逻辑回归)和factorizationmachine(FM,因子分解机)。其中,LR模型计算方式如下:Where X is the input data feature matrix, and y is the probability value between [0,1], indicating the probability of the input data being clicked. Related technologies such as logistics regression (LR) and factorization machine (FM) can be used. The LR model is calculated as follows:
其中,θ是可学习参数。LR模型中各个维度的特征彼此独立,而特征之间的组合往往有助于提升预测效果。基于此,FM将特征之间的交叉加以考虑,在考虑两两特征交叉的情况下,FM模型公式如下:Among them, θ is a learnable parameter. The features of each dimension in the LR model are independent of each other, and the combination of features often helps to improve the prediction effect. Based on this, FM takes the intersection between features into account. When considering the intersection of two features, the FM model formula is as follows:
其中,n表示输入数据X的维度,n为大于或等于1的正整数,xi和xj分别代表X中的第i位和第j位的值,其取值例如可以是0或者1。θ和wij是可学习参数,是模型训练过程中获得的。Where n represents the dimension of the input data X, n is a positive integer greater than or equal to 1, xi and xj represent the values of the i-th and j-th bits in X, respectively, and their values can be, for example, 0 or 1. θ and wij are learnable parameters obtained during the model training process.
虽然特征交叉可以使得预测性能有所提升,但在计算用户对商品的购买概率时,还是采用简单的向量内积操作,这样的传统机器学习方法只能建模特征间的线性关系,模型能力具有一定的局限性,直接根据特征计算预测评分值,不会利用用户或商品的协同信息。Although feature cross-pollination can improve prediction performance, a simple vector inner product operation is still used to calculate the probability of a user purchasing a product. Such traditional machine learning methods can only model the linear relationship between features, and the model capabilities have certain limitations. The predicted score value is directly calculated based on the features, and the collaborative information of users or products will not be utilized.
图3示意性示出了根据本发明的一实施例的信息处理方法的流程图。本发明实施例提供的方法可以由任意具备计算处理能力的电子设备执行,例如如图1中的终端设备101、102、103中的一种或多种和/或服务器105。在下面的举例说明中,以终端设备为执行主体进行示例说明。FIG3 schematically shows a flow chart of an information processing method according to an embodiment of the present invention. The method provided by the embodiment of the present invention can be executed by any electronic device with computing and processing capabilities, such as one or more of the terminal devices 101, 102, 103 and/or the server 105 in FIG1. In the following examples, the terminal device is used as the execution subject for example.
如图3所示,本发明实施例提供的信息处理方法可以包括以下步骤。As shown in FIG. 3 , the information processing method provided by the embodiment of the present invention may include the following steps.
在步骤S310中,确定目标对象的第一角色。In step S310, a first role of a target object is determined.
本发明实施例中,所述目标对象可以是某个游戏平台的某款游戏的某个游戏玩家。当该游戏玩家以其游戏账号登陆该游戏平台后,其可以从该游戏的多个游戏角色中选定一个游戏角色A作为其当前时间t1的第一角色。In the embodiment of the present invention, the target object may be a game player of a game on a game platform. After the game player logs into the game platform with his game account, he may select a game character A from multiple game characters of the game as his first character at the current time t1.
在步骤S320中,根据所述第一角色的第一角色属性信息,获得所述目标对象的第一对象数据。In step S320, first object data of the target object is obtained according to the first role attribute information of the first role.
在示例性实施例中,所述第一角色的第一角色属性信息可以包括所述第一角色的身份信息、当前等级信息和/或当前操作信息等中的任意一项或者多项。In an exemplary embodiment, the first role attribute information of the first role may include any one or more of identity information, current level information and/or current operation information of the first role.
这里以某款RPG(Role-playing game,角色扮演游戏)游戏为例,假设其预先设定了七种身份:镖师、捕快、猎户、杀手、乐伶、游侠和文士,每个身份均对应着独具特色的江湖行当,目标对象可以选择加入其一。Here we take a certain RPG (Role-playing game) game as an example. Assume that it has pre-set seven identities: escort, constable, hunter, killer, musician, ranger and scholar. Each identity corresponds to a unique profession in the martial arts world, and the target object can choose to join one of them.
在该款RPG游戏中,每种身份又可以进一步分为三种等级作为进阶身份,每进阶一级都能获得更强大的制造技能及身份技能。玩家可通过完成日常任务获得历练值,进而消耗历练值学习更多相关技能以及身份进阶。例如文士身份可包括文士、雅士、国士三个依次递增的等级,可以设定文士是最低等级,国士是最高等级。乐伶身份可包括乐伶、优伶、名伶三个依次递增的等级。杀手身份可包括杀手、刺客、杀神三个依次递增的等级。捕快身份可包括捕快、捕头、捕神三个依次递增的等级。镖师身份可包括镖师、镖头、神镖三个依次递增的等级。游侠身份可包括游侠、任侠、豪侠三个依次递增的等级。猎户身份可包括猎户、狩矢、猎圣三个依次递增的等级。In this RPG game, each identity can be further divided into three levels as advanced identities, and each level of advancement can gain more powerful manufacturing skills and identity skills. Players can obtain experience points by completing daily tasks, and then consume experience points to learn more relevant skills and advance their identities. For example, the identity of a scholar can include three levels in ascending order: scholar, elegant scholar, and state scholar. The scholar can be set as the lowest level and the state scholar as the highest level. The identity of a musician can include three levels in ascending order: musician, actor, and famous actor. The identity of a killer can include three levels in ascending order: killer, assassin, and killer god. The identity of a constable can include three levels in ascending order: constable, head of the constable, and god of the constable. The identity of a dart master can include three levels in ascending order: dart master, head of the dart, and divine dart. The identity of a ranger can include three levels in ascending order: ranger, chivalrous man, and heroic man. The identity of a hunter can include three levels in ascending order: hunter, arrow hunter, and hunter saint.
在该款RPG游戏中,具有不同身份的游戏角色可进行不同的操作(例如任务和/或玩法),具有同一身份的游戏角色在不同等级下也可进行不同的操作。In this RPG game, game characters with different identities can perform different operations (such as tasks and/or gameplay), and game characters with the same identity can also perform different operations at different levels.
应该理解的是,上述身份信息、当前等级信息、当前操作信息等仅用于举例说明,在不同的应用场景下、或者不同类型的其他游戏、或者同一类型的其他款游戏中,第一角色属性信息可以进行适应性的调整。It should be understood that the above-mentioned identity information, current level information, current operation information, etc. are only used for illustration, and the first character attribute information can be adaptively adjusted in different application scenarios, or in other games of different types, or in other games of the same type.
在步骤S330中,获得待推荐物的物品属性信息。In step S330, item attribute information of the item to be recommended is obtained.
还是以游戏场景为例,此时待推荐物可以是目标对象所选定的目标游戏的游戏商城中的游戏商城如道具。则此时物品属性信息例如可以包括各个道具所属类别、所能完成的功能、所对应的游戏角色的身份、所对应的游戏角色的等级、所对应的游戏角色的操作等中的任意一种或者多种。例如是用于游戏角色练习轻功所用的道具,还是用于游戏角色提升内力所用的道具等等。具体的,物品属性信息可以根据实际需求进行设定。Taking the game scene as an example, the recommended items can be props in the game mall of the target game selected by the target object. At this time, the item attribute information can include any one or more of the categories to which each item belongs, the functions that can be completed, the identity of the corresponding game character, the level of the corresponding game character, and the operation of the corresponding game character. For example, it can be a prop used by the game character to practice Qinggong, or a prop used by the game character to improve internal strength, etc. Specifically, the item attribute information can be set according to actual needs.
在步骤S340中,通过神经网络模型对所述第一对象数据和所述物品属性信息进行处理,从所述待推荐物中确定向所述目标对象的第一角色推荐的第一目标物品。In step S340, the first object data and the item attribute information are processed by a neural network model to determine a first target item recommended to the first character of the target object from the items to be recommended.
本发明实施方式提供的信息处理方法,通过确定目标对象的第一角色,并根据所述第一角色的第一角色属性信息,获得所述目标对象的第一对象数据,还获得待推荐物的物品属性信息,从而可以通过神经网络模型对所述第一对象数据和所述物品属性信息进行处理,从所述待推荐物中确定向所述目标对象的第一角色推荐的第一目标物品。一方面,通过综合考虑目标对象的丰富的角色属性信息和待推荐物的丰富的物品属性信息,来进行待推荐物中的目标物品的确定,可以提升物品的个性化推荐的精准度;另一方面,通过非线性的神经网络模型来刻画目标对象与待推荐物之间复杂的交互作用,可以达到增强模型可解释性及提升推荐效果的目的。The information processing method provided in the embodiment of the present invention determines the first role of the target object, and obtains the first object data of the target object based on the first role attribute information of the first role, and also obtains the item attribute information of the object to be recommended, so that the first object data and the item attribute information can be processed by a neural network model to determine the first target item recommended to the first role of the target object from the objects to be recommended. On the one hand, by comprehensively considering the rich role attribute information of the target object and the rich item attribute information of the objects to be recommended to determine the target items among the objects to be recommended, the accuracy of personalized recommendation of items can be improved; on the other hand, by using a nonlinear neural network model to characterize the complex interaction between the target object and the objects to be recommended, the purpose of enhancing the model interpretability and improving the recommendation effect can be achieved.
图4示意性示出了根据本发明的另一实施例的信息处理方法的流程图。如图4所示,与上述实施例相比,本发明实施例提供的方法的不同之处在于,还可以进一步包括以下步骤。Fig. 4 schematically shows a flow chart of an information processing method according to another embodiment of the present invention. As shown in Fig. 4, compared with the above embodiment, the method provided by the embodiment of the present invention is different in that it can further include the following steps.
在步骤S410中,确定所述目标对象的第二角色。In step S410, a second role of the target object is determined.
例如,在另一时间t2,该游戏玩家可以更换为另一个游戏角色B作为第二角色。For example, at another time t2, the game player may switch to another game character B as the second character.
在步骤S420中,根据所述第二角色的第二角色属性信息,获得所述目标对象的第二对象数据。In step S420, second object data of the target object is obtained according to the second role attribute information of the second role.
在示例性实施例中,所述第二角色的第二角色属性信息可以包括所述第二角色的身份信息、当前等级信息和/或当前操作信息等中的任意一项或者多项。In an exemplary embodiment, the second role attribute information of the second role may include any one or more of identity information, current level information and/or current operation information of the second role.
在步骤S430中,通过所述神经网络模型对所述第二对象数据和所述物品属性信息进行处理,从所述待推荐物中确定向所述目标对象的第二角色推荐的第二目标物品。In step S430, the second object data and the item attribute information are processed by the neural network model to determine a second target item recommended to the second character of the target object from the items to be recommended.
本发明实施例中,同一个用户(例如游戏玩家)在不同的时刻可以选择同一款游戏中的不同游戏角色,例如t1时刻选择游戏角色A,其是一个低等级的镖师,则系统会向其推荐低等级镖师所需的道具;t2时刻选择游戏角色B,其是一个高等级的杀手,则系统会向其推荐高等级杀手所需的道具,即用户选择不同的游戏角色,可能具有属于不同门派、不同身份等属性,其会进行相应的操作,例如练法术需要的是一类道具,炼心法需要的是另一类的道具。可以预先设定一个道具池,在道具池中具有各种道具,每个道具具有相应的物品属性信息,当用户所选择的游戏角色发生变化和/或所选择的游戏角色的属性值发生变化时,系统向其推荐的道具的种类可以发生变化,或者向其推荐的道具的排列顺序发生变化。本发明实施例中,同一个用户在不同的游戏角色下对于同一个游戏商品做出的选择可能是不同的,这是因为游戏场景中游戏商品是游戏角色的道具,购买行为与角色属性相关联。此外,同一个用户在相同的游戏角色下,若其角色属性发生了变化,则其对同一个游戏商品作出的选择也可能是不同的,例如角色在低等级时可能不需要购买一个豪华的道具,随着等级的升高,则可能会对这个道具产生购买行为。In the embodiment of the present invention, the same user (e.g., a game player) can select different game characters in the same game at different times. For example, if the game character A is selected at time t1, which is a low-level escort, the system will recommend the props required by the low-level escort; if the game character B is selected at time t2, which is a high-level killer, the system will recommend the props required by the high-level killer, that is, the user selects different game characters, which may have attributes such as belonging to different sects and different identities, and they will perform corresponding operations. For example, one type of props is required for practicing magic, and another type of props is required for refining the mind. A prop pool can be pre-set, and there are various props in the prop pool, each prop has corresponding item attribute information. When the game character selected by the user changes and/or the attribute value of the selected game character changes, the type of props recommended by the system to the user can change, or the arrangement order of the props recommended to the user changes. In the embodiment of the present invention, the same user may make different choices for the same game commodity under different game characters. This is because the game commodity in the game scene is the prop of the game character, and the purchase behavior is associated with the character attribute. In addition, if the attributes of the same user's game character change, the choice he makes for the same game product may also be different. For example, when the character is at a low level, he may not need to buy a luxurious item, but as the level increases, he may purchase the item.
图5示意性示出了根据本发明的又一实施例的信息处理方法的流程图。如图5所示,与上述实施例相比,本发明实施例提供的方法的不同之处在于,还可以进一步包括以下步骤。Fig. 5 schematically shows a flow chart of an information processing method according to another embodiment of the present invention. As shown in Fig. 5, compared with the above embodiment, the method provided by the embodiment of the present invention is different in that it can further include the following steps.
在步骤S510中,获得所述目标对象的历史角色。In step S510, the historical role of the target object is obtained.
在步骤S520中,根据所述历史角色的历史角色属性信息,获得所述目标对象的历史对象数据。In step S520, historical object data of the target object is obtained according to the historical role attribute information of the historical role.
在步骤S530中,获得所述目标对象对所述待推荐物的历史操作记录。In step S530, the historical operation record of the target object on the object to be recommended is obtained.
在步骤S540中,根据所述历史操作记录,确定所述历史对象数据和所述物品属性信息的标签,以生成训练数据集。In step S540, labels of the historical object data and the item attribute information are determined according to the historical operation records to generate a training data set.
本发明实施例中,可以预先对所用到的神经网络模型进行训练。训练模型时首先构建训练数据集。这里用到了目标对象对待推荐物的历史操作记录。还是以上述游戏场景为例,则待推荐物可以是道具池中的各个道具,历史操作记录可以是该游戏玩家历史上对各个道具的购买记录,但本发明并不限定于此,还可以是该游戏玩家历史对各个道具的使用记录、预览记录等等。In the embodiment of the present invention, the neural network model used can be trained in advance. When training the model, a training data set is first constructed. Here, the historical operation record of the target object on the recommended item is used. Taking the above game scene as an example, the recommended item can be each item in the item pool, and the historical operation record can be the purchase record of each item by the game player in history, but the present invention is not limited to this, and can also be the game player's historical use record, preview record, etc. of each item.
本发明实施例中,构造训练数据集可以为如下形式:In the embodiment of the present invention, the training data set may be constructed in the following form:
数据可以划分为两部分:目标对象及其第一角色属性信息组成的第一对象数据待推荐物及其物品属性信息组成的用户相关数据包含的域有:[user_id,user_feature_1,user_feature_2,…],商品相关的数据包含的域有:[item_id,item_feature_1,item_feature_2,…],其中id和各feature域均用数值表示,[feature_1,feature_2,…]称为属性信息(context)。其中游戏中用户的feature不是固定不变的,而是随着时间变化,所以同样的id可以对应多个属性信息。The data can be divided into two parts: the first object data consisting of the target object and its first role attribute information The recommended items and their item attribute information The fields of user-related data are: [user_id, user_feature_1, user_feature_2, ...], and the fields of product-related data are: [item_id, item_feature_1, item_feature_2, ...], where the id and each feature field are represented by a numerical value, and [feature_1, feature_2, ...] is called attribute information (context). The features of users in the game are not fixed, but change over time, so the same id can correspond to multiple attribute information.
(1)是目标对象id和目标对象的第一角色的第一角色属性信息的拼接,因为同一个目标对象在不同时间可以处于不同游戏角色,所以一个目标对象可以对应多个例如目标对象id=1,在context=[0.1,0.3,…,0.2]时对应的在id=1,context=[0.5,0.1,…,0.1]时对应的这种表示方式的含义为:在特定游戏角色下的目标对象。(1) It is the concatenation of the target object id and the first character attribute information of the first character of the target object. Because the same target object can be in different game roles at different times, one target object can correspond to multiple For example, when the target object id = 1, the corresponding context = [0.1, 0.3, ..., 0.2] When id=1,context=[0.5,0.1,…,0.1] The meaning of this expression is: the target object under a specific game character.
(2)可以是游戏商品id与其物品属性信息的拼接。(2) It can be a combination of the game product ID and its item attribute information.
(3)标签(label):每一对和对应一个二值的label,0表示该目标对象在该角色属性信息下没有购买该道具,1表示该目标对象在该角色属性信息下购买了该道具,具体的标签数值可以进行自主设定。(3) Label: Each pair and Corresponding to a binary label, 0 means that the target object has not purchased the item under the character attribute information, and 1 means that the target object has purchased the item under the character attribute information. The specific label value can be set independently.
在步骤S550中,利用所述训练数据集训练所述神经网络模型。In step S550, the neural network model is trained using the training data set.
本发明实施例中,在模型训练过程中,可以将训练数据集中的和输入至该神经网络模型,该神经网络模型输出预测值,根据预测值和真实标签计算损失函数,以最小化损失函数为目标计算参数梯度,梯度反向传播以更新模型参数。In the embodiment of the present invention, during the model training process, the training data set may be and The input is sent to the neural network model, which outputs the predicted value. The loss function is calculated based on the predicted value and the true label. The parameter gradient is calculated with the goal of minimizing the loss function, and the gradient is back-propagated to update the model parameters.
上述过程进行迭代,不断更新模型参数,并通过验证集数据进行模型验证,在验证集上的损失函数基本不再下降时即可停止迭代,此时得到拟合能力与泛化能力都较好的模型。The above process is iterated to continuously update the model parameters and verify the model through the validation set data. The iteration can be stopped when the loss function on the validation set basically no longer decreases. At this time, a model with good fitting and generalization capabilities is obtained.
本发明实施例中,损失函数可以采用二值交叉熵损失函数loss,计算方式如下:In the embodiment of the present invention, the loss function may adopt a binary cross entropy loss function loss, which is calculated as follows:
上述公式中,k为大于或等于1且小于或等于m的正整数,m为大于或等于1的正整数,其表示训练数据集中一共有m对和yk是当模型输入第k对和时所对应的真实标签,取值为0或者1;是当模型输入第k对和时模型所输出的预测值,取值为[0,1]之间的数值。优化的目标是最小化loss,当预测值接近真实值时,loss较小,当预测值偏离真实值时,loss较大。In the above formula, k is a positive integer greater than or equal to 1 and less than or equal to m, and m is a positive integer greater than or equal to 1, which means that there are a total of m pairs in the training data set. and y k is when the model inputs the kth pair and The corresponding true label is 0 or 1; When the model inputs the kth pair and The predicted value output by the model at this time is a value between [0,1]. The goal of optimization is to minimize the loss. When the predicted value is close to the true value, the loss is small, and when the predicted value deviates from the true value, the loss is large.
本发明实施例中,还可以包括模型测试过程。模型测试是指在训练好的模型上,用与训练数据集无重合的测试数据集测试模型的预测能力。为更直观的评价模型的预测能力,在测试数据集上使用的评估标准是预测的精确率、召回率、AUC(Area Under Curve,ROC(受试者工作特征曲线(receiver operating characteristic curve))曲线下与坐标轴围成的面积)。精确率能够表示模型的查准能力,召回率能够表示模型的查全能力,AUC是二者的综合。In an embodiment of the present invention, a model testing process may also be included. Model testing refers to testing the predictive ability of the model on the trained model using a test data set that does not overlap with the training data set. In order to more intuitively evaluate the predictive ability of the model, the evaluation criteria used on the test data set are the prediction accuracy, recall rate, and AUC (Area Under Curve, the area under the ROC (receiver operating characteristic curve) curve and the coordinate axis). The accuracy rate can represent the precision ability of the model, the recall rate can represent the completeness ability of the model, and the AUC is a combination of the two.
通过对比不同模型在测试数据集上的精确率、召回率、AUC值,可以观察到各模型的预测能力。By comparing the precision, recall, and AUC values of different models on the test data set, we can observe the predictive ability of each model.
本发明实施例中,在训练模型过程中,不仅考虑了目标对象对所述待推荐物的历史操作记录,还综合考虑了目标对象的历史角色属性信息和待推荐物的物品属性信息,从而可以提升模型的预测准确度。In the embodiment of the present invention, during the model training process, not only the historical operation records of the target object on the object to be recommended are considered, but also the historical role attribute information of the target object and the item attribute information of the object to be recommended are comprehensively considered, thereby improving the prediction accuracy of the model.
图6示出了图3中所示的步骤S320在一实施例中的处理过程示意图。如图6所示,本发明实施例中,上述步骤S320可以进一步包括以下步骤。Fig. 6 is a schematic diagram showing the processing process of step S320 in one embodiment shown in Fig. 3. As shown in Fig. 6, in the embodiment of the present invention, the above step S320 may further include the following steps.
在步骤S321中,获取所述目标对象的对象属性信息。In step S321, object attribute information of the target object is obtained.
例如,还是以目标对象为某个游戏玩家为例,则其对象属性信息可以是该游戏玩家的真实姓名、年龄、性别、所处地理位置、历史在线时长等个人画像信息等。For example, if the target object is a game player, the object attribute information may be the real name, age, gender, geographical location, historical online time, and other personal portrait information of the game player.
在步骤S322中,根据所述第一角色属性信息和所述对象属性信息,获得所述第一对象数据。In step S322, the first object data is obtained according to the first role attribute information and the object attribute information.
具体的,可以将第一角色属性信息和所述对象属性信息进行向量拼接以形成所述第一对象数据,即在向该目标对象推荐道具时,不仅包括其当前所选择的游戏角色的虚拟属性信息,还可以综合考虑该目标对象的真实属性信息,从而进一步提升推荐准确度。Specifically, the first character attribute information and the object attribute information can be vectorized to form the first object data. That is, when recommending props to the target object, not only the virtual attribute information of the currently selected game character is included, but also the real attribute information of the target object can be comprehensively considered, thereby further improving the recommendation accuracy.
图7示出了图3中所示的步骤S340在一实施例中的处理过程示意图。本发明实施例中,所述神经网络模型可以包括第一神经网络子模型、第二神经网络子模型和第三神经网络子模型。Fig. 7 is a schematic diagram showing the processing process of step S340 in one embodiment shown in Fig. 3. In the embodiment of the present invention, the neural network model may include a first neural network sub-model, a second neural network sub-model and a third neural network sub-model.
如图7所示,本发明实施例中,上述步骤S340可以进一步包括以下步骤。As shown in FIG. 7 , in the embodiment of the present invention, the above step S340 may further include the following steps.
在步骤S341中,根据所述第一对象数据生成对象向量。In step S341, an object vector is generated according to the first object data.
在步骤S342中,根据所述物品属性信息生成所述待推荐物的物品向量。In step S342, an item vector of the item to be recommended is generated according to the item attribute information.
在步骤S343中,通过所述第一神经网络子模型对所述对象向量和所述物品向量进行处理,获得所述目标对象的第一角色的对象偏好向量和所述待推荐物的物品特性向量。In step S343, the object vector and the item vector are processed by the first neural network sub-model to obtain the object preference vector of the first character of the target object and the item characteristic vector of the object to be recommended.
在步骤S344中,通过所述第二神经网络子模型对所述对象向量和所述物品向量进行处理,获得所述目标对象的第一角色与所述待推荐物之间的交互关系向量。In step S344, the object vector and the item vector are processed by the second neural network sub-model to obtain an interaction relationship vector between the first character of the target object and the item to be recommended.
在步骤S345中,通过所述第三神经网络子模型对所述对象偏好向量、所述物品特性向量以及所述交互关系向量进行处理,获得所述目标对象的第一角色操作所述待推荐物的预测概率值。In step S345, the object preference vector, the item characteristic vector and the interaction relationship vector are processed by the third neural network sub-model to obtain a predicted probability value of the first character of the target object operating the item to be recommended.
在步骤S346中,根据所述预测概率值,确定向所述目标对象的第一角色推荐的第一目标物品。In step S346, a first target item recommended to the first character of the target object is determined according to the predicted probability value.
本发明实施例中,可以根据道具池中各道具的预测概率值,从大到小排序,选择前预定个数(例如10个,具体取值不作限定)或者预定比例(例如10%,具体取值不作限定)的道具作为第一目标物品返回至游戏客户端进行显示,并且将预测概率值最大的显示在第一位,第一目标物品中预测概率值最小的显示在最后一位,但本发明并不限定于此。在其他实施例中,若道具池中的全部道具数量不多,也可以将所有道具均显示在游戏客户端,只是根据预测概率值的大小进行道具的排序。In an embodiment of the present invention, the props in the prop pool can be sorted from large to small according to the predicted probability value of each prop, and the props with a predetermined number (e.g., 10, the specific value is not limited) or a predetermined proportion (e.g., 10%, the specific value is not limited) are selected as the first target items and returned to the game client for display, and the props with the largest predicted probability value are displayed in the first place, and the props with the smallest predicted probability value in the first target item are displayed in the last place, but the present invention is not limited to this. In other embodiments, if the number of all props in the prop pool is small, all props can also be displayed on the game client, but the props are sorted according to the size of the predicted probability value.
本发明实施例中,可以首先对输入至模型中的数据进行预处理。数据各维度的特征中包含离散特征(categorical feature)和连续特征(dense feature),对于离散特征,可以用嵌入(embedding)将稀疏向量转换为稠密表示,对于连续特征,由于部分连续特征的数据分布往往为长尾分布,这种分布下差异较大的数值会对模型造成干扰,因此,本发明实施例对连续特征首先进行分箱,然后再做数据归一化处理。In an embodiment of the present invention, the data input to the model can be preprocessed first. The features of each dimension of the data include discrete features (categorical features) and continuous features (dense features). For discrete features, embedding can be used to convert sparse vectors into dense representations. For continuous features, since the data distribution of some continuous features is often a long-tail distribution, the values with large differences under this distribution will interfere with the model. Therefore, in an embodiment of the present invention, the continuous features are first binned and then the data is normalized.
图8示出了图7中所示的步骤S341在一实施例中的处理过程示意图。本发明实施例中,所述神经网络模型还可以包括第一嵌入子模型,所述第一对象数据可以包括对象离散特征和对象连续特征。Fig. 8 is a schematic diagram showing the processing process of step S341 in one embodiment shown in Fig. 7. In the embodiment of the present invention, the neural network model may further include a first embedding sub-model, and the first object data may include object discrete features and object continuous features.
如图8所示,本发明实施例中,上述步骤S341可以进一步包括以下步骤。As shown in FIG. 8 , in the embodiment of the present invention, the above step S341 may further include the following steps.
在步骤S3411中,通过所述第一嵌入子模型对所述对象离散特征进行处理,获得对象嵌入向量。In step S3411, the discrete features of the object are processed by the first embedding sub-model to obtain an object embedding vector.
在步骤S3412中,对所述对象连续特征进行分箱处理,获得对象离散表示。In step S3412, the continuous features of the object are binned to obtain a discrete representation of the object.
本发明实施例中,可以采用等频分箱、等距分箱、卡方分箱等中的任意一种分箱方式,对此不作限定。In the embodiment of the present invention, any binning method such as equal frequency binning, equal distance binning, chi-square binning, etc. can be adopted, and there is no limitation on this.
在步骤S3413中,对所述对象离散表示进行归一化处理。In step S3413, the discrete representation of the object is normalized.
在步骤S3414中,将所述对象嵌入向量和归一化后的对象离散表示进行拼接,生成所述对象向量。In step S3414, the object embedding vector and the normalized object discrete representation are concatenated to generate the object vector.
图9示意性示出了根据本发明的一实施例的第一嵌入子模型的示意图。FIG9 schematically shows a schematic diagram of a first embedding sub-model according to an embodiment of the present invention.
如图9所示,第一对象数据假设为4、3、…、0.2、0.5、…。其中4和3为对象离散特征,其独热编码分别为00001和0001,分别将其输入至第一嵌入子模型的嵌入层,输出稠密的对象嵌入向量。0.2、0.5是归一化后的对象连续特征的对象离散表示,保持不变,与对象嵌入向量一起进行级联,输出对象向量 As shown in FIG9 , the first object data Assume that they are 4, 3, …, 0.2, 0.5, …. 4 and 3 are discrete features of the object, and their unique hot codes are 00001 and 0001 respectively. They are input into the embedding layer of the first embedding sub-model, and the dense object embedding vector is output. 0.2 and 0.5 are the object discrete representations of the normalized continuous features of the object, which remain unchanged and are concatenated with the object embedding vector to output the object vector.
图10示出了图7中所示的步骤S342在一实施例中的处理过程示意图。本发明实施例中,所述神经网络模型还可以包括第二嵌入子模型,所述待推荐物的物品属性信息可以包括物品离散特征和物品连续特征。Fig. 10 is a schematic diagram showing the processing process of step S342 in one embodiment shown in Fig. 7. In the embodiment of the present invention, the neural network model may further include a second embedding sub-model, and the item attribute information of the item to be recommended may include item discrete features and item continuous features.
如图10所示,本发明实施例中,上述步骤S342可以进一步包括以下步骤。As shown in FIG. 10 , in an embodiment of the present invention, the above step S342 may further include the following steps.
在步骤S3421中,通过所述第二嵌入子模型对所述物品离散特征进行处理,获得物品嵌入向量。In step S3421, the discrete features of the object are processed by the second embedding sub-model to obtain an object embedding vector.
在步骤S3422中,对所述物品连续特征进行分箱处理,获得物品离散表示。In step S3422, the continuous features of the object are binned to obtain discrete representations of the object.
在步骤S3423中,对所述物品离散表示进行归一化处理。In step S3423, the discrete representation of the object is normalized.
在步骤S3424中,将所述物品嵌入向量和归一化后的物品离散表示进行拼接,生成所述物品向量。In step S3424, the item embedding vector and the normalized item discrete representation are concatenated to generate the item vector.
图11示意性示出了根据本发明的一实施例的第二嵌入子模型的示意图。FIG. 11 schematically shows a schematic diagram of a second embedding sub-model according to an embodiment of the present invention.
如图11所示,物品属性信息假设为2、1、…、0.4、0.1、…。其中2和1为物品离散特征,其独热编码分别为00100和0100,分别将其输入至第二嵌入子模型的嵌入层,输出稠密的物品嵌入向量。0.4、0.1是归一化后的物品连续特征的物品离散表示,保持不变,与物品嵌入向量一起进行级联,输出物品向量 As shown in Figure 11, item attribute information Assume that 2, 1, ..., 0.4, 0.1, .... 2 and 1 are discrete features of the item, and their unique hot encodings are 00100 and 0100 respectively. They are input into the embedding layer of the second embedding sub-model, and the dense item embedding vector is output. 0.4 and 0.1 are the discrete representations of the normalized continuous features of the item, which remain unchanged and are concatenated with the item embedding vector to output the item vector.
图12示意性示出了根据本发明的一实施例的神经网络模型的结构示意图。FIG12 schematically shows a structural diagram of a neural network model according to an embodiment of the present invention.
如图12所示,将第一对象数据输入至第一嵌入子模型,输出对象向量;将物品属性信息输入至第二嵌入子模型,输出物品向量。再将对象向量输入至第一神经网络子模型,输出对象偏好向量和物品特性向量;将物品向量输入至第二神经网络子模型,输出交互关系向量。将对象偏好向量、物品特性向量和交互关系向量输入至第三神经网络子模型,输出预测概率值。As shown in Figure 12, the first object data is input into the first embedding sub-model to output the object vector; the item attribute information is input into the second embedding sub-model to output the item vector. The object vector is then input into the first neural network sub-model to output the object preference vector and the item characteristic vector; the item vector is input into the second neural network sub-model to output the interaction relationship vector. The object preference vector, item characteristic vector and interaction relationship vector are input into the third neural network sub-model to output the predicted probability value.
图13示出了图7中所示的步骤S343在一实施例中的处理过程示意图。本发明实施例中,所述第一神经网络子模型可以包括第一神经网络单元和第二神经网络单元。第一神经网络子模型是表征学习模块(representation learning),可进一步分成两部分:一部分用于学习目标对象的向量表征,一部分用于学习待推荐物的向量表征。FIG13 is a schematic diagram showing the processing process of step S343 shown in FIG7 in one embodiment. In an embodiment of the present invention, the first neural network sub-model may include a first neural network unit and a second neural network unit. The first neural network sub-model is a representation learning module, which can be further divided into two parts: one part is used to learn the vector representation of the target object, and the other part is used to learn the vector representation of the object to be recommended.
如图13所示,本发明实施例中,上述步骤S343可以进一步包括以下步骤。As shown in FIG. 13 , in an embodiment of the present invention, the above step S343 may further include the following steps.
在步骤S3431中,通过所述第一神经网络单元对所述对象向量进行处理,获得所述对象偏好向量。In step S3431, the object vector is processed by the first neural network unit to obtain the object preference vector.
在步骤S3432中,通过所述第二神经网络单元对所述物品向量进行处理,获得所述物品特性向量。In step S3432, the object vector is processed by the second neural network unit to obtain the object feature vector.
图14示意性示出了根据本发明的一实施例的第一神经网络子模型的结构示意图。FIG14 schematically shows a schematic structural diagram of a first neural network sub-model according to an embodiment of the present invention.
如图14所示,将对象向量输入至第一神经网络单元MLPuser,MLPuser包括依次连接的层1、层2至层n1,n1为大于或等于1的正整数,这里n1可以取3~5,但本发明并不对此进行限定。第一神经网络单元MLPuser输出对象偏好向量将物品向量输入至第二神经网络单元MLPitem,MLPitem包括依次连接的层1、层2至层n2,n2为大于或等于1的正整数,这里n2可以取3~5,n1可以与n2取值相同,也可以不同,本发明并不对此进行限定。第二神经网络单元MLPitem输出物品特性向量 As shown in Figure 14, the object vector Input to the first neural network unit MLP user , MLP user includes layers 1, 2 to n1 connected in sequence, n1 is a positive integer greater than or equal to 1, where n1 can be 3 to 5, but the present invention is not limited to this. The first neural network unit MLP user outputs the object preference vector Vectorize the item Input to the second neural network unit MLP item , MLP item includes layers 1, 2 to n2 connected in sequence, n2 is a positive integer greater than or equal to 1, where n2 can be 3 to 5, n1 can be the same as n2 or different, and the present invention is not limited to this. The second neural network unit MLP item outputs the item feature vector
在图14的实施例中,以第一神经网络单元和第二神经网络单元均采用多层感知器(MLP,Multilayer Perceptron)为例进行举例说明,但在其他实施例中,第一神经网络单元和/或第二神经网络单元也可以采用其他的深度学习网络,例如LSTM(Long Short-TermMemory,长短期记忆网络)、GRU(Gated Recurrent Unit,门控循环单元)等,且第一神经网络单元可以采用与第二神经网络单元相同的深度学习网络,也可以采用不同的深度学习网络,本发明对此不作限定。其中,多层感知器是一种前向结构的神经网络,映射一组输入向量到一组输出向量。图14的实施例中,使用MLP学习向量表征,即分别输入和分别输出对应的和 In the embodiment of FIG14 , the first neural network unit and the second neural network unit are both illustrated by using a multilayer perceptron (MLP). However, in other embodiments, the first neural network unit and/or the second neural network unit may also use other deep learning networks, such as LSTM (Long Short-Term Memory), GRU (Gated Recurrent Unit), etc., and the first neural network unit may use the same deep learning network as the second neural network unit, or a different deep learning network, which is not limited in the present invention. Among them, the multilayer perceptron is a forward-structured neural network that maps a set of input vectors to a set of output vectors. In the embodiment of FIG14 , an MLP learning vector representation is used, that is, the inputs are respectively and Output the corresponding and
图15示出了图7中所示的步骤S344在一实施例中的处理过程示意图。如图15所示,本发明实施例中,上述步骤S344可以进一步包括以下步骤。Fig. 15 is a schematic diagram showing the processing process of step S344 in one embodiment shown in Fig. 7. As shown in Fig. 15, in the embodiment of the present invention, the above step S344 may further include the following steps.
在步骤S3441中,将所述对象向量与所述物品向量进行拼接,获得拼接向量。In step S3441, the object vector and the item vector are concatenated to obtain a concatenated vector.
在步骤S3442中,通过所述第二神经网络子模型对所述拼接向量进行处理,获得所述交互关系向量。In step S3442, the concatenated vector is processed by the second neural network sub-model to obtain the interaction relationship vector.
图16示意性示出了根据本发明的一实施例的第二神经网络子模型的结构示意图。FIG16 schematically shows a schematic diagram of the structure of a second neural network sub-model according to an embodiment of the present invention.
如图16所示,将对象向量和物品向量进行级联(拼接),获得拼接向量;将拼接向量输入至第二神经网络子模型MLPuser_item,MLPuser_item包括依次连接的层1、层2至层n3,n3为大于或等于1的正整数,这里n3可以取3~5,n3可以与n1或者n2相等,也可以不等,本发明并不对此进行限定。第二神经网络子模型MLPuser_item输出交互关系向量 As shown in Figure 16, the object vector and the item vector Cascade (concatenate) to obtain a concatenated vector; input the concatenated vector to the second neural network sub-model MLP user_item , MLP user_item includes layers 1, 2 to n3 connected in sequence, n3 is a positive integer greater than or equal to 1, where n3 can be 3 to 5, n3 can be equal to n1 or n2, or it can be different, and the present invention is not limited to this. The second neural network sub-model MLP user_item outputs the interaction relationship vector
本发明实施例中,第二神经网络子模型MLPuser_item也可以称之为关系学习(relation learning)模块。在表征学习模块目标对象和待推荐物的表示是分离开学习得到的,而关系学习模块则被设计用来学习目标对象与待推荐物之间复杂的交互关系。在这一部分中,首先将和进行串接,然后将拼接向量送入MLPuser_item。相比于相关技术中用向量内积这种线性函数刻画目标对象和待推荐物之间的关系,MLP的非线性结构更有利于刻画从表征到结果的复杂过程。In the embodiment of the present invention, the second neural network sub-model MLP user_item can also be called a relation learning module. In the representation learning module, the representations of the target object and the item to be recommended are learned separately, while the relation learning module is designed to learn the complex interactive relationship between the target object and the item to be recommended. and Concatenate them, and then send the concatenated vector to MLP user_item . Compared with the use of linear functions such as vector inner product in related technologies to characterize the relationship between the target object and the item to be recommended, the nonlinear structure of MLP is more conducive to describing the complex process from representation to result.
在其他实施例中,第二神经网络子模型除了采用MLP,还可以采用其他神经网络或者深度学习网络,例如LSTM、GRU等。第一神经网络子模型和第二神经网络子模型可以均采用MLP,也可以均采用其他相同的神经网络,还可以分别采用不同的神经网络。In other embodiments, in addition to MLP, the second neural network sub-model may also use other neural networks or deep learning networks, such as LSTM, GRU, etc. The first neural network sub-model and the second neural network sub-model may both use MLP, or may both use other identical neural networks, or may respectively use different neural networks.
深度学习作为一种适合处理大规模复杂数据且表达力强的技术,在这里被应用于推荐系统中,本发明实施例在游戏场景设计基于深度学习的协同过滤网络结构,以神经网络替代传统的向量内积用于计算用户和商品间的交互关系。Deep learning, as a technology suitable for processing large-scale complex data and with strong expressiveness, is applied here in the recommendation system. The embodiment of the present invention designs a collaborative filtering network structure based on deep learning in the game scenario, and uses a neural network instead of the traditional vector inner product to calculate the interactive relationship between users and products.
图17示出了图7中所示的步骤S345在一实施例中的处理过程示意图。如图17所示,本发明实施例中,上述步骤S345可以进一步包括以下步骤。Fig. 17 is a schematic diagram showing the processing process of step S345 in one embodiment shown in Fig. 7. As shown in Fig. 17, in the embodiment of the present invention, the above step S345 may further include the following steps.
在步骤S3451中,将所述对象偏好向量与所述物品特性向量相乘,获得点乘向量。In step S3451, the object preference vector is multiplied by the item characteristic vector to obtain a dot product vector.
在步骤S3452中,将所述点乘向量与所述交互关系向量串接,获得串接向量。In step S3452, the dot product vector and the interaction relationship vector are concatenated to obtain a concatenated vector.
在步骤S3453中,通过所述第三神经网络子模型对所述串接向量进行处理,获得所述预测概率值。In step S3453, the concatenated vector is processed by the third neural network sub-model to obtain the predicted probability value.
本发明实施例中,所述第三神经网络子模型也可以称之为联合预测层(prediction layer)。经过表征学习模块和关系学习模块之后,需要预测目标对象对游戏商品的购买概率,联合预测层联合表征学习模块和关系学习模块的输出,计算得到最终的预测结果。例如,联合预测层的计算方式可以如下:In the embodiment of the present invention, the third neural network sub-model can also be called a joint prediction layer. After the representation learning module and the relationship learning module, it is necessary to predict the purchase probability of the target object for the game product. The joint prediction layer combines the outputs of the representation learning module and the relationship learning module to calculate the final prediction result. For example, the calculation method of the joint prediction layer can be as follows:
上述公式中,⊙表示向量元素相乘,表示向量串接,所选函数f可以为单层全连接层加softmax函数,输出的是一个二维向量,形如第一位表示用户不购买商品的概率值,第二位表示用户购买商品的概率值即上述的预测概率值,两个概率之和为1。In the above formula, ⊙ represents the multiplication of vector elements. represents vector concatenation, the selected function f can be a single fully connected layer plus a softmax function, and the output is a two-dimensional vector of the form The first digit represents the probability value that the user does not purchase the product, and the second digit represents the probability value that the user purchases the product, which is the predicted probability value mentioned above. The sum of the two probabilities is 1.
下面以将上述实施例提供的方案应用于一款RPG游戏的道具推荐场景为例进行说明。在这款游戏中,用户可选择游戏角色,游戏角色关联着丰富的属性,如角色修为、功力等(会随着在线时长的边长,取值越来越大);用户可进入游戏商城,购买角色所需要的道具,道具同样关联多类的属性。本场景下推荐的目的是根据用户(可以综合考虑用户的真实性别等属性信息,不限于举例的用户id)、角色、道具的属性信息,为用户推荐其最可能感兴趣的一个或者多个道具。The following is an example of applying the solution provided in the above embodiment to a prop recommendation scenario of an RPG game. In this game, users can choose game characters, which are associated with a variety of attributes, such as character cultivation, skill, etc. (the value will increase with the length of online time); users can enter the game mall to buy props needed by the character, and props are also associated with multiple types of attributes. The purpose of recommendation in this scenario is to recommend one or more props that the user is most likely to be interested in based on the attribute information of the user (the user's real gender and other attribute information can be comprehensively considered, not limited to the example user ID), character, and prop.
该款RPG游戏是一款武侠题材的MMORPG(Massive Multiplayer Online Role-Playing Game,大型多人在线角色扮演游戏)游戏,包括八荒门派,有太白、神威、唐门、丐帮、真武、天香、五毒、少林等各派;还包括江湖百业,捕快、镖师、猎户、游侠、杀手、乐伶、文士等行会规模最为宏大,其次还有悬眼、商贾、市井等诸业。用户可以下载并安装游戏客户端。游戏客户端安装完毕后,点击桌面的游戏图标即可运行该款游戏的游戏登陆器。在登陆器右侧点击“进入游戏”即可进入游戏账号登录界面,在此界面上输入游戏账号和密码后点击“进入游戏”,查看“更多服务器”即可打开服务器列表,选择所要登录的游戏大区和服务器(也可以直接在右边选择最近登陆的服务器),点击“开始游戏”,就可以开始江湖之旅。This RPG game is a martial arts theme MMORPG (Massive Multiplayer Online Role-Playing Game), including eight sects, including Taibai, Shenwei, Tangmen, Beggars, Zhenwu, Tianxiang, Wudu, Shaolin and other sects; it also includes hundreds of professions in the rivers and lakes, and the scale of the guilds such as constables, escorts, hunters, rangers, killers, musicians, and literati is the largest, followed by hanging eyes, merchants, and market professionals. Users can download and install the game client. After the game client is installed, click the game icon on the desktop to run the game launcher. Click "Enter the Game" on the right side of the launcher to enter the game account login interface. Enter the game account and password on this interface and click "Enter the Game". View "More Servers" to open the server list, select the game area and server to log in (you can also directly select the server you recently logged in on the right), and click "Start Game" to start your journey in the rivers and lakes.
图18示意性示出了根据本发明的一实施例的门派介绍的界面示意图。FIG18 schematically shows an interface diagram of a martial arts introduction according to an embodiment of the present invention.
如图18所示,用户首先进行角色的创建。第一步是选择门派。如果是用户第一次登陆游戏,该游戏账号在该服务器下没有任何角色,会看到游戏的门派选择界面,可以在这个界面下选择任意一个已开放的门派创建该用户的角色。点选任意一个已开放的门派后进入门派介绍界面。界面正中能看到当前选择的门派和角色外观,界面右侧列出了该门派的战斗特点,下面可以切换角色的男女性别,点击鼠标右键可以转动角色查看形象。左侧可快速切换角色门派。As shown in Figure 18, the user first creates a character. The first step is to select a school. If it is the first time for the user to log in to the game, the game account does not have any character on the server, and the game school selection interface will be displayed. You can select any open school in this interface to create the user's character. Click any open school to enter the school introduction interface. The currently selected school and character appearance can be seen in the middle of the interface. The right side of the interface lists the combat characteristics of the school. The gender of the character can be switched below. Click the right mouse button to rotate the character to view the image. The left side can quickly switch the character school.
图19和20示意性示出了根据本发明的一实施例的角色细节定制的界面示意图。19 and 20 schematically illustrate a schematic diagram of an interface for customizing character details according to an embodiment of the present invention.
如图19所示,点击“定制细节”可进一步定制角色细节,在这个界面下可看到角色的更多细节并可以针对每一项加以细调。根据人类脸部骨骼和肌肉的自然分布,现有48根骨骼上总共超过200项的可调参数。同时如图20所示,还提供了多种(这里以4种为例)面部表情的预览和多套(这里以5套为例)外装的试穿。在界面下方输入角色名字后,点击“创建完成”,即可建立起该用户的角色了。建立角色后选择建好的角色,点击如图21中所示的角色下方的“开始游戏”就会进入到如图22所示的游戏场景里了。As shown in Figure 19, click "Customize Details" to further customize the character details. In this interface, you can see more details of the character and fine-tune each item. According to the natural distribution of human facial bones and muscles, there are more than 200 adjustable parameters on 48 bones. At the same time, as shown in Figure 20, it also provides previews of multiple (4 as an example here) facial expressions and multiple (5 as an example here) outfits to try on. After entering the character name at the bottom of the interface, click "Create Complete" to create the user's character. After creating the character, select the created character and click "Start Game" below the character as shown in Figure 21 to enter the game scene as shown in Figure 22.
如图22所示,侧方快捷栏、聊天界面、人物状态、底部快捷栏、功能按钮(角色和商城)、小地图、任务玩法指引。As shown in Figure 22, there are the side shortcut bar, chat interface, character status, bottom shortcut bar, function buttons (character and mall), mini map, and task gameplay guide.
游戏界面上的功能按钮是游戏最主要的功能模块的入口。其中,角色包含:属性、经脉、心法、装备等。身份包含:镖师、杀手、游侠、猎户、乐伶、文士、捕快,悬眼、商贾、市井三者暂未开放。商城包含:常用、外观、骑宠挂件、珍品、会员专享、天赏积分、绑定点券、购买会员、点券寄售、点券充值。The function buttons on the game interface are the entrances to the most important functional modules of the game. Among them, the roles include: attributes, meridians, mental skills, equipment, etc. The identities include: escort, assassin, ranger, hunter, musician, scholar, and constable. The three roles of hanging eyes, merchants, and market people are not open yet. The mall includes: common, appearance, mount pendants, treasures, member exclusive, Tianshang points, bound coupons, purchase membership, coupon consignment, and coupon recharge.
人物状态是用于查看当前角色的气血、内息、定力、杀意和各门派特有的招式信息。The character status is used to view the current character's Qi, blood, internal energy, concentration, killing intent, and the unique moves of each sect.
底部快捷栏对应QERTG及0-9共15个键位,右边的上下翻页按钮可切换。快捷栏可放置道具和技能,按下相应按键后快速使用。快捷栏上的键位可在系统设置中更改。The shortcut bar at the bottom corresponds to QERTG and 0-9, a total of 15 keys. The up and down buttons on the right can be used to switch. The shortcut bar can be used to place props and skills, and they can be used quickly by pressing the corresponding buttons. The keys on the shortcut bar can be changed in the system settings.
侧方快捷栏对应F1-F10、Ctrl0-Ctrl9及HVCXZ共25个键位,可放置道具和技能,按下相应按键后快速使用。快捷栏上的键位可在系统设置中更改。The side shortcut bar corresponds to F1-F10, Ctrl0-Ctrl9 and HVCXZ, a total of 25 keys, where you can place items and skills, and use them quickly by pressing the corresponding keys. The keys on the shortcut bar can be changed in the system settings.
聊天界面可以用于显示当前与游戏里其他玩家的聊天信息及系统消息。在聊天窗口上部可选择发言的频道以及输入发言的内容。The chat interface can be used to display the current chat information with other players in the game and system messages. In the upper part of the chat window, you can select the channel to speak and enter the content of the speech.
玩家信息中可以查看当前角色的头像、门派、名字、等级信息。In the player information, you can view the current character's avatar, sect, name, and level information.
小地图这里显示玩家当前所处环境的周边地图信息。左上角的按键为时雨历,可显示当前所处地区、日期时间及天气;右上角的按键为邮箱;右下角的按键依次为:放大、缩小、查看世界地图、查看大地图。The mini-map shows the surrounding map information of the player's current environment. The button on the upper left corner is the calendar, which can display the current area, date, time and weather; the button on the upper right corner is the mailbox; the buttons on the lower right corner are: zoom in, zoom out, view world map, view large map.
任务玩法指引用于追踪当前的剧情任务/玩法活动信息。点击上面的链接可指引到目标点,点击上面的剧情/玩法页标可切换查看剧情任务和玩法活动的信息。The mission gameplay guide is used to track the current story mission/game activity information. Click the link above to be directed to the target point, and click the story/game tab above to switch to view the story mission and gameplay activity information.
在该款游戏中,阅历与角色等级的提升紧密相关,也就是人物经验。阅历值显示在游戏客户端的顶部,以一条黄色进度条显示当前拥有的阅历以及接下来升一级所需要的阅历。阅历的获取,除了完成主线任务之外,还有门派打坐、行会日常、荡寇和其他补充玩法等途径,可以打开游戏界面右上方小地图左边的“每日必做”来具体查看每日完成情况。In this game, experience is closely related to the improvement of character level, that is, character experience. The experience value is displayed at the top of the game client, with a yellow progress bar showing the current experience and the experience required for the next level. In addition to completing the main quest, experience can also be obtained through sect meditation, guild daily, bandit fighting and other supplementary gameplay. You can open the "Daily Must-Do" on the left side of the small map in the upper right corner of the game interface to view the daily completion status.
图23示意性示出了根据本发明的一实施例的角色属性的界面示意图。FIG. 23 schematically shows an interface diagram of role attributes according to an embodiment of the present invention.
如图23所示,角色属性可以包括:门派(例如唐门)、称号、功绩值、杀戮、修为、活力等,其中修为可用于修炼角色的经脉和心法。可以点击选择查看全部属性、经脉属性、心法属性和装备属性。全部属性可以包括基础属性和战斗属性。基础属性又可以包括气血、内息、定力、功力、力道、根骨、气劲、洞察、身法。战斗属性又可以包括外功攻击、内功攻击、定力攻击、命中率、会心率、会心伤害、外功防御、内功防御、定力防御、格挡、韧劲。As shown in Figure 23, the character attributes may include: sect (e.g., Tang Sect), title, merit value, killing, cultivation, vitality, etc., among which cultivation can be used to cultivate the meridians and mental methods of the character. You can click to select to view all attributes, meridian attributes, mental method attributes, and equipment attributes. All attributes may include basic attributes and combat attributes. Basic attributes may include Qi and blood, internal breath, concentration, skill, strength, root bones, Qi, insight, and body skills. Combat attributes may include external attack, internal attack, concentration attack, hit rate, critical rate, critical damage, external defense, internal defense, concentration defense, blocking, and tenacity.
图24示意性示出了根据本发明的一实施例的游戏商城的界面示意图。FIG. 24 schematically shows an interface diagram of a game mall according to an embodiment of the present invention.
如图24所示,可以选择查看游戏商城中的全部道具、装备道具、砭石道具、心法道具、身份道具。全部道具可以包括紫色心法注解、玄天石母、藏羚皮料、凤舞图、珍珠、修为丹、铸神令、玉琉璃、金丝穗、龙丹砂。这里对于商品属性展示设置周期为7天,每隔7天根据该用户的角色属性的变化更新道具的排列顺序。As shown in Figure 24, you can choose to view all props, equipment props, Bian stone props, mind props, and identity props in the game mall. All props can include purple mind annotations, Xuantian stone mother, Tibetan antelope leather, phoenix dance picture, pearls, cultivation pills, casting god orders, jade glass, gold wire spikes, and dragon cinnabar. Here, the display cycle for product attributes is set to 7 days, and the order of props is updated every 7 days according to the changes in the user's role attributes.
图25示意性示出了根据本发明的一实施例的信息处理装置的框图。FIG. 25 schematically shows a block diagram of an information processing device according to an embodiment of the present invention.
如图25所示,本发明实施方式提供的信息处理装置2500可以包括:第一对象角色确定模块2510、第一对象数据获得模块2520、物品属性信息获得模块2530以及第一目标物品确定模块2540。As shown in FIG. 25 , the information processing device 2500 provided by the embodiment of the present invention may include: a first object role determination module 2510 , a first object data acquisition module 2520 , an item attribute information acquisition module 2530 and a first target item determination module 2540 .
其中,第一对象角色确定模块2510可以配置为确定目标对象的第一角色。第一对象数据获得模块2520可以配置为根据所述第一角色的第一角色属性信息,获得所述目标对象的第一对象数据。物品属性信息获得模块2530可以配置为获得待推荐物的物品属性信息。第一目标物品确定模块2540可以配置为通过神经网络模型对所述第一对象数据和所述物品属性信息进行处理,从所述待推荐物中确定向所述目标对象的第一角色推荐的第一目标物品。Among them, the first object role determination module 2510 can be configured to determine the first role of the target object. The first object data acquisition module 2520 can be configured to obtain the first object data of the target object according to the first role attribute information of the first role. The item attribute information acquisition module 2530 can be configured to obtain the item attribute information of the item to be recommended. The first target item determination module 2540 can be configured to process the first object data and the item attribute information through a neural network model, and determine the first target item recommended to the first role of the target object from the items to be recommended.
在示例性实施例中,信息处理装置2500还可以包括:第二对象角色确定模块,可以配置为确定所述目标对象的第二角色;第二对象数据获得模块,可以配置为根据所述第二角色的第二角色属性信息,获得所述目标对象的第二对象数据;第二目标物品确定模块,可以配置为通过所述神经网络模型对所述第二对象数据和所述物品属性信息进行处理,从所述待推荐物中确定向所述目标对象的第二角色推荐的第二目标物品。In an exemplary embodiment, the information processing device 2500 may also include: a second object role determination module, which can be configured to determine the second role of the target object; a second object data acquisition module, which can be configured to obtain the second object data of the target object based on the second role attribute information of the second role; a second target item determination module, which can be configured to process the second object data and the item attribute information through the neural network model, and determine the second target item recommended to the second role of the target object from the items to be recommended.
在示例性实施例中,信息处理装置2500还可以包括:历史角色获得模块,可以配置为获得所述目标对象的历史角色;历史对象数据获得模块,可以配置为根据所述历史角色的历史角色属性信息,获得所述目标对象的历史对象数据;历史操作记录获得模块,可以配置为获得所述目标对象对所述待推荐物的历史操作记录;训练集生成模块,可以配置为根据所述历史操作记录,确定所述历史对象数据和所述物品属性信息的标签,以生成训练数据集;模型训练模块,可以配置为利用所述训练数据集训练所述神经网络模型。In an exemplary embodiment, the information processing device 2500 may also include: a historical role acquisition module, which can be configured to obtain the historical role of the target object; a historical object data acquisition module, which can be configured to obtain the historical object data of the target object based on the historical role attribute information of the historical role; a historical operation record acquisition module, which can be configured to obtain the historical operation record of the target object on the object to be recommended; a training set generation module, which can be configured to determine the labels of the historical object data and the item attribute information based on the historical operation record to generate a training data set; and a model training module, which can be configured to train the neural network model using the training data set.
在示例性实施例中,所述神经网络模型可以包括第一神经网络子模型、第二神经网络子模型和第三神经网络子模型。其中,第一目标物品确定模块2540可以包括:对象向量生成单元,可以配置为根据所述第一对象数据生成对象向量;物品向量生成单元,可以配置为根据所述物品属性信息生成所述待推荐物的物品向量;对象物品特性向量获得单元,可以配置为通过所述第一神经网络子模型对所述对象向量和所述物品向量进行处理,获得所述目标对象的第一角色的对象偏好向量和所述待推荐物的物品特性向量;交互关系向量获得单元,可以配置为通过所述第二神经网络子模型对所述对象向量和所述物品向量进行处理,获得所述目标对象的第一角色与所述待推荐物之间的交互关系向量;预测概率获得单元,可以配置为通过所述第三神经网络子模型对所述对象偏好向量、所述物品特性向量以及所述交互关系向量进行处理,获得所述目标对象的第一角色操作所述待推荐物的预测概率值;第一目标物品确定单元,可以配置为根据所述预测概率值,确定向所述目标对象的第一角色推荐的第一目标物品。In an exemplary embodiment, the neural network model may include a first neural network sub-model, a second neural network sub-model, and a third neural network sub-model. The first target item determination module 2540 may include: an object vector generation unit, which may be configured to generate an object vector according to the first object data; an item vector generation unit, which may be configured to generate an item vector of the item to be recommended according to the item attribute information; an object item characteristic vector acquisition unit, which may be configured to process the object vector and the item vector through the first neural network sub-model to obtain an object preference vector of the first role of the target object and an item characteristic vector of the item to be recommended; an interaction relationship vector acquisition unit, which may be configured to process the object vector and the item vector through the second neural network sub-model to obtain an interaction relationship vector between the first role of the target object and the item to be recommended; a prediction probability acquisition unit, which may be configured to process the object preference vector, the item characteristic vector, and the interaction relationship vector through the third neural network sub-model to obtain a prediction probability value of the first role of the target object operating the item to be recommended; and a first target item determination unit, which may be configured to determine the first target item recommended to the first role of the target object according to the prediction probability value.
在示例性实施例中,所述第一神经网络子模型可以包括第一神经网络单元和第二神经网络单元。其中,所述对象物品特性向量获得单元可以包括:对象偏好向量获得子单元,可以配置为通过所述第一神经网络单元对所述对象向量进行处理,获得所述对象偏好向量;物品特性向量获得子单元,可以配置为通过所述第二神经网络单元对所述物品向量进行处理,获得所述物品特性向量。In an exemplary embodiment, the first neural network sub-model may include a first neural network unit and a second neural network unit. The object item characteristic vector obtaining unit may include: an object preference vector obtaining sub-unit, which may be configured to process the object vector through the first neural network unit to obtain the object preference vector; and an item characteristic vector obtaining sub-unit, which may be configured to process the item vector through the second neural network unit to obtain the item characteristic vector.
在示例性实施例中,所述交互关系向量获得单元可以包括:拼接向量获得子单元,可以配置为将所述对象向量与所述物品向量进行拼接,获得拼接向量;交互关系向量获得子单元,可以配置为通过所述第二神经网络子模型对所述拼接向量进行处理,获得所述交互关系向量。In an exemplary embodiment, the interaction relationship vector obtaining unit may include: a splicing vector obtaining subunit, which can be configured to splice the object vector with the item vector to obtain a splicing vector; and an interaction relationship vector obtaining subunit, which can be configured to process the splicing vector through the second neural network sub-model to obtain the interaction relationship vector.
在示例性实施例中,所述预测概率获得单元可以包括:点乘向量获得子单元,可以配置为将所述对象偏好向量与所述物品特性向量相乘,获得点乘向量;串接向量获得子单元,可以配置为将所述点乘向量与所述交互关系向量串接,获得串接向量;预测概率获得子单元,可以配置为通过所述第三神经网络子模型对所述串接向量进行处理,获得所述预测概率值。In an exemplary embodiment, the predicted probability obtaining unit may include: a dot product vector obtaining subunit, which can be configured to multiply the object preference vector with the item characteristic vector to obtain a dot product vector; a concatenation vector obtaining subunit, which can be configured to concatenate the dot product vector with the interaction relationship vector to obtain a concatenation vector; and a predicted probability obtaining subunit, which can be configured to process the concatenation vector through the third neural network submodel to obtain the predicted probability value.
在示例性实施例中,所述神经网络模型还可以包括第一嵌入子模型,所述第一对象数据可以包括对象离散特征和对象连续特征。其中,所述对象向量生成单元可以包括:对象嵌入向量获得子单元,可以配置为通过所述第一嵌入子模型对所述对象离散特征进行处理,获得对象嵌入向量;对象离散表示获得子单元,可以配置为对所述对象连续特征进行分箱处理,获得对象离散表示;对象归一化处理子单元,可以配置为对所述对象离散表示进行归一化处理;对象向量生成子单元,可以配置为将所述对象嵌入向量和归一化后的对象离散表示进行拼接,生成所述对象向量。In an exemplary embodiment, the neural network model may further include a first embedding sub-model, and the first object data may include object discrete features and object continuous features. The object vector generation unit may include: an object embedding vector acquisition sub-unit, which may be configured to process the object discrete features through the first embedding sub-model to obtain an object embedding vector; an object discrete representation acquisition sub-unit, which may be configured to bin the object continuous features to obtain an object discrete representation; an object normalization processing sub-unit, which may be configured to normalize the object discrete representation; and an object vector generation sub-unit, which may be configured to concatenate the object embedding vector and the normalized object discrete representation to generate the object vector.
在示例性实施例中,所述神经网络模型还可以包括第二嵌入子模型,所述待推荐物的物品属性信息可以包括物品离散特征和物品连续特征。其中,所述物品向量生成单元可以包括:物品嵌入向量获得子单元,可以配置为通过所述第二嵌入子模型对所述物品离散特征进行处理,获得物品嵌入向量;物品离散表示获得子单元,可以配置为对所述物品连续特征进行分箱处理,获得物品离散表示;物品归一化处理子单元,可以配置为对所述物品离散表示进行归一化处理;物品向量生成子单元,可以配置为将所述物品嵌入向量和归一化后的物品离散表示进行拼接,生成所述物品向量。In an exemplary embodiment, the neural network model may further include a second embedding sub-model, and the item attribute information of the item to be recommended may include item discrete features and item continuous features. The item vector generation unit may include: an item embedding vector acquisition sub-unit, which may be configured to process the item discrete features through the second embedding sub-model to obtain an item embedding vector; an item discrete representation acquisition sub-unit, which may be configured to bin the item continuous features to obtain an item discrete representation; an item normalization processing sub-unit, which may be configured to normalize the item discrete representation; and an item vector generation sub-unit, which may be configured to concatenate the item embedding vector and the normalized item discrete representation to generate the item vector.
在示例性实施例中,第一对象数据获得模块2520可以包括:对象属性信息获取单元,可以配置为获取所述目标对象的对象属性信息;第一对象数据获得单元,可以配置为根据所述第一角色属性信息和所述对象属性信息,获得所述第一对象数据。In an exemplary embodiment, the first object data obtaining module 2520 may include: an object attribute information obtaining unit, which may be configured to obtain object attribute information of the target object; and a first object data obtaining unit, which may be configured to obtain the first object data according to the first role attribute information and the object attribute information.
在示例性实施例中,所述第一角色的第一角色属性信息可以包括所述第一角色的身份信息、当前等级信息和/或当前操作信息。In an exemplary embodiment, the first role attribute information of the first role may include identity information, current level information and/or current operation information of the first role.
本发明实施例提供的信息处理装置中的各个模块、单元和子单元的具体实现可以参照上述信息处理方法中的内容,在此不再赘述。The specific implementation of each module, unit and sub-unit in the information processing device provided by the embodiment of the present invention can refer to the content of the above-mentioned information processing method, which will not be repeated here.
应当注意,尽管在上文详细描述中提及了用于动作执行的设备的若干模块、单元和子单元,但是这种划分并非强制性的。实际上,根据本发明的实施方式,上文描述的两个或更多模块、单元和子单元的特征和功能可以在一个模块、单元和子单元中具体化。反之,上文描述的一个模块、单元和子单元的特征和功能可以进一步划分为由多个模块、单元和子单元来具体化。It should be noted that, although several modules, units and subunits of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to an embodiment of the present invention, the features and functions of two or more modules, units and subunits described above can be concretized in one module, unit and subunit. On the contrary, the features and functions of one module, unit and subunit described above can be further divided into being concretized by multiple modules, units and subunits.
通过以上的实施方式的描述,本领域的技术人员易于理解,这里描述的示例实施方式可以通过软件实现,也可以通过软件结合必要的硬件的方式来实现。因此,根据本发明实施方式的技术方案可以以软件产品的形式体现出来,该软件产品可以存储在一个非易失性存储介质(可以是CD-ROM,U盘,移动硬盘等)中或网络上,包括若干指令以使得一台计算设备(可以是个人计算机、服务器、触控终端、或者网络设备等)执行根据本发明实施方式的方法。Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present invention can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the implementation of the present invention.
本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本发明的其它实施方案。本申请旨在涵盖本发明的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本发明的一般性原理并包括本发明未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本发明的真正范围和精神由下面的权利要求指出。Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed by the present invention. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present invention are indicated by the following claims.
应当理解的是,本发明并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本发明的范围仅由所附的权利要求来限制。It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.
Claims (14)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910973476.6A CN110807150B (en) | 2019-10-14 | 2019-10-14 | Information processing method and device, electronic equipment and computer readable storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910973476.6A CN110807150B (en) | 2019-10-14 | 2019-10-14 | Information processing method and device, electronic equipment and computer readable storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110807150A CN110807150A (en) | 2020-02-18 |
CN110807150B true CN110807150B (en) | 2024-07-02 |
Family
ID=69488371
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910973476.6A Active CN110807150B (en) | 2019-10-14 | 2019-10-14 | Information processing method and device, electronic equipment and computer readable storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110807150B (en) |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111359203B (en) * | 2020-03-09 | 2021-09-28 | 西南交通大学 | Personalized railway VR scene interaction method |
CN113393281B (en) * | 2020-03-11 | 2025-02-25 | 北京沃东天骏信息技术有限公司 | A method and device for processing a request |
CN111672122B (en) * | 2020-05-29 | 2023-03-24 | 腾讯科技(深圳)有限公司 | Interface display method, device, terminal and storage medium |
CN113813610B (en) * | 2020-06-19 | 2024-05-14 | 北京龙创悦动网络科技有限公司 | Game data prediction model training, prediction method, prediction device and prediction system |
CN111701240B (en) * | 2020-06-22 | 2023-04-25 | 网易(杭州)网络有限公司 | Virtual article prompting method and device, storage medium and electronic device |
CN111870940B (en) * | 2020-08-06 | 2024-02-09 | 网易(杭州)网络有限公司 | Message display method, device, equipment and storage medium |
CN112347361B (en) | 2020-11-16 | 2024-03-01 | 百度在线网络技术(北京)有限公司 | Method for recommending object, neural network, training method, training equipment and training medium thereof |
CN112380216B (en) * | 2020-11-17 | 2023-07-28 | 北京融七牛信息技术有限公司 | Automatic feature generation method based on intersection |
CN113837517B (en) * | 2020-12-01 | 2024-08-20 | 北京沃东天骏信息技术有限公司 | Event triggering method and device, medium and electronic equipment |
CN113407862B (en) * | 2021-05-20 | 2022-06-17 | 桂林电子科技大学 | Sequential social contact recommendation method, system and storage medium based on door mechanism |
CN113509727B (en) * | 2021-07-09 | 2024-06-04 | 网易(杭州)网络有限公司 | Method and device for displaying props in game, electronic equipment and medium |
CN113923006B (en) * | 2021-09-30 | 2024-02-02 | 北京淇瑀信息科技有限公司 | Equipment data authentication method and device and electronic equipment |
CN116304306B (en) * | 2023-02-10 | 2025-08-22 | 网易(杭州)网络有限公司 | Method, device and electronic device for analyzing the recommendation effect of prop recommendation link |
CN117815674B (en) * | 2024-03-06 | 2024-05-24 | 深圳市迷你玩科技有限公司 | Game information recommendation method and device, computer readable medium and electronic equipment |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105447126A (en) * | 2015-11-17 | 2016-03-30 | 苏州蜗牛数字科技股份有限公司 | Game prop personalized recommendation method |
CN109241440A (en) * | 2018-09-29 | 2019-01-18 | 北京工业大学 | It is a kind of based on deep learning towards implicit feedback recommended method |
CN110152298A (en) * | 2018-11-22 | 2019-08-23 | 腾讯科技(深圳)有限公司 | Realize equipment recommended method, device and the computer equipment of virtual role |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6744353B2 (en) * | 2017-04-06 | 2020-08-19 | ネイバー コーポレーションNAVER Corporation | Personalized product recommendation using deep learning |
CN108268934A (en) * | 2018-01-10 | 2018-07-10 | 北京市商汤科技开发有限公司 | Recommendation method and apparatus, electronic equipment, medium, program based on deep learning |
CN110209922B (en) * | 2018-06-12 | 2023-11-10 | 中国科学院自动化研究所 | Object recommendation method, device, storage medium and computer equipment |
CN109087130A (en) * | 2018-07-17 | 2018-12-25 | 深圳先进技术研究院 | A kind of recommender system and recommended method based on attention mechanism |
CN109299995B (en) * | 2018-08-07 | 2022-11-29 | 腾讯科技(深圳)有限公司 | Virtual article sending method, device, server and storage medium |
CN109858956B (en) * | 2019-01-14 | 2023-12-12 | 珠海金山数字网络科技有限公司 | Game item pushing method and system based on big data |
CN109999504B (en) * | 2019-04-22 | 2022-05-31 | 腾讯科技(上海)有限公司 | Game prop recommendation method, device, server and storage medium |
CN110135951B (en) * | 2019-05-15 | 2021-07-27 | 网易(杭州)网络有限公司 | Game commodity recommendation method and device and readable storage medium |
CN110162706B (en) * | 2019-05-22 | 2021-10-26 | 南京邮电大学 | Personalized recommendation method and system based on interactive data clustering |
CN110270093B (en) * | 2019-07-04 | 2023-05-09 | 珠海西山居数字科技有限公司 | Intelligent shopping guide method, intelligent shopping guide device, computing equipment and storage medium |
-
2019
- 2019-10-14 CN CN201910973476.6A patent/CN110807150B/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105447126A (en) * | 2015-11-17 | 2016-03-30 | 苏州蜗牛数字科技股份有限公司 | Game prop personalized recommendation method |
CN109241440A (en) * | 2018-09-29 | 2019-01-18 | 北京工业大学 | It is a kind of based on deep learning towards implicit feedback recommended method |
CN110152298A (en) * | 2018-11-22 | 2019-08-23 | 腾讯科技(深圳)有限公司 | Realize equipment recommended method, device and the computer equipment of virtual role |
Also Published As
Publication number | Publication date |
---|---|
CN110807150A (en) | 2020-02-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110807150B (en) | Information processing method and device, electronic equipment and computer readable storage medium | |
Rane et al. | Metaverse for enhancing customer loyalty: effective strategies to improve customer relationship, service, engagement, satisfaction, and experience | |
Lao | Reorienting machine learning education towards tinkerers and ML-engaged citizens | |
Park et al. | A Bayesian network approach to examining key success factors of mobile games | |
CN111401958A (en) | Method and system for automatically recommending employment consultant to real estate client | |
US20240177216A1 (en) | Digital avatar recommendation method and recommendation system | |
JP7505208B2 (en) | MATCHING SYSTEM, MATCHING METHOD, AND MATCHING PROGRAM | |
CN108647064A (en) | The method and device of courses of action navigation | |
Al-Otaibi et al. | Cosine similarity-based algorithm for social networking recommendation | |
US10587690B2 (en) | Systems and methods for utilizing athlete data to increase athlete performance | |
Grigoryan et al. | Computerized agents versus human agents in finding core coalition in glove games | |
Chen et al. | Evaluating the LLM agents for simulating humanoid behavior | |
Zheng | Construction of an innovative entrepreneurship project learning platform introducing a group recommendation algorithm for college students | |
Yin et al. | Modeling behavioral dynamics in digital content consumption: An attention-based neural point process approach with applications in video games | |
Yu et al. | What drives purchase intention in live streaming e-commerce? The perspectives of virtual streamers | |
US20250108305A1 (en) | Mini-game systems and methods incorporated within a video gaming system environment | |
US20250108304A1 (en) | Video gaming system environments providing mini-games | |
Gemp et al. | Developing, evaluating and scaling learning agents in multi-agent environments | |
CN116823388A (en) | Commodity popularization method, electronic device, storage medium and program product | |
CN116774821A (en) | Virtual e-commerce customer service interaction method, electronic equipment and computer readable storage medium | |
CN116684688A (en) | Live broadcast mode switching method and related device based on emotion of audience | |
Shaikh et al. | The Role of Artificial Intelligence in Personalizing Social Media Advertising: Benefits, Challenges, and Future Directions | |
Long et al. | Determinants and effects of user delight with theme park apps | |
Sung et al. | Human-robot interaction learning using demonstration-based learning and Q-Learning in a pervasive sensing environment | |
CA2979136C (en) | Systems and methods for utilizing athlete data to increase athlete performance |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40022658 Country of ref document: HK |
|
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
TG01 | Patent term adjustment | ||
TG01 | Patent term adjustment |