JP2023113502A - Processing apparatus, processing method and processing program - Google Patents

Abstract

To set contents that match a worldview of a VR space so as to be arranged at a more natural position.SOLUTION: A server device 10 comprises: a first determination unit 1331 which determines whether or not contents being the arrangement candidate are arranged to a virtual reality space being the arrangement target on the basis of the similarity between the contents being the arrangement candidate and a worldview of the virtual reality space being the arrangement target; a second determination unit 1332 which assumes the arrangement position in the virtual reality space being the arrangement target for the contents being the arrangement target determined to be arranged to the virtual reality space being the arrangement target by the first determination unit 1331, and determines whether the arrangement of the contents being the arrangement target is natural or unnatural when the contents being the arrangement target are arranged at the assumed arrangement position; and a setting unit 1333 which sets the arrangement position of the contents being the arrangement target in the virtual reality space being the arrangement target at a position determined to be natural by the second determination unit.SELECTED DRAWING: Figure 2

Description

The present invention relates to a processing device, a processing method, and a processing program.

In recent years, techniques have been proposed that allow users to experience virtual reality (VR) spaces that express various worldviews such as shopping malls and outdoor spaces. For example, a virtual shopping mall (VR shopping mall) reproduces a shopping mall in a virtual space, and by linking with each store's EC (Electronic Commerce) site, you can enjoy a shopping experience similar to purchasing products in a real store. to users.

Japanese Patent No. 2004-220074

Until now, VR space providers have selected content that matches the world view of the VR space so that content that matches the world view of the VR space can be placed in a more natural position. It was necessary to perform a complicated process of arranging it in a suitable position.

The present invention has been made in view of the above, and provides a processing device, a processing method, and a processing program that can be set so that content that matches the world view of the VR space is arranged in a more natural position. intended to

In order to solve the above-described problems and achieve the object, the processing device of the present invention arranges the content of the arrangement candidate based on the degree of similarity between the content of the arrangement candidate and the world view of the virtual reality space to be arranged. a first determination unit that determines whether or not to place the content in the target virtual reality space; a second determination unit that determines whether the placement of the content to be placed is natural or unnatural when the placement position of the target in the virtual reality space is assumed and the content to be placed is arranged at the assumed placement position; and a setting unit that sets the placement position of the content to be placed in the virtual reality space to be placed to a position determined to be natural by the second determination unit.

According to the present invention, it is possible to set content that matches the worldview of the VR space so that it is arranged in a more natural position.

FIG. 1 is a block diagram showing an example of the configuration of a communication system according to an embodiment. FIG. 2 is a block diagram showing an example of the configuration of the server device shown in FIG. 1. As shown in FIG. FIG. 3 is a diagram for explaining placement position determination for content. FIG. 4 is a sequence diagram illustrating an example of a procedure of communication processing in the communication system according to the embodiment; FIG. 5 is a flow chart showing the procedure of the arrangement position determination process shown in FIG. FIG. 6 is a sequence diagram illustrating an example of a procedure of communication processing in the communication system according to the embodiment; FIG. 7 is a diagram showing a computer that executes a program.

Hereinafter, embodiments of a processing apparatus, a processing method, and a processing program according to the present application will be described in detail based on the drawings. Note that the processing apparatus, processing method, and processing program according to the present application are not limited by this embodiment.

In the following embodiments, processing flows of processing apparatuses, processing methods, and processing programs according to the embodiments will be described in order, and finally effects of the embodiments will be described.

[Embodiment]
First, an embodiment will be described. In the embodiment, a communication system for providing VR space to users will be described.

[Configuration of communication system]
A configuration of a communication system according to an embodiment will be described. FIG. 1 is a block diagram showing an example of the configuration of a communication system according to an embodiment.

As shown in FIG. 1, the communication system according to the embodiment includes a user terminal 20 used by each user, a server device 10 (processing device) of a VR provider, and a provider terminal 30 (administrator terminal). have Note that the configuration shown in FIG. 1 is merely an example, and the specific configuration and the number of each device are not particularly limited.

The server device 10 is a server device of a VR provider that provides each user with a VR space. For example, the server device 10 builds a virtual town in the virtual space, and builds a VR shopping mall including a plurality of VR stores and street advertisements in the town. In addition, the server device 10 constructs an outdoor space representing a trekking footpath and the surrounding natural environment so that trekking can be experienced. The server device 10 automatically sets the content that matches the world view of the VR space to be placed so that the content is placed in a more natural position.

The operator terminal 30 is a terminal device used by a VR space administrator or the like on the side of the VR provider. For example, the provider terminal 30 transmits content layout setting instruction information. The content placement setting instruction information includes information indicating the VR space to be placed and the content of the placement candidate, and information for instructing setting of the placement position of the content of the placement candidate. The placement position of the content of the placement candidate is indicated using coordinates or the like.

The user terminal 20 is an information processing device such as a notebook PC (Personal Computer) or a desktop PC, or a smart device such as a tablet or a smart phone. The user terminal 20 connects to the server device 10 via the network N and receives provision of the VR space constructed by the server device 10 . For example, the user browses advertisements and purchases products in the VR shopping mall by operating the user terminal 20 from a browser using the Web VR mechanism. Furthermore, the user may wear, for example, VR goggles to experience the VR space. Also, the user can experience an outdoor space by operating the user terminal 20 from a browser using, for example, a Web VR mechanism. Furthermore, the user may wear, for example, VR goggles to experience the VR space.

[Server device]
Next, the server device 10 will be described. FIG. 2 is a block diagram showing an example of the configuration of the server device 10 shown in FIG. 1. As shown in FIG. As shown in FIG. 2, the server device 10 includes a communication unit 11 that controls communication related to various types of information, a storage unit 12 that stores data and programs required for various processes by the control unit 13, and various processes. It has a control unit 13 .

The communication unit 11 is a communication interface that transmits and receives various information to and from other devices connected via a network or the like. The communication unit 11 is implemented by a NIC (Network Interface Card) or the like, and performs communication between another device and the control unit 13 (described later) via an electric communication line such as a LAN (Local Area Network) or the Internet.

For example, the communication unit 11 receives a request to enter the VR space from the user terminal 20 via the network N. FIG. In addition, the communication unit 11 receives requests for browsing and purchase requests for content such as products from the user terminal 20 . In addition, the communication unit 11 receives an instruction to set the layout of the layout candidate content in the VR space from the operator terminal 30 .

The storage unit 12 is a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). Note that the storage unit 12 may be a rewritable semiconductor memory such as a RAM (Random Access Memory), a flash memory, or an NVSRAM (Non Volatile Static Random Access Memory). The storage unit 12 stores an OS (Operating System) and various programs executed by the server device 10 . Furthermore, the storage unit 12 stores various information used in executing the program. The storage unit 12 stores construction information 121 , user information 122 , store and product information 123 , content information 124 , user position information 125 , user operation information 126 and content layout information 127 .

The building information 121 is information required for building a VR space in a virtual space. The construction information 121 includes image processing conditions and an image processing program for constructing the VR space in the virtual space. Also, the construction information 121 includes photographs of the area to be expressed in the VR space taken at a fixed point or 360 degrees, or images of the VR space constructed by image processing these photographs. The construction information 121 is, for example, an image that reproduces an area to be expressed in the VR space when the VR space is constructed by CG (Computer Graphics).

When the VR space is a VR shopping mall, the construction information 121 is a photograph taken at a fixed point or 360° of the cityscape, the exterior and interior of the VR store, and the products to be displayed in the VR shopping mall, or an image of these photographs. Contains images of the processed and constructed VR store and VR shopping mall. When the VR space is an outdoor space, the construction information 121 includes, for example, photographs of the trekking footpath and the surrounding natural environment taken at a fixed point or 360 degrees, or images obtained by image processing these photographs.

The user information 122 is information about each user registered as a visitor of the VR space. The user information 122 includes, for example, user IDs and browsing history associated with each user ID. For example, the browsing history has items such as browsing time, ID and name of browsed content. In the case of a VR shopping mall, the user information 122 includes product purchase history. The purchase history has items of purchase time, name of the store where the product was purchased, product ID, product name, size, color, and quantity.

If the VR space is a VR shopping mall, the storage unit 12 stores store and product information 123 . The store and product information 123 is information related to stores located in the VR shopping mall and products displayed in the VR store. The store and product information 123 has items of store ID, store type, product ID, product name, size, color, and number of products held by each store that can be displayed in VR stores and advertisements.

The content information 124 is information about content arranged in the VR space. The content is image content or audio content. Content is placed on the VR space, for example, for advertising or sales. In this case, when content is selected, a pop-up describing the product displayed by this content is displayed. Alternatively, when content is selected, it is possible to transition to an EC site where the product displayed by this content can be purchased.

The user position information 125 is information in which the position information of each user on the VR, which is transmitted from the user terminal 20, is associated with time information. This user location information 125 is, for example, periodically collected from each user terminal 20 and accumulated.

The user operation information 126 is information in which each user's operation information transmitted from the user terminal 20 is associated with time information. This user operation information 126 is, for example, periodically collected from each user terminal 20 and accumulated. The user operation information 126 is user operation information regarding viewing or purchase of a product. In addition, the user operation information 126 includes one or more of user line-of-sight information, image enlargement operation information via an input device, and pointer position information via an input device. The line-of-sight information of the user is measured based on the angle information of the VR goggles when the user is wearing the VR gold.

The content placement information 127 is information indicating the placement position of each content in the VR space set by the placement determination unit 133 (described later). The arrangement position of the content is set for each VR space.

The control unit 13 controls the server device 10 as a whole. The control unit 13 is, for example, an electronic circuit such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 13 also has an internal memory for storing programs defining various processing procedures and control data, and executes each processing using the internal memory. Further, the control unit 13 functions as various processing units by running various programs. The control unit 13 has a reception unit 131, a construction unit 132, and an arrangement determination unit 133 (determination unit).

The reception unit 131 receives entry into the VR space by the user. Also, if the VR space is a VR shopping mall, it accepts entry to the VR store, browsing of products, and purchase of products.

The constructing unit 132 constructs a VR space such as a VR shopping mall, a VR store, or an outdoor space in a virtual space using images or CG. Upon receiving the entry of the user into the VR space, the constructing unit 132 acquires the construction information 121 and constructs the VR space for which the entry is accepted in the virtual space. Then, the constructing unit 132 provides the constructed VR space to each user terminal 20 used by the user.

When the arrangement determination unit 133 receives an instruction to set the arrangement of arrangement candidate content (for example, an image) in the VR space from the operator terminal 30, the arrangement determination unit 133 places which content in which position in the VR space for which the arrangement of the content has been instructed. Automatically determine whether to place. For example, the placement candidate content is an image of a product sold by a business or an image of a product whose advertisement is requested by an advertiser. The placement determination unit 133 has a first determination unit 1331 , a second determination unit 1332 and a setting unit 1333 .

First, when setting the placement position of the content in the instructed VR space, the first determination unit 1331 compares the content itself with the world view of the VR space to be placed, and determines whether the content itself is appropriate in the VR space. determine whether The first determination unit 1331 determines whether or not to place the placement candidate content in the placement target VR space based on the degree of similarity between the placement candidate content and the worldview of the placement target VR space. do.

For example, the first determination unit 1331 selects the placement candidate content based on the degree of similarity between the image recognition result for the placement candidate content and the phrase preset as the VR worldview to be placed. It is determined whether or not to arrange in the VR space.

First, the first determination unit 1331 performs image recognition on the content of the layout candidate. Then, the first determination unit 1331 obtains the degree of similarity between the phrase preset as the world view of the VR space to be placed and the text obtained by image recognition for the content. The first determination unit 1331 uses a text similarity calculation method such as word2vec to acquire the similarity between the phrase set as the world view of the VR space and the text obtained by image recognition of the content.

If the degree of similarity is equal to or greater than a predetermined threshold, it is considered that the content of the placement candidate is similar to the world view of the VR space. (placement target content). On the other hand, if the degree of similarity is less than the predetermined threshold, it is considered that the content of the placement candidate is not similar to the world view of the VR space. It is determined that it is not content.

Note that when a plurality of phrases are set, the first determination unit 1331 may determine content to be arranged if the degree of similarity with one of the plurality of phrases is equal to or greater than a predetermined threshold. Also, the first determination unit 1331 may determine whether or not the content is to be placed, using a statistical value such as an average value of similarities with a plurality of phrases.

Further, whether or not the contents of the placement candidates are similar to the worldview of the VR space may be determined by the administrator or the like. Using a similarity threshold, the first determination unit 1331 determines whether the similarity between the phrase of the world view of the VR space and the text for the content is significantly different (obviously unnatural), Depending on whether or not they are slightly apart (if they are slightly unnatural), a notification may be made so that the administrator or the like can determine whether or not they are similar. For example, if the degrees of similarity are significantly different and clearly unnatural, the first determination unit 1331 determines that the placement candidate content is not the placement target content, and proceeds to the next process. On the other hand, if the degree of similarity is slightly different and is a little unnatural, the first determination unit 1331 notifies the manager or the like of a similarity determination request.

In addition, the first determination unit 1331 assumes that even when the natural determination is made, the user may feel slightly unnatural when actually visually recognizing, and according to the difference value between the similarity and the threshold, A manager or the like may be notified of the similarity determination request.

Subsequently, the second determination unit 1332 determines the placement position of the content to be placed that has been determined by the first determination unit 1331 to be placed in the VR space to be placed. The second determination unit 1332 assumes the placement position of the content to be placed, and determines whether the placement of the content is natural or unnatural when the content to be placed is placed in the assumed placement position. The second determination unit 1332 uses a determination device that determines whether an image is natural or unnatural. The determiner is configured using, for example, a neural network.

Note that the second determination unit 1332 registers phrases related to placement positions in advance, and if the assumed placement position and the registered phrase have a degree of similarity equal to or greater than a predetermined value, the assumed placement position becomes the placement target. may be determined to be the arrangement position of the content. Further, the second determination unit 1332 may perform image recognition on the assumed layout position, and determine from the image recognition result that the assumed layout position is the layout position of the layout target content. For example, when the assumed placement position is image-recognized as a river, the second determination unit 1332 determines that the content of the tent to be placed is not placed on the river. Further, the second determination unit 1332 may determine natural and unnatural portions based on a predetermined threshold value. For example, a threshold value is provided for each stage so that the second determination unit 1332 can determine a plurality of stages (n stages) of clearly unnatural, slightly unnatural, and clearly natural.

The setting unit 1333 sets the placement position of the placement target content in the placement target VR space to the position determined by the second determination unit 1332 to be natural. If the second determination unit 1332 determines that the content to be placed is natural when the content to be placed is placed at the assumed placement position, the setting unit 1333 sets the assumed placement position as the placement position of this content. When the content to be arranged is arranged at the assumed arrangement position and the second judgment unit determines that the arrangement position is unnatural, the setting unit 1333 does not set the assumed arrangement position as the arrangement position of the content.

Note that the setting unit 1333 may notify the administrator or the like to determine whether or not the content can be placed when the content to be placed is desired to be placed in an unnatural placement position. In addition, an administrator or the like may determine whether or not it is unnatural to arrange the content of the arrangement candidate at the assumed arrangement position. The setting unit 1333 may notify the administrator or the like to determine whether or not the arrangement is permitted depending on whether the arrangement is clearly unnatural or slightly unnatural.

For example, if it is clearly unnatural, the setting unit 1333 determines that the assumed placement position is not the placement position of the placement candidate content, and proceeds to the next process. On the other hand, if it is a little unnatural, the setting unit 1333 notifies the administrator or the like of a request to determine whether or not arrangement is possible. In addition, the first determination unit 1331 assumes that even when the natural determination is made, the user may feel slightly unnatural when the user actually visually recognizes it, and the determination value is used when the natural determination is made. A similarity judgment request may be sent to an administrator or the like according to the difference value from the threshold.

FIG. 3 is a diagram for explaining placement position determination for content. Referring to FIG. 3, a case will be described in which a content G1, which is an image of a tent, and a content G2, which is an image of a cup, are arranged in a VR space V1 expressing an outdoor world view ((1) in FIG. 3). , (3)).

The placement determination unit 133 performs image recognition on the contents G1 and G2 to obtain the texts "tent" and "cup", respectively. The placement determination unit 133 selects phrases preset as the world view of the VR space V1 (for example, “outdoor”, “camp”, “tent”, etc.), and the text “tent” of the content G1 obtained by image recognition. The degree of similarity between the content G2 and the text “Cup” is obtained, and a first determination is made. Note that the arrangement determination unit 133 has an option to add a phrase as well as the result of image recognition, and may use the degree of similarity with the phrase to perform the first determination.

In the example of FIG. 3, the phrase preset as the worldview of the VR space V1 matches the text "tent" of the content G1. Therefore, the placement determination unit 133 determines that the content G1 is content to be placed in the VR space V1. On the other hand, the degree of similarity between the text "cup" of the content G2 and the phrase preset as the world view of the VR space V1 is less than the predetermined threshold. Therefore, the placement determination unit 133 determines that the content G2 is inappropriate as content to be placed in the VR space V1 ((4) in FIG. 3) and is not content to be placed.

Subsequently, the placement determination unit 133 performs a second determination on the positions R1 and R2 where the content G1 to be placed can be placed. The placement determination unit 133 determines whether the placement of the content G1 is natural or unnatural based on the images of the content at the positions R1 and R2 and the surrounding content when the content G1 is placed at the positions R1 and R2. . For example, the determiner may acquire pixel data of the entire VR space V1 to make a determination, or may acquire data of a predetermined number of pixels around the location of the content and make a determination.

Since the position R2 is above the river W1, placing the tent is unnatural. Therefore, the placement determination unit 133 determines that the position R2 is inappropriate as the placement position of the content G1 ((4) in FIG. 3). On the other hand, position R1 is a vacant lot away from the river, so it is natural to place a tent there. The placement determination unit 133 determines that the position R1 is appropriate as the placement position of the content G1 ((2) in FIG. 3), and sets the position R1 as the placement position of the content G1.

[Processing Procedure 1 of Communication Processing]
FIG. 4 is a sequence diagram illustrating an example of a procedure of communication processing in the communication system according to the embodiment; FIG. 4 shows a processing procedure for setting the layout position of content.

As shown in FIG. 4, when the server device 10 receives a placement setting instruction for placement candidate content from the provider terminal 30 (step S11), the server device 10 receives various information on the VR space to be placed and information on the placement position of the content. (step S12).

Subsequently, the server device 10 performs placement determination processing for determining which content is to be placed in which position in the VR space for which the content placement has been instructed (step S13). In the placement determination process, the content to be placed among the placement candidate contents is determined, and the position where the content to be placed is naturally placed is determined. Based on the determination result, the server device 10 sets the content to be arranged and the arrangement position of this content (step S14), and transmits the setting information of the content to be arranged and the arrangement position of the content to the operator terminal 30. Notify (step S15).

Through this processing, the content that matches the worldview of the VR space to be placed is set to be placed in a natural position.

[Placement determination processing]
Next, the placement position determination processing (step S13) shown in FIG. 4 will be described. FIG. 5 is a flow chart showing the procedure of the arrangement position determination process shown in FIG.

As shown in FIG. 5, in the server apparatus 10, the placement determination unit 133 acquires various types of information about the content designated by the business as a placement candidate from the content information 124, for example (step S21). The placement determination unit 133 acquires a phrase preset as the world view of the VR space to be placed (step S22).

The placement determination unit 133 performs image recognition on the placement candidate content (step S23). Then, the placement determination unit 133 acquires the degree of similarity between the phrase preset as the world view of the VR space to be placed and the text obtained by image recognition for the content (step S24). The arrangement determination unit 133 determines whether or not the degree of similarity is equal to or greater than a predetermined threshold (step S25).

If the degree of similarity is greater than or equal to the predetermined threshold (step S25: Yes), the placement determination unit 133 determines that the placement candidate content is the content to be placed in this VR space (step S26). If the degree of similarity is less than the predetermined threshold (step S25: No), the placement determination unit 133 determines that the placement candidate content is not the content to be placed, and proceeds to step S31.

Subsequently, the placement determination unit 133 assumes one of the possible placement positions in the designated area as the placement position of the content to be placed (step S27). The placement determination unit 133 determines whether the placement of the content is natural or unnatural when the content to be placed is placed at this placement position (step S28).

When the determination result of the determination process in step S28 is natural (step S29: natural), the placement determination unit 136 sets the assumed placement position as the placement position of this content (step S30). On the other hand, if the determination result of the determination processing in step S28 is unnatural (step S29: unnatural), the arrangement determination unit 133 returns to step S27, assumes another position, and performs natural/unnatural determination. .

After the process of step S30, the placement determination unit 133 determines whether or not there is content for the next placement candidate (step S31). If there is a layout candidate content (step S31: Yes), the layout determination unit 133 returns to step S21 and executes layout determination processing for the layout candidate content. On the other hand, if there is no placement candidate content (step S31: No), the placement determination unit 133 terminates the placement determination process.

[Processing Procedure 2 of Communication Processing]
FIG. 6 is a sequence diagram illustrating an example of a procedure of communication processing in the communication system according to the embodiment; FIG. 6 shows a processing procedure for providing a VR space to the user terminal 20. As shown in FIG.

As shown in FIG. 6, in the server device 10, when the reception unit 131 receives an application to enter the VR space from the user terminal 20 (steps S41 and S42), the construction unit 132 receives the construction information 121 and the content information 124. is obtained (step S43), and a VR space is constructed on the virtual space (step S44). The construction unit 132 then provides the user terminal 20 with the VR space (step S45).

The server device 10 collects position information in which each user's position in the VR space is associated with time information from each user terminal 20 (step S46), and stores it in the user position information 125 (step S48). The server apparatus 10 collects operation information in which information indicating operations of each user is associated with time information from each user terminal 20 (step S47), and stores the operation information in the user operation information 126 (step S48).

[Effects of Embodiment]
In this manner, the server device 10 according to the embodiment automatically sets content that matches the world view of the VR space to be placed so that the content is placed in a more natural position. For this reason, according to the embodiment, it is not necessary for each business operator to perform the complicated process of selecting content that matches the world view of the VR space and arranging the selected content in a natural position. Furthermore, according to the embodiment, by providing content that is naturally arranged in the VR space, the user can experience a comfortable VR space, and appeal and sell various products to the user through the content. becomes possible.

[System configuration, etc.]
Also, each component of each device illustrated is functionally conceptual, and does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution and integration of each device is not limited to the one shown in the figure, and all or part of them can be functionally or physically distributed and integrated in arbitrary units according to various loads and usage conditions. Can be integrated and configured. Furthermore, all or any part of each processing function performed by each device is realized by a CPU or GPU and a program analyzed and executed by the CPU or GPU, or as hardware by wired logic can be realized.

Further, among the processes described in this embodiment, all or part of the processes described as being automatically performed can be performed manually, or the processes described as being performed manually can be performed manually. All or part of this can also be done automatically by known methods. In addition, information including processing procedures, control procedures, specific names, and various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified.

[program]
It is also possible to create a program in which the processing executed by the server device 10 described in the above embodiment is described in a computer-executable language. For example, it is also possible to create a program in which the processing executed by the server device 10 in the embodiment is described in a computer-executable language. In this case, the same effects as those of the above embodiments can be obtained by having the computer execute the program. Further, such a program may be recorded in a computer-readable recording medium, and the program recorded in this recording medium may be read by a computer and executed to realize processing similar to that of the above embodiments.

FIG. 7 is a diagram showing a computer that executes a program. As illustrated in FIG. 7, computer 1000 includes, for example, memory 1010, CPU 1020, hard disk drive interface 1030, disk drive interface 1040, serial port interface 1050, video adapter 1060, and network interface 1070. , and these units are connected by a bus 1080 .

The memory 1010 includes a ROM (Read Only Memory) 1011 and a RAM 1012 as illustrated in FIG. The ROM 1011 stores a boot program such as BIOS (Basic Input Output System). Hard disk drive interface 1030 is connected to hard disk drive 1090 as illustrated in FIG. A disk drive interface 1040 is connected to the disk drive 1100 . A removable storage medium such as a magnetic disk or optical disk is inserted into the disk drive 1100 . Serial port interface 1050 is connected to mouse 1110 and keyboard 1120, for example. Video adapter 1060 is connected to display 1130, for example.

Here, as illustrated in FIG. 7, the hard disk drive 1090 stores an OS 1091, application programs 1092, program modules 1093, and program data 1094, for example. That is, the above program is stored, for example, in hard disk drive 1090 as a program module in which instructions to be executed by computer 1000 are described.

Various data described in the above embodiments are stored as program data in the memory 1010 or the hard disk drive 1090, for example. Then, the CPU 1020 reads the program modules 1093 and program data 1094 stored in the memory 1010 and the hard disk drive 1090 to the RAM 1012 as necessary, and executes various processing procedures.

Note that the program module 1093 and program data 1094 related to the program are not limited to being stored in the hard disk drive 1090. For example, they may be stored in a removable storage medium and read by the CPU 1020 via a disk drive or the like. . Alternatively, the program module 1093 and program data 1094 related to the program are stored in another computer connected via a network (LAN (Local Area Network), WAN (Wide Area Network), etc.), and are transmitted via the network interface 1070. It may be read by CPU 1020 .

The above-described embodiments and modifications thereof are included in the scope of the invention described in the claims and their equivalents, as well as in the technology disclosed in the present application.

10 server device 11 communication unit 12 storage unit 13 control unit 20 user terminal 30 provider terminal 121 construction information 122 user information 123 store and product information 124 content information 125 user position information 126 user operation information 127 content arrangement information 131 reception unit 132 Construction unit 133 Placement determination unit 1331 First determination unit 1332 Second determination unit 1333 Setting unit

Claims (4)

Determining whether or not to arrange the content of the placement candidate in the virtual reality space of the placement target based on the degree of similarity between the content of the placement candidate and the world view of the virtual reality space of the placement target. a determination unit;
With respect to the content to be placed that has been determined to be placed in the virtual reality space of the placement target by the first determination unit, a placement position in the virtual reality space of the placement target is assumed, and the placement target is placed in the assumed placement position. a second determination unit that determines whether the placement of the content to be placed is natural or unnatural when the content of
a setting unit configured to set an arrangement position of the content to be arranged in the virtual reality space to be arranged to a position judged to be natural by the second judgment unit;
A processing apparatus comprising: the content of the placement candidate is image content;
The first determination unit selects the placement candidate content based on the degree of similarity between an image recognition result for the placement candidate content and a phrase preset as a world view of the virtual reality space to be placed. 2. The processing apparatus according to claim 1, wherein it is determined whether or not to place the object in the virtual reality space to be placed. A processing method executed by a processing device,
Determining whether or not to arrange the content of the placement candidate in the virtual reality space of the placement target based on the degree of similarity between the content of the placement candidate and the world view of the virtual reality space of the placement target. a judgment process;
For the content to be placed determined to be placed in the virtual reality space of the placement target in the first determination step, a placement position in the virtual reality space of the placement target is assumed, and the placement target is placed in the assumed placement position. a second determination step of determining whether the placement of the content to be placed is natural or unnatural when the content of
a setting step of setting an arrangement position of the content to be arranged in the virtual reality space to be arranged to a position judged to be natural in the second judgment step;
A processing method characterized by including Determining whether or not to arrange the content of the placement candidate in the virtual reality space of the placement target based on the degree of similarity between the content of the placement candidate and the world view of the virtual reality space of the placement target. a judgment process;
For the content to be placed determined to be placed in the virtual reality space of the placement target in the first determination step, a placement position in the virtual reality space of the placement target is assumed, and the placement target is placed in the assumed placement position. a second determination step of determining whether the placement of the content to be placed is natural or unnatural when the content of
a setting step of setting an arrangement position of the content to be arranged in the virtual reality space to be arranged to a position judged to be natural in the second judgment step;
A processing program for causing a computer to execute

Images