WO2026018673A1 - Information processing device and information processing method - Google Patents

Abstract

The present technology relates to an information processing device and an information processing method that make it possible to easily generate a virtual item to be attached to a moving virtual body in a virtual space. This information processing device comprises: an image acquisition unit that acquires image data of an autonomous moving body that takes a pose corresponding to an attached item; and an image processing unit that generates, on the basis of the image data, a virtual item that can be attached to a moving virtual body in a virtual space. The present technology can be applied to, for example, smartphones.

Description

Information processing device and information processing method

This technology relates to an information processing device and information processing method suitable for use when generating virtual items to be worn by virtual moving objects in a virtual space.

Technology has been proposed to create a virtual space that conforms to the real space in which a self-propelled robot exists (see, for example, Patent Document 1).

Furthermore, in recent years, applications (hereinafter referred to as virtual mobile object applications) that allow users to communicate with virtual mobile objects corresponding to autonomous mobile objects such as pet-type robots in virtual spaces have become popular. Some virtual mobile object applications, for example, allow users to equip virtual items such as virtual clothing on the virtual mobile objects.

JP 2023-41983 A

For example, in virtual mobile applications, there is a need to generate unique virtual items.

This technology was developed in response to these circumstances, making it easy to generate virtual items to be worn by virtual moving objects in virtual space.

An information processing device according to one aspect of the present technology includes an image acquisition unit that acquires image data of a first autonomous moving body striking a pose corresponding to an attached item, and an image processing unit that generates, based on the image data, a virtual item that can be attached to the first virtual moving body in a virtual space.

An information processing method according to one aspect of the present technology includes an information processing device acquiring image data of an autonomous moving body striking a pose corresponding to an attached item, and generating, based on the image data, a virtual item that can be attached to the virtual moving body in a virtual space.

In one aspect of this technology, image data of an autonomous moving body striking a pose corresponding to an attached item is acquired, and a virtual item that can be attached to the virtual moving body in a virtual space is generated based on the image data.

1 is a block diagram showing an embodiment of an information processing system to which the present technology is applied. FIG. 2 is a diagram illustrating an example of the hardware configuration of an autonomous moving body. 10 is a diagram illustrating a configuration example of an actuator provided in an autonomous moving body. FIG. 2 is a diagram for explaining functions of a display provided in an autonomous moving body. FIG. 10 is a diagram illustrating an example of the operation of an autonomous moving body. FIG. 2 is a block diagram illustrating an example of the functional configuration of an autonomous moving body. FIG. 2 is a block diagram illustrating an example of a functional configuration of the information processing terminal. 3 is a block diagram showing an example of a functional configuration of an information processing unit of the information processing terminal; FIG. 2 is a block diagram illustrating an example of a functional configuration of an information processing server. 10 is a flowchart illustrating a dress-up item generation process. 10 is a flowchart illustrating details of a scan process. FIG. 10 is a diagram illustrating an example of a scan pause. FIG. 10 is a diagram illustrating an example of a scan pause. FIG. 10 is a diagram illustrating an example of a scan pause. 10A and 10B are diagrams for explaining an example of the operation of an autonomous moving body when a scanning pose is taken. FIG. 10 is a diagram illustrating an example of a method for capturing an image of an autonomous moving body. 10A and 10B are diagrams for explaining an example of the operation of an autonomous moving body during imaging. 10 is a flowchart for explaining details of a 3D data generation process. 10 is a flowchart illustrating details of a virtual item creation process. FIG. 10 is a diagram illustrating an example of a method for extracting a 3D item. FIG. 10 is a diagram illustrating an example of a 3D item. 10 is a flowchart illustrating a dress-up process. FIG. 10 is a diagram showing an example of a selection menu. FIG. 10 is a diagram showing an example of a dress-up image. FIG. 10 is a diagram showing an example of the reuse of dress-up items. FIG. 10 is a diagram showing an example of the reuse of dress-up items. FIG. 1 illustrates an example of the configuration of a computer.

Hereinafter, embodiments of the present technology will be described in the following order.
1. Embodiment 2. Modification 3. Other

<<1. Embodiment>>
An embodiment of the present technology will be described with reference to FIGS. 1 to 24. FIG.

<Configuration example of information processing system 1>
FIG. 1 is a block diagram showing an embodiment of an information processing system 1 to which the present technology is applied.

The information processing system 1 includes autonomous mobile units 11-1 to 11-n, information processing terminals 12-1 to 12-n, and an information processing server 13.

Note that, hereinafter, when there is no need to distinguish between the autonomous mobile units 11-1 to 11-n, they will simply be referred to as autonomous mobile units 11. Hereinafter, when there is no need to distinguish between the information processing terminals 12-1 to 12-n, they will simply be referred to as information processing terminals 12.

Communication is possible between each autonomous mobile body 11 and the information processing server 13, between each information processing terminal 12 and the information processing server 13, between each autonomous mobile body 11 and each information processing terminal 12, between each autonomous mobile body 11, and between each information processing terminal 12 via the network 21. Furthermore, direct communication is also possible between each autonomous mobile body 11 and each information processing terminal 12, between each autonomous mobile body 11, and between each information processing terminal 12 without going through the network 21.

The autonomous mobile unit 11 is an information processing device that recognizes its own and its surrounding situations based on collected sensor data, etc., and autonomously selects and executes various actions according to the situation. Unlike robots that simply perform actions according to user instructions, one of the features of the autonomous mobile unit 11 is that it autonomously executes appropriate actions according to the situation.

The autonomous mobile body 11 can, for example, perform user recognition or object recognition based on captured images, and perform various autonomous actions in response to the recognized user or object. The autonomous mobile body 11 can also, for example, perform voice recognition based on the user's speech, and take actions based on the user's instructions.

Furthermore, the autonomous mobile body 11 performs pattern recognition learning to acquire the ability to recognize users and objects. In this case, the autonomous mobile body 11 can not only perform supervised learning based on given learning data, but also dynamically collect learning data based on instructions from users, etc., and perform pattern recognition learning related to objects, etc.

Furthermore, the autonomous mobile body 11 can be disciplined by the user. Here, discipline of the autonomous mobile body 11 is broader than general discipline, such as teaching and making the autonomous mobile body 11 memorize rules and prohibitions, and refers to changes in the autonomous mobile body 11 that the user can sense as a result of the user's interaction with the autonomous mobile body 11.

The shape, capabilities, desires, and other levels of the autonomous mobile body 11 can be designed appropriately according to its purpose and role. For example, the autonomous mobile body 11 may be an autonomous mobile robot that moves autonomously within a space and performs various actions. Specifically, the autonomous mobile body 11 may be an autonomous mobile robot that has a shape and movement capabilities that mimic those of a human, dog, or other animal. Also, for example, the autonomous mobile body 11 may be a vehicle or other device that has the ability to communicate with the user.

The information processing terminal 12 may be, for example, a smartphone, tablet terminal, or PC (personal computer), and is used by the user of the autonomous mobile body 11. The information processing terminal 12 performs various functions by executing a predetermined application program (hereinafter simply referred to as an application). For example, the information processing terminal 12 communicates with the information processing server 13 via the network 21 or directly with the autonomous mobile body 11 to collect various data related to the autonomous mobile body 11, present it to the user, and issue instructions to the autonomous mobile body 11.

The applications executed by the information processing terminal 12 include, for example, a virtual mobile object application that allows communication with a virtual mobile object corresponding to the autonomous mobile object 11 in a virtual space. The virtual mobile object application includes, for example, a dress-up function that allows virtual items such as virtual clothing (hereinafter referred to as dress-up items) to be attached to the virtual mobile object.

A virtual moving body corresponding to the autonomous moving body 11 is, for example, a virtual moving body that simulates the autonomous moving body 11 in a virtual space. Note that the appearance of the virtual moving body does not necessarily have to be identical to that of the autonomous moving body 11, and may be somewhat deformed. Also, for example, characteristics of the autonomous moving body 11 other than its appearance (e.g., gender, age, personality, behavior patterns, etc.) may be simulated by the virtual moving body.

The information processing server 13, for example, collects various types of data from each autonomous mobile body 11 and each information processing terminal 12, provides various types of data to each autonomous mobile body 11 and each information processing terminal 12, and controls the operation of each autonomous mobile body 11. Furthermore, for example, the information processing server 13 can also perform pattern recognition learning and processing corresponding to user discipline, similar to the autonomous mobile body 11, based on the data collected from each autonomous mobile body 11 and each information processing terminal 12. Furthermore, for example, the information processing server 13 supplies each information processing terminal 12 with the above-mentioned applications and various types of data related to each autonomous mobile body 11.

Network 21 may be composed of, for example, public network such as the Internet, telephone network, satellite communication network, or various LANs (Local Area Networks) including Ethernet (registered trademark), WANs (Wide Area Networks), etc. Network 21 may also include dedicated network such as IP-VPN (Internet Protocol-Virtual Private Network). Network 21 may also include wireless communication networks such as Wi-Fi (registered trademark) and Bluetooth (registered trademark).

The configuration of the information processing system 1 can be flexibly changed depending on specifications, operations, etc. For example, the autonomous mobile body 11 may communicate information with various external devices in addition to the information processing terminal 12 and information processing server 13. These external devices may include, for example, servers that transmit weather, news, and other service information, as well as various home appliances owned by the user.

Furthermore, for example, the relationship between the autonomous mobile bodies 11 and the information processing terminals 12 does not necessarily have to be one-to-one, and may be, for example, a many-to-many, many-to-one, or one-to-many relationship. For example, one user can use one information processing terminal 12 to check data related to multiple autonomous mobile bodies 11, or use multiple information processing terminals to check data related to one autonomous mobile body 11.

<Example of Hardware Configuration of Autonomous Mobile Body 11>
Next, a description will be given of an example of the hardware configuration of the autonomous moving body 11. In the following, a case will be described where the autonomous moving body 11 is a dog-type four-legged walking robot.

Figure 2 is a diagram showing an example of the hardware configuration of the autonomous mobile body 11. The autonomous mobile body 11 is a dog-like quadrupedal robot equipped with a head, a torso, four legs, and a tail.

The autonomous moving body 11 is equipped with two displays, 51L and 51R, on its head. Hereinafter, when there is no need to distinguish between the displays 51L and 51R, they will simply be referred to as displays 51.

The autonomous mobile body 11 also includes various sensors. For example, the autonomous mobile body 11 includes a microphone 52, a camera 53, a ToF (Time Of Flight) sensor 525, a human presence sensor 55, a distance measurement sensor 56, a touch sensor 57, an illuminance sensor 58, a sole button 59, and an inertial sensor 60.

The autonomous mobile body 11 is equipped with, for example, four microphones 52 on its head. Each microphone 52 collects surrounding sounds, including, for example, the user's speech and ambient environmental sounds. Furthermore, by providing multiple microphones 52, it is possible to collect surrounding sounds with high sensitivity and localize the sound source.

The autonomous mobile body 11 is equipped with two wide-angle cameras 53, for example, located at the nose and waist, which capture images of the area around the autonomous mobile body 11. For example, the camera 53 located at the nose captures images within the autonomous mobile body 11's forward field of view (i.e., the dog's field of view). The camera 53 located at the waist captures images of the area around the autonomous mobile body 11, with the area above the autonomous mobile body 11 as the center. The autonomous mobile body 11 can extract feature points on the ceiling, for example, based on images captured by the camera 53 located at the waist, and achieve SLAM (Simultaneous Localization and Mapping).

The ToF sensor 54 is mounted, for example, on the tip of the nose and detects the distance to an object located in front of the head. The ToF sensor 54 enables the autonomous mobile body 11 to accurately detect the distance to various objects, enabling it to perform operations according to the relative position of objects, including the user, and obstacles.

The human presence sensor 55 is placed, for example, on the chest and detects the location of the user or the user's pets. By detecting an animal in front of the autonomous mobile body 11 using the human presence sensor 55, the autonomous mobile body 11 can perform various actions in response to the animal, such as actions in response to emotions such as interest, fear, or surprise.

The distance measurement sensor 56 is placed, for example, on the chest, and detects the condition of the floor surface in front of the autonomous mobile body 11. The distance measurement sensor 56 allows the autonomous mobile body 11 to accurately detect the distance to an object on the floor surface in front of it, and to perform operations according to the relative position of that object.

The touch sensor 57 is placed in areas where the user is likely to touch the autonomous moving body 11, such as the top of the head, under the chin, or on the back, and detects contact by the user. The touch sensor 57 is configured, for example, by a capacitance-type or pressure-sensitive touch sensor. The touch sensor 57 allows the autonomous moving body 11 to detect contact actions by the user, such as touching, stroking, tapping, or pushing, and to perform an action in accordance with the contact action.

The illuminance sensor 58 is located, for example, on the back of the head at the base of the tail, and detects the illuminance of the space in which the autonomous mobile body 11 is located. The autonomous mobile body 11 can detect the ambient brightness using the illuminance sensor 58 and perform operations according to the brightness.

The sole buttons 59 are, for example, positioned on the areas corresponding to the pads of each of the four legs, and detect whether the bottom surfaces of the legs of the autonomous mobile body 11 are in contact with the floor. The sole buttons 59 allow the autonomous mobile body 11 to detect whether or not it is in contact with the floor, and can, for example, determine when it has been picked up by a user.

The inertial sensors 60 are placed, for example, on the head and torso, respectively, and detect physical quantities such as the speed, acceleration, and rotation of the head and torso. For example, the inertial sensors 60 are configured with a six-axis sensor that detects acceleration and angular velocity along the X, Y, and Z axes. The autonomous mobile body 11 can accurately detect the movement of the head and torso using the inertial sensors 60, enabling it to control its movement according to the situation.

The configuration of the sensors equipped in the autonomous mobile body 11 can be flexibly changed depending on the specifications, operation, etc. For example, in addition to the above configuration, the autonomous mobile body 11 may further be equipped with various communication devices including, for example, a temperature sensor, a geomagnetic sensor, and a GNSS (Global Navigation Satellite System) signal receiver.

Next, an example configuration of the joints of the autonomous mobile body 11 will be described with reference to Figure 3. Figure 3 shows an example configuration of the actuator 71 provided in the autonomous mobile body 11. In addition to the rotation points shown in Figure 3, the autonomous mobile body 11 has two degrees of freedom of rotation each in the ears and tail, and one in the mouth, for a total of 22 degrees of freedom of rotation.

For example, the autonomous mobile body 11 has three degrees of freedom in its head, allowing it to perform both nodding and tilting its head. Furthermore, the autonomous mobile body 11 can reproduce swinging movements of its waist using the actuator 71 provided in its waist, allowing it to achieve natural and flexible movements that are closer to those of a real dog.

The autonomous mobile body 11 may achieve the above-mentioned 22 degrees of rotational freedom by, for example, combining a single-axis actuator and a two-axis actuator. For example, single-axis actuators may be used in the elbows and knees of the legs, and two-axis actuators may be used in the shoulders and thigh joints.

Next, the functions of the display 51 provided on the autonomous moving body 11 will be explained with reference to Figure 4.

The autonomous mobile body 11 is equipped with two displays 51R and 51L, which correspond to the right and left eyes, respectively. Each display 51 has the function of visually expressing the eye movements and emotions of the autonomous mobile body 11. For example, each display 51 can express the movements of the eyeballs, pupils, and eyelids in accordance with emotions and actions, thereby producing natural movements similar to those of real animals such as dogs, and can express the line of sight and emotions of the autonomous mobile body 11 with high precision and flexibility. Furthermore, the user can intuitively grasp the state of the autonomous mobile body 11 from the eyeball movements displayed on the display 51.

Furthermore, each display 51 is realized, for example, by two independent OLEDs (Organic Light Emitting Diodes). By using OLEDs, it is possible to reproduce the curved surface of an eyeball. As a result, a more natural appearance can be achieved compared to when a pair of eyeballs are represented by a single flat display, or when two eyeballs are each represented by two independent flat displays.

With the above configuration, the autonomous mobile body 11 can reproduce movements and emotional expressions that are closer to those of real living creatures by controlling the movements of its joints and eyeballs with high precision and flexibility, as shown in Figure 5.

Note that Figure 5 is a diagram showing an example of the operation of the autonomous mobile body 11, but in Figure 5, the external structure of the autonomous mobile body 11 is shown in a simplified manner in order to focus the explanation on the operation of the joints and eyeballs of the autonomous mobile body 11.

<Example of functional configuration of autonomous moving body 11>
Next, an example of the functional configuration of the autonomous mobile body 11 will be described with reference to Fig. 6. The autonomous mobile body 11 includes an input unit 101, a sensing unit 102, a communication unit 103, an information processing unit 104, a drive unit 105, an output unit 106, and a storage unit 107.

The input unit 101 includes input devices such as switches and buttons. The input unit 101 supplies input data input via the input devices to the information processing unit 104.

The sensing unit 102 includes, for example, various sensors shown in FIG. 2 and has the function of collecting various sensor data related to the user and the surrounding conditions. The sensing unit 102 supplies the collected sensor data to the information processing unit 104.

The communication unit 103 communicates with other autonomous mobile bodies 11, information processing terminals 12, and information processing servers 13, either via the network 21 or without the network 21, to send and receive various types of data. The communication unit 103 supplies received data to the information processing unit 104 and obtains data to be sent from the information processing unit 104.

The communication method of the communication unit 103 is not particularly limited and can be flexibly changed depending on the specifications and operation.

The information processing unit 104 includes a processor such as a CPU (Central Processing Unit), and performs various types of information processing and controls each part of the autonomous mobile body 11. The information processing unit 104 includes a recognition unit 121, a learning unit 122, an action planning unit 123, and an operation control unit 124.

The recognition unit 121 recognizes the situation in which the autonomous mobile body 11 is located, based on input data supplied from the input unit 101, sensor data supplied from the sensing unit 102, and received data supplied from the communication unit 103. The situation in which the autonomous mobile body 11 is located includes, for example, its own situation and its surroundings. Its own situation includes, for example, the state and movement of the autonomous mobile body 11. The surrounding situation includes, for example, the state, movement, and instructions of surrounding people such as the user, the state and movement of surrounding living things such as pets, the state and movement of surrounding objects, time, location, and the surrounding environment. Surrounding objects include, for example, other autonomous mobile bodies. Furthermore, in order to recognize the situation, the recognition unit 121 performs, for example, person identification, facial expression and gaze recognition, emotion recognition, object recognition, action recognition, spatial region recognition, color recognition, shape recognition, marker recognition, obstacle recognition, step recognition, brightness recognition, temperature recognition, voice recognition, word understanding, position estimation, and posture estimation.

The recognition unit 121 also has the ability to estimate and understand the situation based on the various types of information that it recognizes. In this case, the recognition unit 121 may use knowledge stored in advance to comprehensively estimate the situation.

The recognition unit 121 supplies data indicating the situation recognition results or estimation results (hereinafter referred to as situation data) to the learning unit 122 and the action planning unit 123. The recognition unit 121 also registers the data indicating the situation recognition results or estimation results in the action history data stored in the memory unit 107.

The behavior history data is data that indicates the behavior history of the autonomous mobile body 11. The behavior history data includes, for example, items such as the date and time the behavior started, the date and time the behavior ended, the trigger for performing the behavior, the location where the behavior was instructed (if a location was instructed), the circumstances under which the behavior occurred, and whether the behavior was completed (whether the behavior was performed to the end).

For example, if an action is performed as a result of a user instruction, the content of that instruction is registered as the trigger for the action. Also, for example, if an action is performed as a result of a specific situation occurring, the content of that situation is registered. Furthermore, for example, if an action is performed as a result of an object indicated by the user or a recognized object, the type of object is registered.

The learning unit 122 learns the situation, behavior, and the effect of that behavior on the environment based on the input data supplied from the input unit 101, the sensor data supplied from the sensing unit 102, and the received data supplied from the communication unit 103, as well as the situation data supplied from the recognition unit 121, data related to the behavior of the autonomous mobile body 11 supplied from the behavior planning unit 123, and the behavior history data stored in the memory unit 107. For example, the learning unit 122 performs the pattern recognition learning described above and learns behavior patterns corresponding to the user's discipline.

For example, the learning unit 122 achieves the above learning using a machine learning algorithm such as deep learning. Note that the learning algorithm employed by the learning unit 122 is not limited to the above example, and can be designed as appropriate.

The learning unit 122 supplies data indicating the learning results (hereinafter referred to as learning result data) to the action planning unit 123 and stores it in the memory unit 107.

The behavior planning unit 123 plans the behavior of the autonomous mobile body 11 based on the recognized or estimated situation and the learning result data. The behavior planning unit 123 supplies data indicating the planned behavior (hereinafter referred to as behavior plan data) to the operation control unit 124. The behavior planning unit 123 also supplies data regarding the behavior of the autonomous mobile body 11 to the learning unit 122 and registers it in the behavior history data stored in the memory unit 107.

The operation control unit 124 controls the operation of the autonomous mobile body 11 so as to execute the planned action by controlling the drive unit 105 and output unit 106 based on the action plan data. For example, the operation control unit 124 controls the rotation of the actuator 71, the display of the display 51, and the audio output from the speaker based on the action plan.

The drive unit 105 bends and stretches the multiple joints of the autonomous mobile body 11 based on control by the movement control unit 124. More specifically, the drive unit 105 drives the actuators 71 provided in each joint based on control by the movement control unit 124.

The output unit 106 includes, for example, a display 51, a speaker, a haptic device, etc., and outputs visual information, auditory information, tactile information, etc. based on the control of the operation control unit 124.

The storage unit 107 includes, for example, non-volatile memory and volatile memory, and stores various programs and data.

Note that hereinafter, when each unit of the autonomous mobile body 11 communicates with the information processing server 13, etc. via the communication unit 103 and the network 21, the phrase "via the communication unit 103 and the network 21" will be omitted as appropriate. For example, when the recognition unit 121 communicates with the information processing server 13 via the communication unit 103 and the network 21, it will simply be stated that the recognition unit 121 communicates with the information processing server 13.

<Example of functional configuration of information processing terminal 12>
Next, an example of the functional configuration of the information processing terminal 12 will be described with reference to Fig. 7. The information processing terminal 12 includes an input unit 201, a sensing unit 202, a communication unit 203, an information processing unit 204, an output unit 205, and a storage unit 206.

The input unit 201 includes input devices such as switches (not shown) and buttons (not shown). The input unit 201 supplies input data input via the input devices to the information processing unit 204.

The sensing unit 202 includes various sensors, such as a camera (not shown), a microphone (not shown), and an inertial sensor (not shown). The sensing unit 202 supplies sensor data output from the various sensors to the information processing unit 204.

The communication unit 203 communicates with the autonomous mobile body 11, other information processing terminals 12, and the information processing server 13 via the network 21 or without the network 21, and transmits and receives various types of data. The communication unit 203 supplies received data to the information processing unit 204 and obtains data to be transmitted from the information processing unit 204.

The communication method of the communication unit 203 is not particularly limited and can be flexibly changed depending on the specifications and operation.

The information processing unit 204 includes, for example, a processor such as a CPU, and performs various types of information processing, controls each part of the information processing terminal 12, and executes various applications.

The output unit 205 includes, for example, a display (not shown), a speaker (not shown), a haptic device (not shown), etc., and outputs visual information, auditory information, tactile information, etc. based on the control of the information processing unit 204.

The storage unit 206 includes, for example, non-volatile memory and volatile memory, and stores various programs and data.

The functional configuration of the information processing terminal 12 can be flexibly changed depending on the specifications and operation.

Furthermore, hereinafter, when each unit of the information processing terminal 12 communicates with the information processing server 13, etc. via the communication unit 203 and the network 21, the phrase "via the communication unit 203 and the network 21" will be omitted as appropriate. For example, when the information processing unit 204 communicates with the information processing server 13 via the communication unit 203 and the network 21, it will simply be stated that the information processing unit 204 communicates with the information processing server 13.

<Example of functional configuration of information processing unit 204>
Next, Fig. 8 shows a part of an example of the functional configuration of the information processing unit 204 of the information processing terminal 12. In particular, Fig. 8 shows an example of the functional configuration of a part that performs processing related to the dress-up function of the virtual mobile application.

The information processing unit 204 includes a dress-up item generation unit 241, a dress-up image generation unit 242, and a UI control unit 243.

The dress-up item generation unit 241 executes processing to generate dress-up items. The dress-up item generation unit 241 includes an image acquisition unit 251, an image processing unit 252, and a registration unit 253.

The image acquisition unit 251 acquires image data obtained by photographing a real autonomous moving body 11 wearing real items such as clothing from the sensing unit 202. The image acquisition unit 251 supplies the acquired image data to the 3D (three-dimensional) data conversion unit 261 of the image processing unit 252.

Furthermore, for example, the image acquisition unit 251 can control the autonomous mobile body 11 being photographed by the sensing unit 202. Furthermore, for example, the image acquisition unit 251 can control the autonomous mobile body 11 to assume a pose for scanning when photographing by issuing instructions to the autonomous mobile body 11 via the communication unit 203.

The image processing unit 252 generates dress-up items by performing image processing on the image data of the autonomous moving body 11. The image processing unit 252 includes a 3D data conversion unit 261 and a virtual item conversion unit 262.

The 3D data generation unit 261 generates 3D data of the autonomous mobile body 11 (hereinafter referred to as the 3D mobile body) based on the image data of the autonomous mobile body 11. The 3D data generation unit 261 supplies the data of the 3D mobile body to the extraction unit 271 of the virtual item generation unit 262.

The virtual item creation unit 262 generates, based on the 3D moving body, a dress-up item, which is a virtual item corresponding to the item worn by the autonomous moving body 11. The virtual item creation unit 262 includes an extraction unit 271 and an editing unit 272.

The extraction unit 271 uses the 3D model of the autonomous mobile body 11 to extract 3D data of items (hereinafter referred to as 3D items) worn by the autonomous mobile body 11 from the 3D mobile body. The 3D model of the autonomous mobile body 11 is, for example, CAD data created when the autonomous mobile body 11 was designed, and is stored in the storage unit 206. The extraction unit 271 supplies the data of the 3D items to the editing unit 272.

The editing unit 272 performs various editing processes on the 3D items to generate dress-up items. The editing unit 272 supplies the dress-up item data to the registration unit 253.

The registration unit 253 transmits data on the dress-up items to the information processing server 13 and executes processing to register the dress-up items in the dress-up function of the virtual mobile application.

The dress-up image generation unit 242 receives data on the virtual moving object and data on the dress-up items from the information processing server 13. The dress-up image generation unit 242 generates an image of the virtual moving object equipped with the dress-up items (hereinafter referred to as the dress-up image), and supplies the data on the dress-up image to the UI control unit 243.

The UI control unit 243 controls the user interface related to the dress-up function provided by the input unit 201 and the output unit 205. For example, the UI control unit 243 controls the display of dress-up images provided by the output unit 205.

<Example of functional configuration of information processing server 13>
Next, an example of the functional configuration of the information processing server 13 will be described with reference to Fig. 9. The information processing server 13 includes a communication unit 301, an information processing unit 302, and a storage unit 303.

The communication unit 301 communicates with each autonomous mobile body 11 and each information processing terminal 12 via the network 21, sending and receiving various types of data. The communication unit 301 supplies the received data to the information processing unit 302 and obtains data to be transmitted from the information processing unit 302.

The communication method of the communication unit 301 is not particularly limited and can be flexibly changed depending on the specifications and operation.

The information processing unit 302 includes, for example, a processor such as a CPU, and performs various types of information processing and controls each unit of the information processing terminal 12. The information processing unit 302 includes an autonomous mobile object control unit 321 and an application control unit 322.

The autonomous mobile object control unit 321 has a configuration similar to that of the information processing unit 104 of the autonomous mobile object 11. Specifically, the autonomous mobile object control unit 321 has a recognition unit 331, a learning unit 332, an action planning unit 333, and an operation control unit 334.

The autonomous mobile object control unit 321 has the same functions as the information processing unit 104 of the autonomous mobile object 11. For example, the autonomous mobile object control unit 321 receives sensor data, input data, behavioral history data, etc. from the autonomous mobile object 11, and recognizes the situation of the autonomous mobile object 11 and its surroundings. For example, the autonomous mobile object control unit 321 generates control data for controlling the operation of the autonomous mobile object 11 based on the situation of the autonomous mobile object 11 and its surroundings, and controls the operation of the autonomous mobile object 11 by transmitting this data to the autonomous mobile object 11. For example, the autonomous mobile object control unit 321, like the autonomous mobile object 11, performs pattern recognition learning and learns behavioral patterns corresponding to user discipline.

In addition, the learning unit 332 of the autonomous mobile object control unit 321 can also learn collective intelligence common to multiple autonomous mobile objects 11 by performing pattern recognition learning and learning behavioral patterns corresponding to user discipline based on data collected from multiple autonomous mobile objects 11.

The application control unit 322 communicates with the autonomous mobile body 11 and the information processing terminal 12 via the communication unit 301, and controls applications executed by the information processing terminal 12.

For example, the application control unit 322 collects various data related to the autonomous mobile body 11 from the autonomous mobile body 11 via the communication unit 301. The application control unit 322 then transmits the collected data to the information processing terminal 12 via the communication unit 301, thereby displaying the data related to the autonomous mobile body 11 in an application executed by the information processing terminal 12.

For example, the application control unit 322 receives data indicating instructions to the autonomous mobile body 11 input via an application from the information processing terminal 12 via the communication unit 301. The application control unit 322 then transmits the received data to the autonomous mobile body 11 via the communication unit 301, thereby providing instructions from the user to the autonomous mobile body 11.

For example, the application control unit 322 receives data related to various operations on the virtual mobile application from the information processing terminal 12 via the communication unit 301. Then, the application control unit 322 controls and configures the virtual mobile application based on the data received via the communication unit 301.

The storage unit 303 includes, for example, non-volatile memory and volatile memory, and stores various programs and data.

The functional configuration of the information processing server 13 can be flexibly changed depending on the specifications and operations.

Furthermore, hereinafter, when each unit of the information processing server 13 communicates with the information processing terminal 12, etc. via the communication unit 301 and the network 21, the phrase "via the communication unit 301 and the network 21" will be omitted as appropriate. For example, when the application control unit 322 communicates with the information processing terminal 12 via the communication unit 301 and the network 21, it will simply be stated that the application control unit 322 communicates with the information processing terminal 12.

<Clothing item generation process>
Next, the dress-up item generation process executed by the information processing system 1 will be described with reference to the flowchart of FIG.

In step S1, the information processing system 1 executes a scan process.

Here, we will explain the details of the scanning process with reference to the flowchart in Figure 11.

In step S21, the information processing system 1 accepts the start of scanning of the autonomous moving body 11.

For example, the output unit 205 of the information processing terminal 12 displays an operation menu under the control of the UI control unit 243. For example, the operation menu includes an "item scan" item for scanning an item attached to the autonomous moving body 11.

In response to this, for example, if the user selects "Item Scan" from the operation menu via the input unit 201, the input unit 201 notifies the information processing unit 204 that item scan has been selected.

The UI control unit 243 of the information processing unit 204 notifies the autonomous mobile body 11 via the communication unit 203 that an item scan will begin.

In response to this, the recognition unit 121 of the autonomous mobile object 11 receives a notification from the information processing terminal 12 via the communication unit 103. As a result, the recognition unit 121 recognizes that an item scan will begin.

Note that step S21 may be omitted.

In step S22, the autonomous mobile body 11 begins a scanning pause.

For example, the user instructs the autonomous mobile body 11 to perform a scanning pause by issuing a predetermined voice command (e.g., "Hi, scan").

In response, the sensing unit 102 of the autonomous mobile body 11 collects the voice corresponding to the voice command and supplies the voice data corresponding to the collected voice to the information processing unit 104. The recognition unit 121 of the information processing unit 104 recognizes that the voice command has been instructed to execute a pause for scanning by recognizing the voice command based on the voice data.

Alternatively, for example, the user inputs an instruction to the autonomous moving body 11 to perform a scanning pose via the input unit 201 of the information processing terminal 12.

In response to this, the input unit 201 of the information processing terminal 12 notifies the information processing unit 204 that an instruction to start a scan pause has been input. The image acquisition unit 251 of the information processing unit 204 transmits an instruction to execute a scan pause to the autonomous mobile body 11 via the communication unit 203.

In response to this, the recognition unit 121 of the autonomous mobile body 11 receives an instruction to execute a scanning pause from the information processing terminal 12 via the communication unit 103. As a result, the recognition unit 121 recognizes that an instruction to execute a scanning pause has been issued.

When the recognition unit 121 of the autonomous mobile body 11 recognizes that an instruction to perform a scanning pose has been issued, it recognizes the position of the item attached to the autonomous mobile body 11 based on sensor data from the sensing unit 202, etc. The recognition unit 121 supplies the instruction to perform a scanning pose and situation data indicating the recognition result of the position of the attached item to the action planning unit 123.

The behavior planning unit 123 plans the behavior of the autonomous mobile body 11 so that the autonomous mobile body 11 assumes a pose that corresponds to the item worn by the autonomous mobile body 11. A pose that corresponds to the worn item is, for example, a pose that makes it easy to photograph the item. The behavior planning unit 123 supplies behavior plan data indicating the planned behavior to the operation control unit 124.

The movement control unit 124 controls the movement of the autonomous mobile body 11 so that it assumes a pose corresponding to the item it is wearing by controlling the drive unit 105 and output unit 106 based on the behavior plan data.

For example, when the autonomous moving body 11 is wearing shoes (not shown), it will assume a pose in which it stands still for a while with its legs raised, as shown in A and B of Figure 12, so that the soles of its feet can be easily photographed.

For example, when the autonomous mobile body 11 is wearing a hat (not shown) or a collar (not shown), it will assume a pose in a sitting position with its head held firmly up, as shown in FIG. 13, to make it easier to photograph it from the front, back, left and right. Furthermore, when the autonomous mobile body 11 is wearing a collar, it will close its mouth, for example, to make it easier to photograph the area around its neck.

For example, when the autonomous mobile body 11 is wearing clothes (not shown), it will assume a standing pose with its legs spread and stretched out so that it can easily photograph the underside of its abdomen, as shown in FIG. 14. For example, when the autonomous mobile body 11 has a ribbon (not shown) or the like attached to its tail, it will assume a stationary pose with its tail raised, as shown in FIG. 14.

For example, as shown in FIG. 15, when the autonomous mobile body 11 has struck a pose, it may bark "Woof!" to notify the user that the pose has been struck.

In step S23, the information processing terminal 12 captures an image of the autonomous moving body 11.

For example, the output unit 205 of the information processing terminal 12 displays guidance for photographing the autonomous moving body 11 under the control of the UI control unit 243.

In response, the user follows the guidance and photographs the autonomous moving body 11 using the information processing terminal 12. For example, the autonomous moving body 11 is photographed using a method similar to that used to generate a 3D model using general photogrammetry. Specifically, for example, the autonomous moving body 11 is photographed from a 360-degree angle, at least the number of images required to generate 3D data for the area around the part of the autonomous moving body 11 where the item is attached.

At this time, for example, the user may photograph the autonomous mobile body 11 while holding the information processing terminal 12 and moving around the autonomous mobile body 11. Alternatively, for example, as shown in FIG. 16, the user may photograph the autonomous mobile body 11 while rotating the turntable 402 on which the autonomous mobile body 11 is placed, with the information processing terminal 12 fixed.

Note that Figure 16 shows an example in which the autonomous moving body 11 is wearing a hat 401 as an item.

Furthermore, for example, as shown in FIG. 17, a user may use the information processing terminal 12 to capture images of the surroundings of the autonomous moving body 11 from three directions: diagonally above, in front of, and diagonally below the autonomous moving body 11.

The image acquisition unit 251 of the information processing terminal 12 acquires image data obtained by photographing the autonomous moving body 11 from the sensing unit 202.

For example, the image acquisition unit 251 may generate information indicating the progress of the imaging (scanning) of the autonomous moving body 11, and supply the information to the UI control unit 243 or transmit it to the autonomous moving body 11 via the communication unit 203.

Information indicating the progress of the imaging of the autonomous moving body 11 includes, for example, information indicating which image data has been captured and which image data has not yet been captured, and information regarding the direction in which imaging is required.

In response to this, for example, the output unit 205 may display the progress of the image capture of the autonomous moving body 11 under the control of the UI control unit 243.

Furthermore, for example, the autonomous mobile body 11 may be configured to show a reaction according to the progress of the autonomous mobile body 11's filming. For example, as shown in FIG. 17, if filming is progressing smoothly, the autonomous mobile body 11 may be configured to bark "woof." For example, if filming is not progressing smoothly, for example, if filming is not being performed from the required direction, the autonomous mobile body 11 may be configured to meow "meow."

For example, if the autonomous mobile body 11 is wearing multiple items, it may be configured to assume a different pose for each item. Then, the user may photograph the autonomous mobile body 11 from 360 degrees around it each time the autonomous mobile body 11 assumes a different pose.

In step S24, the autonomous mobile body 11 ends the scanning pause.

For example, the user instructs the autonomous mobile body 11 to end the scanning pause by issuing a predetermined voice command (e.g., "That's enough," "It's done," etc.).

In response, the sensing unit 102 of the autonomous mobile body 11 collects the voice corresponding to the voice command and supplies the voice data corresponding to the collected voice to the information processing unit 104. The recognition unit 121 of the information processing unit 104 recognizes the voice command based on the voice data, thereby recognizing that an instruction to end the scanning pause has been issued.

Alternatively, for example, the user inputs an instruction to end the scanning pause to the autonomous moving body 11 via the input unit 201 of the information processing terminal 12.

In response to this, the input unit 201 of the information processing terminal 12 notifies the information processing unit 204 that an instruction to end the scan pause has been input. The image acquisition unit 251 of the information processing unit 204 transmits the instruction to end the scan pause to the autonomous mobile body 11 via the communication unit 203.

In response to this, the recognition unit 121 of the autonomous mobile body 11 receives an instruction to end the scanning pause from the information processing terminal 12 via the communication unit 103. As a result, the recognition unit 121 recognizes that an instruction to end the scanning pause has been issued.

When the recognition unit 121 of the autonomous mobile body 11 recognizes that an instruction to end the scanning pause has been issued, it supplies situation data indicating the recognition result to the action planning unit 123.

The behavior planning unit 123 plans the behavior of the autonomous mobile body 11 so that the scanning pose ends. The behavior planning unit 123 supplies behavior plan data indicating the planned behavior to the operation control unit 124.

The motion control unit 124 ends the scanning pause by controlling the drive unit 105 and output unit 106 based on the action plan data.

The scanning process will then end.

Returning to FIG. 10, in step S2, the information processing terminal 12 executes the 3D data creation process.

Here, we will explain the details of the 3D data creation process with reference to the flowchart in Figure 18.

In step S41, the 3D data conversion unit 261 of the information processing terminal 12 generates 3D data (3D moving body) of the autonomous moving body 11. Specifically, the image acquisition unit 251 supplies image data of the autonomous moving body 11 to the 3D data conversion unit 261.

The 3D data generation unit 261 generates a 3D moving body, which is 3D data of the autonomous moving body 11, from multiple image data captured from multiple different directions, using, for example, common photogrammetry technology.

In step S42, the 3D data generation unit 261 adjusts the size of the 3D data (3D moving body) of the autonomous moving body 11. For example, the 3D data generation unit 261 detects a specific part of the 3D moving body (e.g., a hand, an eye, etc.). Based on the detected part, the 3D data generation unit 261 adjusts the size (e.g., dimensions) of the 3D moving body to be equivalent to the actual size of the autonomous moving body 11. The 3D data generation unit 261 supplies the 3D moving body after the size adjustment to the extraction unit 271.

The 3D data conversion process then ends.

Returning to FIG. 10, in step S3, the information processing terminal 12 executes the virtual item creation process.

Here, the virtual item creation process will be explained in detail with reference to the flowchart in Figure 19.

In step S61, the extraction unit 271 of the information processing terminal 12 extracts 3D data of the item (3D item). For example, the extraction unit 271 extracts the 3D item, which is the 3D data of the item attached to the autonomous mobile body 11, by subtracting the 3D model of the autonomous mobile body 11 from the 3D mobile body.

For example, A in Figure 20 shows an example of a 3D model 411 (CAD data) of the head of the autonomous mobile body 11.

B in Figure 20 schematically shows the portion to be deleted from the 3D data of the autonomous moving body 11 wearing the hat 401 shown in Figure 16, based on the 3D model 411 in A in Figure 20. For example, the portion shown with diagonal lines in B in Figure 20 is deleted.

As a result, 3D data for hat 401 is extracted, as shown in Figure 21, for example.

The extraction unit 271 supplies the 3D items to the editing unit 272.

In step S62, the editing unit 272 adjusts the size of the item's 3D data (3D item). For example, the editing unit 272 adjusts the size of the 3D item for a virtual mobile object application.

For example, step S62 may be omitted, and the size of the 3D item may be adjusted as necessary in step S64, which will be described later.

In step S63, the editing unit 272 changes the surface texture of the item's 3D data (3D item). For example, the editing unit 272 changes the surface texture (material) of the 3D item for a virtual mobile object application.

The editing unit 272 supplies the 3D items to the UI control unit 243. The output unit 205 displays the 3D items under the control of the UI control unit 243.

For example, the processing of step S63 may be omitted, and the texture of the 3D item may be changed as necessary in step S64, which will be described later.

In step S64, the editing unit 272 edits the 3D data of the item (3D item).

For example, the user performs an operation via the input unit 201 to edit the 3D item displayed on the output unit 205 as needed. For example, if the 3D item includes multiple items, the user performs an operation to separate each item. For example, the user performs an operation to remove noise from the 3D item or adjust the shape as needed. For example, the user performs an operation to change the size or design (e.g., color, pattern, shape, etc.) of the 3D item as needed. For example, the user performs an operation to combine the 3D data of another item with the 3D item.

In response to this, the input unit 201 supplies input data indicating the edits made by the user to the information processing unit 204. The editing unit 272 of the information processing unit 204 edits the 3D items based on the edits made by the user. This generates dress-up items, which are virtual items corresponding to the items attached to the autonomous moving body 11.

If editing is not required, step S64 may be omitted.

Furthermore, for example, the editing unit 272 may use AI (Artificial Intelligence) or the like to automatically edit 3D items.

In step S65, the editing unit 272 assigns a title to the dress-up item.

For example, the user inputs a title to be assigned to the dress-up item via the input unit 201 of the information processing terminal 12.

In response, the input unit 201 supplies input data indicating the input title to the information processing unit 204. The editing unit 272 of the information processing unit 204 assigns the input title to the dress-up item.

The editing unit 272 supplies the dress-up items with the titles assigned to them to the registration unit 253.

For example, a title may be assigned to a 3D item before editing it.

The virtual item conversion process then ends.

Returning to FIG. 10, in step S4, the registration unit 253 registers the dress-up item. Specifically, the registration unit 253 transmits data on the dress-up item to the information processing server 13.

In response, the information processing unit 302 of the information processing server 13 receives the dress-up item data. For example, the application control unit 322 of the information processing unit 302 adds the newly generated dress-up item to a list of dress-up items in the virtual mobile application of the user's account.

This allows users to select and use the created dress-up items in virtual mobile applications.

Then the costume item generation process ends.

<Dressing process>
Next, the dress-up process executed by the information processing terminal 12 will be described with reference to the flowchart of FIG.

In step S101, the information processing terminal 12 acquires a dress-up item.

For example, the output unit 205 displays the menu screen 451 in FIG. 23 under the control of the UI control unit 243. The menu screen 451 includes an item for "changing clothes."

In response to this, for example, the user selects "Change Clothes" from the menu screen 451 via the input unit 201.

In response to this, the input unit 201 supplies input data indicating that "Dress Up" has been selected to the information processing unit 204. The UI control unit 243 of the information processing unit 204 controls the output unit 205 to display a list of dress-up items available to the user.

In response to this, for example, the user selects a desired dress-up item from a list of dress-up items via the input unit 201.

In response, the input unit 201 supplies input data indicating the selected dress-up item to the information processing unit 204. The dress-up image generation unit 242 receives data on the virtual moving object and the selected dress-up item from the information processing server 13.

In step S102, the dress-up image generation unit 242 attaches dress-up items to the virtual moving object. Specifically, the dress-up image generation unit 242 generates a 3D image in which the dress-up items are combined with the virtual moving object based on data on the virtual moving object and the dress-up items. The dress-up image generation unit 242 supplies data for the generated 3D image to the UI control unit 243.

In step S103, the information processing terminal 12 displays the virtual moving object wearing the dress-up item. Specifically, the UI control unit 243 causes the output unit 205 to display a 3D image of the virtual moving object wearing the dress-up item based on the acquired 3D image data. As a result, for example, as shown in A of FIG. 24, a virtual moving object 501 wearing a hat 502, which is a dress-up item, is displayed.

In addition, for example, the viewpoint from which the virtual moving object is displayed may be freely changed in accordance with user operation. For example, as shown in B of Figure 24, the viewpoint from which the virtual moving object 501 wearing a hat 502 is displayed may be changed.

Then the dress-up process will end.

In this way, it is possible to easily generate dress-up items that can be worn on virtual moving objects.

For example, a user can attach items such as hats, clothes, or shoes to the autonomous moving body 11 and generate dress-up items corresponding to the attached items simply by taking a photo of the autonomous moving body 11 using the information processing terminal 12.

This allows users to easily create original, one-of-a-kind dress-up items. Furthermore, for example, users can easily create dress-up items using commercially available items, fabrics, etc.

Furthermore, for example, if an attempt is made to generate a dress-up item by photographing an item alone, the item may not be able to maintain a shape that matches the shape of the autonomous moving body 11. In other words, the shape of the item may differ from the state when it is attached to the autonomous moving body 11. As a result, the image of the generated dress-up item may differ from the image of the item actually attached to the autonomous moving body 11.

In contrast, with this technology, the dress-up items are generated based on the items actually attached to the autonomous moving body 11, so the shape of the dress-up items is maintained in an ideal state.

Furthermore, because the dress-up items are generated based on the items actually attached to the autonomous moving body 11, the virtual item generation unit 262 of the information processing terminal 12, for example, can easily recognize the attachment position of the dress-up items on the virtual moving body. By using this recognized information, for example, it becomes possible to automatically attach dress-up items to appropriate positions on the virtual moving body without the user having to set the attachment position of the dress-up items.

<<2. Modified Examples>>
Hereinafter, modifications of the above-described embodiment of the present technology will be described.

<Modifications regarding sharing of processing in information processing system 1>
The above-described division of processing roles among the devices in the information processing system 1 is one example, and can be changed as appropriate.

For example, the information processing server 13 may be configured to execute part of the processing of the information processing terminal 12 described above. For example, the information processing server 13 may be configured to execute part of the processing of the dress-up item generation unit 241 of the information processing terminal 12. In other words, the information processing server 13 may be configured to generate dress-up items.

For example, an autonomous moving body 11 (hereinafter referred to as a target moving body) wearing an item may be photographed by another autonomous moving body 11 (hereinafter referred to as a photographing moving body).

For example, when a user instructs the photographing moving object to scan a target moving object, the target moving object will assume a pose corresponding to the item it is wearing. The photographing moving object photographs the target moving object with camera 53 while moving around the target moving object.

In this case, for example, the photographing mobile object may generate a dress-up item based on the captured image data. Alternatively, for example, the photographing mobile object may transmit the captured image data to the information processing terminal 12 or the information processing server 13, and the information processing terminal 12 or the information processing server 13 may generate a dress-up item.

For example, the image acquisition unit 251 of the information processing terminal 12 may transmit a scanning pose instruction to the autonomous moving body 11 via the communication unit 203, thereby controlling the pose of the autonomous moving body 11.

<About reusing costume items>
For example, a dress-up item for a virtual moving body (hereinafter referred to as a destination virtual moving body) corresponding to another autonomous moving body (hereinafter referred to as a destination real moving body) may be generated based on an item worn by the autonomous moving body 11 (hereinafter referred to as the source real moving body) or a dress-up item for a virtual moving body (hereinafter referred to as the source virtual moving body) corresponding to the autonomous moving body 11.

For example, the 3D data conversion unit 261 of the information processing terminal 12 modifies the 3D item generated based on the image data of the source real moving body to a size and shape that corresponds to the destination real moving body, based on the size and shape of the source real moving body, the size and shape of the destination real moving body, and the expected item attachment position. In other words, the size and shape of the 3D item generated based on the image data of the source real moving body is changed to match the destination real moving body. Then, a dress-up item is generated based on the modified 3D item, thereby generating a virtual item that can be attached to the destination virtual moving body.

For example, the editing unit 272 of the information processing terminal 12 modifies the dress-up item for the source virtual moving body to a size and shape that corresponds to the shape and attachment position of the destination virtual moving body, based on the size and shape of the source virtual moving body and the size, shape, and attachment position of the dress-up item of the destination virtual moving body. In other words, the size and shape of the dress-up item for the source virtual moving body are changed to match the destination virtual moving body. This generates a virtual item that can be attached to the destination virtual moving body.

For example, as shown in FIG. 25, hat 522B is generated as a virtual item that can be worn by virtual moving body 521, which corresponds to a different type of autonomous moving body from virtual moving body 501, and has the same design as hat 522A, which is a virtual item worn by virtual moving body 501. For example, as shown in FIG. 26, outfit 531B is generated as a virtual item that can be worn by virtual moving body 521, and has the same design as outfit 531A, which is a virtual item worn by virtual moving body 501.

In the latter generation method, a destination real moving body corresponding to the destination virtual moving body does not necessarily have to exist. In other words, the destination virtual moving body may exist only in virtual space.

Conversely, for example, using a similar method, it is possible to generate dress-up items for a virtual moving body corresponding to the autonomous moving body 11 based on items attached to other autonomous moving bodies or dress-up items for virtual moving bodies corresponding to other autonomous moving bodies.

In this case, for example, by setting another autonomous mobile body as the user, it is possible to generate dress-up items for the virtual mobile body corresponding to the autonomous mobile body 11 based on items worn by the user. This makes it possible, for example, in a virtual mobile body application, to wear dress-up items that match the user's on the virtual mobile body.

Furthermore, for example, by treating the other autonomous moving body as a pet such as a dog or cat, it is possible to generate dress-up items for the virtual moving body corresponding to the autonomous moving body 11 based on the items attached to the pet. This makes it possible, for example, in a virtual moving body application, to attach dress-up items that match the pet to the virtual moving body.

<Other Modifications>
For example, the dress-up items may be 3D data or 2D (two-dimensional) data.

For example, a dress-up item created by a user may be made public on the Internet, etc., so that other users can use it. Furthermore, other users may be able to edit the published dress-up items.

The autonomous moving bodies to which this technology can be applied are not particularly limited, as long as they are real autonomous moving bodies that can be equipped with items in the real world and that can equip corresponding virtual items to a corresponding virtual moving body in a virtual space. Such autonomous moving bodies may be living beings such as people (e.g., users) or animals (e.g., pets).

<<3. Other>>
<Example of computer configuration>
The above-described series of processes can be executed by hardware or software. When the series of processes is executed by software, the programs that make up the software are installed on a computer. Here, the term "computer" includes computers built into dedicated hardware, and general-purpose personal computers, for example, that can execute various functions by installing various programs.

Figure 27 is a block diagram showing an example of the hardware configuration of a computer that executes the above-mentioned series of processes using a program.

In computer 1000, CPU (Central Processing Unit) 1001, ROM (Read Only Memory) 1002, and RAM (Random Access Memory) 1003 are interconnected by bus 1004.

Further connected to the bus 1004 is an input/output interface 1005. Connected to the input/output interface 1005 are an input unit 1006, an output unit 1007, a recording unit 1008, a communication unit 1009, and a drive 1010.

The input unit 1006 consists of input switches, buttons, a microphone, an image sensor, etc. The output unit 1007 consists of a display, a speaker, etc. The recording unit 1008 consists of a hard disk, non-volatile memory, etc. The communication unit 1009 consists of a network interface, etc. The drive 1010 drives removable media 1011 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory.

In the computer 1000 configured as described above, the CPU 1001 loads a program recorded in the recording unit 1008, for example, into the RAM 1003 via the input/output interface 1005 and bus 1004, and executes it, thereby performing the series of processes described above.

The program executed by the computer 1000 (CPU 1001) can be provided by being recorded on removable media 1011, such as package media. The program can also be provided via wired or wireless transmission media, such as a local area network, the Internet, or digital satellite broadcasting.

In the computer 1000, a program can be installed in the recording unit 1008 via the input/output interface 1005 by inserting the removable media 1011 into the drive 1010. The program can also be received by the communication unit 1009 via a wired or wireless transmission medium and installed in the recording unit 1008. Alternatively, the program can be pre-installed in the ROM 1002 or the recording unit 1008.

The program executed by the computer may be a program in which processing is performed chronologically in the order described in this specification, or a program in which processing is performed in parallel or at the required timing, such as when called.

Furthermore, in this specification, a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all of the components are contained in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device with multiple modules housed in a single housing, are both systems.

Furthermore, the embodiments of this technology are not limited to the above-described embodiments, and various modifications are possible within the scope of the gist of this technology.

For example, this technology can be configured as a cloud computing system in which a single function is shared and processed collaboratively by multiple devices over a network.

Furthermore, each step described in the above flowchart can be performed by a single device, or can be shared and executed by multiple devices.

Furthermore, if one step includes multiple processes, the multiple processes included in that one step can be executed by one device, or they can be shared and executed by multiple devices.

<Configuration combination example>
The present technology can also be configured as follows.

(1)
an image acquisition unit that acquires image data of the first autonomous moving body taking a pose corresponding to the attached item;
an image processing unit that generates a virtual item that can be attached to a first virtual moving object in a virtual space based on the image data.
(2)
The image processing unit
a 3D data generation unit that generates a 3D moving body, which is 3D data of the first autonomous moving body, based on a plurality of image data obtained by photographing the first autonomous moving body from a plurality of different directions;
an extraction unit that extracts a 3D item, which is 3D data of the item, from the 3D moving object;
and an editing unit that edits the 3D item and generates the virtual item.
(3)
The information processing device according to (2), wherein the editing unit changes at least one of the size, design, and surface texture of the 3D item.
(4)
The information processing device according to (2) or (3), wherein the extraction unit extracts the 3D item from the 3D moving body using a 3D model of the first autonomous moving body.
(5)
The information processing device according to any one of (2) to (4), wherein the first virtual moving body is a simulation of a second autonomous moving body different from the first autonomous moving body in the virtual space.
(6)
The information processing device described in (5), wherein the editing unit changes the size and shape of the 3D item to match the second autonomous moving body based on the size and shape of the first autonomous moving body, the size and shape of the second autonomous moving body, and the attachment position of the item, edits the changed 3D item, and generates the virtual item.
(7)
The information processing device described in (5), wherein the editing unit changes the size and shape of the virtual item to match the first virtual moving body based on the size and shape of a second virtual moving body corresponding to the first autonomous moving body, as well as the size and shape of the first virtual moving body and the wearing position of the virtual item.
(8)
The information processing device according to any one of (1) to (4), wherein the first virtual moving body is a simulation of the first autonomous moving body in the virtual space.
(9)
The information processing device according to any one of (1) to (8), wherein the pose corresponding to the item is a pose that makes it easy to photograph the item.
(10)
The information processing device according to any one of (1) to (9), wherein the image acquisition unit controls a pose of the first autonomous moving body.
(11)
The information processing device according to any one of (1) to (10), wherein the image acquisition unit outputs information indicating a progress status of the image capturing of the first autonomous moving body.
(12)
The information processing device according to any one of (1) to (11), further comprising an image generating unit that generates an image of the first virtual moving object wearing the virtual item in the virtual space.
(13)
The information processing device
Acquiring image data of the autonomous moving body that assumes a pose corresponding to the attached item;
generating a virtual item that can be attached to a virtual moving body in a virtual space based on the image data.

Please note that the effects described in this specification are merely examples and are not limiting, and other effects may also be present.

1. Information processing system, 11-1 to 11-n. Autonomous mobile objects, 12-1 to 12-n. Information processing terminals, 13. Information processing server, 104. Information processing unit, 105. Drive unit, 106. Output unit, 121. Recognition unit, 123. Action planning unit, 124. Motion control unit, 202. Sensing unit, 204. Information processing unit, 241. Dress-up item generation unit, 242. Dress-up image generation unit, 243. UI control unit, 251. Image acquisition unit, 252. Image processing unit, 261. 3D data conversion unit, 262. Virtual item conversion unit, 271. Extraction unit, 272. Editing unit, 302. Information processing unit, 322. Application control unit, 501. Virtual mobile object

Claims (13)

an image acquisition unit that acquires image data of the first autonomous moving body taking a pose corresponding to the attached item;
an image processing unit that generates a virtual item that can be attached to a first virtual moving object in a virtual space based on the image data. The image processing unit
a 3D data generation unit that generates a 3D moving body, which is 3D data of the first autonomous moving body, based on a plurality of image data obtained by photographing the first autonomous moving body from a plurality of different directions;
an extraction unit that extracts a 3D item, which is 3D data of the item, from the 3D moving object;
The information processing device according to claim 1 , further comprising: an editing unit that edits the 3D item and generates the virtual item. The information processing device according to claim 2 , wherein the editing unit changes at least one of the size, design, and surface texture of the 3D item. The information processing device according to claim 2 , wherein the extraction unit extracts the 3D item from the 3D moving body by using a 3D model of the first autonomous moving body. The information processing apparatus according to claim 2 , wherein the first virtual moving body is a simulation of a second autonomous moving body different from the first autonomous moving body in the virtual space. The information processing device according to claim 5, wherein the editing unit changes the size and shape of the 3D item to match the second autonomous moving body based on the size and shape of the first autonomous moving body and the size, shape, and attachment position of the item of the second autonomous moving body, edits the changed 3D item, and generates the virtual item. The information processing device according to claim 5, wherein the editing unit changes the size and shape of the virtual item to match the first virtual moving body based on the size and shape of a second virtual moving body corresponding to the first autonomous moving body, as well as the size and shape of the first virtual moving body and the position at which the virtual item is attached. The information processing apparatus according to claim 1 , wherein the first virtual moving body is a simulation of the first autonomous moving body in the virtual space. The information processing device according to claim 1 , wherein the pose corresponding to the item is a pose that makes it easy to photograph the item. The information processing device according to claim 1 , wherein the image acquisition unit controls a pose of the first autonomous moving body. The information processing device according to claim 1 , wherein the image acquisition unit outputs information indicating a progress status of the image capturing of the first autonomous moving body. The information processing device according to claim 1 , further comprising an image generating unit configured to generate an image of the first virtual moving object equipped with the virtual item in the virtual space. The information processing device
Acquiring image data of the autonomous moving body that assumes a pose corresponding to the attached item;
generating a virtual item that can be attached to a virtual moving body in a virtual space based on the image data.