JP2019068364A - Image pickup apparatus, information processing apparatus, control method thereof, and information processing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique for recording position information expected by an image pickup device even during a period in which the image pickup device and the position information providing device are disconnected from proximity wireless communication such as BLE. An image pickup device having a communication unit and an image pickup unit that perform short-range wireless communication, and the image pickup unit captures an image while communicating with a first external device that provides position information via the communication unit. When this is done, a predetermined situation in which communication between the recording unit that associates the image obtained by imaging with the position information received from the first external device and records it on a predetermined storage medium and the first external device is interrupted. In this case, it has a first external device and a control unit that transmits a request to continue acquiring the position information to the first external device in order to secure the position information of the image to be captured in the disconnected state. [Selection diagram] Fig. 5

Description

  The present invention relates to an imaging device, an information processing device, a control method thereof, and an information processing system.

  Although the communication speed is slow, there is a standard called Bluetooth (registered trademark) that can operate with low power consumption. In particular, since version 4.0, adoption of equipment in a wide range of fields is progressing by focusing on low power consumption. Generally, Bluetooth (registered trademark) of Version 4.0 or later is called Bluetooth (registered trademark) Low Energy (hereinafter referred to as BLE).

  There is known a technique in which a digital camera receives positional information from an external device and adds the positional information to a captured image. For example, it is patent document 1. In this patent document 1, when an imaging device having a Global Positioning System (hereinafter referred to as GPS) function can not acquire position information from its own GPS function, the position information can be provided to the photographed image by receiving the position information from an external device. It discloses the technology to be applied.

  Furthermore, by utilizing the BLE excellent in power consumption by the digital camera and constantly connecting to the smart device, the position information can be attached to the photographed image by periodically providing the position information.

JP 2008-72228 A

  In general, digital cameras can receive location information periodically by constantly connecting them with smart devices using BLE. However, for example, when the BLE connection with the smart device is disconnected because the digital camera is switched to connect with a device other than the smart device by BLE, acquisition of position information can not be performed.

  The present invention has been made in view of the above problems, and provides position information which is expected by the imaging apparatus even during a period in which the imaging apparatus and the position information providing apparatus cut off close proximity wireless communication such as BLE. It is an object of the present invention to provide a technique for recording by a device.

In order to solve this problem, for example, the imaging device of the present invention has the following configuration. That is,
An imaging apparatus comprising communication means for performing near-field wireless communication and imaging means, comprising:
When imaging is performed by the imaging unit while communicating with the first external device that provides position information via the communication unit, the image obtained by imaging and the position received from the first external device Recording means for associating information with information and recording the information in a predetermined storage medium;
In order to secure positional information of an image to be captured in a disconnected state with the first external device, when communication with the first external device is interrupted, the first external device is secured. And control means for transmitting a request for continuation of acquisition of location information.

  According to the present invention, the position information providing apparatus can record the position information expected by the imaging apparatus even during a period in which the imaging apparatus and the position information providing apparatus cut off the close proximity wireless communication such as BLE. become.

FIG. 1 is a block diagram of a digital camera according to an embodiment. The block block diagram of the information processing terminal in an embodiment. FIG. 2 is a block diagram of a remote controller according to the embodiment. BRIEF DESCRIPTION OF THE DRAWINGS The figure which shows the structure of the positional infomation provision system in embodiment. The figure which shows the communication sequence in embodiment. FIG. 3 is a view showing information on a position information reception service and a remote imaging service in the embodiment.

  Hereinafter, embodiments according to the present invention will be described in detail with reference to the attached drawings. In this embodiment, when the BLE connection in the information processing system configured by BLE connection between the digital camera and the information processing terminal is disconnected, the connection destination in BLE is switched to the remote controller (remote control device) of the digital camera Will be described by way of example.

  FIG. 1 is a block diagram of a digital camera 100 having a function as an imaging and recording device in the embodiment.

  The digital camera 100 includes a lens 101, an imaging unit 102, a control unit 103, an image processing unit 104, an encoding unit 105, a ROM 106, a RAM 107, a storage unit 108, a BMU 109m near field wireless unit 110, and a system bus 111 connecting them. Have.

  The imaging unit 102 includes an imaging device such as a CCD and a CMOS and various electronic devices, and converts an object image optically captured by the lens 101 into digital data. The control unit 103 controls the entire digital camera 101, and is, for example, a central processing unit (CPU). The image processing unit 104 performs image processing on the still image captured by the imaging unit 102. The encoding unit 105 subjects the image data processed by the image processing unit 104 to encoding and decoding in accordance with a desired encoding method.

  A ROM (Read Only Memory) 106 is a rewritable nonvolatile memory, and holds a program such as an Operating System (OS) executed by the control unit 103 and a program supplied from an external apparatus. A random access memory (RAM) 107 is a volatile memory and temporarily stores programs, captured image data, communication data, and the like. The storage unit 108 is a non-volatile memory card removable from the digital camera 101. The storage unit 108 can store image data and moving image data captured by the digital camera 101.

  A BMU (Bit Move Unit) 109 is, for example, between the memories (for example, between the RAM 107 and another memory) or between the memory and each I / O device (for example, the near field wireless unit 110) via the system bus 111. Control the data transfer that takes place.

  The short distance wireless unit 110 communicates with the information processing terminal 200 by inter-device communication in a short distance. Bluetooth (registered trademark) is assumed in this embodiment. Although the communication speed is slow, it is an advantageous wireless interface in terms of power consumption. In the present embodiment, it is assumed to be compliant with BLE (Bluetooth (registered trademark) Low Energy). Act as a peripheral as a role in BLE. This means that the central connection destination is limited to one.

  FIG. 2 is a block diagram of an information processing terminal 200 connected to the digital camera 100 by BLE and performing communication. The information processing terminal 200 may be realized by a single computer device such as a tablet or a smartphone, or the functions may be distributed to a plurality of computer devices as needed.

  The information processing terminal 200 connects the control unit 201, ROM 202, RAM 203, storage unit 204, BMU 205, VRAM 206, touch sensor 207, liquid crystal monitor 208, near field wireless unit 209, wireless LAN unit 210, GPS unit 211, and these. The system bus 212 is provided.

  The control unit 201 controls the entire information processing terminal 200, and is, for example, a central processing unit (CPU). A ROM (Read Only Memory) 202 is a rewritable nonvolatile memory, and holds a program such as an Operating System (OS) executed by the control unit 201 and a program supplied from an external device. A random access memory (RAM) 203 is a volatile memory that temporarily stores programs and data. The storage unit 204 is a hard disk drive (HDD), a solid state drive (SSD) configured by a flash memory, a hybrid drive using a hard disk and a flash memory in combination, a memory card, or the like. The storage unit 204 stores image data and the like.

  A BMU (Bit Move Unit) 205 is, for example, data between memories (for example, between the VRAM 206 and another memory), data between the memory and each I / O device (for example, the short distance wireless unit 209, wireless LAN unit 210) Control the transfer. A VRAM (Video RAM) 206 draws an image to be displayed on the liquid crystal monitor 208. The image generated in the VRAM 206 is transmitted to the liquid crystal monitor 208 according to a predetermined rule, whereby the liquid crystal monitor 208 displays the image. Further, the liquid crystal monitor 208 is provided with a touch panel having a touch sensor 207 on the display surface. Note that the touch panel is an input device that is planarly configured to be superimposed on the liquid crystal monitor 208 and that coordinate information corresponding to the touched position is output. The control unit 201 detects an operation on the touch panel.

  The type of operation on the touch panel is that the touch panel is touched with a finger or a pen (hereinafter referred to as touch down), that the touch panel is touched with a finger or a pen (hereinafter referred to as touch on), the touch panel is finger Moving while touching with a pen or pen (hereinafter referred to as move), releasing a finger or pen touching the touch panel (hereinafter referred to as touch-up), a state where nothing is touched on the touch panel (hereinafter referred to as (Referred to as touch-off). The control unit 201 is notified of these operations and position coordinates where a finger or a pen is touching on the touch panel, and the control unit 201 determines what kind of operation has been performed on the touch panel based on the notified information. Do. With regard to the move, the moving direction of the finger or pen moving on the touch panel can also be determined for each vertical component and horizontal component on the touch panel based on the change in position coordinates. In addition, when touch-up is performed on the touch panel through a move of a predetermined distance or more from touch-down, it is assumed that the drop is performed after the drag (drag and drop). The touch panel may be any of various touch panels such as resistive film type, capacitive type, surface acoustic wave type, infrared type, electromagnetic induction type, image recognition type, optical sensor type, etc. .

  The short distance wireless unit 209 performs wireless communication with the digital camera 100 by inter-device communication in a short distance. Bluetooth (registered trademark) is assumed in this embodiment. Although the communication speed is slow, it is an advantageous wireless interface in terms of power consumption. In the present embodiment, it is assumed to be compliant with BLE. Act as Central as a role in BLE. This means that the digital camera 100, which is a peripheral, is the connection destination.

  The GPS unit 211 is a part that performs positioning based on the Global Positioning Service. Accurate positional information of the information processing terminal 200 can be calculated by receiving an electric field from a satellite and performing arithmetic processing. It is effective for outdoor positioning.

  FIG. 3 is a block diagram showing the configuration of the remote controller 300 in the present embodiment. The remote controller 300 is realized as a single device, and includes a control unit 301, a ROM 302, a button 303, a button detection unit 304, a near field wireless unit 305, a RAM 307, and a system bus 306 connecting these.

  The control unit 301 controls the entire remote controller 300, and is, for example, a central processing unit (CPU). The read only memory (ROM) 302 is a rewritable non-volatile memory and holds a program such as an operating system (OS). The program as the remote controller 300 is not large. The control unit 301 acquires an instruction directly from the ROM 302 and performs processing, and uses the RAM 307 as a work area.

  The button 303 is a portion operated by the user. A connection button, a disconnect button, an imaging button, a wide-angle zoom button, a telephoto zoom button, and the like are mounted, and the user instructs a desired operation by operating each button. The button detection unit 304 is a part that detects the content of the operation of the button 303 by the user. By detecting the pressing of each button and notifying the control unit 301, the control unit 301 is requested to execute the operation expected by the user.

  The short distance wireless unit 305 performs wireless communication with the digital camera 100 by communication between devices in a short distance. Bluetooth (registered trademark) is assumed in this embodiment. Although the communication speed is slow, it is an advantageous wireless interface in terms of power consumption. In the present embodiment, it is assumed to be compliant with BLE. Act as Central as a role in BLE. This means that the digital camera 100, which is a peripheral, is the connection destination. A command according to the operation content of the user detected by the button detection unit 304 is transmitted to the digital camera 100.

  FIG. 4 is a block diagram of the information processing system in the embodiment. The digital camera 100 and the information processing terminal 200 are constantly connected by BLE. In this case, the information processing apparatus acts as a central, and the digital camera 100 acts as a peripheral as a role of BLE. Then, the information processing apparatus 200 detects the GPS radio wave emitted by the GPS satellite 400 with the GPS unit 211 to acquire position information, and provides the position information to the digital camera 100 by BLE communication. Thus, the digital camera 100 can acquire position information to be added to the image data generated by photographing. Since BLE is a communication standard excellent in low power consumption performance, the digital camera 100 can always utilize the latest position information by regularly providing position information by constantly connecting.

  Furthermore, the remote controller 300 exists as a connection destination of the BLE connection as viewed from the digital camera 100. Also in this BLE connection, the digital camera 100 becomes a peripheral, and the remote controller 300 becomes a central BLE connection. In this connection, the user can operate the button 303 of the remote controller 300 to perform remote photographing in which the digital camera 100 is operated from a distance.

  However, as a restriction of BLE, the digital camera 100 acting as a peripheral can not be connected simultaneously to two centrals. That is, in the situation where the digital camera 100 and the information processing terminal 200 are constantly connected in BLE, when it is desired to BLE connect the remote controller 300 to the digital camera 100, it is necessary to disconnect the constant connection with the information processing terminal 200. As one method of this switching, there can be considered a method of giving priority to the central apparatus of the connection destination in the digital camera 100 as the peripheral. That is, when a connection request is received from a high priority central apparatus, it is possible to switch the connection timely by giving priority to it. In the present embodiment, it is assumed that in the digital camera 100, the remote controller 300 is set to have a higher priority than the information processing terminal 200.

  Next, the specific operation of the system of FIG. 4 will be described using the sequence diagram of FIG. It represents that the digital camera 100 communicates with the information processing terminal 200 or the remote controller 300 while switching the connection destination in BLE.

  First, in step S501, the control unit 103 of the digital camera 100 starts Advertise in accordance with the BLE standard for connecting to the information processing terminal 200. Advertise can be started by the control unit 103 setting a setting value such as an Advertise interval and data of Advertise for the short distance wireless unit 110. Thus, the presence of the digital camera 100 can be notified to surrounding devices. Advertise is in the form of a broadcast that is periodically delivered according to the Advertise interval, and if the delivery interval becomes long, it can continue delivering Advertise for a long time.

  In step S502, the control unit 201 of the information processing terminal 200 issues a connection request to the digital camera 100. The control unit 201 can transmit a request message by setting a connection request to the short-distance wireless unit 209. In addition, an instruction from the user may be used as a trigger for issuing the connection request, or the information processing terminal 200 may automatically perform the connection request. Since the presence of the digital camera 100 can be detected by Advertise delivered by the digital camera 100 in S501, the presence of the digital camera 100 can be displayed on the liquid crystal monitor 208 and the user can select one.

  In step S503, the digital camera 100 and the information processing terminal 200 establish a BLE connection. Link layer connection. The near field wireless unit 110 and the near field wireless unit 209 exchange information with each other and can exchange radio waves. Basically, the near field wireless unit 110 and the near field wireless unit 209 automatically establish the connection of the link layer according to the BLE standard, triggered by the issue of the connection request in S502. The control unit 103 and the control unit 201 can grasp the completion of the BLE connection by monitoring the states of the near field wireless unit 110 and the near field wireless unit 209.

  After that, it runs up to connection with ATT service. It is the connection of the application layer based on the connection of the link layer. The camera will be able to provide various functions. Communication follows the protocol defined by ATT. The control unit 103 of the digital camera 100 can realize the short distance wireless unit 110, and the control unit 201 of the information processing terminal 200 can exchange requests and responses using the short distance wireless unit 209. In the present embodiment, it is assumed that the digital camera 100 corresponds to a service related to position information as shown in FIG. A position information reception service 602 and a remote photographing service 608 are prepared in a GATT server 601 which is a server function conforming to GATT (General ATTribute Profile). The GATT server 601 is realized by the control unit 103 executing a program on the RAM 107. The position information reception service 602 and the remote imaging service 608 exist on the RAM 107 as data managed by the program of the GATT server 601. Furthermore, the location information reception service 602 and the remote imaging service 608 have universally unique identifiers (UUIDs) 603 and 609 for uniquely identifying themselves, and the location information reception service 602 has latitude values 606 identifiable by the handle 604. And the longitude value 607 identifiable by the handle 605. The digital camera 100 can utilize the position information by referring to the latitude value 606 and the longitude value 607. The remote imaging service 608 includes an imaging 611 identifiable by the handle 610, a wide angle 613 distinguishable by the handle 612, and a telephoto 615 distinguishable by the handle 614. The digital camera 100 can grasp the operation content of the user in remote photographing by referring to the photographing 611, the telephoto 613, and the wide angle 615.

  At S504, the information processing terminal transmits position information to the digital camera 100 in communication. This is realized as a write request according to the ATT protocol from the information processing terminal 200 to the digital camera 100. The information processing terminal 200 is a request for requesting update of the position information managed by the position information reception service 602 of the digital camera 100. The control unit 201 of the information processing terminal 200 can transmit a request message by setting a write request for requesting the short distance wireless unit 209 to update position information. The latitude value 606 and the longitude value 607 in the position information reception service 602 managed by the GATT server 601 can be uniquely specified by combining the UUID 603 and the handles 604 and 605 as arguments as a write request. Further, the latest position information to be actually transmitted can be transmitted at any time by holding the position information obtained from the GPS unit 211 in the RAM 203 and periodically updating it. In the digital camera 100 that has received the request, the GATT server 601 operated by the control unit 103 extracts latitude and longitude information from the request received by the short distance wireless communication unit 110. Thereafter, the GATT server 601 updates the latitude value 606 and the longitude value 607 on the RAM 107. Thus, the position information that the digital camera 100 can handle is updated. In S505, the digital camera 100 transmits a response to position information writing by a write request according to the ATT protocol in S504. First, the control unit 103 acquires the position information write request sent from the information processing terminal 200 in S504 from the short distance wireless unit 110, identifies the service to be the write target with UUID 603, and follows the handles 604 and 605 The data is copied to the area of the value 606 and the latitude value 607. After that, the control unit 103 can transmit the response message by setting the position information write response to the short distance wireless unit 110 as the response message according to the ATT protocol.

  Next, as S506, which is parallel processing of S504 and S505, the digital camera 100 performs Multiple Advertise. Multiple Advertise is a mechanism that allows you to separately advertise during BLE connection. The mechanism of Advertise transmission is the same as S501. The Multiple Advertise in S506 can notify the remote controller 300 of the presence of the digital camera 100 and notify that it can be connected.

  As can be understood from the above description, the digital camera 100 notifies the remote controller 300 that connection is possible while acquiring position information by BLE connection with the information processing terminal 200.

  Next, in S507, the user requests the start of remote imaging with the remote controller 300. This can be realized by pressing the connection button on the button 303 of the remote controller 300. At S508, remote controller 300 issues a connection request message to digital camera 100. When the control unit 301 sets a connection request to the short distance wireless unit 305, the connection request message is transmitted. Since the presence of the digital camera 100 can be detected by Multiple Advertise distributed by the digital camera 100 in S506, the information of the transmission destination of the connection request can be grasped. In step S509, the digital camera 100 requests the information processing terminal 200 to record the position information as processing prior to interrupting the communication with the information processing terminal 200. As described above, the digital camera 100 according to the present embodiment sets the remote controller 300 with higher priority than the information processing terminal 200 as the BLE connection destination. Therefore, when the digital camera 100 receives a connection request from the remote controller 300, the digital camera 100 switches the connection destination. That is, since the position information can not be acquired from the information processing terminal 200, the position information at the time of imaging is secured by requesting recording of the position information before cutting. This is realized as ATT Notification from the digital camera 100 to the information processing terminal 200. The control unit 103 can transmit the short distance wireless unit 110 by writing a message of a recording request for position information.

  In step S510, the information processing terminal 200 starts recording of position information in accordance with a request to record the position information received from the digital camera 100 in step S509. This can be realized by the control unit 201 periodically accessing the GPS unit 211 and recording the acquired position information in the RAM 203 as a history together with time information when acquired. The processing of S510 is continued until the next BLE reconnection with the digital camera 100.

  Thereafter, in step S511, the digital camera 100 transmits a disconnection request to the information processing terminal 200. This can be transmitted by the control unit 103 writing a message of a recording request for position information to the short distance wireless unit 110. In response to the disconnection request, the BLE connection between the digital camera 100 and the information processing terminal 200 is disconnected, and communication can not be performed. However, even when the communication with the digital camera 100 is in a disconnected state, the information processing terminal 200 continues recording of the position information acquired by the GPS unit 211 according to the request received in S509. Note that an interval at which position information is acquired by the GPS unit 211 in the information processing terminal 200 is, for example, an interval of one second.

  As described above, the BLE communication between the digital camera 100 and the information processing terminal 200 is disconnected in response to the user's operation of the remote controller 300 in S507, and recording of position information is started in the information processing terminal 200 at the time of this disconnection. Ru. That is, the position information in the cutting period of the digital camera 100 and the information processing terminal 200 is recorded as a history on the information processing terminal 200.

  At S512, the digital camera 100 and the remote controller 300 establish a BLE connection. Basically, it is the same as the connection process of S503. First, as connection of the link layer, mutual information exchange is performed between the short distance wireless unit 110 and the short distance wireless unit 305, and the wireless radio waves can be exchanged. After that, it executes up to connection with ATT service as connection of application layer. The camera will be able to provide various functions related to remote shooting. Communication follows the protocol defined by ATT. The control unit 103 of the digital camera 100 can realize the short distance wireless unit 110 and the control unit 301 of the remote controller 300 can exchange requests and responses using the short distance wireless unit 305. In the present embodiment, the digital camera 100 corresponds to the remote imaging service 608. Remote photographing can be realized by the remote controller 300 transmitting a request to the remote photographing service 608 of the digital camera 100 according to the operation of the user by the remote controller 300.

  The procedure of the remote imaging between S513 and S516 will be briefly described. In step S513, the user performs a shooting operation with the remote controller 300. The photographing button of the remote controller 300 is pressed as a photographing instruction. In S514, the remote controller 300 transmits a photographing request. It is realized as a write request from the remote controller 300 to the digital camera 100 according to the ATT protocol. The remote controller 300 is a write request for imaging 611 of the remote imaging service 608 of the digital camera 100. The control unit 301 of the remote controller 300 can transmit the short distance wireless unit 305 by setting a write request for the imaging 611. By combining UUID 609 and the handle 610 as an argument as a write request, it is possible to uniquely specify the imaging 611 of the remote imaging service 608 managed by the GATT server 601. In the digital camera 100 that has received the request, the GATT server 601 operated by the control unit 103 extracts a photographing request from the request received by the short distance wireless communication unit 110. Thereafter, the GATT server 601 updates the value of the imaging 611 on the RAM 107. As a result, the digital camera 100 can receive a shooting request.

  Thereafter, in step S515, the digital camera 100 executes a photographing process. By detecting the change in the imaging 611 in S514, the imaging process is triggered. The program of the photographing process operated by the control unit 103 starts the photographing when the change of the photographing 611 is detected. The control unit 103 passes the image processing unit 104 and the encoding unit 105 using the BMU 109 to generate image data (encoded image data) according to a desired format by using the BMU 109 for the image data acquired from the imaging unit 102. Let The generated image data is temporarily stored in the RAM 107. Next, in step S516, the digital camera 100 saves the generated image data. This can be realized by the control unit 103 moving image data from the RAM 107 to the storage unit 108 using the BMU 109. While the user performs remote shooting by remote control operation, the processing of S514 to S516 is repeated.

  In the above process, when the user operates the zoom button of the remote controller 300, the control unit 301 of the remote controller 300 sets the write request for wide angle and telephoto to the short distance wireless unit 305. Do. In response to this, the near field wireless unit 305 uniquely specifies the wide angle 613 and the telephoto 615 of the remote photographing service managed by the GATT server 601 by combining the UUID 609 as an argument and the handle 612 or 614 as a write request. it can. In the digital camera 100 that has received the request, the GATT server 601 operated by the control unit 103 extracts a photographing request from the request received by the short distance wireless communication unit 110. Thereafter, the GATT server 601 updates the value of the wide angle 613 or the telephoto 615 on the RAM 107. As a result, the digital camera 100 can receive a photographing request, and control is performed according to the instruction.

  In step S517, the user requests the end of the remote imaging with the remote controller 300. This can be realized by pressing the disconnect button on the button 303 of the remote controller 300. In step S518, the remote controller 300 issues a disconnection request to the digital camera 100. The control unit 301 can transmit a request message by setting the disconnection request to the short-distance wireless unit 305. In response to the disconnection request, the BLE connection between the digital camera 100 and the remote controller 300 is disconnected and communication can not be performed.

  Next, the digital camera 100 attempts to reconnect with the information processing terminal 200 in BLE. This is the same as the processing of S501 to S503. In response to the establishment of the BLE connection with the digital camera 100, the information processing terminal 200 ends the processing of position information recording started in S510.

  After that, at S519, the digital camera 100 notifies information on the photographing time of the image photographed at the processing of S514 to S516 during the BLE disconnection with the information processing terminal 200. This is realized as ATT Notification from the digital camera 100 to the information processing terminal 200. The control unit 103 can transmit the short distance wireless unit 110 by writing a message of a recording request for position information. At S520, the information processing terminal 200 extracts position information of the time notified at S519. This can be realized by extracting position information of a designated time from the position information recorded in the RAM 203 from S510. Next, the information processing terminal 200 transmits the position information extracted in S520 to the digital camera 100. This is also the same as the processing of S504 and S505. The digital camera 100 that has acquired the position information gives the position information to the image data generated by the remote photographing during the disconnection of the information processing terminal 200. This can be realized by the control unit 103 copying the longitude value 906 and the latitude value 907 acquired in S506 and held in the RAM 107 to a predetermined area of the image data. The predetermined area of the image data is assumed to be an area of position information in Exif (Exchangeable image file format). Then, as described in S514 to S516, there may be a plurality of images captured in remote imaging. Therefore, the steps S519 to S521 are repeated as many times as necessary.

  As described above, the digital camera 100 can usually add position information to image data captured by acquiring position information by always connecting the information processing terminal 200 with BLE. Furthermore, even if the position information can not be acquired from the information processing terminal 200 by switching the connection destination with the remote controller 300, the position information during the disconnection period is held by the information processing terminal 200. In this way, by having position information provided by the information processing terminal 200 be provided at the time of reconnection in BLE, position information is later given to image data captured during a period in which the BLE connection is disconnected. Is possible. In addition, since recording of position information on the information processing terminal 200 is also limited to the disconnection period, the information processing terminal 200 does not acquire a large amount of unnecessary position information. Such management of position information during BLE cutting makes it possible to increase the possibility of giving position information to image data captured by the digital camera 100. Therefore, it is possible to use the function and service of image utilization utilizing position information using more image data.

  In addition, after the BLE connection with the remote controller 300 is established in S512, the digital camera 100 may start Multiple Advertise (beacon transmission) for the purpose of indicating the presence of itself to the information processing terminal 200. This means that the information processing terminal 200 is notified of the presence of its own device in the vicinity while the BLE connection with the information processing terminal 200 is disconnected. Then, the information processing terminal 200 records the position information started in S510 only while the Multiple Advertise from the digital camera 100 can be received. That is, if it can not be received by Multiple Advertise, it is determined that the digital camera 100 is not near the information processing terminal 200, and since it becomes unnecessary position information for the digital camera 100, that period is not recorded. This makes it possible to reduce acquisition of useless position information in the information processing terminal 200, and the position indicated by the position information to be recorded by the digital camera 100 in association with the image and the digital when the image is captured. It also ensures that the position of the camera 100 substantially matches.

  Next, after S512, a method may be considered in which the imaging time (imaging time) at which imaging was performed in S513 to S516 is set in AdvertiseData of Multiple Advertise transmitted by the digital camera 100 toward the information processing terminal 200. It is conceivable that the information processing terminal 200 investigates the information of the imaging time of Multiple Advertise AdvertiseData, and records the position information only when there is a change between the imaging time received last and the imaging time received this time. . By notifying the imaging time by the change in AdertiseData, it is possible to further reduce the acquisition of useless position information in the information processing terminal 200.

  Further, as AdvertiseData set by the digital camera 100, a method of setting a file name of a captured image in addition to the captured time may be considered. The information processing terminal 200 links and records not only the time for acquiring the position information but also the acquired time information and the image file name. Since the image corresponding to the acquired position information can be specified, the position information can be attached at 521 without performing the process of S519.

  In this embodiment, when the digital camera 100 disconnects the BLE connection destination with the information processing terminal 200, switching to the remote controller 300 is described as an example of requesting the information processing terminal 200 to record the position information. did. However, other examples in which the digital camera 100 disconnects the BLE connection with the information processing terminal 200 are conceivable.

  For example, handover from BLE to other wireless means (eg: WiFi (registered trademark) or Classic Bluetooth (registered trademark)) can be considered. There is a case where BLE can not be used by handover to the wireless means (only one of the plurality of communication units functions exclusively), in which case it is necessary to disconnect the BLE connection. Also at this time, it is possible to transmit the request for recording of the position information described in S 509 before transmitting the disconnection request.

  It is also conceivable that the radio wave intensity in the BLE connection with the information processing terminal 200 falls below a predetermined threshold. That is, it is also possible to transmit a request for recording of position information when it is detected that the BLE connection with the information processing terminal 200 can not be made.

  With respect to the request for recording of the position information described in S509 of the present embodiment, an implementation may be considered in which transmission is not performed under predetermined conditions. For example, in the setting of the digital camera 100, it may be considered that the setting is made so as not to add position information to the image data generated by photographing. If the position information is not attached, the recording of the position information of the information processing terminal 200 is unnecessary, and there is no problem even if the process of S509 is not performed.

  Furthermore, in the above-described handover from BLE to the wireless means, even when the handover destination is the same information processing terminal 200, it is possible not to transmit the request for recording of the position information. If the same information processing terminal 200 is to be connected, the position information may be acquired by the hand-over wireless means, so there is no problem even if the process of S509 is not performed.

  As described above, according to the present embodiment, it is possible to record position information of a period during which the digital camera can not acquire position information from the smart device as a history in the smart device by breaking the BLE connection. . Thus, by providing the necessary position information to the digital camera when the BLE connection is restored, the position information can be given even if the image is captured during the BLE disconnection of the digital camera.

(Other embodiments)
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. Can also be realized. It can also be implemented by a circuit (eg, an ASIC) that implements one or more functions.

DESCRIPTION OF SYMBOLS 100 ... Digital camera, 101 ... Lens, 102 ... Imaging part, 103 ... Control part, 104 ... Image processing part, 105 ... Encoding part, 106 ... ROM, 107 ... RAM, 108 ... Recording part, 109 ... BMU, 110 ... Near field wireless unit 111 System bus 200 Information processing terminal 201 Control unit 202 ROM 203 203 RAM 204 Storage unit 205 BMU 206 VRAM 207 Touch sensor 208 Liquid crystal Monitor 209: short distance wireless unit 210: wireless LAN unit 211: GPS unit 212: system bus 300: remote controller 301: control unit 302: ROM 303: button 304: button detection unit 305 ... Short-range wireless unit, 306 ... System bus, 306 ... RAM

Claims (18)

An imaging apparatus comprising communication means for performing near-field wireless communication and imaging means, comprising:
When imaging is performed by the imaging unit while communicating with the first external device that provides position information via the communication unit, the image obtained by imaging and the position received from the first external device Recording means for associating information with information and recording the information in a predetermined storage medium;
In order to secure positional information of an image to be captured in a disconnected state with the first external device, when communication with the first external device is interrupted, the first external device is secured. An image pickup apparatus comprising: control means for transmitting a request for continuation of acquisition of position information.   The imaging according to claim 1, wherein the control means determines, as the predetermined situation, a case where a connection request from a second external device having a higher priority than the first external device is received. apparatus.   The imaging device according to claim 2, wherein the second external device is a remote controller that remotely controls the imaging device.   The imaging apparatus according to claim 1, wherein the control unit determines, as the predetermined situation, a case where a field intensity of communication with the first external device falls below a preset threshold. Furthermore, the communication means has a second communication means that functions exclusively.
The imaging apparatus according to claim 1, wherein the control unit determines, as the predetermined situation, a case where the communication unit switches to the communication by the second communication unit.   The imaging device according to claim 1, wherein the control means includes transmission means for transmitting a beacon for notifying an external device located in the vicinity of the presence of the imaging device via the communication means. 7. The imaging according to claim 6, wherein the transmitting unit transmits the beacon including an imaging time each time imaging is performed by the imaging unit in a state in which communication with the first external device is disconnected. apparatus. The imaging apparatus according to claim 7, wherein the transmission unit further transmits the beacon including a file name of a captured image. The control means
When the communication with the first external device is switched from the disconnection state to the reconnection state, the position information at the imaging time of the image captured in the disconnection state is requested to the first external device, and the request is obtained by the request The image pickup apparatus according to any one of claims 1 to 8, further comprising means for associating the position information with the image and recording the image on the storage medium. An information processing apparatus comprising: communication means for performing near-field wireless communication; and acquisition means for acquiring position information,
Transmission means for transmitting position information acquired from the acquisition means to an imaging device in communication via the communication means;
A recording unit that records the position information obtained by the acquisition unit during a period until reconnection with the imaging device is performed when a predetermined request before disconnection of the communication is received from the imaging device in communication And an information processing apparatus characterized by comprising: 11. The apparatus according to claim 10, wherein the recording unit records position information acquired in a period in which a predetermined beacon is received from the imaging device in a state in which communication with the imaging device is disconnected. Information processing device.   The information processing apparatus according to claim 11, wherein, when the beacon includes an imaging time different from the previous time, the recording means records position information acquired at the time.   12. The apparatus according to claim 11, wherein, when the beacon includes an imaging time and a file name of an image, the recording means records positional information acquired at the time and the file name in association with each other. Information processing equipment. And second transmitting means for transmitting position information of the time requested by the imaging device from among the position information recorded by the recording means when reconnected to the imaging device. The information processing apparatus according to any one of claims 10 to 13, characterized in that: A control method of an imaging apparatus having communication means and imaging means for performing near field communication,
When imaging is performed by the imaging unit while communicating with the first external device that provides position information via the communication unit, the image obtained by imaging and the position received from the first external device A recording step of recording information in a predetermined storage medium in association with the information;
In order to secure positional information of an image to be captured in a disconnected state with the first external device, when communication with the first external device is interrupted, the first external device is secured. And a control step of transmitting a request for continuation of acquisition of position information. A control method of an information processing apparatus, comprising: communication means for performing near field communication and an acquisition means for acquiring position information,
A transmitting step of transmitting position information acquired from the acquiring unit to an imaging device in communication via the communication unit;
A recording step of recording the position information obtained by the acquisition unit during a period until reconnection with the imaging device is performed when a predetermined request before disconnection of the communication is received from the imaging device in communication And a control method of an information processing apparatus.   The program for making the said computer perform each process of the method of Claim 15 or 16 by reading and performing a computer. INFORMATION PROCESSING APPARATUS HAVING INFORMATION PROCESSING DEVICE HAVING IMAGING DEVICE HAVING FIRST COMMUNICATION MEANS AND IMAGING MEANS FOR WHICH SHORT WIRELESS COMMUNICATIONS A system,
The imaging device is
When imaging is performed by the imaging unit while communicating with the information processing apparatus that provides position information via the first communication unit, an image obtained by imaging and a position received from the information processing apparatus Recording means for associating information with information and recording the information in a predetermined storage medium;
When a predetermined situation in which communication with the information processing apparatus is interrupted, the acquisition of position information with respect to the information processing apparatus is continued in order to secure the position information of the image captured in a disconnected state with the information processing apparatus. Control means for transmitting the request of
The information processing apparatus is
Transmission means for transmitting position information acquired from the acquisition means to the imaging device in communication via the second communication means;
A recording unit that records the position information obtained by the acquisition unit during a period until reconnection with the imaging device is performed when a predetermined request before disconnection of the communication is received from the imaging device in communication And an information processing system characterized by having.

Images