DE102005010031A1 - Method for marking an image content and marking device - Google Patents

Abstract

The The invention relates to a method for marking an image content in at least one output image at a marking position with a marker object that generates at least one control image is, with the control image comprises a pointer object, from the control image the pointer object detects and a pointer position of the pointer object is determined and from the pointer position, the marking position is produced. Furthermore, the invention also relates to a marking device for Carry out of the method according to the invention, wherein this marking device realized by means of two devices can be.

Description

The The invention relates to a method according to the preamble of the claim 1 and a marking device according to the preamble of the claim 8th.

In In recent years, the number of terminals, the photos and / or moving picture sequences record and store digitally on a storage medium, strong increased. A very big one There is an increase in mobile phones, which have been around since the introduction of the MMS (Multimedia Messaging Service) standards are able to Photos and short moving picture sequences to an MMS receiver too send or receive. Here are photos according to the JPEG standard (JPEG = Joint Picture Expert Group) and moving picture sequences ITU H.263 standard (ITU = International Telecommunications Union). In the following, the terms photo and image are used synonymously.

Just through the introduction These technologies in a mobile phone is a user in the Location, anywhere and at any time a photo and / or create a moving picture sequence and transmit it to a receiver. in this connection For example, if the request is an image resolution, i. the number of pixels of a photo, to enlarge. today Mobile phones already offer an image resolution of, for example, 1.3 million Pixels. In contrast to the increase in image resolution new devices an ever smaller housing volume exhibit. This requires, among other things, that the size of a Screen of the mobile phone due to the housing volume limited is.

Further should be before sending a picture or a moving picture sequence should one or more image content, eg. As a specific person, marked become. Hereby can the recipient particularly important image areas are visually communicated.

to Mark could transmits the captured image to a personal computer with graphics program, there with the desired Marked and then sent back to the recipient become. However, this has the disadvantage that a personal computer needed for post processing and as this is not available at any place or at any time, sending marked pictures with some delay it works.

Of Further could a mobile phone with a touch screen equipped be with that by means of touch of the screen marks within the captured image added can be. However, this proves to be disadvantageous since a touch-sensitive Screen increases the cost of a mobile phone and at small screens is not particularly appropriate.

Finally, marks can be made also about one Keyboard of a mobile telephone. This proves in practice as less efficient, since both the handling for one untrained User not intuitive as well as navigating with the help of the keyboard time consuming is.

The The object underlying the invention is a method and to provide a marking device that marks the image content in pictures or moving picture sequences in a simpler and more efficient way Way allows.

These The object is based on the method according to the preamble of the claim 1 solved by its characterizing features. Further, this task becomes by a marking device starting from the preamble of claim 8 solved by its characterizing features.

at the method of marking an image content in at least one Starting picture at a marking position with a marking object becomes generates at least one control image, wherein the control image is a pointer object comprises, detected from the control image, the pointer object and a Pointer position of the pointer object, and from the pointer position generates the marking position.

The inventive method allows the marking of the picture content at the marking position in the source picture in easier and cheaper Way, because except a camera, which is needed to capture the control image, are not additional Input tools, such as a touchscreen, needed. Therefore may be a mobile phone, which the inventive method implemented for image marking, produced in a cost effective manner. Furthermore, the use of the method according to the invention for a User uncomplicated, since only one pointer object added and from this the marking position is determined.

Preferably, the pointer position is calculated as a relative position with respect to height and width of the control image and the marker position generated from the pointer position and from a height and width of the output image. In this case, the marker position ermit in a particularly simple manner be telt. Furthermore, the use of relative position information enables the generation of the marker position as a function of any height and width of the output image.

Becomes preferably initializes the pointer object before taking the control image, so the pointer object can be customized, z. By a user, be set.

Becomes in a preferred embodiment at least create a test image, from the test image on a background image Moving test object determined and the pointer object under Initialized using the test object, the pointer object can be off a freely definable object, such as a hand with outstretched index finger to be generated individually.

alternative the second pointer object can be an illustration of a hand or a Stylus or a hand with a stylus. This allows different predefined pointer objects are initialized.

Become preferably the marking object is a picture of an arrow, assigned an image of a point or a sequence of letters, so can different image contents by means of different marking objects visually distinguished.

Preferably will be in a first device at least create one of the control images and determine the pointer position, transmit the pointer position from the first to a second device, in the second device the marker position generated from the pointer position and with Help of the marking object creates a marked starting picture .. Thus, the inventive method by two users on two devices done so that one of the users transmits the pointer position to the other user and the other user, this pointer position at the marking position represented by the marking object. This can also be done at big Removal of two users a mark of at least one image content respectively.

Further The invention relates to a marking device for image marking with a first means for creating an output image, a second means for generating at least one control image, wherein the control image comprises a pointer object, a third means for Detect the pointer object and determine a pointer position of the second pointer object, a fourth means for generating a Marking position using a respective pointer position, and a fifth means to create a highlighted source image by highlighting a Image content of the output image at the marking position with a Marking object. By using the marking device can the inventive method to mark a picture content.

Preferably the marking device comprises a transmission means for transmission a marked output image to a playback device. hereby The selected output image can be changed by a device other than the marking device are shown.

alternative For this purpose, the marking device comprises a first device with the second and third means and with a transmitting means for transmitting at least a pointer position to a second device, and the second device with a Receiving means for receiving at least one pointer position of the first device, and with the first, fourth and fifth means. Hereby can an application of the method according to the invention also over long distances through two devices carried out become.

Further details and advantages of the invention are set forth below with reference to the attached 1 to 7 explained in more detail with reference to several embodiments. The features shown there and also the features already described above can be essential to the invention not only in the combination mentioned, but also individually or in other combinations. In detail show:

1 a flow diagram for carrying out the method according to the invention;

2 with sub-figures a to d different pictures, which illustrate the implementation of the method according to the invention in more detail;

3 a marking device for carrying out the method according to the invention;

4 an alternative marking device that realizes the method according to the invention with a first and second device;

5 a further marking device consisting of a first and second device, wherein this device arrangement is suitable for carrying out the method according to the invention;

6 a first and second mobile device comprising a first and a second device, respectively;

7 a first mobile device, which together with a personal computer is suitable for carrying out the method according to the invention;

Elements with the same function and mode of action are in the 1 to 7 provided with the same reference numerals. This does not apply to the first and second devices G1, G2.

A mobile phone user wants to take his wife and both children on a photo with his mobile phone MG1, mark one of the children with an arrow and this marked recording to a recipient, eg. B. to the grandmother, send. For this purpose, according to the inventive method according to 1 in a step S11 an output image AB recorded, for example. With a camera K of the mobile phone MG1. In subfigure 2a such an output image AB is shown as an example, this output image AB showing the woman and the two children. The recorded output image AB is stored, for example, on a memory card in the mobile phone. Instead of taking the output image AB with the camera this can be loaded from an image archive, the image archive is stored, for example, on a computer in the mobile network or on the memory card of the mobile phone.

In In a following step S12, the output image AB is displayed on a screen of the mobile phone MG1 shown in one of the following Steps a marker MO into the place of one of the children in the output picture AB to set.

For example, an arrow for marking the left child should be set to a position in the output picture AB (= middle person in the output picture AB). For this purpose, one or more control images SB are recorded, for example by means of the camera of the mobile radio telephone, wherein at least one of these control images SB comprises a pointer object ZO. For example, serves as a pointer object ZO a hand with an outstretched index finger. In subfigure 2 B is such a control image SB shown.

Thereafter, the pointer position ZP (= local position), for example, the index finger tip, determined within the control image SB. Here, as a pointer position ZP z. B. the distance from the upper left corner of the control image SB to the determined pointer position ZP index finger tip specified. As a measure of the distance, a number of pixels can be used. So z. B. an image size of the control image 200 × 100 pixels. The distance of the pointer position ZP to the left edge of the image is 150 pixels and to the upper edge of the image of the control image SB 50 pixels. Thus ZP = (150; 50). Here, the pointer position ZP is given in absolute values. This is in 2 B exemplified.

The Pointer position ZP can also be used instead of the absolute position a relative position. Here is the Pointer position ZP relative to, for example, the left and the upper edge in Terms of width and height of the control image SB determined. For example. is calculated for the above Example the relative position to 150 pixels to 200 pixels = 75% to the left edge or 50 pixels to 100 pixels = 50% to the top. Thus, amounts ZP = (75%, 50%). in principle the relative position shows the local Position of the pointer object ZO in relation to the height and width of the control image SB, the height and the width of the control image SB each correspond to 100%.

The recording of the control image SB including the pointer object ZO is in step S13, and the detection of the pointer object ZO and the location of the pointer position ZP of the pointer object ZO in the control image SB is in step S14 in FIG 1 shown. The recording of at least one control image SB can take place before a background different from the original image AB image background, since only the pointer object ZO and the pointer position ZP is evaluated in the control image SB. In subfigure 2 B this is exemplified. In this case, the control image SB in the image background shows a house and as a pointer object ZO a hand with an outstretched index finger.

Furthermore, this subfigure shows 2 B a mobile phone MG1, on the screen of the output image AB is displayed. To carry out the marking of the image content in the output image AB, the respective pointer position ZP is determined during the acquisition of a sequence of control images SB. From the respective pointer position ZP, a respective marking position MP related to the output image AB is calculated. After the marker position MP is determined (step S15), it can be displayed on the position control screen in step S19 by means of a marker object MO.

Become several control pictures SB recorded, so is in each control picture SB the respective pointer position ZP and thus the associated marking position MP is determined and displayed in real time on the screen using the marker object MO reproduced. As shown in step S18, the Steps S13, S14, S15 and S19 for every second captured image SB is repeated.

The determination of the marking position MP taking into account the pointer position ZP according to step S15 will now be explained in more detail. The marker position MP becomes the pointer position ZP and a height and width of the output image AB generated. Thus, the width and height of the output image AB is 100 × 100 pixels and the pointer position in relative position ZP = {75%; 50%}. From this, by multiplying the relative position of the pointer position ZP by the width or height of the output image AB, the marking position MP can be calculated to be 75% × 100 pixels = 75 pixels and 50% × 100 pixels = 50 pixels. Thus, the marker position MP at the image location is 75 pixels horizontally and 50 pixels vertically. This is in the subfigure 2c graphically represented by dashed lines.

In a further step S16 of 1 is generated from the output image AB and the marker MO a marked output image AB '. For this purpose, the marking object MO is superimposed on the output image AB at the marking position MP. In the subfigure 2c the marker object MO is an arrow pointing to the left child. Thus, the marker object points to the image content, ie the left child. In addition to an arrow representation, a point or one or more letters or another object suitable for marking can also be used as marking object MO.

Furthermore, instead of just one control image SB, a plurality of control images SB can also be analyzed. For example. For example, ten control images SB are picked up and one of these ten control images SB is selected to detect the pointer object ZO. In this selected control image SB, the pointer object ZO and the pointer position ZP is determined. The recording of a plurality of control images SB is in step S17 in FIG 1 shown, wherein the last recorded control image SB is used for detection.

In an alternative extension of the method according to the invention, a plurality of pointer positions ZP and associated marking positions MP can be determined which mark one or more image contents in the marked output image AB '. Thus, for example, a sequence of ten control images SB is recorded, in which the pointer object ZO moves in a circle. After the respective pointer positions ZP have been determined from the ten control images SB, an associated marker position MP is calculated for each pointer position ZP. Thereafter, at each of the ten marker positions MO, a marker object MO is inserted in the marked output image AB '. In the subfigure 2d this is exemplified clarified. Here, the marker object MO is represented in the form of a dot, and the ten marker positions MP mark a dotted circle around the left child in the marked output image AB '.

Next The possibility, that at all marking positions MP in the marked output image AB 'an identical one Marking object MO is applied, it is in an alternative Variant (not shown) of the method according to the invention possible that at each marking position MP another marking object MO is represented, such as, for example, a string of letters. In an additional variant the inventive method, the individual marking objects MO are automatically connected. Consequently image contents are marked in the marked output image AB 'with an arbitrary border.

3 shows a first embodiment marking device MV for carrying out the method according to the invention. The marking device MV comprises a first means for producing at least one output image AB. With the aid of a second means M2, at least one control image SB is generated, which comprises a pointer object ZO. This output image AB is supplied to a third means M3 for determining the pointer object ZO and a pointer position ZP of the pointer object ZO in the control image SB. Furthermore, one or more output images AB and the associated pointer positions ZP are transferred to a fourth means M4 for generating in each case a marking position MP belonging to the respective output image AB. Thereafter, one or more output images AB and the respectively associated marking position ZP are transmitted to the fifth means M5 for marking the output image AB at the at least one marking position MP. After that, the fifth means M5 creates a marked output image AB 'in such a way that a marking object MO is superimposed on the output image AB at the position defined by the marking position MP. This marked output image AB 'can be displayed on a screen BS of the marking device MV.

One or more marked output images AB ' with the help of a transmitting means SM via a transmission channel UE transmitted from the marking device MV to a playback device become. Upon receipt of at least one of the marked images AB ', the playback device display this on a screen or in a storage element for later Save editing.

The Pointer object ZO can be fixed or with the help of the following Description generated dynamically. A first aid Y1 generates one or more test images TB, with at least one of these test images TB comprises a test object TO. With the help of the second Aid Y2 becomes the test object TO, such as a Hand with an outstretched forefinger, identified and to the third Transfer funds M3. The third means initializes the pointer object ZO with the test object TO.

In the example according to 3 the inventive method for marking an image content has been carried out in a marking device MV. In one embodiment, the marking device MV is divided into two devices G1, G2, which together implement the method according to the invention. Two variants for the marking device MV with two devices G1, G2 will be explained below.

4 shows a first embodiment variant for the marking device MV with two devices G1, G2. The first device G1 corresponds to the marking device MV off 3 wherein the first device has no fifth means and no screen BS. In this case, the first device G1 sends a bit stream BT via the transmission medium UE. This bitstream BT comprises at least one pointer position ZP and the output image AB. This bit stream BT consists, for example, of a single data packet, which has advantageously been formed according to the standard MMS. According to 4 a receiving module EM of the second device G2 receives the bit stream BT and extracts the data contained there, such. B. the pointer position ZP and the output image AB. These are fed to a mixing module MM, which generates the marked output image AB '. This marked output image AB 'corresponds to the output image AB, but at the marking position MP the marking object MO has been superimposed on the output image AB. This marked output image AB 'can be reproduced on a screen BS.

Based on 5 In the following, a second embodiment is presented. The marking device VM initially comprises a first device G1, which has the first and third means M1, M3. The first means M1 receives at least one control image SB. The recorded control images SB are sent to the third means M3 for determining the respective pointer position ZP. The third means M3 passes at least one pointer position ZP to the transmitting means SM on. According to the at least one pointer position ZP is transmitted to the second device G2 of the marking device VM.

According to 5 the second device G2 has the receiving device EM for receiving the at least one pointer position ZP. Furthermore, the second device G2 comprises via the first means M1 for recording an output image AB, which is transferred to the fourth and fifth means M4, M5. In the fourth means M4, the respectively associated marking position MP in the output image AB is determined on the basis of at least one pointer position ZP, which is encoded, for example, in the form of a relative position specification. This marking position MP is transferred to the fifth means M5, the fifth means M5 generating the marked output image AB 'by superposition of the marking object MO at the marking position MP and the output image AB. The marked output image AB 'is displayed on a screen BS.

When using both devices G1, G2 according to 4 or 5 In practice, it may be expedient to provide the initial image AB to be marked with the first device G1 for determining the pointer position ZO in the third means M3. For this purpose, the second device G2 sends the output image AB to the first device G1, which this initial image AB z. B. on his screen. During the recording of the control image SB or during determination of the pointer position ZP, that position in the output image AB can be represented in the first device G1 at which the pointing position ZP or the calculated marking position MP would come to a standstill. With the aid of this procedure, the selection of the pointer position ZP with respect to the marking position in the initial image can be controlled.

In 6 the mobile telephone MG1 is shown, which comprises the marking device MV. Furthermore, the first mobile telephone MG1 may include a camera K for receiving one or more output images AB and / or control images SB.

alternative For this purpose, the mobile telephone MG1, the first device G1 and a second mobile telephone MG2 the second device G2. Both mobile phones MG1 and MG2 can Data, such as the pointer position ZP or the marked Output image AB 'over the transmission channel Exchange UE. The mobile phone MG1 can be connected to the second mobile phone MG2 the data (= bitstream BT) directly, that is without a base station one Replace mobile network. In another embodiment uses the mobile phone MG1 to exchange data with the second mobile phone MG2 a transmission channel UE, with Help a mobile network, such as a GSM network (GSM - Global System for Mobile Communication) is realized.

In 7 The first mobile device MG1 exchanges the data with a computer PC. The mobile device MG1 in this case comprises the first device G1 and the computer PC, the second device G2. First, the mobile telephone MG1 sends the data via the transmission channel UE to a base station BS, which forwards the data to the computer PC, for example via a LAN connection (LRN - Local Area Network). Instead of a LAN network or a wireless transmission channel UE, the computer PC and the first mobile device MG1 can also send data via another wired network, such as an ISDN (Integrated Digital Subscriber Network).

Claims (10)

Method for marking an image content in at least one output image (AB) at a marking position (MP) with a marking object (MO), characterized in that a) at least one control image (SB) is generated, wherein the control image (SB) is a pointer object (ZO ), b) from the control image (SB) detects the pointer object (ZO) and a pointer position (ZP) of the pointer object (ZO) is determined, c) from the pointer position (ZP) the marking position (MP) is generated. Method according to claim 1, characterized, that - the Pointer position (ZP) as relative position in terms of height and width the control image (SB) is calculated, - the marking position (MP) from the pointer position (ZP) and from a height and width of the output image (AB) is generated. Method according to one of the preceding claims, characterized characterized in that the pointer object (ZO) before recording the control image (SB) is initialized. Method according to claim 3, characterized, that - at least a test image (TB) is created, - from the test image (TB) in front of a background image (BH), a moving test object (TO) is detected becomes, - the Pointer object (ZO) initialized using the test object (TO) becomes. Method according to claim 3, characterized that the pointer object (ZO) is an image of a hand and / or a Stylus and / or a hand with a stylus assigned becomes. Method according to one of the preceding claims, characterized characterized in that the marking object (MO) is an illustration of a Arrow, an illustration of a point or a sequence of letters is assigned. Method according to one of the preceding claims, thereby marked that - in a first device (G1) at least one of the control images (SB) created and the pointer position (ZP) is determined - the Pointer position (ZP) transferred from the first to a second device becomes, - in the second device (G2) generates the marking position (MP) from the pointer position (ZP) and with the help of the marking object (MO) a marked output image (AB ') is created. Marking device (MV) for image marking, in particular according to one of the preceding claims, marked by, a) a first means (M1) for creating an output image (AB), b) a second means (M2) for generating at least one control image (SB), wherein the control image comprises a pointer object (ZO), c) a third means (M3) for detecting the pointer object (ZO) and for determining a pointer position (ZP) of the pointer object (ZO), d) a fourth means (M4) for generating a marker position (MO) by means of a respective pointer position (ZP), e) a fifth Means (M5) for creating a marked output image (AB ') by marking an image content of the output image (AB) at the marking position (MP) with a marker object (MO). Marking device (MV) according to claim 8, characterized by, a transmitting means (SM) for transmitting a marked output image (AB ') to a playback device. Marking device (MV) according to claim 8, marked by, - one first device (G1) with the second and third means (M2, M3) and with a transmitting means (SM) to submit at least one pointer position (ZP) to a second device (G2), - the second Device (G2) with a receiving means (EM) for receiving at least one pointer position (ZP) from the first device (G1), and the first, fourth and fifth means (M1, M4, M5).