CN112115696A - Data processing method and device and recording equipment - Google Patents

Abstract

Embodiments of the present invention provide a data processing method, device, and recording device, wherein the method includes: acquiring a target image by a recording device; performing text recognition on the target image, determining corresponding text information, and determining the text information The typesetting information in the target image; the text information is displayed according to the typesetting information of the text information in the target image; the typesetting of the displayed text information can be made the same or similar to the typesetting in the target image, which is convenient for users The reading and comprehension of the information in the image; thus improving the user experience.

Description

A data processing method, device and recording device

technical field

The present invention relates to the technical field of data processing, in particular to a data processing method, device and recording device.

Background technique

In recent years, recording equipment, as a product in the professional field, has developed rapidly and entered the public field. Reporters, students, teachers and other groups usually need recording equipment for recording. In addition, the recording of various TV programs, movies, music, etc. also requires the use of recording equipment.

With the popularization of the use of recording devices, the functions of the recording devices are gradually improved by users; at present, the functions of the recording devices cannot meet the needs of users, resulting in poor user experience.

SUMMARY OF THE INVENTION

The embodiment of the present invention provides a data processing method, so as to facilitate the user's reading and understanding of the information in the image.

Correspondingly, the embodiments of the present invention also provide a data processing apparatus and a recording device, so as to ensure the implementation and application of the above method.

In order to solve the above problem, an embodiment of the present invention discloses a data processing method, which specifically includes: acquiring a target image by a recording device; performing text recognition on the target image, determining corresponding text information, and determining that the text information is in the target image. The typesetting information in the image; the text information is displayed according to the typesetting information of the text information in the target image.

Optionally, the text information includes a plurality of texts, and the determining the typesetting information of the text information in the target image includes: respectively recording line information corresponding to each text in the target image, and the line where each text is located. The position information of the text information; according to the line information and position information of each text in the text information, the typesetting information of the text information in the target image is generated.

Optionally, the displaying the text information according to the typesetting information of the text information in the target image includes: performing a paragraph on the text information according to the line information and position information of each text in the text information. Divide; display the textual information in paragraphs.

Optionally, displaying the text information according to the typesetting information of the text information in the target image includes: controlling each text in the text information according to the line information and position information of each text in the text information according to the The text is shown in the same typography in the image.

Optionally, the method further includes: translating the text information, obtaining a corresponding translation result, and displaying the translation result.

Optionally, the translation results include: picture translation results and/or text translation results.

Optionally, the method further includes: receiving a transmission instruction, where the transmission instruction includes at least one of the following: a sharing instruction, a forwarding instruction, and a dump instruction; transmitting the data corresponding to the transmission instruction to other devices; The data corresponding to the transmission instruction includes at least one of the following: target image, text information and translation result.

Optionally, the method further includes: acquiring target audio data, the target audio data is associated with the target image, and the target image is collected by a recording device in the process of recording the target audio data; according to the text information Perform speech recognition on the target audio data to determine a corresponding speech recognition result.

The embodiment of the present invention also discloses a data processing device, which is applied to a recording device, and specifically includes: an image acquisition module, used to acquire a target image; a text recognition module, used to perform text recognition on the target image, and determine the corresponding text information and determining the typesetting information of the text information in the target image; a display module, configured to display the text information according to the typesetting information of the text information in the target image.

Optionally, the text information includes a plurality of texts, and the text recognition module is used to respectively record the line information corresponding to each text in the target image, and the position information of the line where each text is located; The line information and position information of the text are used to generate the typesetting information of the text information in the target image.

Optionally, the display module includes: a first typesetting display sub-module, configured to divide the text information into paragraphs according to the line information and position information of each text in the text information; text information.

Optionally, the display module includes: a second typesetting display sub-module, configured to control each text in the text information to be the same as the text in the image according to the line information and position information of each text in the text information. typography display.

Optionally, the apparatus further includes: a translation module, configured to translate the text information, obtain a corresponding translation result, and display the translation result.

Optionally, the translation results include: picture translation results and/or text translation results.

Optionally, the device further includes: a data transmission module, configured to receive a transmission instruction, where the transmission instruction includes at least one of the following: a sharing instruction, a forwarding instruction, and a dump instruction; the data corresponding to the transmission instruction, The data is transmitted to other devices; the data corresponding to the transmission instruction includes at least one of the following: target image, text information and translation result.

Optionally, the device further includes: a speech recognition module for acquiring target audio data, the target audio data is associated with the target image, and the target image is collected by the recording device during the recording of the target audio data ; Perform speech recognition on the target audio data according to the text information, and determine a corresponding speech recognition result.

The embodiment of the present invention also discloses a readable storage medium, when the instructions in the storage medium are executed by the processor of the recording device, the recording device can execute the data processing method according to any one of the embodiments of the present invention.

An embodiment of the present invention also discloses a recording device including a memory and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors. Or one or more programs include instructions for performing the following operations: acquiring a target image; performing text recognition on the target image, determining corresponding text information and determining the typesetting information of the text information in the target image; The typesetting information of the text information in the target image, showing the text information.

Optionally, the text information includes a plurality of texts, and the determining the typesetting information of the text information in the target image includes: respectively recording line information corresponding to each text in the target image, and the line where each text is located. The position information of the text information; according to the line information and position information of each text in the text information, the typesetting information of the text information in the target image is generated.

Optionally, the displaying the text information according to the typesetting information of the text information in the target image includes: performing a paragraph on the text information according to the line information and position information of each text in the text information. Divide; display the textual information in paragraphs.

Optionally, displaying the text information according to the typesetting information of the text information in the target image includes: controlling each text in the text information according to the line information and position information of each text in the text information according to the The text is shown in the same typography in the image.

Optionally, it also includes instructions for performing the following operations: translating the text information, obtaining a corresponding translation result, and displaying the translation result.

Optionally, the translation results include: picture translation results and/or text translation results.

Optionally, it also includes an instruction for performing the following operations: receiving a transmission instruction, where the transmission instruction includes at least one of the following: a sharing instruction, a forwarding instruction, and a dump instruction; transmitting the data corresponding to the transmission instruction to other equipment; the data corresponding to the transmission instruction includes at least one of the following: target image, text information and translation result.

Optionally, it also includes instructions for performing the following operations: acquiring target audio data, the target audio data is associated with the target image, and the target image is collected by the recording device in the process of recording the target audio data; The text information is used to perform speech recognition on the target audio data, and the corresponding speech recognition result is determined.

The embodiments of the present invention include the following advantages:

In the embodiment of the present invention, the text recognition function of the image can be added to the recording device; then when the user uses the recording device to perform text recognition on the target image, the recording device can obtain the target image; then perform text recognition on the target image, determine Corresponding text information and determine the typesetting information of the text information in the target image; and display the text information according to the typesetting information of the text information in the target image; and then make the typesetting of the displayed text information match the same. The layout in the target image is the same or similar, which facilitates the user to read and understand the information in the image, thereby improving the user experience.

Description of drawings

Fig. 1 is the step flow chart of a kind of data processing method embodiment of the present invention;

Fig. 2 is a flow chart of steps of an optional embodiment of a data processing method of the present invention;

3 is a flow chart of steps of another data processing method embodiment of the present invention;

4 is a flow chart of steps of another data processing method embodiment of the present invention;

Fig. 5 is a flow chart of steps of still another data processing method embodiment of the present invention;

6 is a structural block diagram of an embodiment of a data processing apparatus of the present invention;

7 is a structural block diagram of an optional embodiment of a data processing apparatus of the present invention;

Fig. 8 shows a structural block diagram of a recording device for data processing according to an exemplary embodiment.

Detailed ways

In order to make the above objects, features and advantages of the present invention more clearly understood, the present invention will be described in further detail below with reference to the accompanying drawings and specific embodiments.

A data processing method provided by an embodiment of the present invention is applied to a recording device, and the recording device may refer to a device with a recording function, such as a recording pen, a translation device such as a translation pen, a translator, etc.; the embodiment of the present invention There is no restriction on this.

In the embodiment of the present invention, an image acquisition module may be set in the recording device, so as to add an image acquisition function in the recording device; thus, the user can use the recording device to perform image acquisition. The recording device is also provided with a display component, and the display component may include a display screen, which may be used for information display.

In many cases, after a user obtains an image, it is necessary to perform text recognition on the image to obtain text information in the image. Therefore, the embodiment of the present invention also adds a text recognition function of an image to the recording device, so as to meet the user's usage requirements and improve the user experience.

On the above basis, one of the core concepts of the embodiments of the present invention is to recognize the typesetting of the text while recognizing the text in the image; then, based on the typesetting of the text in the image, the recognized text information is displayed; The typesetting of the information is the same as or similar to the typesetting of the information in the target image; thus, it is convenient for the user to read and understand the information in the image.

Referring to FIG. 1, a flow chart of steps of an embodiment of a data processing method of the present invention is shown, which may specifically include the following steps:

Step 102: The recording device acquires the target image.

In this embodiment of the present invention, a user may perform an image acquisition operation in a recording device, and correspondingly, the recording device may receive an image acquisition instruction, and then call an image acquisition module set therein to perform image acquisition to acquire a target image. Of course, the user can also select an image that needs text recognition from the images stored in the recording device as the target image.

The target image stored in the recording device may be pre-collected and stored by the recording device calling the image acquisition module set in the recording device; it may also be stored by the recording device after being sent to the recording device by other devices. No restrictions apply. The other devices may refer to devices other than recording devices.

Step 104: Perform text recognition on the target image, determine corresponding text information, and determine the typesetting information of the text information in the target image.

After acquiring the target image, text recognition can be performed on the target image to determine text information corresponding to the target image; and while the text recognition is performed on the target image, typesetting information of the text information in the target image can be determined. The typesetting information may be used to describe the typesetting of text in the target image.

Step 106: Display the text information according to the typesetting information of the text information in the target image.

In the embodiment of the present invention, when displaying text information on the display screen, the text information can be controlled to be displayed according to the same or similar typesetting as the typesetting information in the target image according to the typesetting information of the text information in the target image.

The typesetting information can be used to represent the typesetting of the text information in the target image, for example, it can represent the paragraph where the text information is located, the line of the paragraph where the text information is located, the line spacing between each line of text information, the same line of text information space between texts, etc.

Wherein, in this embodiment of the present invention, steps 102 to 106 may be executed by the recording device; or after the recording device executes step 102, the target image is sent to the server, and the server executes step 104; The text information and typesetting information are returned to the recording device, and the recording device performs step 106; this is not limited in this embodiment of the present invention.

To sum up, in the embodiment of the present invention, the text recognition function of the image can be added to the recording device; and when the user uses the recording device to perform text recognition on the target image, the recording device can obtain the target image; Identify, determine the corresponding text information and determine the typesetting information of the text information in the target image; and display the text information according to the typesetting information of the text information in the target image; and then make the displayed text information The typesetting of the image is the same as or similar to the typesetting in the target image, which is convenient for the user to read and understand the information in the image; thereby improving the user's experience.

In this embodiment of the present invention, according to the typesetting information of the text information in the target image, the text information can be controlled to be displayed according to the typesetting similar to that of the text information in the image. details as follows:

Referring to FIG. 2, a flowchart of steps of an optional embodiment of a data processing method of the present invention is shown, which may specifically include the following steps:

Step 202, the recording device acquires the target image.

In the embodiment of the present invention, the target image may be collected by invoking the image acquisition module set in the recording device during the process of recording audio data; or it may be acquired by invoking the image acquisition module set in the recording process independent of the recording device. is not limited in this embodiment of the present invention.

Step 204: Perform text recognition on the target image to determine corresponding text information.

Wherein, an OCR (Optical Character Recognition, Optical Character Recognition) recognition technology may be used to perform text recognition on each text of the target image to obtain text information corresponding to the target image.

Wherein, the text information includes a plurality of texts, and the texts may include characters and characters.

Step 206 , respectively record the line information corresponding to each text in the target image in the text information, and the position information of the line where each text is located.

Step 208: Generate typesetting information of the text information in the target image according to the line information and position information of each text in the text information.

Wherein, in this embodiment of the present invention, when step 204 is performed, steps 206 to 208 may be performed.

In this embodiment of the present invention, while identifying each text, the line information of the text in the target image and the position information of the text in each line can be recorded. The row information may include row serial numbers, such as row 1, row 2, etc.; and may also include row coordinates, and the row coordinates may include pixel coordinates of four vertices of the row. The position information can be represented in a variety of ways, such as: the pixel coordinates of the leftmost point of the text, the pixel coordinates of the rightmost point of the text, the pixel coordinates of the uppermost point of the text, and the lowermost point of the text. The pixel coordinates of ; where . For another example, it may also include: the coordinates of the center position of the text. Also for example, the text sequence number of the line where the text is located may be included, such as the first, the second, etc., which is not limited in this embodiment of the present invention.

In this embodiment of the present invention, a method for displaying the text information according to the typesetting information of the text information in the target image may refer to the steps

Step 210: Divide the text information into paragraphs according to the line information and position information of each text in the text information.

Step 212 , displaying the text information in paragraphs.

In this embodiment of the present invention, all the text information identified from the target image can be divided into paragraphs according to the line information and position information of each text in the text information, and the text information can be divided into multiple paragraphs. Wherein, for each text in the text information, the row where the text information is located can be determined first according to the row information of the text; and then it can be determined whether the text is the first row of the row where the text is located according to the position information of the text text. If the text is the first text of the line where it is located, it is determined whether there are at least two spaces before the text according to the position information of the text; when there are at least two spaces before the text, it can be determined that the line where the text is located is The starting line of a paragraph, the text is the starting text of the starting line of a paragraph. Then the previous line of the line where the text is located can be used as the previous paragraph of the paragraph where the text is located as the end line of the previous paragraph. The text information can then be divided into multiple paragraphs for display; the number of paragraphs displayed is the same as the number of paragraphs in the target image.

To sum up, in this embodiment of the present invention, the text information can be divided into paragraphs according to the line information and position information of each text in the text information; the text information is displayed in paragraphs; The number of paragraphs is consistent with the number of paragraphs in the target image, which is convenient for the user to clearly distinguish each paragraph, and further facilitates the user to read and understand the information in the image.

In this embodiment of the present invention, according to the typesetting information of the text information in the target image, the text information can be controlled to be displayed according to the same typesetting as the text information in the image. details as follows:

Referring to FIG. 3, a flowchart of steps of another data processing method embodiment of the present invention is shown, which may specifically include the following steps:

Step 302: The recording device acquires the target image.

Step 304: Perform text recognition on the target image to determine corresponding text information.

Step 306 , respectively record the line information corresponding to each text in the target image in the text information, and the position information of the line where each text is located.

Step 208: Generate typesetting information of the text information in the target image according to the line information and position information of each text in the text information.

Steps 302 to 308 are similar to the above-mentioned steps 202 to 308, and are not repeated here.

Step 310: Control each text in the text information to be displayed according to the same typesetting as the text in the image according to the line information and position information of each text in the text information.

Then, according to the line information and position information of each text in the text information, each text in the text information can be controlled to be displayed according to the same typesetting as the text in the image; further, the text information can be typed exactly the same as that in the target image. exhibit.

To sum up, in this embodiment of the present invention, according to the line information and position information of each text in the text information, each text in the text information can be controlled to be displayed according to the same typesetting as the text in the image; further, the displayed text can be displayed. The information, consistent with its typesetting in the target image, further facilitates the user's reading and understanding of the information in the image.

In this embodiment of the present invention, when the language corresponding to the text information in the target image is not the language that the user is proficient in, the text information in the image can also be translated to generate a translation result corresponding to the language that the user is proficient in, which is convenient for the user. User understands.

Referring to FIG. 4 , a flowchart of steps of another data processing method embodiment of the present invention is shown, which may specifically include the following steps:

Step 402: The recording device acquires the target image.

Step 404: Perform text recognition on the target image, determine corresponding text information, and determine the typesetting information of the text information in the target image.

Step 406: Display the text information according to the typesetting information of the text information in the target image.

Wherein, for steps 402 to 406, reference may be made to the foregoing embodiments, and details are not described herein again.

Step 408: Translate the text information to obtain a corresponding translation result.

Step 410: Display the translation result.

After the text information is identified, the text information can be translated to determine the corresponding translation result. The target language can be determined, and then the text information can be translated to obtain a translation result corresponding to the target language. Wherein, the target language may be a language that the user is proficient in.

In an optional embodiment of the present invention, only the translation result may be displayed without displaying the text information; the translation result and the text information may also be displayed at the same time; this is not limited in this embodiment of the present invention.

In an optional embodiment of the present invention, the translation result may be a picture translation result. The text information may be translated, and after the corresponding translated text information is determined, a picture translation result is generated based on the translated text information. Among them, the target image and the translated text information can be synthesized to generate a picture translation result. For example, the translated text information can be overlaid on the text information corresponding to the translated text information in the target image; for another example, the translated text information can be added in the target image, and the association with the text information corresponding to the translated text information location; thus, it is convenient for users to check and check. For example, when the target image is an image of a presentation, the translated text information corresponding to each line of text may be added at a position between the line of text and the next/previous line of text. For example, when the target image is an image of a menu, the translated dish name may be overlaid on the dish name corresponding to the translated dish name in the target image. Of course, it is also possible to use the translated text information to generate a new image according to the typesetting method of the text in the target image as the image translation result.

In this embodiment of the present invention, the translation result may also be a text translation result; that is, the translated text information may be directly used as the text translation result. When the translation result is a text translation result, if the translation result and the text information are displayed at the same time, the translation result and the text information can be displayed in comparison.

In an optional embodiment of the present invention, the method further includes: receiving a transmission instruction, where the transmission instruction includes at least one of the following: a sharing instruction, a forwarding instruction, and a dump instruction; to other devices; the data corresponding to the transmission instruction includes at least one of the following: target image, text information and translation result. Then the user can transmit one or more of the target image, the text information of the target image, and the translation result of the target image to other devices; it is convenient for the user to use the text information of the target image, the target image in other devices, and the translation result of the target image.

In an optional embodiment of the present invention, when the target image is collected during the recording of the target audio data by the recording device, the target image can be associated with the target audio data; the association of recorded data from multiple dimensions is realized, which is convenient for users Subsequent use of the recorded data of multiple dimensions at the same time improves user experience.

The following describes how to collect image data in the process of recording audio data, and how to associate image data with audio data.

During the recording process, the recording device receives an image acquisition instruction.

In the embodiment of the present invention, when the user needs to record, the recording function of the recording device can be turned on, and the recording device is used for recording. During the recording process, users can perform image acquisition operations when they need to record data in other dimensions, such as image materials, such as printed materials, screen projection images, etc. After the user performs the image capture operation, the corresponding recording device can receive the image capture instruction corresponding to the image capture operation.

In an example of the present invention, a user may perform an image capturing operation in a recording device, and correspondingly, the recording device may generate an image capturing instruction according to receiving an image capturing operation performed by the user.

In an example of the present invention, when the recording device is connected to other devices, the user can also execute the image capturing device in the application program corresponding to the recording device of the other device. At this time, other devices may generate image capture instructions according to the user's image capture operation; and then send the image capture instructions to the recording device.

Image acquisition is performed according to the image acquisition instruction.

Then, the recording device can call the image acquisition module to perform image acquisition according to the image acquisition instruction to obtain image data.

During the recording process, the user may perform multiple image capturing operations, and correspondingly, the recording device may receive multiple image capturing instructions. The recording device may perform an image acquisition every time an image acquisition instruction is received to obtain a corresponding image frame.

The collected image data and the recorded audio data are associated and stored.

In this embodiment of the present invention, in order to facilitate the user to use the recorded data of multiple dimensions simultaneously, after the image data is collected, the collected image data can be associated with the recorded audio data and stored in the recording device. The image data and the audio data may be associated based on the time of the collected image data and the time corresponding to the recorded audio data, which is not limited in this embodiment of the present invention.

In an example, the recording device can associate the image frame with the audio frame corresponding to the image frame obtained in the recording process after collecting an image frame; and then realize the image data obtained by the collection and the audio data obtained by the recording. to associate. In another example, the recording device may store each image frame in the image frame; and after the recording ends, associate each image frame of the image data with the corresponding audio frame in the audio data obtained by the recording.

Wherein, the way of associating each image frame with the corresponding audio frame may be as follows: for the target image frame in the image data, determine the target time stamp corresponding to the target image frame; The target audio frame with the same target time stamp; the target image frame and the target audio frame are associated.

Wherein, if the recording device associates the image frame with the audio frame corresponding to the image frame obtained in the recording process after each image frame is collected, one image frame collected each time can be used as the target image frame. If the recording device associates each image frame of the image data with the corresponding audio frame in the audio data obtained by the recording after the recording is completed, one image frame can be arbitrarily selected from the image data as the target image frame each time, until All the image frames in the image data are associated with the corresponding audio frames in the audio data.

In the embodiment of the present invention, for a target image frame, a target time stamp corresponding to the target image frame may be determined, and a target audio frame with the same time stamp as the target time stamp in the audio data obtained from the recording; The target image frame and the target audio frame are associated.

Then when the user needs to perform speech recognition on the target audio data, the target audio data can be speech recognized in combination with the target image data; thus, by combining the information associated with the target audio data, the target audio data is subjected to speech recognition, to Improve the accuracy of speech recognition.

Referring to FIG. 5 , a flow chart of the steps of another embodiment of a data processing method of the present invention is shown.

Step 502: The recording device acquires the target image.

Step 504: Perform text recognition on the target image, determine corresponding text information, and determine the typesetting information of the text information in the target image.

Step 506: Display the text information according to the typesetting information of the text information in the target image.

Step 508: Acquire target audio data, where the target audio data is associated with the target image, and the target image is collected by the recording device in the process of recording the target audio data.

Step 510: Perform speech recognition on the target audio data according to the text information, and determine a corresponding speech recognition result.

In this embodiment of the present invention, during the process of recording the target audio data by the recording device, speech recognition may be performed on the target audio data in real time. Wherein, in the process of recording the target audio data, if the recording device obtains the target image collected by the image acquisition module called therein, it can record the target audio data recorded after the target image is collected according to the text information identified on the target image. Perform speech recognition to determine the corresponding speech recognition result.

In this embodiment of the present invention, after the recording device records the target audio data, speech recognition may also be performed on the target audio data (ie, the non-real-time target audio data). Wherein, according to the text information of all the target images collected by calling the image acquisition module in the process of recording the target audio data, the target audio data can be speech recognized, and the corresponding speech recognition result can be determined; the embodiment of the present invention does not limit this. .

Wherein, the text information can be used in the speech recognition process of the target audio data to improve the accuracy of the speech recognition of the target audio data.

Of course, in this embodiment of the present invention, a transmission instruction for target audio data and/or speech recognition result may also be received, and the target audio data and/or speech recognition result are transmitted to other devices; this embodiment of the present invention does not make any limit.

To sum up, in this embodiment of the present invention, the target audio data can be obtained; then, the target audio data is subjected to speech recognition according to the text information of the target image, and the corresponding speech recognition result is determined; The target audio data is collected in the process, and the target audio data is associated with the target image, and then the accuracy of speech recognition is improved by combining the information associated with the target audio data to perform speech recognition on the target audio data.

It should be noted that, for the sake of simple description, the method embodiments are described as a series of action combinations, but those skilled in the art should know that the embodiments of the present invention are not limited by the described action sequences, because According to embodiments of the present invention, certain steps may be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

The embodiment of the present invention also provides a data processing apparatus, which is applied to a recording device.

Referring to FIG. 6 , a structural block diagram of an embodiment of a data processing apparatus of the present invention is shown, which may specifically include the following modules:

an image acquisition module 602, configured to acquire a target image;

A text recognition module 604, configured to perform text recognition on the target image, determine corresponding text information and determine the typesetting information of the text information in the target image;

The display module 606 is configured to display the text information according to the typesetting information of the text information in the target image.

Referring to FIG. 7 , a structural block diagram of an optional embodiment of a data processing apparatus of the present invention is shown.

In an optional embodiment of the present invention, the text information includes a plurality of texts, and the text recognition module 604 is configured to respectively record the line information corresponding to each text in the target image, and the position information of the line where each text is located; According to the line information and position information of each text in the text information, the typesetting information of the text information in the target image is generated.

In an optional embodiment of the present invention, the display module 606 includes:

The first typesetting display sub-module 6062 is configured to divide the text information into paragraphs according to the line information and position information of each text in the text information; and display the text information in paragraphs.

In an optional embodiment of the present invention, the display module 606 includes:

The second typesetting display sub-module 6064 is configured to control each text in the text information to display according to the same typesetting as the text in the image according to the line information and position information of each text in the text information.

In an optional embodiment of the present invention, the device further includes:

The translation module 608 is configured to translate the text information to obtain a corresponding translation result and display the translation result.

In an optional embodiment of the present invention, the translation result includes: a picture translation result and/or a text translation result.

In an optional embodiment of the present invention, the device further includes:

The data transmission module 610 is configured to receive transmission instructions, the transmission instructions include at least one of the following: a sharing instruction, a forwarding instruction, and a dump instruction; data corresponding to the transmission instruction is transmitted to other devices; the transmission instruction corresponds to The data includes at least one of the following: target image, text information and translation result.

In an optional embodiment of the present invention, the device further includes:

The speech recognition module 612 is configured to acquire target audio data, the target audio data is associated with the target image, and the target image is collected by the recording device in the process of recording the target audio data; The audio data is subjected to speech recognition, and the corresponding speech recognition result is determined.

To sum up, in the embodiment of the present invention, the text recognition function of the image can be added to the recording device; and when the user uses the recording device to perform text recognition on the target image, the recording device can obtain the target image; Identify, determine the corresponding text information and determine the typesetting information of the text information in the target image; and display the text information according to the typesetting information of the text information in the target image; and then make the displayed text information The typesetting of the image is the same as or similar to the typesetting in the target image, which is convenient for the user to read and understand the information in the image; thereby improving the user's experience.

As for the apparatus embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and reference may be made to the partial description of the method embodiment for related parts.

FIG. 8 is a structural block diagram of a recording device 800 for data processing according to an exemplary embodiment. For example, the recording device 800 may be a voice recorder, a translator pen, a translator, or the like.

8, the recording device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814 , and the communication component 816 .

The processing component 802 generally controls the overall operations of the recording device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing element 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the methods described above. Additionally, processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

Memory 804 is configured to store various types of data to support operation of recording device 800 . Examples of such data include instructions for any application or method operating on the recording device 800, contact data, phonebook data, messages, pictures, videos, and the like. Memory 804 may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.

Power component 806 provides power to the various components of recording device 800 . Power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to recording device 800 .

Multimedia component 808 includes a screen that provides an output interface between the recording device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe action. In some embodiments, the multimedia component 808 includes a front-facing camera and/or a rear-facing camera. When the recording device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each of the front and rear cameras can be a fixed optical lens system or have focal length and optical zoom capability.

Audio component 810 is configured to output and/or input audio signals. For example, audio component 810 includes a microphone (MIC) that is configured to receive external audio signals when recording device 800 is in operating modes, such as call mode, recording mode, and voice recognition mode. The received audio signal may be further stored in memory 804 or transmitted via communication component 816 . In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to: home button, volume buttons, start button, and lock button.

Sensor assembly 814 includes one or more sensors for providing status assessments of various aspects of recording device 800 . For example, the sensor component 814 can detect the on/off state of the recording device 800, the relative positioning of the components, such as the display and the keypad of the recording device 800, the sensor component 814 can also detect the recording device 800 or a recording device 800. The position of the components changes, the presence or absence of user contact with the recording device 800, the orientation or acceleration/deceleration of the recording device 800, and the temperature of the recording device 800 changes. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

Communication component 816 is configured to facilitate wired or wireless communication between recording device 800 and other devices. The recording device 800 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In one exemplary embodiment, the communication component 814 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 814 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, recording device 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmed gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation is used to perform the above method.

In an exemplary embodiment, there is also provided a non-transitory computer-readable storage medium including instructions, such as a memory 804 including instructions, executable by the processor 820 of the recording device 800 to perform the above method. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

A non-transitory computer-readable storage medium, when an instruction in the storage medium is executed by a processor of a recording device, the recording device can execute a data processing method, the method comprising: acquiring a target image by the recording device; Perform text recognition on the target image, determine corresponding text information and determine the typesetting information of the text information in the target image; display the text information according to the typesetting information of the text information in the target image.

Optionally, the text information includes a plurality of texts, and the determining the typesetting information of the text information in the target image includes: respectively recording line information corresponding to each text in the target image, and the line where each text is located. The position information of the text information; according to the line information and position information of each text in the text information, the typesetting information of the text information in the target image is generated.

Optionally, the displaying the text information according to the typesetting information of the text information in the target image includes: performing a paragraph on the text information according to the line information and position information of each text in the text information. Divide; display the textual information in paragraphs.

Optionally, displaying the text information according to the typesetting information of the text information in the target image includes: controlling each text in the text information according to the line information and position information of each text in the text information according to the The text is shown in the same typography in the image.

Optionally, the method further includes: translating the text information, obtaining a corresponding translation result, and displaying the translation result.

Optionally, the translation results include: picture translation results and/or text translation results.

Optionally, the method further includes: receiving a transmission instruction, where the transmission instruction includes at least one of the following: a sharing instruction, a forwarding instruction, and a dump instruction; transmitting the data corresponding to the transmission instruction to other devices; The data corresponding to the transmission instruction includes at least one of the following: target image, text information and translation result.

Optionally, the method further includes: acquiring target audio data, the target audio data is associated with the target image, and the target image is collected by a recording device in the process of recording the target audio data; according to the text information Perform speech recognition on the target audio data to determine a corresponding speech recognition result.

The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the various embodiments may be referred to each other.

Embodiments of the present invention are described with reference to flowcharts and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the present invention. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing terminal equipment to produce a machine that causes the instructions to be executed by the processor of the computer or other programmable data processing terminal equipment Means are created for implementing the functions specified in the flow or flows of the flowcharts and/or the blocks or blocks of the block diagrams.

These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing terminal equipment to operate in a particular manner, such that the instructions stored in the computer readable memory result in an article of manufacture comprising instruction means, the The instruction means implement the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.

These computer program instructions can also be loaded on a computer or other programmable data processing terminal equipment, so that a series of operational steps are performed on the computer or other programmable terminal equipment to produce a computer-implemented process, thereby executing on the computer or other programmable terminal equipment The instructions executed on the above provide steps for implementing the functions specified in the flowchart or blocks and/or the block or blocks of the block diagrams.

Although preferred embodiments of the embodiments of the present invention have been described, additional changes and modifications to these embodiments may be made by those skilled in the art once the basic inventive concepts are known. Therefore, the appended claims are intended to be construed to include the preferred embodiment as well as all changes and modifications that fall within the scope of the embodiments of the present invention.

Finally, it should also be noted that in this document, relational terms such as first and second are used only to distinguish one entity or operation from another, and do not necessarily require or imply these entities or there is any such actual relationship or sequence between operations. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion such that a process, method, article or terminal device that includes a list of elements includes not only those elements, but also a non-exclusive list of elements. other elements, or also include elements inherent to such a process, method, article or terminal equipment. Without further limitation, an element defined by the phrase "comprises a..." does not preclude the presence of additional identical elements in the process, method, article, or terminal device that includes the element.

A data processing method, a data processing device and a recording device provided by the present invention have been described in detail above. Specific examples are used in this paper to illustrate the principles and implementations of the present invention. The description is only used to help understand the method of the present invention and its core idea; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific embodiments and application scope. , the contents of this specification should not be construed as limiting the invention.

Claims (10)

1. a data processing method, is characterized in that, comprises: The recording device obtains the target image; Perform text recognition on the target image, determine the corresponding text information and determine the typesetting information of the text information in the target image; The text information is displayed according to the typesetting information of the text information in the target image. 2. The method according to claim 1, wherein the text information comprises a plurality of texts, and the determining the typesetting information of the text information in the target image comprises: Record the line information corresponding to each text in the target image in the text information, and the position information of the line where each text is located; According to the line information and position information of each text in the text information, the typesetting information of the text information in the target image is generated. 3. The method according to claim 2, wherein the displaying the text information according to the typesetting information of the text information in the target image comprises: According to the line information and position information of each text in the text information, the text information is divided into paragraphs; The textual information is presented in paragraphs. 4. The method according to claim 2, wherein the displaying the text information according to the typesetting information of the text information in the target image comprises: According to the line information and position information of each text in the text information, each text in the text information is controlled to be displayed according to the same typesetting as the text in the image. 5. The method according to claim 1, wherein the method further comprises: Translate the text information to obtain a corresponding translation result and display the translation result. 6. The method according to claim 5, wherein the translation result comprises: a picture translation result and/or a text translation result. 7. The method according to claim 5, wherein the method further comprises: receiving a transmission instruction, where the transmission instruction includes at least one of the following: a sharing instruction, a forwarding instruction, and a dumping instruction; The data corresponding to the transmission instruction is transmitted to other devices; the data corresponding to the transmission instruction includes at least one of the following: target image, text information and translation result. 8. A data processing device, characterized in that, applied in a recording device, comprising: The image acquisition module is used to acquire the target image; a text recognition module, configured to perform text recognition on the target image, determine corresponding text information and determine the typesetting information of the text information in the target image; The display module is configured to display the text information according to the typesetting information of the text information in the target image. 9. A recording device comprising a memory and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors. More than one program contains instructions to: Get the target image; Perform text recognition on the target image, determine the corresponding text information and determine the typesetting information of the text information in the target image; The text information is displayed according to the typesetting information of the text information in the target image. 10. A readable storage medium, characterized in that, when the instructions in the storage medium are executed by a processor of a recording device, the recording device is enabled to execute the data processing method according to any one of method claims 1-7 .

Images