[go: up one dir, main page]

CN111833917A - Information interaction method, readable storage medium and electronic device - Google Patents

Information interaction method, readable storage medium and electronic device Download PDF

Info

Publication number
CN111833917A
CN111833917A CN202010621911.1A CN202010621911A CN111833917A CN 111833917 A CN111833917 A CN 111833917A CN 202010621911 A CN202010621911 A CN 202010621911A CN 111833917 A CN111833917 A CN 111833917A
Authority
CN
China
Prior art keywords
control
audio
mark
sub
audio stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010621911.1A
Other languages
Chinese (zh)
Inventor
唐毅
刘璨
乌尼尔
姜鹏
任凯
王峰
邓明灿
苗海强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Impression Notebook Technology Co ltd
Original Assignee
Beijing Impression Notebook Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Impression Notebook Technology Co ltd filed Critical Beijing Impression Notebook Technology Co ltd
Priority to CN202010621911.1A priority Critical patent/CN111833917A/en
Publication of CN111833917A publication Critical patent/CN111833917A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B20/10527Audio or video recording; Data buffering arrangements
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B20/10527Audio or video recording; Data buffering arrangements
    • G11B2020/10537Audio or video recording
    • G11B2020/10546Audio or video recording specifically adapted for audio data

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Management Or Editing Of Information On Record Carriers (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The embodiment of the invention discloses an information interaction method, a readable storage medium and electronic equipment. And in the audio recording process, inserting marks at corresponding positions of the recorded audio stream according to the time point when the first audio mark sub-control is triggered. And storing the audio stream and each mark when the audio recording is finished, and displaying a playing editing control in the note editor page so as to further display the audio stream and the mark in the playing editing control. The embodiment of the invention can insert the audio file in the note editing process and mark the specific position of the corresponding audio stream so as to facilitate the user to determine the position of important information in the audio file.

Description

信息交互方法、可读存储介质和电子设备Information interaction method, readable storage medium and electronic device

技术领域technical field

本发明涉及计算机技术领域,尤其涉及一种信息交互方法、可读存储介质和电子设备。The present invention relates to the field of computer technology, and in particular, to an information interaction method, a readable storage medium and an electronic device.

背景技术Background technique

目前随着互联网的发展,工作、生活、学习中的很多应用场景可以在线上完成。随之而来地,越来越多的人选择通过笔记软件辅助学习或工作,以提高效率。而目前的笔记软件功能单一,通常仅包括记录文字,以及插入表格、图片等常规功能。在目前终端设备功能多样化的前提下,简单的功能难以发挥在线笔记的优势。At present, with the development of the Internet, many application scenarios in work, life and study can be completed online. Subsequently, more and more people choose to use note-taking software to assist their study or work to improve efficiency. The current note-taking software has a single function, usually only including recording text, and inserting tables, pictures and other conventional functions. Under the premise of diversified functions of current terminal devices, it is difficult to take advantage of online note taking with simple functions.

发明内容SUMMARY OF THE INVENTION

有鉴于此,本发明实施例提供了一种信息交互方法、可读存储介质和电子设备,旨在实现在笔记编辑的过程中插入音频文件,以及在对应音频流的特定位置进行标记。In view of this, the embodiments of the present invention provide an information interaction method, a readable storage medium, and an electronic device, aiming at inserting an audio file and marking a specific position of the corresponding audio stream during the note editing process.

第一方面,本发明实施例提供了一种信息交互方法,所述方法包括:In a first aspect, an embodiment of the present invention provides an information interaction method, and the method includes:

在笔记编辑器页面中显示音频插入控件;Show audio insert controls in the note editor page;

响应于音频插入控件被触发,显示音频录制控件,所述音频录制控件具有第一音频标记子控件;In response to the audio insert control being triggered, displaying an audio recording control, the audio recording control having a first audio marker sub-control;

在音频录制过程中,响应于所述第一音频标记子控件被触发,在录制的音频流的对应时间点插入标记,所述标记用于表征所述音频流的被标记位置;In the audio recording process, in response to the first audio marker sub-control being triggered, a marker is inserted at the corresponding time point of the recorded audio stream, and the marker is used to represent the marked position of the audio stream;

响应于音频录制结束,保存所述音频流和所述标记,并在所述笔记编辑器页面中显示播放编辑控件;In response to the audio recording ending, saving the audio stream and the markup, and displaying a playback edit control in the note editor page;

在所述播放编辑控件中显示所述音频流和所述标记。The audio stream and the marker are displayed in the play edit control.

进一步地,在所述播放编辑控件中显示所述音频流和所述标记具体为:Further, displaying the audio stream and the mark in the playback editing control is specifically:

在所述播放编辑控件中显示带有至少一个标记的音频流的时域波形,并在时间线对应的位置显示各所述标记对应的图标。The time-domain waveform of the audio stream with at least one marker is displayed in the playback editing control, and an icon corresponding to each marker is displayed at a position corresponding to the timeline.

进一步地,所述播放编辑控件包括标记编辑子控件;Further, the playback editing control includes a mark editing sub-control;

所述方法还包括:The method also includes:

通过所述标记编辑子控件接收对于选中标记的标记附注信息;Receive mark annotation information for the selected mark through the mark editing sub-control;

将所述标记附注信息与对应的标记绑定存储并显示。The tag annotation information is bound, stored and displayed with the corresponding tag.

进一步地,通过所述标记编辑子控件接收对于选中标记的标记附注信息包括:Further, receiving the mark annotation information for the selected mark through the mark editing sub-control includes:

以列表方式在所述标记编辑子控件中显示各所述标记的标记附注信息;Displaying the tag annotation information of each of the tags in the tag editing sub-control in a list manner;

响应于选定操作,确定被选定的标记,并激活所述选定标记的标记附注信息;In response to the selection operation, determining the selected markup and activating markup annotation information for the selected markup;

接收对于标记附注信息的输入信息。Receives input information for tagging annotation information.

进一步地,所述选定操作为对于所述时间线上的图标的选定;或者Further, the selection operation is selection of an icon on the timeline; or

所述选定操作为对于标记附注信息的选定。The selection operation is selection of tag annotation information.

进一步地,所述播放编辑控件具有第二音频标记子控件;Further, the playback editing control has a second audio marker sub-control;

所述方法还包括:The method also includes:

响应于所述第二音频标记子控件被触发,在所述播放编辑控件显示的音频流中对应的时间点插入标记。In response to the second audio marker sub-control being triggered, a marker is inserted at a corresponding time point in the audio stream displayed by the play edit control.

进一步地,所述方法还包括:Further, the method also includes:

在音频录制过程中,在所述音频录制控件上显示所录制的音频流的时域波形;以及During audio recording, displaying the time domain waveform of the recorded audio stream on the audio recording control; and

与所述时域波形同步地显示各所述标记对应的图标。An icon corresponding to each of the marks is displayed in synchronization with the time-domain waveform.

进一步地,所述方法还包括:Further, the method also includes:

响应于笔记同步指令,将笔记编辑器页面数据保存到云端,所述笔记编辑器页面数据包括所述音频流、所述标记和所述标记附注信息。In response to the note synchronization instruction, note editor page data is saved to the cloud, and the note editor page data includes the audio stream, the markup, and the markup annotation information.

第二方面,本发明实施例提供了一种计算机可读存储介质,用于存储计算机程序指令,所述计算机程序指令在被处理器执行时实现如第一方面中任一项所述的方法。In a second aspect, embodiments of the present invention provide a computer-readable storage medium for storing computer program instructions, the computer program instructions implementing the method according to any one of the first aspects when executed by a processor.

第三方面,本发明实施例提供了一种电子设备,包括存储器和处理器,所述存储器用于存储一条或多条计算机程序指令,其中,所述一条或多条计算机程序指令被所述处理器执行以实现如第一方面中任一项所述的方法。In a third aspect, an embodiment of the present invention provides an electronic device, including a memory and a processor, where the memory is configured to store one or more computer program instructions, wherein the one or more computer program instructions are processed by the The processor executes to implement the method of any one of the first aspects.

本发明实施例通过在笔记编辑器页面中显示的音频插入控件被触发时,显示具有第一音频标记子控件的音频录制控件。在音频录制过程中,根据第一音频标记子控件被触发的时间点在录制音频流的对应位置插入标记。在音频录制结束时保存音频流和各标记,在所述笔记编辑器页面中显示播放编辑控件,以进一步在播放编辑控件中显示音频流和标记。本发明实施例可以在笔记编辑的过程中插入音频文件,并在对应音频流的特定位置进行标记,以便于用户确定音频文件中重要信息所在位置。The embodiment of the present invention displays an audio recording control having a first audio mark sub-control when the audio insertion control displayed in the note editor page is triggered. During the audio recording process, a marker is inserted at the corresponding position of the recorded audio stream according to the time point when the first audio marker sub-control is triggered. The audio stream and markers are saved at the end of the audio recording, and a play edit control is displayed in the note editor page to further display the audio stream and markers in the play edit control. In the embodiment of the present invention, an audio file can be inserted in the process of editing a note, and a specific position corresponding to the audio stream can be marked, so as to facilitate the user to determine the position of important information in the audio file.

附图说明Description of drawings

通过以下参照附图对本发明实施例的描述,本发明的上述以及其它目的、特征和优点将更为清楚,在附图中:The above and other objects, features and advantages of the present invention will become more apparent from the following description of embodiments of the present invention with reference to the accompanying drawings, in which:

图1为应用本发明实施例的信息交互方法的信息交互系统的示意图;FIG. 1 is a schematic diagram of an information interaction system applying an information interaction method according to an embodiment of the present invention;

图2为本发明实施例的笔记编辑器页面示意图;2 is a schematic diagram of a note editor page according to an embodiment of the present invention;

图3为本发明实施例的在线笔记传输的示意图;3 is a schematic diagram of online note transmission according to an embodiment of the present invention;

图4为本发明实施例的信息交互方法的流程图;4 is a flowchart of an information interaction method according to an embodiment of the present invention;

图5为本发明实施例插入音频过程笔记编辑器页面的示意图;5 is a schematic diagram of inserting an audio process note editor page according to an embodiment of the present invention;

图6为本发明实施例录制音频过程笔记编辑器页面的示意图;6 is a schematic diagram of an audio recording process note editor page according to an embodiment of the present invention;

图7为本发明实施例音频录制结束笔记编辑器页面的示意图;7 is a schematic diagram of an audio recording end note editor page according to an embodiment of the present invention;

图8为本发明实施例具有标记附注信息的笔记编辑器页面的示意图;8 is a schematic diagram of a note editor page with marked annotation information according to an embodiment of the present invention;

图9为本发明实施例的电子设备的示意图。FIG. 9 is a schematic diagram of an electronic device according to an embodiment of the present invention.

具体实施方式Detailed ways

以下基于实施例对本发明进行描述,但是本发明并不仅仅限于这些实施例。在下文对本发明的细节描述中,详尽描述了一些特定的细节部分。对本领域技术人员来说没有这些细节部分的描述也可以完全理解本发明。为了避免混淆本发明的实质,公知的方法、过程、流程、元件和电路并没有详细叙述。The present invention is described below based on examples, but the present invention is not limited to these examples only. In the following detailed description of the invention, some specific details are described in detail. The present invention can be fully understood by those skilled in the art without the description of these detailed parts. Well-known methods, procedures, procedures, components and circuits have not been described in detail in order to avoid obscuring the essence of the present invention.

此外,本领域普通技术人员应当理解,在此提供的附图都是为了说明的目的,并且附图不一定是按比例绘制的。Furthermore, those of ordinary skill in the art will appreciate that the drawings provided herein are for illustrative purposes and are not necessarily drawn to scale.

除非上下文明确要求,否则在说明书的“包括”、“包含”等类似词语应当解释为包含的含义而不是排他或穷举的含义;也就是说,是“包括但不限于”的含义。Unless clearly required by the context, words such as "including", "comprising" and the like in the specification should be construed in an inclusive rather than an exclusive or exhaustive sense; that is, in the sense of "including but not limited to".

在本发明的描述中,需要理解的是,术语“第一”、“第二”等仅用于描述目的,而不能理解为指示或暗示相对重要性。此外,在本发明的描述中,除非另有说明,“多个”的含义是两个或两个以上。In the description of the present invention, it should be understood that the terms "first", "second" and the like are used for descriptive purposes only, and should not be construed as indicating or implying relative importance. Also, in the description of the present invention, unless otherwise specified, "plurality" means two or more.

图1为应用本发明实施例的信息交互方法的信息交互系统的示意图,如图1所示,所述信息交互系统包括第一终端设备11,所述第一终端设备11可以是能够运行计算机程序的、具有通信功能通用数据处理终端,例如,智能手机、平板电脑或笔记本电脑等。FIG. 1 is a schematic diagram of an information interaction system applying an information interaction method according to an embodiment of the present invention. As shown in FIG. 1 , the information interaction system includes a first terminal device 11, and the first terminal device 11 may be capable of running a computer program , general-purpose data processing terminals with communication functions, such as smart phones, tablet computers or notebook computers, etc.

所述终端设备11可以通过预设的I/O通信接口与用户10进行人机交互。所述人机交互过程为通过第一终端设备11的显示界面显示包括音频插入控件的笔记编辑器页面,用户10触发所述音频插入控件以向笔记编辑器页面插入音频流和对音频流至少一个时间点的标记,并通过笔记编辑器页面显示播放编辑控件,以在所述播放编辑控件中显示所述音频流和所述标记。The terminal device 11 can perform man-machine interaction with the user 10 through a preset I/O communication interface. The human-computer interaction process is to display a note editor page including an audio insertion control through the display interface of the first terminal device 11, and the user 10 triggers the audio insertion control to insert an audio stream into the note editor page and at least one of the audio streams. mark the time point, and display the playback edit control through the note editor page to display the audio stream and the mark in the playback edit control.

进一步地,所述信息交互系统还可以包括通过网络与用户10对应账号登录笔记编辑器的第一终端设备11的服务器12,所述服务器12可以是单个服务器、也可以是以分布式方式配置的服务器集群。所述服务器12用于存储所述第一终端设备11与用户10进行人机交互的结果,即最终保存的包括音频流和各标记的笔记编辑器页面,用于用户在更换终端设备11时也可以通过服务器10获取到已存储的笔记编辑器页面。进一步地,所述服务器12还可以存储第一终端设备11与用户10进行人机交互的过程,用于在出现故障信息时对故障操作进行定位。Further, the information interaction system may further include a server 12 for logging in to the first terminal device 11 of the note editor with the account corresponding to the user 10 through the network. The server 12 may be a single server or may be configured in a distributed manner. Server cluster. The server 12 is used to store the result of the human-computer interaction between the first terminal device 11 and the user 10 , that is, the final saved note editor page including the audio stream and each mark, which is used for the user to change the terminal device 11 . The stored note editor pages can be obtained through the server 10 . Further, the server 12 may also store a process of human-computer interaction between the first terminal device 11 and the user 10, so as to locate the fault operation when fault information occurs.

在本发明实施例中,用户10可以通过在所述笔记编辑器注册对应账号的方式与所述笔记编辑器绑定,以实现用户10记录的在线笔记在不同终端设备之间的迁移。例如,当用户10先通过第一终端设备11登录笔记编辑器,并记录在线笔记后,又通过第二终端设备13登录笔记编辑器,可以通过用户10对应的账号将在第一终端设备11记录的在线笔记迁移至第二终端设备13,以供用户进行浏览、查阅、编辑等操作。In this embodiment of the present invention, the user 10 may bind with the note editor by registering a corresponding account in the note editor, so as to realize the migration of online notes recorded by the user 10 between different terminal devices. For example, when the user 10 first logs in to the note editor through the first terminal device 11 and records online notes, and then logs in to the note editor through the second terminal device 13, the user 10 can use the account corresponding to the user 10 to record in the first terminal device 11. The online notes are migrated to the second terminal device 13 for the user to browse, view, edit and other operations.

图2为本发明实施例的笔记编辑器页面示意图。如图2所示,所述笔记编辑器页面20中包括用于输入文本内容的文本输入控件21,以及用于插入音频、视频、图片、表格等不同格式的文件附件的附件插入控件22。同时,为保证用户在所述笔记编辑器记录的在线笔记不会在不同终端设备的迁移过程中丢失,所述笔记编辑器页面中还包括用于登录用户账号的用户登录控件23,用户可以通过在不同终端设备触发用户登录控件23获取历史在任意终端设备记录的在线笔记。FIG. 2 is a schematic diagram of a note editor page according to an embodiment of the present invention. As shown in FIG. 2 , the note editor page 20 includes a text input control 21 for inputting text content, and an attachment insertion control 22 for inserting file attachments in different formats such as audio, video, pictures, and tables. At the same time, in order to ensure that the online notes recorded by the user in the note editor will not be lost during the migration process of different terminal devices, the note editor page also includes a user login control 23 for logging in to the user account. Trigger the user login control 23 on different terminal devices to obtain the online notes recorded in any terminal device.

进一步地,所述笔记编辑页面20中还包括用于不同用户分享在线笔记的笔记分享控件24。当所述笔记分享控件24被触发时,可以向其他终端设备发送对应的在线笔记。其中,所述接收在线笔记的终端设备可以为其他用户登录的终端设备、发送在线笔记的用户登录的终端设备以及无用户登录的终端设备。Further, the note editing page 20 also includes a note sharing control 24 for different users to share online notes. When the note sharing control 24 is triggered, corresponding online notes can be sent to other terminal devices. The terminal device for receiving online notes may be a terminal device logged in by other users, a terminal device logged in by a user sending online notes, and a terminal device without user login.

图3为本发明实施例的在线笔记传输的示意图。如图3所示,当第一用户30和第二用户31分别通过对应的第一用户终端32和第二用户终端33登录笔记编辑器。所述第一用户30和所述第二用户31可以通过触发笔记编辑页面中的笔记分享控件,在第一用户终端32和第二终端设备33之间传送在线笔记。FIG. 3 is a schematic diagram of online note transmission according to an embodiment of the present invention. As shown in FIG. 3 , when the first user 30 and the second user 31 log into the note editor through the corresponding first user terminal 32 and the second user terminal 33 respectively. The first user 30 and the second user 31 can transmit online notes between the first user terminal 32 and the second terminal device 33 by triggering the note sharing control in the note editing page.

具体地,所述第一用户30触发所述第一用户终端32显示的笔记编辑页面中的笔记分享控件时,所述第一用户终端32可以向所述第二用户终端33传输所述笔记分享控件所在笔记编辑页面显示的在线笔记。所述第二用户31触发所述第二用户终端33显示的笔记编辑页面中的笔记分享控件时,所述第二用户终端33可以向所述第一用户终端32传输所述笔记分享控件所在笔记编辑页面显示的在线笔记。Specifically, when the first user 30 triggers the note sharing control in the note editing page displayed by the first user terminal 32 , the first user terminal 32 may transmit the note sharing to the second user terminal 33 The online note displayed on the note editing page where the control is located. When the second user 31 triggers the note sharing control in the note editing page displayed by the second user terminal 33, the second user terminal 33 may transmit the note where the note sharing control is located to the first user terminal 32. Edit the online notes displayed on the page.

图4为本发明实施例的信息交互方法的流程图。如图4所示,所述方法包括:FIG. 4 is a flowchart of an information interaction method according to an embodiment of the present invention. As shown in Figure 4, the method includes:

步骤S100、在笔记编辑器页面中显示音频插入控件。Step S100, displaying an audio insertion control on the note editor page.

具体地,所述笔记编辑器页面为笔记编辑器的前端页面,通过安装所述笔记编辑器的终端设备显示界面显示。在本发明实施例中,所述笔记编辑器页面中还显示音频插入控件,用于在被用户触发时向所述笔记编辑器页面中插入音频格式的数据信息。所述音频插入控件可以包括至少一个对应于不同音频插入方式的音频插入子控件,各所述音频插入子控件可以通过点击的方式触发。以所述音频插入控件包括录制子控件和上传子控件为例进行说明。在所述音频录制子控件被触发时,显示对应的音频录制控件,以在编辑笔记内容的过程中进行音频录制。在所述上传子控件被触发时,显示对应的音频上传控件,以向所述笔记编辑器页面中插入预先录制完成的音频。可选地,所述笔记编辑器页面中还可以用于文本输入控件,以及其他信息插入控件,例如图片插入控件、视频插入控件、附件插入控件等,分别用于向所述笔记编辑器页面插入对应格式的数据。Specifically, the note editor page is a front-end page of the note editor, and is displayed on a display interface of a terminal device on which the note editor is installed. In this embodiment of the present invention, an audio insertion control is also displayed on the note editor page, which is used to insert data information in audio format into the note editor page when triggered by the user. The audio insertion control may include at least one audio insertion sub-control corresponding to different audio insertion modes, and each of the audio insertion sub-controls may be triggered by clicking. The audio insertion control includes a recording sub-control and an uploading sub-control as an example for description. When the audio recording sub-control is triggered, the corresponding audio recording control is displayed, so as to perform audio recording in the process of editing the note content. When the uploading sub-control is triggered, the corresponding audio uploading control is displayed to insert the pre-recorded audio into the note editor page. Optionally, the note editor page can also be used for text input controls, and other information insertion controls, such as picture insertion controls, video insertion controls, attachment insertion controls, etc., for inserting into the note editor page respectively. data in the corresponding format.

图5为本发明实施例插入音频过程笔记编辑器页面的示意图。如图5所示,所述笔记编辑器页面50通过显示界面显示,用于接收用户通过人机交互端口输入的笔记内容。所述笔记内容包括文本数据和插入数据,所述文本数据可以通过文本输入控件51接收,并显示在笔记内容中,所述插入数据可以通过用户触发插入数据控件52的方式插入所述笔记内容中。FIG. 5 is a schematic diagram of inserting an audio process note editor page according to an embodiment of the present invention. As shown in FIG. 5 , the note editor page 50 is displayed through a display interface, and is used for receiving the note content input by the user through the human-computer interaction port. The note content includes text data and insert data, the text data can be received through the text input control 51 and displayed in the note content, and the insert data can be inserted into the note content by triggering the insert data control 52 by the user. .

在本发明实施例中,所述插入数据控件52中包括素材插入子控件、附件插入子控件、图片插入子控件、音频插入子控件和视频插入子控件。用户通过触发所述插入数据控件52中的插入子控件向笔记内容中插入对应格式的插入数据。进一步地,所述插入数据控件中各插入子控件被触发时,还可以显示各插入子控件对应的用于选择数据插入方式/规则的控件。例如,当音频插入子控件被触发时,所述笔记编辑器页面中显示音频录制子控件53和音频上传子控件54。所述音频录制子控件53用于在被触发时,插入在编辑笔记内容的过程中录制的音频。所述音频上传子控件54用于在被触发时,插入在编辑笔记内容之前预先录制完成的音频。In this embodiment of the present invention, the data insertion control 52 includes a material insertion sub-control, an attachment insertion sub-control, a picture insertion sub-control, an audio insertion sub-control, and a video insertion sub-control. The user inserts the insert data of the corresponding format into the note content by triggering the insert sub-control in the insert data control 52 . Further, when each inserting sub-control in the inserting data control is triggered, a control corresponding to each inserting sub-control for selecting a data inserting mode/rule may also be displayed. For example, when the audio insertion sub-control is triggered, the audio recording sub-control 53 and the audio uploading sub-control 54 are displayed in the note editor page. The audio recording sub-control 53 is used to insert the audio recorded in the process of editing the note content when triggered. The audio upload sub-control 54 is used to insert the pre-recorded audio before editing the note content when triggered.

步骤S200、响应于音频插入控件被触发,显示音频录制控件。Step S200, in response to the audio insertion control being triggered, displaying the audio recording control.

具体地,所述音频插入控件可以通过用户点击的方式触发。当所述音频插入控件被触发时,在所述笔记编辑器页面显示音频录制控件,用于在通过所述笔记编辑器页面编辑笔记内容的过程中录制音频数据。其中,所述音频录制控件具有第一音频标记子控件,用于在音频录制过程中基于用户触发时刻对录音过程中记录的音频流进行标记。在本发明实施例中,所述音频录制控件可以在显示时即开始录音过程,直到满足预设条件时结束,或通过具有特定功能的子控件由用户控制录音过程。例如,所述音频录制控件还可以包括开始录制子控件和结束录制子控件。当用户触发所述开始录制子控件时,所述笔记编辑器调用终端设备的录音装置以开始进行录音,当用户触发所述结束录制子控件时,停止录音过程以得到录制完成的音频数据。Specifically, the audio insertion control may be triggered by a user clicking. When the audio insertion control is triggered, an audio recording control is displayed on the note editor page for recording audio data in the process of editing the note content through the note editor page. Wherein, the audio recording control has a first audio marking sub-control, which is used to mark the audio stream recorded in the recording process based on the user trigger moment during the audio recording process. In this embodiment of the present invention, the audio recording control may start the recording process when displayed and end when a preset condition is met, or the user may control the recording process through a sub-control with a specific function. For example, the audio recording control may further include a start recording sub-control and an end recording sub-control. When the user triggers the start recording sub-control, the note editor calls the recording device of the terminal device to start recording, and when the user triggers the end recording sub-control, the recording process is stopped to obtain the recorded audio data.

步骤S300、在音频录制过程中,响应于所述第一音频标记子控件被触发,在录制的音频流的对应时间点插入标记。Step S300: During the audio recording process, in response to the first audio marker sub-control being triggered, insert a marker at a corresponding time point of the recorded audio stream.

具体地,在音频插入控件被触发,以通过笔记编辑器进行音频录制的过程中,录制用于承载接收到声音信息的音频流。在所述录制音频流的过程中,当所述音频插入控件中的第一音频标记子控件被触发时,在录制的音频流的对应时间点插入标记。即确定所述第一音频标记子控件被触发的时刻,所述音频流上相同时刻记录的信息位置插入标记。例如,当用户在开始录制16s时点击所述第一音频标记子控件,在所述音频流的00:16位置插入对应的标记。所述标记用于表征所述音频流的被标记位置,通常用于标记所述音频流中的重要信息所在位置,以在后期进行笔记查找、阅读、信息整理以及音频处理的过程中进行快速的信息定位。Specifically, in a process in which the audio insertion control is triggered to perform audio recording through the note editor, an audio stream for carrying the received sound information is recorded. In the process of recording the audio stream, when the first audio marker sub-control in the audio insertion control is triggered, a marker is inserted at a corresponding time point of the recorded audio stream. That is, the moment when the first audio marker sub-control is triggered is determined, and a marker is inserted into the information position recorded at the same moment on the audio stream. For example, when the user clicks the first audio marker sub-control when the recording starts for 16s, a corresponding marker is inserted at the 00:16 position of the audio stream. The mark is used to represent the marked position of the audio stream, and is usually used to mark the position of important information in the audio stream, so as to quickly perform note searching, reading, information sorting and audio processing in the later stage. Information location.

进一步地,在所述音频录制过程中,所述笔记编辑器页面上的音频录制控件上还显示所录制的音频流的时域波形,以及与所述时域波形同步地显示各所述标记对应的图标,所述图标显示在所述音频流中插入标记的位置。用户可以根据所述音频流时域波形的波动情况判定音频是否录制成功,还可以在触发第一音频标记子控件后,根据时域波形上对应时刻是否显示图标判断是否标记成功。Further, during the audio recording process, the audio recording control on the note editor page also displays the time-domain waveform of the recorded audio stream, and displays the corresponding markers synchronously with the time-domain waveform. , which shows the location where the marker was inserted in the audio stream. The user can determine whether the audio is recorded successfully according to the fluctuation of the time-domain waveform of the audio stream, and can also determine whether the marking is successful according to whether an icon is displayed at the corresponding time on the time-domain waveform after triggering the first audio marker sub-control.

图6为本发明实施例录制音频过程笔记编辑器页面的示意图。如图6所示,用户触发音频插入控件后所述笔记编辑器页面60上显示音频录制控件61,开始进行音频录制过程。所述音频录制控件61中包括第一音频标记子控件62,用于在音频录制过程中在音频流的对应时间点插入标记。进一步地,所述音频录制控件61还用于显示音频录制过程中录制的音频流的时域波形63,以及与所述时域波形63同步地显示各所述标记对应的图标64。FIG. 6 is a schematic diagram of an audio recording process note editor page according to an embodiment of the present invention. As shown in FIG. 6, after the user triggers the audio insertion control, an audio recording control 61 is displayed on the note editor page 60, and the audio recording process starts. The audio recording control 61 includes a first audio mark sub-control 62 for inserting a mark at a corresponding time point in the audio stream during the audio recording process. Further, the audio recording control 61 is further configured to display the time domain waveform 63 of the audio stream recorded in the audio recording process, and display the icon 64 corresponding to each mark in synchronization with the time domain waveform 63 .

可选地,所述音频录制控件61中还包括开始录制子控件65和结束录制子控件66。当所述开始录制子控件65被触发时开始录制音频流,当所述结束录制子控件66被触发时完成音频流录制过程。Optionally, the audio recording control 61 further includes a start recording sub-control 65 and an end recording sub-control 66 . The audio stream recording starts when the start recording sub-control 65 is triggered, and the audio stream recording process is completed when the end recording sub-control 66 is triggered.

步骤S400、响应于音频录制结束,保存所述音频流和所述标记,并在所述笔记编辑器页面中显示播放编辑控件。Step S400, in response to the end of the audio recording, save the audio stream and the mark, and display a playback edit control on the note editor page.

具体地,在音频录制结束后,通过所述笔记编辑器保存录制的音频流和在音频流录制过程中插入的至少一个标记。同时,在所述笔记编辑器页面中显示播放编辑控件,以通过所述播放编辑控件对录制的音频流进行编辑或播放。可选地,本发明实施例中的音频录制过程可以通过用户触发音频录制控件中的结束录制子控件结束,或在录制过程满足预设条件时停止录制。所述预定条件例如可以是设定录制时长,当录制时间满足预设的录制时长时结束录制过程。Specifically, after the audio recording ends, the recorded audio stream and at least one mark inserted during the recording of the audio stream are saved by the note editor. At the same time, a playback editing control is displayed on the note editor page, so that the recorded audio stream can be edited or played through the playback editing control. Optionally, the audio recording process in this embodiment of the present invention may be ended by triggering the end recording sub-control in the audio recording control by the user, or the recording may be stopped when the recording process satisfies a preset condition. The predetermined condition may be, for example, setting the recording duration, and ending the recording process when the recording duration meets the preset recording duration.

在本发明实施例的一个可选地实现方式中,所述音频插入控件中还包括上传子控件。用户触发所述上传子控件,以向所述笔记编辑器页面中插入预先录制完成的音频数据时,所述笔记编辑器页面中也显示播放编辑控件,以通过所述播放编辑控件对用户上传的音频数据对应的音频流进行编辑或播放。In an optional implementation manner of the embodiment of the present invention, the audio insertion control further includes an upload sub-control. When the user triggers the upload sub-control to insert pre-recorded audio data into the note editor page, the note editor page also displays a playback edit control, so as to use the playback edit control to upload the audio data uploaded by the user. Edit or play the audio stream corresponding to the audio data.

步骤S500、在所述播放编辑控件中显示所述音频流和所述标记。Step S500, displaying the audio stream and the mark in the playback editing control.

具体地,在所述笔记编辑页面中显示播放编辑控件的同时,在所述播放编辑控件中显示所述音频流和所述标记。以便于通过所述播放编辑控件对所述音频流和音频流上插入的标记进行编辑,以及控制所述音频流的播放过程。其中,所述播放编辑控件中以时域波形的形式显示录制完成的音频流或用户上传的音频数据对应的音频流,即展示所述音频流在时间线上的变化。同时,在所述音频流的时间线上对应的位置显示各所述标记对应的图标。可选地,播放编辑控件中还可以仅展示音频流对应的时间线,并直接在所述时间线上对应的位置显示各所述标记对应的图标。Specifically, the audio stream and the mark are displayed in the playback editing control while the playback editing control is displayed in the note editing page. In order to edit the audio stream and the mark inserted on the audio stream through the playback editing control, and control the playback process of the audio stream. Wherein, the playback editing control displays the recorded audio stream or the audio stream corresponding to the audio data uploaded by the user in the form of a time domain waveform, that is, displays the change of the audio stream on the timeline. At the same time, icons corresponding to the marks are displayed at corresponding positions on the timeline of the audio stream. Optionally, only the timeline corresponding to the audio stream may be displayed in the playback editing control, and icons corresponding to the marks are directly displayed at the corresponding positions on the timeline.

在本发明实施例中,所述播放编辑控件中还包括第二音频标记子控件,用于在音频录制结束后向所述音频流中插入标记。在本发明实施例的一个可选地实现方式中,所述插入标记的过程可以在通过所述播放编辑控件播放所述音频流的过程中完成。即在所述音频流的播放过程中,所述第二音频标记子控件被触发时,在所述播放编辑控件显示的音频流中对应的时间点插入标记。在本发明实施例另一个可选地实现方式中,所述插入标记的过程可以为直接选中所述音频流中对应的时间点,再触发所述第二音频标记子控件以在选中的时间点插入标记。In this embodiment of the present invention, the playback editing control further includes a second audio marker sub-control, which is used to insert a marker into the audio stream after the audio recording ends. In an optional implementation manner of the embodiment of the present invention, the process of inserting a marker may be completed during the process of playing the audio stream through the playback editing control. That is, during the playback of the audio stream, when the second audio marker sub-control is triggered, a marker is inserted at a corresponding time point in the audio stream displayed by the playback edit control. In another optional implementation manner of the embodiment of the present invention, the process of inserting a marker may be to directly select a corresponding time point in the audio stream, and then trigger the second audio marker sub-control to select a time point at the selected time point. Insert marker.

图7为本发明实施例音频录制结束笔记编辑器页面的示意图。如图7所示,音频录制结束后或上传后,所述笔记编辑器页面中显示播放编辑控件70,并在所述播放编辑控件70中显示音频流对应的时域波形71或直接显示所述音频流对应的时间线。同时,所述播放编辑控件70中还用于显示所述时间线上对应的位置在音频录制过程中插入的各标记对应的图标72。FIG. 7 is a schematic diagram of an audio recording end note editor page according to an embodiment of the present invention. As shown in FIG. 7 , after the audio recording is completed or after uploading, a playback editing control 70 is displayed on the note editor page, and the time domain waveform 71 corresponding to the audio stream is displayed in the playback editing control 70 or the The timeline corresponding to the audio stream. At the same time, the playback editing control 70 is also used to display the icons 72 corresponding to the marks inserted at the corresponding positions on the timeline during the audio recording process.

进一步地,为实现对用户录制或上传的音频流进行播放或编辑,所述播放编辑控件中还包括第二音频标记子控件73,以及播放开始子控件74。当用户触发所述播放开始子控件74时,开始播放所述时域波形71表征的音频流。在音频播放过程中,所述播放编辑控件70中还显示用于表征当前播放时间位置的进度线75。在所述音频流的播放过程中,当用户触发所述第二音频标记子控件73时,在所述进度线75所在的位置插入标记。可选地,在音频流播放时或不播放时,用户均可以在所述时域波形71中直接选中进度线75所在的位置。在选中所述进度线75所在位置后,触发所述第二音频标记子控件73时,在所述进度线75所在的位置插入标记。插入标记后在所述时域波形71上,所述进度线75所在的位置显示标记对应的图标72。Further, in order to play or edit the audio stream recorded or uploaded by the user, the playback editing control further includes a second audio mark sub-control 73 and a playback start sub-control 74 . When the user triggers the playback start sub-control 74, the audio stream represented by the time domain waveform 71 starts to be played. During the audio playback, the playback editing control 70 also displays a progress line 75 for representing the current playback time position. During the playback of the audio stream, when the user triggers the second audio marker sub-control 73, a marker is inserted at the position where the progress line 75 is located. Optionally, when the audio stream is playing or not, the user can directly select the position where the progress line 75 is located in the time domain waveform 71 . After the position of the progress line 75 is selected, when the second audio mark sub-control 73 is triggered, a mark is inserted at the position of the progress line 75 . After the marker is inserted, on the time domain waveform 71, the icon 72 corresponding to the marker is displayed at the position where the progress line 75 is located.

进一步地,本发明实施例中所述音频流上插入的各标记还可以包括对应的标记附注信息,用于表征对应标记的具体情况。所述标记附注信息可以通过在所述笔记编辑器预先设定的多个候选标记中选定。或者,在所述播放编辑控件包括标记编辑子控件的前提下,在所述音频流对应的多个标记中选中一个标记,输入与选中标记对应的标记附注信息。以通过所述标记编辑子控件接收对于选中标记的标记附注信息,将所述标记附注信息与对应的标记绑定存储并显示。Further, each marker inserted into the audio stream in the embodiment of the present invention may further include corresponding marker annotation information, which is used to represent the specific situation of the corresponding marker. The marking annotation information can be selected from a plurality of candidate markings preset by the note editor. Alternatively, on the premise that the playback editing control includes a marker editing sub-control, a marker is selected from a plurality of markers corresponding to the audio stream, and the marker annotation information corresponding to the selected marker is input. The tag annotation information for the selected tag is received through the tag editing sub-control, and the tag annotation information is stored and displayed in binding with the corresponding tag.

在本发明实施例的一个可选地实现方式中,所述选中标记的方式可以为通过在时域波形时间线上选中对应的图标选中标记。所述通过标记编辑子控件接收对于选中标记的标记附注信息可以通过以下过程实现:在选中所述标记对应的图标后,显示所述标记的标记附注信息。选定所述标记附注信息并激活,以接收对于所述标记附注信息的输入信息。在输入标记附注信息后,当未选中所述时域波形时间线上的图标时,所述播放编辑控件中不显示图标对应的标记附注信息。当选中所述时域波形时间线上的图标时,所述播放编辑控件中在图标位置或图标附近位置还显示与所述图标对应的标记附注信息。In an optional implementation manner of the embodiment of the present invention, the manner of the check mark may be a check mark by selecting a corresponding icon on the time-domain waveform timeline. The receiving mark annotation information for the selected mark through the mark editing sub-control may be implemented through the following process: after the icon corresponding to the mark is selected, the mark annotation information of the mark is displayed. The marker annotation information is selected and activated to receive input information for the marker annotation information. After the marker annotation information is input, when the icon on the time-domain waveform timeline is not selected, the marker annotation information corresponding to the icon is not displayed in the playback editing control. When an icon on the time-domain waveform timeline is selected, the mark and annotation information corresponding to the icon is also displayed at the icon position or the position near the icon in the playback editing control.

在本发明实施例的另一个可选地实现方式中,所述播放编辑控件中以列表方式在所述标记编辑子控件中显示各所述标记的标记附注信息。所述选中标记的方式可以为对于所述时域波形时间线上的图标的选定,或者直接对于所述列表形式展示的标记附注信息的选定。在选定标记后,激活所述选定标记的标记附注信息,以接收对于标记附注信息的输入信息。其中,所述激活方式可以为触发用于接收标记附注信息的附注信息文本编辑子控件,或通过双击所述标记附注信息、长按所述标记附注信息等预设的激活方式激活所述选定标记的标记附注信息。In another optional implementation manner of the embodiment of the present invention, in the playback editing control, the tag annotation information of each tag is displayed in the tag editing sub-control in a list manner. The manner of selecting the mark may be selection of an icon on the time-domain waveform timeline, or selection of annotated information of the mark displayed in the form of a list directly. After a marker is selected, the marker annotation information for the selected marker is activated to receive input information for the marker annotation information. The activation method may be triggering the annotation information text editing sub-control for receiving marked annotation information, or activating the selection by a preset activation method such as double-clicking the marked annotation information, long-pressing the marked annotation information, etc. Tag annotation information for the tag.

图8为本发明实施例具有标记附注信息的笔记编辑器页面的示意图。如图8所示,音频录制结束后或上传后,所述笔记编辑器页面中显示播放编辑控件,并在所述播放编辑控件中显示音频流对应的时域波形71,并且在所述时域波形的时间线上对应的位置显示在音频录制过程中插入的各标记对应的图标。同时,所述播放编辑控件中还包括标记编辑子控件80,用于以列表方式在所述标记编辑子控件中显示各所述标记的标记附注信息81,各所述标记可以通过在所述时域波形时间线上的时间点表征。FIG. 8 is a schematic diagram of a note editor page with marked annotation information according to an embodiment of the present invention. As shown in FIG. 8 , after the audio recording is completed or after uploading, a playback editing control is displayed on the note editor page, and the time domain waveform 71 corresponding to the audio stream is displayed in the playback editing control, and in the time domain Corresponding locations on the waveform's timeline display icons for each marker inserted during audio recording. At the same time, the playback editing control also includes a marker editing sub-control 80, which is used to display the marker annotation information 81 of each marker in the marker editing sub-control in a list manner. Time-point characterization on the domain waveform timeline.

在本发明实施例中,用户在编辑各所述标记对应的标记附注信息81的过程中,还可以通过选定时间线上的图标或直接在标记编辑子控件中选择标记的方式直接确定需要编辑标记附注信息81的标记。在选定需要编辑标记附注信息81的标记后,可以通过双击所述标记附注信息81或触发附注信息文本编辑子控件82的方式激活所述选定标记的标记附注信息81。以接收对于标记附注信息81的输入信息,将所述输入信息确定为所述选定标记的标记附注信息81,将所述标记附注信息81与对应的标记绑定存储并显示。In this embodiment of the present invention, in the process of editing the mark annotation information 81 corresponding to each mark, the user can also directly determine the need to edit by selecting an icon on the timeline or directly selecting a mark in the mark editing sub-control. Marks the mark of the annotation information 81 . After selecting the mark that needs to edit the mark and note information 81 , the mark and note information 81 of the selected mark can be activated by double-clicking the mark and note information 81 or triggering the sub-control 82 for editing the mark and note text. In order to receive the input information for the marker annotation information 81, the input information is determined as the marker annotation information 81 of the selected marker, and the marker annotation information 81 is stored and displayed in binding with the corresponding marker.

如图8所示,为进一步地提高音频流播放过程的效率,所述播放编辑页面中还可以包括用于控制所述音频流播放方式的第一播放子控件83和第二播放子控件84。所述第一播放子控件83用于表征向前播放15秒,即在音频流播放过程中,当所述第一播放子控件83被触发时,将所述时域波形的播放进度线向前移动15s。所述第二播放子控件84用于表征向后播放15秒,即在音频流播放过程中,当所述第二播放子控件84被触发时,将所述时域波形的播放进度线向后移动15s。As shown in FIG. 8 , in order to further improve the efficiency of the audio stream playback process, the playback editing page may further include a first playback sub-control 83 and a second playback sub-control 84 for controlling the playback mode of the audio stream. The first playback sub-control 83 is used to represent forward playback for 15 seconds, that is, during the audio stream playback process, when the first playback sub-control 83 is triggered, the playback progress line of the time domain waveform is forwarded. Move 15s. The second playback sub-control 84 is used to represent playing backward for 15 seconds, that is, during the playback of the audio stream, when the second playback sub-control 84 is triggered, the playback progress line of the time domain waveform is moved backward. Move 15s.

由于本发明实施例的信息交互方法应用于笔记编辑器中,为防止所述插入音频数据的笔记内容遗失,以及保证所述在线笔记在迁移过程中的安全性。所述笔记编辑器在接收到笔记同步指令时,将所述笔记编辑器页面数据保存到云端,所述笔记编辑器页面数据包括所述音频流、所述标记和所述标记附注信息。使得用户在更换安装所述笔记编辑器的终端设备时,仍然可以通过云端获取包括音频流、所述标记和所述标记附注信息的笔记内容。Since the information interaction method according to the embodiment of the present invention is applied to a note editor, in order to prevent the content of the note inserted into the audio data from being lost, and to ensure the security of the online note during the migration process. The note editor saves the note editor page data to the cloud when receiving the note synchronization instruction, where the note editor page data includes the audio stream, the mark and the mark annotated information. This enables the user to obtain the note content including the audio stream, the tag and the tag annotation information through the cloud when changing the terminal device on which the note editor is installed.

本发明实施例的信息交互方法以在笔记编辑的过程中可以通过上传或在线录制的方式插入音频文件,并在录制的过程中或录制完成后在对应音频流的特定位置插入标记。本发明实施例便于用户在会议、线下课堂等需要记录在线笔记,且无法再现的场景中通过插入音频文件的方式在在线笔记中完整的记录重要信息。同时,通过插入标记以及对应的标记附注信息的方式确定插入音频文件中重点信息所在的位置,便于后期浏览笔记、查找信息以及进行数据处理的过程中确定音频文件中的重要信息。进而可以提高用户使用笔记过程的用户体验。The information interaction method of the embodiment of the present invention inserts an audio file by uploading or online recording during the note editing process, and inserts a mark at a specific position corresponding to the audio stream during the recording process or after the recording is completed. The embodiments of the present invention are convenient for users to record important information in the online notes by inserting audio files in scenarios where online notes need to be recorded in meetings, offline classes, etc. and cannot be reproduced. At the same time, the position of the key information in the inserted audio file is determined by inserting the mark and the corresponding mark and annotation information, which is convenient for later browsing the notes, searching for information and determining the important information in the audio file in the process of data processing. Further, the user experience of the user using the note-taking process can be improved.

图9是本发明实施例的电子设备的示意图。如图9所示,图9所示的电子设备为通用地址查询装置,其包括通用的计算机硬件结构,其至少包括处理器90和存储器91。处理器90和存储器91通过总线92连接。存储器91适于存储处理器90可执行的指令或程序。处理器90可以是独立的微处理器,也可以是一个或者多个微处理器集合。由此,处理器90通过执行存储器91所存储的指令,从而执行如上所述的本发明实施例的方法流程实现对于数据的处理和对于其它装置的控制。总线92将上述多个组件连接在一起,同时将上述组件连接到显示控制器93和显示装置以及输入/输出(I/O)装置94。输入/输出(I/O)装置94可以是鼠标、键盘、调制解调器、网络接口、触控输入装置、体感输入装置、打印机以及本领域公知的其他装置。典型地,输入/输出装置94通过输入/输出(I/O)控制器95与系统相连。FIG. 9 is a schematic diagram of an electronic device according to an embodiment of the present invention. As shown in FIG. 9 , the electronic device shown in FIG. 9 is a general address query apparatus, which includes a general computer hardware structure, which at least includes a processor 90 and a memory 91 . The processor 90 and the memory 91 are connected by a bus 92 . Memory 91 is adapted to store instructions or programs executable by processor 90 . The processor 90 may be an independent microprocessor, or may be a set of one or more microprocessors. Thus, the processor 90 executes the instructions stored in the memory 91 to execute the above-described method flow of the embodiments of the present invention to process data and control other devices. The bus 92 connects the above-mentioned various components together, while connecting the above-mentioned components to the display controller 93 and the display device and the input/output (I/O) device 94 . The input/output (I/O) device 94 may be a mouse, keyboard, modem, network interface, touch input device, somatosensory input device, printer, and other devices known in the art. Typically, input/output devices 94 are connected to the system through input/output (I/O) controllers 95 .

本领域的技术人员应明白,本申请的实施例可提供为方法、装置(设备)或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可读存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品。It should be understood by those skilled in the art that the embodiments of the present application may be provided as a method, an apparatus (apparatus) or a computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may employ a computer program product embodied on one or more computer-readable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

本申请是参照根据本申请实施例的方法、装置(设备)和计算机程序产品的流程图来描述的。应理解可由计算机程序指令实现流程图中的每一流程。The present application is described with reference to flowchart illustrations of methods, apparatus (apparatus) and computer program products according to embodiments of the present application. It will be understood that each process in the flowchart can be implemented by computer program instructions.

这些计算机程序指令可以存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现流程图一个流程或多个流程中指定的功能。These computer program instructions may be stored in a computer readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer readable memory result in an article of manufacture comprising instruction means, the instruction means Implements the function specified in a flow chart or flows.

也可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程中指定的功能的装置。These computer program instructions may also be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flows of a flowchart.

本发明的另一实施例涉及一种非易失性存储介质,用于存储计算机可读程序,所述计算机可读程序用于供计算机执行上述部分或全部的方法实施例。Another embodiment of the present invention relates to a non-volatile storage medium for storing a computer-readable program, the computer-readable program being used for a computer to execute some or all of the above method embodiments.

即,本领域技术人员可以理解,实现上述实施例方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序存储在一个存储介质中,包括若干指令用以使得一个设备(可以是单片机,芯片等)或处理器(processor)执行本申请各实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-OnlyMemory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。That is, those skilled in the art can understand that all or part of the steps in the method for implementing the above embodiments can be completed by instructing the relevant hardware through a program, and the program is stored in a storage medium and includes several instructions to make a device ( It may be a single chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods described in the embodiments of the present application. The aforementioned storage medium includes: U disk, removable hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes.

以上所述仅为本发明的优选实施例,并不用于限制本发明,对于本领域技术人员而言,本发明可以有各种改动和变化。凡在本发明的精神和原理之内所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.

Claims (10)

1. An information interaction method, characterized in that the method comprises:
displaying an audio insertion control in a note editor page;
in response to an audio insertion control being triggered, displaying an audio recording control having a first audio tagging sub-control;
in an audio recording process, responding to the triggering of the first audio marking sub-control, inserting a mark at a corresponding time point of a recorded audio stream, wherein the mark is used for representing the marked position of the audio stream;
responding to the end of audio recording, saving the audio stream and the mark, and displaying a playing editing control in the note editor page;
displaying the audio stream and the mark in the playing editing control.
2. The information interaction method according to claim 1, wherein displaying the audio stream and the mark in the play editing control specifically includes:
and displaying a time domain waveform of the audio stream with at least one mark in the playing and editing control, and displaying an icon corresponding to each mark at a position corresponding to a time line.
3. The information interaction method of claim 2, wherein the playing editing control comprises a mark editing sub-control;
the method further comprises the following steps:
receiving label attaching information for the selected label through the label editing sub-control;
and binding, storing and displaying the label attaching information and the corresponding label.
4. The information interaction method of claim 3, wherein receiving label annotation information for the selected label via the label editing sub-control comprises:
displaying label remark information of each label in the label editing sub-control in a list mode;
in response to a selection operation, determining a selected mark and activating mark attaching information of the selected mark;
input information for label remark information is received.
5. The information interaction method according to claim 4, wherein the selected operation is selection of an icon on the timeline; or
The selecting operation is selection of label affixing information.
6. The information interaction method of claim 2, wherein the play editing control has a second audio mark sub-control;
the method further comprises the following steps:
and in response to the second audio marking sub-control being triggered, inserting a mark at a corresponding time point in the audio stream displayed by the playing and editing control.
7. The information interaction method of claim 1, wherein the method further comprises:
in the audio recording process, displaying the time domain waveform of the recorded audio stream on the audio recording control; and
and displaying the icon corresponding to each mark synchronously with the time domain waveform.
8. The information interaction method of claim 2, wherein the method further comprises:
and responding to a note synchronization instruction, and saving note editor page data to a cloud end, wherein the note editor page data comprises the audio stream, the mark and the mark annotation information.
9. A computer readable storage medium storing computer program instructions, which when executed by a processor implement the method of any one of claims 1-8.
10. An electronic device comprising a memory and a processor, wherein the memory is configured to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method of any of claims 1-8.
CN202010621911.1A 2020-06-30 2020-06-30 Information interaction method, readable storage medium and electronic device Pending CN111833917A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010621911.1A CN111833917A (en) 2020-06-30 2020-06-30 Information interaction method, readable storage medium and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010621911.1A CN111833917A (en) 2020-06-30 2020-06-30 Information interaction method, readable storage medium and electronic device

Publications (1)

Publication Number Publication Date
CN111833917A true CN111833917A (en) 2020-10-27

Family

ID=72900978

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010621911.1A Pending CN111833917A (en) 2020-06-30 2020-06-30 Information interaction method, readable storage medium and electronic device

Country Status (1)

Country Link
CN (1) CN111833917A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114242120A (en) * 2021-11-25 2022-03-25 广东电力信息科技有限公司 Audio editing method and audio marking method based on DTMF technology
CN116682465A (en) * 2022-10-31 2023-09-01 荣耀终端有限公司 Method and electronic device for recording content
CN116708888A (en) * 2022-11-22 2023-09-05 荣耀终端有限公司 Video recording method and related device
CN116737667A (en) * 2022-11-22 2023-09-12 荣耀终端有限公司 Method for importing portable document format file and terminal equipment
WO2024230334A1 (en) * 2023-05-10 2024-11-14 荣耀终端有限公司 Call method and electronic device

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101404680A (en) * 2008-11-12 2009-04-08 深圳市杰特电信控股有限公司 Method for inserting and playing media fragment in electronic document
CN101799994A (en) * 2010-02-10 2010-08-11 惠州Tcl移动通信有限公司 Voice note recording method of e-book reader
CN102830977A (en) * 2012-08-21 2012-12-19 上海量明科技发展有限公司 Method, client and system for adding insert type data in recording process during instant messaging
CN103038738A (en) * 2010-06-22 2013-04-10 微软公司 Personal assistant for task utilization
CN103400592A (en) * 2013-07-30 2013-11-20 北京小米科技有限责任公司 Recording method, playing method, device, terminal and system
CN104520843A (en) * 2012-08-08 2015-04-15 微软公司 Providing note based annotation of content in e-reader
CN104581351A (en) * 2015-01-28 2015-04-29 上海与德通讯技术有限公司 Audio/video recording method, audio/video playing method and electronic device
CN104679724A (en) * 2013-12-03 2015-06-03 腾讯科技(深圳)有限公司 Page noting method and device
CN105144148A (en) * 2012-12-11 2015-12-09 微软技术许可有限责任公司 Appending content with annotation
CN106653077A (en) * 2016-12-30 2017-05-10 网易(杭州)网络有限公司 Method and device for recording voice notes as well as readable storage medium
CN108241461A (en) * 2016-12-26 2018-07-03 北京奇虎科技有限公司 A method and device for online production of audio presentations
CN109815200A (en) * 2019-01-14 2019-05-28 腾讯科技(深圳)有限公司 A kind of sharing files method, apparatus and storage medium
CN110381382A (en) * 2019-07-23 2019-10-25 腾讯科技(深圳)有限公司 Video takes down notes generation method, device, storage medium and computer equipment
CN110622119A (en) * 2017-05-15 2019-12-27 微软技术许可有限责任公司 Object insertion

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101404680A (en) * 2008-11-12 2009-04-08 深圳市杰特电信控股有限公司 Method for inserting and playing media fragment in electronic document
CN101799994A (en) * 2010-02-10 2010-08-11 惠州Tcl移动通信有限公司 Voice note recording method of e-book reader
CN103038738A (en) * 2010-06-22 2013-04-10 微软公司 Personal assistant for task utilization
CN104520843A (en) * 2012-08-08 2015-04-15 微软公司 Providing note based annotation of content in e-reader
CN102830977A (en) * 2012-08-21 2012-12-19 上海量明科技发展有限公司 Method, client and system for adding insert type data in recording process during instant messaging
CN105144148A (en) * 2012-12-11 2015-12-09 微软技术许可有限责任公司 Appending content with annotation
CN103400592A (en) * 2013-07-30 2013-11-20 北京小米科技有限责任公司 Recording method, playing method, device, terminal and system
CN104679724A (en) * 2013-12-03 2015-06-03 腾讯科技(深圳)有限公司 Page noting method and device
CN104581351A (en) * 2015-01-28 2015-04-29 上海与德通讯技术有限公司 Audio/video recording method, audio/video playing method and electronic device
CN108241461A (en) * 2016-12-26 2018-07-03 北京奇虎科技有限公司 A method and device for online production of audio presentations
CN106653077A (en) * 2016-12-30 2017-05-10 网易(杭州)网络有限公司 Method and device for recording voice notes as well as readable storage medium
CN110622119A (en) * 2017-05-15 2019-12-27 微软技术许可有限责任公司 Object insertion
CN109815200A (en) * 2019-01-14 2019-05-28 腾讯科技(深圳)有限公司 A kind of sharing files method, apparatus and storage medium
CN110381382A (en) * 2019-07-23 2019-10-25 腾讯科技(深圳)有限公司 Video takes down notes generation method, device, storage medium and computer equipment

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114242120A (en) * 2021-11-25 2022-03-25 广东电力信息科技有限公司 Audio editing method and audio marking method based on DTMF technology
CN114242120B (en) * 2021-11-25 2023-11-10 广东电力信息科技有限公司 An audio editing method and audio marking method based on DTMF technology
CN116682465A (en) * 2022-10-31 2023-09-01 荣耀终端有限公司 Method and electronic device for recording content
CN116682465B (en) * 2022-10-31 2024-09-27 荣耀终端有限公司 Method and electronic device for recording content
CN116708888A (en) * 2022-11-22 2023-09-05 荣耀终端有限公司 Video recording method and related device
CN116737667A (en) * 2022-11-22 2023-09-12 荣耀终端有限公司 Method for importing portable document format file and terminal equipment
WO2024230334A1 (en) * 2023-05-10 2024-11-14 荣耀终端有限公司 Call method and electronic device

Similar Documents

Publication Publication Date Title
CN111833917A (en) Information interaction method, readable storage medium and electronic device
US11627001B2 (en) Collaborative document editing
US7886228B2 (en) Method and apparatus for storytelling with digital photographs
JP4347223B2 (en) System and method for annotating multimodal characteristics in multimedia documents
US9384178B2 (en) Review of signature based content
US9122886B2 (en) Track changes permissions
US9230356B2 (en) Document collaboration effects
KR20150087405A (en) Providing note based annotation of content in e-reader
US20250273198A1 (en) Audio processing method, apparatus, and device, and storage medium
CN111008520A (en) An annotation method, device, terminal device and storage medium
US9990102B2 (en) Creating and editing digital content works
CN103530320A (en) Multimedia file processing method and device and terminal
CN108241461A (en) A method and device for online production of audio presentations
JP2010165068A (en) Album editing apparatus, method of controlling the same, and program
US10204080B2 (en) Rich formatting for a data label associated with a data point
US8020097B2 (en) Recorder user interface
JP2004038283A (en) Contents management program, information processor, and information processing method
JP2014171053A (en) Electronic document container data file, electronic document container data file generating apparatus, electronic document container data file generating program, server apparatus, and electronic document container data file generating method
CN113821131B (en) Multimedia information processing method, device, electronic equipment and storage medium
US20130086476A1 (en) Video Editing Methods and Apparatus
CN115048659A (en) Sharing method and device of shared object, electronic equipment and storage medium
CN111158808B (en) Display device and whiteboard file storage method
US8014883B2 (en) Templates and style sheets for audio broadcasts
JP5864796B1 (en) Text processing device, computer program, and content processing device
US20130311861A1 (en) Effect Editing Methods, Systems, Application Products and Electronic Devices for Electronic Books

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20201027