Detailed Description
The technical solutions in the embodiments of the present application will be described clearly below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of the present disclosure.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
In the embodiments of the present application, the term "plurality" means two or more, and other terms are similar thereto.
The directional recording method provided by the embodiments of the present application is described in detail below with reference to the accompanying drawings by using some embodiments and application scenarios thereof. The execution subject of the directional recording method provided by the embodiment of the application is electronic equipment, and the electronic equipment provided by the embodiment of the application includes but is not limited to a mobile phone, a tablet computer, a computer, wearable equipment and the like.
Fig. 1 is a schematic flow chart of a directional recording method according to an embodiment of the present application, and as shown in fig. 1, the directional recording method includes the following steps:
step 100, a first electronic device acquires position information of a plurality of second electronic devices based on an ultra wideband UWB technology;
the Ultra Wide Band (UWB) technology is an accurate positioning technology and has the advantage of high positioning accuracy, but UWB signals are close in propagation distance and have a large error with respect to floors or walls.
In the embodiment of the present application, the first electronic device serves as a main sound recording device, and the second electronic device supporting the UWB technology in the current environment is identified, so as to locate the relative position between the user using the second electronic device and the main sound recording device, that is, the first electronic device obtains the position information of the plurality of second electronic devices based on the ultra wideband UWB technology.
For example, a plurality of users participating in a conference join the conference by scanning a two-dimensional code using a second electronic device, and a first electronic device identifies a plurality of second electronic devices joining the conference and acquires location information of the plurality of second electronic devices. Fig. 2 is a schematic diagram illustrating identification of a plurality of second electronic devices according to an embodiment of the present application.
Step 101, the first electronic device identifies voice output state information of a user corresponding to each second electronic device based on position information of each second electronic device;
optionally, after the first electronic device obtains the location information of each second electronic device, the first electronic device starts a recording function, and during recording, based on the location information of each second electronic device, identifies a user who is performing voice output, that is, identifies voice output status information of a user corresponding to each second electronic device.
Wherein the voice output state information includes ongoing voice output and non-ongoing voice output. Fig. 3 is a schematic diagram illustrating recognition of voice output state information of a user corresponding to each of the second electronic devices according to an embodiment of the present application.
And 102, recording voice signals of users corresponding to the second electronic devices based on the voice output state information of the users corresponding to the second electronic devices to obtain recording audios corresponding to the second electronic devices.
Optionally, in the recording process, the first electronic device may record the voice signal of the user corresponding to each second electronic device based on the voice output state information of the user corresponding to each second electronic device, so as to obtain the recorded audio corresponding to each second electronic device.
In the embodiment of the application, the position information of a plurality of recorded objects is acquired based on the ultra-wideband UWB technology, the voice output state information is identified based on the position information, and recording is carried out based on the voice output state information of each recorded object, so that directional recording of the recorded objects can be realized, and the recording effect is improved.
Optionally, the obtaining, by the first electronic device, location information of a plurality of second electronic devices based on an ultra wideband UWB technology includes:
under the condition that second electronic equipment joins in a conference, the first electronic equipment identifies each second electronic equipment based on an ultra wideband UWB technology, and obtains distance information and direction information from each second electronic equipment to the first electronic equipment.
The embodiment of the application is applied to a conference scene, under the condition that second electronic equipment joins in a conference, the electronic equipment positions and identifies each second electronic equipment joining in the conference based on the UWB technology, and distance information and direction information from each second electronic equipment to the first electronic equipment can be obtained through positioning.
Optionally, the recognizing, by the first electronic device, the voice output state information of the user corresponding to each second electronic device based on the location information of each second electronic device includes:
acquiring microphone information of each second electronic device, and identifying voice output state information of a user corresponding to each second electronic device based on the position information and the microphone information of each second electronic device;
or recognizing the voice output state information of the user corresponding to each second electronic device based on a sound propagation model and the position information of each second electronic device.
In one embodiment, after the second electronic devices join the conference, each of the second electronic devices shares the microphone permission with the first electronic device, and the first electronic device obtains the microphone permission of each of the second electronic devices, that is, can obtain the microphone information of each of the second electronic devices. The first electronic device identifies whether each second electronic device is in use or not based on the microphone information of each second electronic device, and judges the voice output state information of the user corresponding to each second electronic device by combining the position information of each second electronic device.
In one embodiment, the first electronic device determines the voice output state information of the user corresponding to each second electronic device based on a sound propagation model and the position information of each second electronic device.
Wherein, the sound propagation model is a physics model conforming to the sound propagation theory.
Based on the sound propagation model and the location information of each second electronic device, the time when the voice output by the user corresponding to each second electronic device reaches the first electronic device can be obtained, that is, if the user corresponding to the second electronic device is outputting the voice, the time when the voice output by the second electronic device reaches the first electronic device is determined. The first electronic device may determine a second electronic device that is currently performing voice output based on a time difference between when the voice reaches the device and the voice output.
In the embodiment of the application, based on the position information of each second electronic device, the voice output state information of the user corresponding to each second electronic device is identified, so that directional recording of a recorded object can be realized, and the recording effect is improved.
Optionally, the directional recording method further includes:
receiving a first input;
and responding to the first input, determining a recording composition object, and outputting the recording audio corresponding to the recording composition object.
Optionally, the first electronic device receives a first input, determines a recording composition object in response to the first input, synthesizes recording audio corresponding to the recording composition object based on the recording audio corresponding to each of the second electronic devices, and outputs the recording audio corresponding to the recording composition object.
Optionally, the first input comprises at least one of:
selecting an operation of a second electronic device;
setting a recording range;
and setting the recording direction.
In one embodiment, the user may select the second electronic device. For example, by identifying which devices are speaking and directly clicking a close button on a device, such as close device 1 or device 4, the recording corresponding to the orientation of device 1 or device 4 will be masked. Fig. 4 is a schematic diagram illustrating a sound selected by a user from a second electronic device for derivation according to an embodiment of the present application.
Optionally, in a case that the first input is an operation of selecting a second electronic device, the determining the sound recording composition object includes:
and using the selected second electronic equipment or other second electronic equipment except the selected second electronic equipment as a sound recording composition object.
In one embodiment, the user may set the recording range. Fig. 5 is a schematic diagram of setting a recording range according to an embodiment of the present application.
Optionally, in a case where the first input is an operation of setting a recording range, the determining of the recording composition object includes:
determining second electronic equipment in the recording range based on the distance information from each second electronic equipment to the first electronic equipment;
and taking the second electronic equipment in the recording range as a recording synthesis object.
In one embodiment, the user may set the recording direction.
Optionally, in a case where the first input is an operation of setting a recording direction, the determining of the recording composition object includes:
determining second electronic equipment corresponding to the recording direction based on the direction information of each piece of second electronic equipment;
and taking the second electronic equipment corresponding to the recording direction as a recording synthesis object.
It can be understood that, the first electronic device may determine, according to the location information of each second electronic device, the second electronic device that satisfies the recording direction set by the user, because the location information includes the direction information, that is, the first electronic device may determine, according to the direction information of each second electronic device, the second electronic device that satisfies the recording direction set by the user.
In the embodiment of the application, the position information of a plurality of recorded objects is acquired based on the ultra-wideband UWB technology, the voice output state information is identified based on the position information, recording is carried out based on the voice output state information of each recorded object, the recording audio of each second electronic device is acquired, directional recording is realized, corresponding recording audio can be output according to the setting of a user, and the recording effect is improved.
It should be noted that, in the directional recording method provided in the embodiment of the present application, the execution main body may be a directional recording apparatus, or a control module in the directional recording apparatus for executing the directional recording method. The directional recording device provided by the embodiment of the present application is described by taking the directional recording method executed by the directional recording device as an example.
Fig. 6 is a schematic structural diagram of a directional recording apparatus according to an embodiment of the present application. As shown in fig. 6, the apparatus includes:
a positioning unit 610 for acquiring location information of a plurality of second electronic devices based on ultra wideband UWB technology;
an identifying unit 620, configured to identify, based on location information of each of the second electronic devices, voice output state information of a user corresponding to each of the second electronic devices;
and a recording unit 630, configured to record, based on the voice output state information of the user corresponding to each second electronic device, a voice signal of the user corresponding to each second electronic device, so as to obtain a recording audio corresponding to each second electronic device.
In the embodiment of the application, the position information of a plurality of recorded objects is acquired based on the ultra-wideband UWB technology, the voice output state information is identified based on the position information, and recording is carried out based on the voice output state information of each recorded object, so that directional recording of the recorded objects can be realized, and the recording effect is improved.
Optionally, the positioning unit is configured to:
under the condition that second electronic equipment joins in a conference, the first electronic equipment identifies each second electronic equipment based on an ultra wideband UWB technology, and obtains distance information and direction information from each second electronic equipment to the first electronic equipment.
Optionally, the identification unit is configured to:
acquiring microphone information of each second electronic device, and identifying voice output state information of a user corresponding to each second electronic device based on the position information and the microphone information of each second electronic device;
or recognizing the voice output state information of the user corresponding to each second electronic device based on a sound propagation model and the position information of each second electronic device.
Optionally, the method further comprises:
a receiving unit for receiving a first input;
and the response unit is used for responding to the first input, determining a recording composition object and outputting the recording audio corresponding to the recording composition object.
Optionally, the first input comprises at least one of:
selecting an operation of a second electronic device;
setting a recording range;
and setting the recording direction.
In the embodiment of the application, the position information of a plurality of recorded objects is acquired based on the ultra-wideband UWB technology, the voice output state information is identified based on the position information, recording is carried out based on the voice output state information of each recorded object, the recording audio of each second electronic device is acquired, directional recording is realized, corresponding recording audio can be output according to the setting of a user, and the recording effect is improved.
The directional recording device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The directional recording device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system (Android), an iOS operating system, or other possible operating systems, which is not specifically limited in the embodiments of the present application.
The directional recording apparatus provided in the embodiment of the present application can implement each process implemented by the method embodiments of fig. 1 to 5, and is not described here again to avoid repetition.
Optionally, as shown in fig. 7, an electronic device 700 is further provided in this embodiment of the present application, and includes a processor 701, a memory 702, and a program or an instruction stored in the memory 702 and executable on the processor 701, where the program or the instruction is executed by the processor 701 to implement each process of the foregoing directional recording method embodiment, and can achieve the same technical effect, and no further description is provided here to avoid repetition.
It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 8 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 800 includes, but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, and a processor 810.
Those skilled in the art will appreciate that the electronic device 800 may further comprise a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 810 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system. Drawing (A)8The electronic device structures shown in the figures do not constitute limitations of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is not repeated here.
Wherein, the processor 810 is configured to:
acquiring position information of a plurality of second electronic devices based on an ultra wideband UWB technology;
recognizing voice output state information of a user corresponding to each second electronic device based on the position information of each second electronic device;
recording the voice signals of the users corresponding to the second electronic equipment based on the voice output state information of the users corresponding to the second electronic equipment to obtain the recording audio corresponding to the second electronic equipment.
In the embodiment of the application, the position information of a plurality of recorded objects is acquired based on the ultra-wideband UWB technology, the voice output state information is identified based on the position information, and recording is carried out based on the voice output state information of each recorded object, so that directional recording of the recorded objects can be realized, and the recording effect is improved.
Optionally, the acquiring location information of a plurality of second electronic devices based on the ultra-wideband UWB technology includes:
under the condition that second electronic equipment joins in a conference, the first electronic equipment identifies each second electronic equipment based on an ultra wideband UWB technology, and obtains distance information and direction information from each second electronic equipment to the first electronic equipment.
Optionally, the identifying, based on the location information of each of the second electronic devices, the voice output state information of the user corresponding to each of the second electronic devices includes:
acquiring microphone information of each second electronic device, and identifying voice output state information of a user corresponding to each second electronic device based on the position information and the microphone information of each second electronic device;
or recognizing the voice output state information of the user corresponding to each second electronic device based on a sound propagation model and the position information of each second electronic device.
Optionally, the user input unit 807 is for receiving a first input;
the processor 810 is further configured to determine, in response to the first input, a recording composition object, and the audio output unit 803 is configured to output a recording audio corresponding to the recording composition object;
optionally, the first input comprises at least one of:
selecting an operation of a second electronic device;
setting a recording range;
and setting the recording direction.
It should be understood that in the embodiment of the present application, the input Unit 804 may include a Graphics Processing Unit (GPU) 8041 and a microphone 8042, and the Graphics Processing Unit 8041 processes image data of a still picture or a video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 806 may include a display panel 8061, and the display panel 8061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 807 includes a touch panel 8071 and other input devices 8072. A touch panel 8071, also referred to as a touch screen. The touch panel 8071 may include two portions of a touch detection device and a touch controller. Other input devices 8072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 809 may be used to store software programs as well as various data including, but not limited to, application programs and operating systems. The processor 810 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 810.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the above-mentioned directional recording method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement each process of the above directional recording method embodiment, and can achieve the same technical effect, and is not repeated here to avoid repetition.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.