CN108429972B - Music playing method, device, terminal, earphone and readable storage medium - Google Patents

Abstract

The present application relates to a music playing method, device, terminal, earphone and readable storage medium. The method includes: when the earphone is worn at a preset position of the user, obtaining a pressure change signal generated by the vibration of the earphone at the preset position; obtaining heart rate information according to the pressure change signal; pushing and playing music according to the earphone being worn at the preset position of the user and the heart rate information, and recommending and playing personalized music for the user without manual operation by the user, which increases the pleasure of the user in using the earphone and meets the personalized needs of the user; at the same time, the above-mentioned music playing method can obtain the user's heart rate information without adding additional sensors in the earphone, has low cost and simple design, expands the use function of ordinary earphones, and improves the user experience.

Description

Music playing method, device, terminal, earphone and readable storage medium

technical field

The present application relates to the field of communication technologies, and in particular, to a music playing method, device, terminal, earphone and readable storage medium.

Background technique

With the development of communication technology, smart devices have been closely integrated into people's lives, greatly improving people's lives. At the same time, people are paying more and more attention to sports and health. Among them, the heart rate information is one of the important indicators for judging whether the user is healthy.

Many people like to listen to music with headphones in the process of exercising. In order to measure the heart rate during exercise, users generally need to wear additional auxiliary equipment such as blood pressure monitors, pedometers, heart rate monitors, and bracelets to monitor the user's heart rate. Real-time heart rate information brings inconvenience to users. At the same time, traditional earphones usually only realize the functions of playing and receiving sound, but cannot identify users and meet the individual needs of different users.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a music playing method, device, terminal, earphone, and readable storage medium, which can acquire the user's heart rate information and push music based on the earphone, have low cost, and can meet the individual needs of different users.

A music playing method, comprising:

When the earphone is worn at the preset position of the user, acquire the pressure change signal generated by the vibration collected by the earphone at the preset position;

Obtain heart rate information according to the pressure change signal;

Push and play music according to the preset position of the headset worn by the user and heart rate information.

A music playback device, comprising:

a signal acquisition module, configured to acquire a pressure change signal generated by vibration collected by the earphone at the preset position when the earphone is worn at the preset position of the user;

a heart rate acquisition module, configured to acquire heart rate information according to the pressure change signal;

The music playback module is used to push and play music according to the preset position of the headset worn by the user and the heart rate information.

A terminal includes a memory and a processor, the memory stores computer-readable instructions, and when the instructions are executed by the processor, the processor executes the steps of the above method.

A computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the steps of the above method.

An earphone includes a memory, a processor and a computer program stored in the memory and running on the processor, the processor is electrically connected to the memory, and the processor implements the steps of the above method when executing the computer program.

The above-mentioned music playback method, device, terminal, earphone and computer-readable storage medium, when the earphone is worn at the preset position of the user, the pressure change signal collected by the earphone at the preset position due to vibration is obtained; according to the pressure change Signal to obtain heart rate information; push and play music according to the earphones are worn at the user's preset position and heart rate information, and can recommend and play personalized music for users without manual operation, which increases the user's pleasure in using earphones and satisfies At the same time, the above-mentioned music playback method can obtain the user's heart rate information without adding an additional sensor in the earphone, the cost is low, the design is simple, the use function of the ordinary earphone is expanded, and the user experience is improved.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

1 is a schematic diagram of an application environment of a music playing method in one embodiment;

2 is a schematic diagram of the internal structure of a terminal in one embodiment;

3 is a schematic flowchart of a music playing method in one embodiment;

FIG. 4 is a flow chart of obtaining pressure change information due to vibration at the preset position in one embodiment;

Fig. 5 is the flow chart of the music playing method in another embodiment;

6 is a flow chart of pushing and playing music according to the preset position of the headset being worn by the user and heart rate information in one embodiment;

7 is a flow chart of playing music when the state is marked as a prenatal education mark in one embodiment;

8 is a flow chart of playing music when the state is marked as a prenatal education mark in another embodiment;

9 is a flow chart of playing music when the state is marked as a motion mark in one embodiment;

10 is a structural block diagram of a music playback device in one embodiment;

FIG. 11 is a block diagram of a partial structure of a mobile phone related to a terminal provided by an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the technical field to which this application belongs. The terms used herein in the specification of the application are for the purpose of describing specific embodiments only, and are not intended to limit the application.

FIG. 1 is a schematic diagram of an application environment of an input operation control method in one embodiment. As shown in FIG. 1 , the application environment includes a terminal 110 and a headset 120 that communicates with the terminal 110 .

Wherein, an audio signal is played on the terminal 110 , and the audio signal includes but is not limited to songs, video audio, call audio, etc., and the terminal 110 is connected to the earphone 120 for communication. The type of the earphone 120 may be an in-ear earphone, an earphone type, a headphone, etc., and the terminal 110 and the earphone 120 may communicate in a wired or wireless manner to realize data transmission.

An application program (Application, APP) is installed on the terminal 110. An application program refers to a computer program for completing one or more specific tasks. It runs in a user mode, can interact with a user, and has a visual user interface. The terminal 110 interacts with the user through an application program, for example, the terminal 110 can play the user's favorite songs and recommend songs to the user through a music playing application.

FIG. 2 is a schematic diagram of an internal structure of a terminal in an embodiment. The terminal 110 includes a processor, memory and a display screen connected by a system bus. Wherein, the processor is used to provide computing and control capabilities to support the operation of the entire terminal 110 . The memory is used for storing data, programs, and/or instruction codes, etc., and at least one computer program is stored in the memory, and the computer program can be executed by the processor to implement the music playing method applicable to the terminal 110 provided in the embodiments of the present application. The memory may include a non-volatile storage medium such as a magnetic disk, an optical disk, and a read-only memory (Read-Only Memory, ROM), or a random-access-memory (Random-Access-Memory, RAM) and the like. For example, in one embodiment, the memory includes a non-volatile storage medium and internal memory. The nonvolatile storage medium stores an operating system, a database, and a computer program. The database stores data related to implementing a music playing method provided by each of the above embodiments. The computer program can be executed by the processor to implement a music playing method provided by various embodiments of the present application. Internal memory provides a cached operating environment for operating systems, databases, and computer programs in non-volatile storage media. The display screen may be a touch screen, such as a capacitive screen or an electronic screen, for displaying interface information of the terminal 110 , and the display screen includes a screen-on state and a screen-off state. The terminal 110 may be a mobile phone, a tablet computer, a personal digital assistant, a wearable device, or the like.

Those skilled in the art can understand that the structure shown in FIG. 2 is only a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the terminal 110 to which the solution of the present application is applied. The specific terminal 110 may be Include more or fewer components than shown in the figures, or combine certain components, or have a different arrangement of components.

As shown in FIG. 3 , it is a flowchart of a music playing method in an embodiment. The music playing method in this embodiment is described by taking the terminal and/or the earphone in FIG. 1 as an example. The music playing method includes the following steps 302 to 306:

Step 302: When the earphone is worn at the preset position of the user, acquire the pressure change signal generated by the vibration collected by the earphone at the preset position.

When the user needs to use the headset to listen to music, watch videos or answer calls, etc., the headset is worn at a preset position according to the type of the headset to receive audio signals propagated on the headset. The preset position may be a position in the user's ear canal, ear, belly, or the like. For example, in-ear and earphones can be placed in the ear canal, and headphones can be worn on the ears or on the belly of a pregnant woman according to different user groups to play audio signals for the user or the fetus in the pregnant woman's womb.

When the earphone is worn on the user's ear or in the ear canal, a relatively closed cavity is formed between the earphone and the user's ear because the earphone blocks the ear canal, and the contraction and vibration of the ear canal wall will cause the pressure change in the cavity. Among them, the movement of the eardrum is usually synchronized with the pulse of the artery, and the change of the pressure in the ear canal can be collected by the microphone on the earphone or the electroacoustic transducer.

When the earphone is worn on the belly of a pregnant woman, a relatively closed cavity will be formed between the earphone and the belly of the pregnant woman, and the contraction and vibration of the belly will cause the pressure change in the cavity. Among them, the vibration of the belly is usually synchronized with the heart rate of the fetus in the abdomen, and the change of the pressure in the cavity between the belly and the earphone can be collected by a microphone or an electro-acoustic transducer on the earphone.

It should be noted that, in step 302, acquiring the pressure change signal generated by the vibration of the earphone at the preset position can be understood as that the processor in the earphone acquires the pressure change collected by the earphone microphone or the electro-acoustic transducer. Signal, it can also be understood that the terminal communicating with the headset acquires the pressure change signal collected by the headset microphone or the electro-acoustic transducer, that is, the headset transmits the acquired pressure change signal to the terminal for subsequent related processing.

Step 304: Acquire heart rate information according to the pressure change signal.

The beating of the heart has a certain periodicity, and the beating of the heart will cause the contraction and vibration of the ear canal wall. According to the cycle of the obtained pressure change signal, the beating law of the heart can be reflected to a certain extent, then the reciprocal of the cycle of the pressure change signal That is heart rate information.

Further, the signal collected by the microphone can also be filtered to obtain the pressure change signal, which can eliminate the interference of external noise on the pressure change signal, that is, a pressure change signal with a relatively clear period can be obtained, according to the pressure change signal. To form a signal waveform diagram, the signal period of the pressure change signal can be calculated by detecting the interval between two adjacent peaks. The signal period can reflect the beating law of the heart to a certain extent, then the reciprocal of the period of the pressure change signal is Heart rate information.

It should be noted that in step 302, acquiring the heart rate information according to the pressure change signal can be understood as that the processor in the earphone acquires the heart rate information according to the pressure change signal, or it can be understood that the terminal that communicates with the earphone acquires the heart rate information. The pressure change signal is obtained, and heart rate information is obtained according to the pressure change signal, that is, the terminal that communicates with the earphone obtains the heart rate information.

Step 306: Push and play music according to the preset position and heart rate information.

Different heart rate information can be used to characterize different user groups. For example, users of different ages have different heart rates. The average fetal heart rate is 162 beats per minute before 20 weeks of pregnancy, and the fetal heart rate is 162 beats per minute before 20 weeks of pregnancy. The average rate is 147 beats/min, and the average fetal heart rate is 139 beats/min at 31 to 40 weeks of pregnancy; the normal heart rate of newborns is 120-140 beats/min; 1 month-1 year old is 110-130 beats/min 2-3 years old is 100-120 beats/min; the normal heart rate of adults is 60-100 beats/min; the heartbeat of the elderly is slower than that of the young. At the same time, different heart rate information can also be used to represent the exercise state information of the same user, for example, sleep state (40-70 times/min), resting (60-90 times/min) state, walking state, running exercise state, etc.

According to the preset position of the headset and the obtained heart rate information, the music list can be pushed for the user, and the music in the music list can be played. For example, when the user puts the headset in the ear canal, the current user's exercise state can be known according to the current heart rate information, and the song that matches the current exercise state can be pushed and played according to the current exercise state; when the user places the headset on the user's belly At the time, according to the currently obtained heart rate information, the pregnancy cycle of the fetus in the user's womb can be known, the prenatal education music that matches the current pregnancy cycle is pushed according to the pregnancy cycle, and the prenatal education music is played.

The above music playback method can obtain the corresponding heart rate information at the preset position according to the preset position where the user wears the earphone, and push and play music that matches the heart rate information for the user according to the obtained heart rate information, without the need for manual operation by the user. It can recommend and play personalized music for users, which increases the user's sense of pleasure in using headphones and satisfies the user's personalized needs; at the same time, the above music playback method can obtain the user's heart rate without adding additional sensors to the headphones. Information, low cost, simple design, expands the use function of ordinary headphones, and improves user experience.

It should be noted that, in steps 302 to 306, the execution subject of each step may be a terminal or an earphone, which is not further limited herein.

FIG. 4 is a flow chart of acquiring pressure change information at the preset position due to vibration in one embodiment. In one embodiment, acquiring pressure change information at the preset position due to vibration includes:

Step 402: Acquire the detection signal collected by the earphone at the preset position.

Specifically, the detection signal at the preset position can be collected based on the electro-acoustic transducer of the earphone. The electro-acoustic transducer is a speaker, which can convert the electrical signal corresponding to the audio signal into a sound wave signal that the user can hear. At the same time, the electro-acoustic transducer is very sensitive to the sound waves in the internal structure of the user's ear (ear canal), which can cause the speaker cone to vibrate, and drive the coil connected to the paper cone to cut the magnetic field lines in the magnetic field of the permanent magnet. A current that changes with the change of the sound wave is generated (the phenomenon of generating current is called electromagnetic induction in physics), and at the same time, the electromotive force of the audio frequency will be output at both ends of the coil. Therefore, the electroacoustic transducer can also be used to collect pressure change signals and environmental disturbance signals generated by pressure changes caused by the contraction vibration of the ear canal wall. That is, the electroacoustic transducer can also be used as a microphone.

It can be understood that the detection signal includes a pressure change signal caused by a pressure change caused by the contraction and vibration of the ear canal wall and a noise signal that interferes with the heart rate information detection. The noise signal includes environmental noise and circuit noise. The environmental noise is the external ambient sound, and the circuit noise is the noise caused by the built-in circuit of the earphone, which is an inherent property of the earphone.

When the electro-acoustic transducer in the earphone is used to collect the pressure change signal and the noise signal generated by the pressure change caused by the contraction and vibration of the ear canal wall, it is not necessary to install an additional microphone in the earphone to collect the acoustic echo signal, saving energy cost, simplifies the internal structure of the headset.

Optionally, the pressure change signal and the noise signal generated by the pressure change caused by the contraction and vibration of the ear canal wall can also be collected by the microphone provided in the earphone. Wherein, a cavity is arranged in the earphone, the microphone is installed in the cavity, the earphone shell to which the mouth of the cavity is fitted has a hole, and when the earphone is worn, the cavity and the auricle that is fitted with the hole are formed. hermetic space.

Step 404: Perform filtering processing on the detection signal to filter out interference signals in the detection signal, and obtain the pressure change signal.

Because the frequency of pulse vibration is low (about 0.3Hz-3Hz), and the noise frequency of external noise signal is relatively high, according to this feature, the influence of external high-frequency noise can be eliminated by low-pass filter. For example, a low-pass filter can choose a FIR filter with a cutoff frequency of 5Hz, etc. The low-pass filtering process may be performed on the earphone side or the terminal side, that is, the filter may be set in the earphone or on the terminal, which is not limited in this embodiment.

Specifically, the detection signal collected by the microphone at the preset position is obtained first, and then the detection signal collected by the microphone is low-pass filtered with a low-pass filter to obtain a pressure change signal, which can more accurately reflect the user's heart rate information.

FIG. 5 is a flowchart of a music playing method in another embodiment. In one embodiment, the music playing method further includes:

Step 502: Acquire a status mark of the working mode of the headset by the user, where the status mark includes at least a default mark, a sports mark and a prenatal education mark.

The working modes of the earphone include at least a normal mode, a sports mode and a prenatal education mode, and the corresponding state marks are respectively a default mark, a sports mark and a prenatal education mark. Users can adjust and set the corresponding working mode through the physical buttons of the headset or the terminal connected to the headset according to their own needs. For example, when the user needs to exercise, the working mode can be switched to the exercise mode; the user needs to be a fetus in the womb. During prenatal education, the working mode can be switched to prenatal education mode, etc.

When the headset is in the normal mode, that is, when the status is marked as the default mark, the heart rate information of any wearing of the headset can be obtained based on the headset, and music is recommended for the user, that is, the user group using the headset is not limited.

When the headset is in sport mode, the state is marked as sport flag. For example, when a user performs various sports such as walking, running, cycling, mountain climbing, etc., he can obtain the user's current heart rate information based on the headset, and recommend music that matches the current user's heart rate information based on the heart rate information. It will not only make people feel happy, but also exciting music will stimulate people's potential for sports and cultivate a strong will, so as to achieve better sports results.

When the headset is in prenatal education mode, the status is marked as prenatal education mark. The headset is worn on the user's belly, and the heart rate information of the fetus in the user's abdomen can be obtained based on the headset, and based on the heart rate information, music that matches the heart rate information is recommended for the fetus, and prenatal education is performed for the fetus in the abdomen. Among them, music prenatal education is to promote the development of axons, dendrites and synapses of neurons by continuously applying appropriate musical stimulation to the fetus, laying the foundation for optimizing acquired intelligence and developing musical talent. In terms of physiological effects, prenatal music stimulates the brain cells to stimulate the auditory nerve organs of pregnant women and fetuses through pleasant sound effects.

It should be noted that the status mark is unique and can be formed by a combination of different numbers, characters, letters, etc., and the current working mode of the headset can be correspondingly obtained according to the obtained status mark.

Step 504: Prompt the user to wear the earphone in the preset position according to the status mark.

The user is prompted to wear the earphone at a preset position according to the acquired status mark, where the preset position may be the user's ear (ear canal) or the user's belly. When the status mark is the default mark and the motion mark, the corresponding preset position is the ear (ear canal); when the status mark is the prenatal education mark, the corresponding preset position is the belly. According to the acquired status mark, the user may be prompted to wear the headset at a preset position corresponding to the status mark.

Wherein, the prompting method for prompting the user may be an earphone voice prompt, or a terminal display prompt and/or voice prompt. The headset can prompt the user in the form of a voice announcement, such as playing a preset audio of "Place the headset in the ear canal" or "Place the headset on the belly". Of course, the terminal may also prompt the user in the form of a voice broadcast, and may also display a picture or text of a preset position where the headset needs to be placed on the terminal.

Step 506: Detect whether the earphone is worn at the preset position based on the audio signal played by the earphone.

When the user wears the earphone, it can be detected whether the earphone is worn at the preset position according to the audio signal played by the earphone. Specifically, the audio signal s(t) currently played by the earphone is acquired, and the acoustic echo signal r(t) formed by the reflection and vibration of the audio signal s(t) through the ear canal or the belly is recorded. According to the acquired audio signal s (t) and the acoustic echo signal r(t), the acoustic echo impulse response w(t) of the current position of the earphone can be determined. Among them, the audio signal s(t), the acoustic echo signal r(t) and the acoustic echo impulse response w(t) can be expressed by the following formula:

r(t)=s(t)*w(t)

In the formula, w(t) is a parameter that can reflect the coupling between the earphone and the user's ear or belly, and can be used to characterize the spatial acoustic characteristics of the earphone placed in the user's ear (ear canal) or belly. In the formula, the audio signal is s(t) and the acoustic echo signal is r(t), which can be obtained by monitoring the audio circuit set by the earphone or electronic device, and then the echo impulse response w(t) associated with the current position of the earphone can be obtained.

Further, the earphone can be worn at the first preset position (ear canal), and multiple echo impulse responses can be measured to form a first group of echo impulse responses; correspondingly, the earphone can be worn at the second preset position At the place (belly), a plurality of echo impulse responses are measured to form a second set of echo impulse responses, a database is formed according to the acquired first echo impulse responses and the second set of echo impulse responses, and the acquired echo impulse responses are compared with those in the database. The data is compared to determine whether the headset is worn in the preset position. For example, when the acquired echo impulse response is consistent with the data in the database, it means that the earphone is worn at the preset position, and the specific position information of the preset position can also be determined.

FIG. 6 is a flow chart of pushing and playing music according to the earphones being worn at the preset position of the user and heart rate information in one embodiment. In one embodiment, the music is pushed and played according to the preset position where the headset is worn by the user and heart rate information, including:

Step 602: Call the music database corresponding to the state flag according to the state flag.

A state flag corresponds to a music database. Specifically, the default mark corresponds to the first music database; the sports mark corresponds to the second music database, and the prenatal education mark corresponds to the third database. Among them, each music database includes multiple styles of music and the like. For example, the music in the first music database may include children's songs suitable for different age groups (children, teenagers, adults, the elderly), popular songs, red songs and square dance songs, etc.; the music in the second music database may include rhythm Fitness music with appropriate sense and rhythm and suitable for different sports states (sitting, walking, jogging, mountain climbing, fast running, sprinting), fitness music can reduce fatigue and enhance motivation, while fitness music blocks fatigue and effort. Improve exercise effect. The music in the third music database may include prenatal education music with gentle and smooth rhythm, without lyrics, suitable for different pregnancy and childbirth periods (first trimester, second trimester, and third trimester).

It should be noted that the music in the music database can be obtained based on big data statistics, and the user can perform operations such as updating, replacing, and deleting the music in the music database. The music database may be stored in the terminal, or may be stored in a server where the terminal communicates.

Step 604: Acquire a music list matching the heart rate information in the music database.

According to the acquired state flag, a music database matching the state price tag can be acquired, and a music list matching the user's current heart rate can be acquired in the music database.

When the status flag is the default flag, the user's age information can be acquired according to the currently acquired heart rate information, and a music list that matches the age information is pushed to the user in the first music database. Specifically, the range of the heart rate of users in different age groups is different. The normal heart rate of a newborn is 120-140 beats/min; 1 month-1 year old is 110-130 beats/min; 2-3 years old is 100-120 beats/min The normal heart rate of adults is 60 to 100 beats per minute; the heart rate of the elderly is slower than that of the young. For example, if the obtained heart rate information is 100-120 beats/min, it can be known that the user currently using the earphone is a child of 2-3 years old, and the music database will push children's songs and the like to the user.

When the state is marked as an exercise flag, the user's exercise state, such as sleeping, sitting, walking, jogging, mountain climbing, fast running, sprinting, etc., can be acquired according to the currently acquired heart rate information. Among them, in a static state, the user's heart rate is generally between 60 and 90, the maximum heart rate of a healthy adult = 220-age, and the maximum heart rate will generally not exceed the maximum heart rate during exercise. As shown in Table 1:

Table 1 is the correspondence table between heart rate information and exercise state

In the second music database, according to the movement state of the current user, a music list that conforms to the movement state is pushed to the user.

When the status is marked as a prenatal education mark, the age information of the fetus in the belly of the pregnant woman can be obtained according to the currently obtained heart rate information, that is, the pregnancy period of the pregnant woman can be obtained. For example, the fetal heart rate averaged 162 beats/min before 20 weeks of pregnancy, 147 beats/min at 21 to 30 weeks of pregnancy, and 139 beats/min at 31 to 40 weeks of pregnancy. According to the currently obtained heart rate information, the pregnancy stage of the current pregnant woman can be known, such as the first trimester, the second trimester and the third trimester. According to the pregnancy stage of pregnant women, corresponding music lists can be pushed for them.

For example, in the first trimester, the rhythmic vibration of music is also a good stimulus for fetal brain development, which will promote fetal brain development. In the first trimester, you can choose light-hearted, witty, and beautiful music, such as mermaid singing, warm happiness, sunday park, olive tree, etc.; in the second trimester, the fetus has the first fetal movement, which marks the central nervous system of the fetus The differentiation has been completed; the hearing and vision of the fetus begin to develop rapidly, and gradually respond to the pressure, movements, and sounds exerted by the outside world. The content of prenatal education music can be richer, adding more relaxed and lively, slightly faster rhythm music. Babies increase interaction, such as the Happy Farmer's Lyrical Sacred Flute Quintet in B-flat Minor's No. 1 Piano Concerto, Blowing in the Wind, Drunk Together, etc.; in the third trimester of pregnancy, the fetus is in the stage of stable physical and mental growth, and the neurons in the brain are rapidly developing. Growth, the hearing organ has matured, and its structure is basically the same as at birth. At this time, you can choose music that is both soft and full of hope, such as the prenatal education music in the summer when the wind rises and kisses my little baby by the sea.

Step 606: Play the music in the music list according to the preset play strategy corresponding to the state flag.

After the music list matching the heart rate information is acquired in the music database, the music in the music list can be played according to a preset play strategy corresponding to the status flag. For example, when the status is marked as a prenatal education mark, it can filter the music to be played, and at the same time, it can also limit the playing volume, time and other information to protect the safety of the fetus and avoid unnecessary harm to it, etc. .

The music playing method in this embodiment can push different music to different user groups according to the currently obtained heart rate information based on the status mark of the earphone, and the pushed music can also be played according to the preset playing strategy, so as to increase the usage of users. The pleasant feeling of earphones expands the use functions of ordinary earphones, improves user experience, and meets the individual needs of users.

FIG. 7 is a flow chart of playing music according to yet another embodiment. In one embodiment, when the state is marked as a prenatal education mark, the playing music includes:

Step 702: Acquire the to-be-processed audio whose audio frequency is higher than a preset frequency in the music;

The preset frequency is an audio signal value that the fetus can receive. Specifically, the preset frequency may be set to 2000 Hz. Acquire the to-be-processed audio signal higher than the preset frequency in the music to be played.

Step 704: Perform low-pass filtering on the to-be-processed audio to filter the to-be-processed audio.

The low-pass filter is used to filter the audio frequency in the received music higher than the preset frequency, so as to filter out the audio harmful to the fetus, which can well protect the hearing of the fetus and avoid the medium and high frequency sound. damage to the hearing of the fetus.

Step 706: Play the processed music according to a preset volume within a preset time.

Among them, the prenatal education time in the preset time can generally be set to 10-15 minutes. Within the set preset time, the filtered music is played according to the preset volume. The preset volume can be adjusted according to the sound intensity of the microphone heard by adults through the palm of the hand, which is equivalent to the sound intensity that the fetus can hear in the womb; pregnant women with thick abdominal walls, the volume can be slightly larger; abdominal wall Thin pregnant women, the volume should be appropriately small.

In this embodiment, when playing the music in the music list, the audio frequency higher than the preset frequency can be filtered, so as to filter out the audio frequency that is harmful to the fetus, so that the hearing of the fetus can be well protected and the medium and high frequency sound can be avoided. It can cause damage to the hearing of the fetus; at the same time, when playing the filtered music, by controlling the playing time and volume, it can further avoid the damage to the hearing of the fetus caused by playing music for a long time and high decibels.

FIG. 8 is a flow chart of playing music when the status is marked as a prenatal education mark in one embodiment. In one embodiment, when the status is marked as a prenatal education mark, the playing music further includes:

Step 802: Prompt the user whether to record the heart rate signal.

When the status flag is the prenatal education flag, the acquired heart rate signal is the fetal heart rate signal, that is, the fetal heart rate. When acquiring the fetal heart rate, the user is prompted whether to record the heart rate signal. The prompting method may be voice prompting, display prompting, and the like. For example, a voice prompt "whether to record fetal heart rate" can be issued, and the voice prompt can be played through headphones or directly played by the terminal; it can also be displayed on the terminal by displaying pictures and/or text "whether to record the fetal heart rate or not" Heart Rate" prompt.

It should be noted that the prompting method and prompting content for prompting the user whether to record the heart rate signal are not further limited, and the settings can be customized according to the needs of the user.

Step 804: Receive a user's trigger operation, and record the heart rate information based on the earphone.

A trigger operation of the user is received, and the trigger operation is used to instruct the earphone to perform the operation of recording the heart rate information. Among them, the trigger operation can be a user-defined voice trigger, such as "record fetal heart rate", and can also be a touch operation such as clicking or sliding based on a terminal or an earphone. Again, the triggering operation of the user is not further limited.

When the terminal or the earphone receives the user's trigger operation, the earphone-based microphone or electro-acoustic transducer records the heart rate information.

In the music playback method in this embodiment, the heart rate information of the fetus can be recorded based on the earphone, and the recorded fetal heart rate can be marked and stored, which can be kept as a souvenir to improve the user's experience.

FIG. 9 is a flow chart of playing music in another embodiment. In one embodiment, when the state is marked as a motion mark, the playing music includes:

Step 902: When playing music, detect the heart rate information of the current user according to a preset period.

When the state of the earphone is marked as a sports mark, music that matches the heart rate information can be played according to the user's current heart rate information. In the process of playing music, the heart rate information of the current user is detected according to a preset cycle. Wherein, the preset period may be set to 10-30 minutes. When the user's heart rate information needs to be detected, the currently playing music is paused, the pressure change signal in the ear canal due to vibration is collected based on the earphone, and the current user's heart rate information is obtained.

Step 904: When the heart rate information is continuously greater than the first preset heart rate value, perform an operation of reminding the current user.

When the detected heart rate information is continuously greater than the first preset heart rate value, the operation of reminding the current user is performed. The first preset heart rate value is 80% to 90% of the maximum heart rate, and the maximum heart rate of a healthy adult=220-age. Continuously greater than the first preset heart rate value can be understood as the heart rate information measured twice in a row is greater than the first preset heart rate value. When the heart rate information is continuously greater than the first preset heart rate value, an operation of reminding the current user is performed. Among them, the user can be reminded to stop exercising, pay attention to rest, etc. by means of earphone reminders, ringtone reminders, vibration reminders, display reminders, and the like. In this embodiment, the reminder method and reminder content are not limited.

Step 906: When the heart rate information is less than the second preset heart rate value, turn off or pause the currently playing music.

When the detected heart rate information is less than the second preset heart rate value, the music currently being played is turned off or paused. Among them, the second preset heart rate value can be set to 40-60 minutes/time, that is, when the detected heart rate information is less than 40-60 minutes/time, it can be considered that the current user has entered a sleep state, and can be turned off or suspended. Currently playing music to reduce power consumption caused by playing music.

It should be understood that, although the steps in the flowcharts corresponding to the above embodiments are sequentially displayed according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, the execution of these steps is not strictly limited to the order, and these steps may be performed in other orders. Moreover, at least a part of the steps in FIGS. 3-9 may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed and completed at the same time, but may be executed at different times. These sub-steps or stages are not necessarily completed at the same time. The order of execution of the steps is not necessarily sequential, but may be performed alternately or alternately with other steps or at least a part of sub-steps or stages of other steps.

As shown in Figure 10, in one embodiment, a music playback device is provided, the device comprising:

a signal acquisition module 1010, configured to acquire the pressure change signal of the earphone due to vibration at the preset position when the earphone is worn at the preset position of the user;

a heart rate acquisition module 1020, configured to acquire heart rate information according to the pressure change signal;

The music playing module 1030 is configured to push and play music according to the preset position where the headset is worn by the user and heart rate information.

The above-mentioned music playback device can obtain the corresponding heart rate information at the preset position according to the preset position where the user wears the earphone, and push and play music that matches the heart rate information for the user according to the obtained heart rate information, without the need for manual operation by the user. It can recommend and play personalized music for users, which increases the user's sense of pleasure in using headphones and satisfies the user's personalized needs; at the same time, the above music playback method can obtain the user's heart rate without adding additional sensors to the headphones. Information, low cost, simple design, expands the use function of ordinary headphones, and improves user experience.

In one embodiment, the music playback device further includes:

a mark acquiring module, configured to acquire a status mark of the working mode of the earphone by the user, the status mark including at least a default mark, a sports mark and a prenatal education mark;

a prompting module, used for prompting the user to wear the earphone in the preset position according to the status mark;

A determination module, configured to detect whether the earphone is worn at the preset position based on the audio signal played by the earphone.

In one embodiment, the signal acquisition module includes:

an acquisition unit, configured to acquire the detection signal acquired by the earphone at the preset position;

A filtering unit, configured to perform filtering processing on the detection signal, so as to filter out the noise signal in the detection signal, and obtain the pressure change signal.

In one embodiment, the music playback module includes:

a calling unit, configured to call the music database corresponding to the status mark according to the status mark;

a list acquisition unit, configured to acquire a music list matching the heart rate information in the music database;

A playing unit, configured to play the music in the music list according to a preset playing strategy corresponding to the state flag.

In one embodiment, when the status is marked as a prenatal education mark, the playback unit is configured to acquire the audio to be processed whose audio frequency is higher than a preset frequency in the music; perform low-pass filtering on the audio to be processed , to filter the audio to be processed; within a preset time, play the processed music according to a preset volume.

In one embodiment, when the state is marked as a prenatal education mark, the playback unit is further configured to prompt the user whether to record the heart rate signal; receive a trigger operation from the user, and record the heart rate information based on the earphone.

In one embodiment, when the state is marked as a sports mark, the playback unit is used to play music, and detect the current user's heart rate information according to a preset period; when the heart rate information is continuously greater than the first preset heart rate value When the heart rate information is less than the second preset heart rate value, the operation of reminding the user is performed; when the heart rate information is less than the second preset heart rate value, the currently playing music is turned off or paused.

The division of each module in the above music playing device is only for illustration. In other embodiments, the music playing device can be divided into different modules as required to complete all or part of the functions of the above music playing device.

For specific limitations on the music playing device, reference may be made to the above limitations on the music playing method, which will not be repeated here. Each module in the above-mentioned music playing device can be implemented in whole or in part by software, hardware and combinations thereof. The above modules can be embedded in or independent of the processor in the computer device in the form of hardware, or stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

The implementation of each module in the music playing device provided in the embodiments of the present application may be in the form of a computer program. The computer program can be run on a terminal or server. The program modules constituted by the computer program can be stored in the memory of the terminal or the server. When the computer program is executed by the processor, the steps of the music playing method described in the embodiments of the present application are implemented.

The embodiment of the present application also provides an earphone, the earphone includes a collection module, a memory, a processor, and a computer program stored in the memory and running on the processor, the processor is electrically connected to the collection module and the memory, respectively. The acquisition module is configured to acquire the pressure change signal due to vibration at the preset position, and the processor implements the music playing method described in the above embodiments when the processor executes the computer program.

In one embodiment, the acquisition module is an electro-acoustic transducer, and the electro-acoustic transducer is used to play the audio signal and to collect the pressure change signal generated by vibration at the preset position, Wherein, the electro-acoustic transducer is a speaker or a horn.

In one embodiment, the acquisition module is a microphone, which is used to acquire a pressure change signal generated by vibration at the preset position.

Further, when the acquisition module is a microphone, the earphone further includes a speaker, and the speaker is used to play the audio signal.

The embodiment of the present application also provides a computer-readable storage medium. One or more non-volatile computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform as described in the various embodiments above. Describes the music playback method.

The embodiments of the present application also provide a computer program product. A computer program product containing instructions, when run on a computer, causes the computer to execute the music playing method described in the above embodiments.

The embodiment of the present application also provides a terminal device. As shown in FIG. 11 , for the convenience of description, only the parts related to the embodiments of the present application are shown, and the specific technical details are not disclosed, please refer to the method part of the embodiments of the present application. The terminal device can be any terminal device including mobile phone, tablet computer, PDA (Personal Digital Assistant, personal digital assistant), POS (Point of Sales, sales electronic device), vehicle computer, wearable device, etc. example:

FIG. 11 is a block diagram of a partial structure of a mobile phone related to a terminal device provided by an embodiment of the present application. 11 , the mobile phone includes: a radio frequency (RF) circuit 1110 , a memory 1120 , an input unit 1130 , a display unit 1140 , a sensor 1150 , an audio circuit 1160 , a wireless fidelity (WiFi) module 1170 , and a processor 1180 , and power supply 1190 and other components. Those skilled in the art can understand that the structure of the mobile phone shown in FIG. 11 does not constitute a limitation on the mobile phone, and may include more or less components than shown, or combine some components, or arrange different components.

The RF circuit 1110 can be used for receiving and sending signals during sending and receiving of information or during a call. After receiving the downlink information of the base station, it can be processed by the processor 1180; it can also send the uplink data to the base station. Typically, the RF circuit includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 1110 may also communicate with networks and other devices via wireless communication. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division Multiple Access) Access, CDMA), Wideband Code Division Multiple Access (Wideband Code Division Multiple Access, WCDMA), Long Term Evolution (Long Term Evolution, LTE)), email, Short Messaging Service (Short Messaging Service, SMS) and the like.

The memory 1120 can be used to store software programs and modules, and the processor 1180 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 1120 . The memory 1120 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function (such as an application program for a sound playback function, an application program for an image playback function, etc.), etc.; The data storage area may store data (such as audio data, address book, etc.) created according to the usage of the mobile phone, and the like. Additionally, memory 1120 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input unit 1130 may be used to receive input numerical or character information, and generate key signal input related to user settings and function control of the mobile phone 1100 . Specifically, the input unit 1130 may include an operation panel 1131 and other input devices 1132 . The operation panel 1131, also known as a touch screen, can collect the user's touch operations on or near it (such as the user's operations on or near the operation panel 1131 using any suitable object or accessory such as a finger, a stylus, etc.) , and drive the corresponding connection device according to the preset program. In one embodiment, the operation panel 1131 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. To the processor 1180, and can receive the commands sent by the processor 1180 and execute them. In addition, the operation panel 1131 can be implemented in various types such as resistive type, capacitive type, infrared ray, and surface acoustic wave. In addition to the operation panel 1131 , the input unit 1130 may further include other input devices 1132 . Specifically, other input devices 1132 may include, but are not limited to, one or more of physical keyboards, function keys (such as volume control keys, switch keys, etc.), and the like.

The display unit 1140 may be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 1140 may include a display panel 1141 . In one embodiment, the display panel 1141 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. In one embodiment, the operation panel 1131 may cover the display panel 1141. When the operation panel 1131 detects a touch operation on or near it, it transmits it to the processor 1180 to determine the type of the touch event, and then the processor 1180 determines the type of the touch event according to the touch event. The type provides corresponding visual output on the display panel 1141. Although in FIG. 11, the operation panel 1131 and the display panel 1141 are used as two independent components to realize the input and input functions of the mobile phone, in some embodiments, the operation panel 1131 and the display panel 1141 can be integrated to realize the mobile phone input and output functions.

Cell phone 1100 may also include at least one sensor 1150, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor can include an ambient light sensor and a distance sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1141 according to the brightness of the ambient light, and the distance sensor can turn off the display panel 1141 and/or when the mobile phone is moved to the ear. or backlight. Motion sensors can include acceleration sensors, which can detect the magnitude of acceleration in all directions, and can detect the magnitude and direction of gravity when stationary. It can be used for applications that recognize the posture of mobile phones (such as switching between horizontal and vertical screens), and vibration recognition related functions (such as Pedometer, tapping), etc.; in addition, the mobile phone can also be equipped with other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc.

Audio circuit 1160, speaker 1161 and microphone 1162 may provide an audio interface between the user and the cell phone. The audio circuit 1160 can convert the received audio data into an electrical signal, and transmit it to the speaker 1161, and the speaker 1161 converts it into a sound signal for output; on the other hand, the microphone 1162 converts the collected sound signal into an electrical signal, which is converted by the audio circuit 1160 After receiving, the audio data is converted into audio data, and then the audio data is output to the processor 1180 for processing, and can be sent to another mobile phone through the RF circuit 1110, or the audio data can be output to the memory 1120 for subsequent processing.

WiFi is a short-distance wireless transmission technology. The mobile phone can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 1170, which provides users with wireless broadband Internet access. Although FIG. 11 shows the WiFi module 1170, it can be understood that it is not a necessary component of the mobile phone 1100 and can be omitted as required.

The processor 1180 is the control center of the mobile phone, using various interfaces and lines to connect various parts of the entire mobile phone, by running or executing the software programs and/or modules stored in the memory 1120, and calling the data stored in the memory 1120. Various functions of the mobile phone and processing data, so as to monitor the mobile phone as a whole. In one embodiment, the processor 1180 may include one or more processing units. In one embodiment, the processor 1180 may integrate an application processor and a modem, wherein the application processor mainly handles the operating system, user interface and application programs, etc.; the modem mainly handles wireless communication. It can be understood that the above-mentioned modem may not be integrated into the processor 1180. For example, the processor 1180 can integrate an application processor and a baseband processor, and the baseband processor and other peripheral chips can form a modem. The mobile phone 1100 also includes a power supply 1190 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 1180 through a power management system, so as to manage charging, discharging, and power consumption management functions through the power management system.

In one embodiment, the mobile phone 1100 may further include a camera, a Bluetooth module, and the like.

In the embodiment of the present application, the above-described music playing method is implemented when the processor included in the mobile phone executes the computer program stored in the memory.

When the computer program running on the processor is executed, the equipment cost for monitoring the user's health data is saved, the way for the user to obtain the health data is more convenient, and the user's human-computer interaction experience is improved.

Any reference to a memory, storage, database, or other medium as used herein may include non-volatile and/or volatile memory. Suitable nonvolatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in various forms such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), Memory Bus (Rambus) Direct RAM (RDRAM), Direct Memory Bus Dynamic RAM (DRDRAM), and Memory Bus Dynamic RAM (RDRAM).

The above-mentioned embodiments only represent several embodiments of the present application, and the descriptions thereof are relatively specific and detailed, but should not be construed as a limitation on the scope of the patent of the present application. It should be pointed out that for those skilled in the art, without departing from the concept of the present application, several modifications and improvements can be made, which all belong to the protection scope of the present application. Therefore, the scope of protection of the patent of the present application shall be subject to the appended claims.

Claims (12)

1. A music playing method, comprising:

when the earphone is worn at a preset position of a user, acquiring a pressure change signal, which is acquired by the earphone at the preset position and is generated due to vibration;

acquiring heart rate information according to the pressure change signal;

pushing and playing music according to the preset position of the earphone worn and the heart rate information;

acquiring state marks of a working mode of the earphone by a user, wherein the state marks at least comprise default marks, motion marks and antenatal training marks;

prompting a user to wear the earphone at the preset position according to the state mark;

detecting whether the earphone is worn at the preset position or not based on an audio signal played by the earphone;

further comprising:

when the status flag is a prenatal education flag;

prompting a user whether to record the heart rate signal;

and receiving the triggering operation of the user, and recording the heart rate information based on the earphone.

2. The method of claim 1, wherein the obtaining pressure change information due to vibration at the preset position comprises:

acquiring a detection signal acquired by the earphone at the preset position;

and filtering the detection signal to filter a noise signal in the detection signal and obtain the pressure change signal.

3. The method of claim 1, wherein pushing and playing music according to the preset position and heart rate information that the earphone is worn comprises:

calling a music database corresponding to the state mark according to the state mark;

acquiring a music list matched with the heart rate information in the music database;

and playing the music in the music list according to a preset playing strategy corresponding to the state mark.

4. The method of claim 1, wherein when the status flag is a prenatal education flag, the playing music comprises:

acquiring audio to be processed, of which the audio frequency is higher than a preset frequency, in the music;

performing low-pass filtering processing on the audio to be processed to filter the audio to be processed;

and playing the processed music according to a preset volume within a preset time.

5. The method of claim 1, wherein when the status flag is a motion flag, the playing music comprises:

when music is played, detecting the heart rate information of the current user according to a preset period;

when the heart rate information is continuously larger than a first preset heart rate value, executing operation of reminding a user;

and when the heart rate information is smaller than a second preset heart rate value, closing or pausing the currently played music.

6. A music playing apparatus, comprising:

the signal acquisition module is used for acquiring a pressure change signal which is acquired by the earphone at a preset position and is generated due to vibration when the earphone is worn at the preset position of a user;

the heart rate acquisition module is used for acquiring heart rate information according to the pressure change signal;

the music playing module is used for pushing and playing music according to the preset position and the heart rate information of the worn earphone;

acquiring state marks of a working mode of the earphone by a user, wherein the state marks at least comprise default marks, motion marks and antenatal training marks;

prompting a user to wear the earphone at the preset position according to the state mark;

detecting whether the earphone is worn at the preset position or not based on an audio signal played by the earphone;

further comprising:

when the status flag is a prenatal education flag;

prompting a user whether to record the heart rate signal;

and receiving the triggering operation of the user, and recording the heart rate information based on the earphone.

7. A terminal comprising a memory and a processor, the memory having stored therein computer readable instructions which, when executed by the processor, cause the processor to perform the steps of the method of any one of claims 1 to 5.

8. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 5.

9. An earphone, comprising: the system comprises an acquisition module, a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor is respectively electrically connected with the acquisition module and the memory, and the acquisition module is used for acquiring a pressure change signal generated due to vibration at the preset position; the processor, when executing the computer program, realizes the steps of the method of any one of claims 1 to 5.

10. The headset of claim 9, wherein the collecting module is an electroacoustic transducer for playing the audio signal and for collecting the pressure variation signal due to vibration at the preset position.

11. The headset of claim 9, wherein the collecting means is a microphone for collecting a pressure variation signal due to vibration at the preset position.

12. The headset of claim 11, further comprising a speaker for playing the audio signal.