JP2023072045A - Operation device, control method for operation device, and program - Google Patents

Abstract

Kind Code: A1 In a state in which a plurality of artworks corresponding to a plurality of music pieces are displayed in an array, various operations such as an artwork replacement operation can be easily performed. Kind Code: A1 An in-vehicle device 1 of the present invention includes a display unit 110 for displaying artworks of a plurality of songs arranged in tiles in a predetermined display area, an operation unit 120 for performing operations on the display area, an operation unit 120, a display control unit 150 that replaces the arbitrary artwork with other artwork that is not displayed when an operation having the first directionality is performed on the arbitrary artwork; and a reproduction control unit 160 for starting reproduction of music corresponding to any artwork when an operation having a second directionality different from the first directionality is performed on the work. characterized by [Selection drawing] Fig. 2

Description

The present invention relates to an operating device, a control method for the operating device, and a program for performing operations such as exchanging artworks.

2. Description of the Related Art Conventionally, there has been known an audio device that displays a plurality of artworks corresponding to a plurality of songs for the purpose of song selection (for example, Patent Document 1). In this type of audio device, when an arbitrary artwork being displayed is to be replaced with another artwork, (1) the arbitrary artwork is selected, and (2) the arbitrary artwork is deleted (for example, delete button), (3) selecting another artwork, and (4) inserting another artwork (for example, operating an insert button).

JP 2009-252329 A

However, when the display screen is small, the artwork replacement operation as described above has a problem that it is difficult to operate because the delete button and the insert button are small. In addition, when the audio device is used as an in-vehicle device, regardless of the size of the display screen, it is dangerous because it will bother the user while driving.

In view of the above problems, the present invention provides an operation device and an operation device that can easily perform various operations such as replacing artworks in a state in which artworks corresponding to multiple songs are displayed in a plurality of arrays. To provide a control method and program for

The operation device of the present invention includes a display unit that displays artworks of a plurality of songs arranged in tiles within a predetermined display area, an operation unit that performs operations on the display area, and a display control that performs display control of the display area. and a display control unit, when an operation having the first directionality is performed on an arbitrary artwork by the operation unit, the arbitrary artwork is displayed as other art that is not displayed. It is characterized by replacing with a work.

In the operation device described above, when an operation having a second direction different from the first direction is performed on an arbitrary artwork, reproduction of music corresponding to the arbitrary artwork is started. It is characterized by further comprising a control unit.

In the operating device described above, the first directionality is a directionality toward the outside of the display area, and the second directionality is a directionality toward the inside of the display area.

In the operation device described above, the display unit and the operation unit are configured by touch panels, and the operation having the first directionality and the operation having the second directionality are flick operations.

In the above operation device, a music list generation unit that generates a plurality of music lists in which music is classified according to its feature amount, and one or more of user's preference, user's biometric information, and environmental information for each music list. and a recommendation level determination unit that determines the recommendation level of each song based on the information of the display control unit, and the display control unit displays the artwork of songs with high recommendation levels in each song list side by side in the display area. Characterized by

In the operation device described above, when an arbitrary artwork is flicked toward the outside of the display area, the display control unit displays the arbitrary artwork as the same music list as the music corresponding to the arbitrary artwork. It is characterized by replacing the artwork of other songs belonging to.

In the operating device described above, the display control unit arranges a feature amount tile indicating the feature amount of each song at an arbitrary position in the display area, and places a song highly recommended in the corresponding song list near the feature amount tile. characterized by arranging the artwork of

In the operating device described above, when a feature amount tile is touched, the display control unit changes all the artwork displayed in the display area to the art of the songs in the song list corresponding to the touched feature amount tile. It is characterized by replacing with a workpiece.

In the above operation device, the display control unit arranges a refresh tile different from the feature amount tile at an arbitrary position in the display area, and when the refresh tile is touched, all art displayed in the display area is displayed. It is characterized by exchanging works.

In the above operation device, the display control unit displays the artwork of the song being played in the center of the display area, and when the artwork of the song being played is touched, the detailed information of the song being played is displayed. is characterized by performing screen switching to a screen that displays .

A control method for an operation device according to the present invention includes a display step of displaying artworks of a plurality of songs arranged in tiles in a predetermined display area, an operation step of performing an operation on the display area, and an operation step of performing an arbitrary operation step. and a replacing step of replacing the arbitrary artwork with other artwork that is not displayed when an operation having the first directionality is performed on the artwork.

A program according to the present invention causes a computer to execute each step in the control method for the operating device.

1 is a system configuration diagram of an in-vehicle system according to an embodiment of the present invention; FIG. (a) is a functional block diagram of an in-vehicle device, and (b) is a diagram showing an example of a music list. FIG. 11 is a diagram showing a display example of an artwork screen; FIG. 4 is a diagram showing a display example of an artwork screen when the artwork groups classified by feature quantity are rotated and the artworks are exchanged from the state of FIG. 3 ; 4 is a flow chart showing the flow of display control of in-vehicle equipment. FIG. 10 is a diagram showing an operation of replacing arbitrary artwork on the artwork screen; FIG. 7 is a diagram showing a display example of an artwork screen when the artwork is replaced by the operation of FIG. 6; FIG. 10 is a diagram showing a reproduction start operation on the artwork screen; 9 is a diagram showing a display example of an artwork screen when music reproduction is started by the operation of FIG. 8. FIG. FIG. 4 is a diagram showing a display example of an artwork screen when a feature amount tile is touched from the state of FIG. 3; FIG. 4 is a diagram showing a display example of an artwork screen when a refresh tile is touched from the state of FIG. 3; FIG. 10 is a diagram showing a display example of a status screen;

An embodiment of the present invention will be described in detail below with reference to the accompanying drawings. In the present embodiment, a case where in-vehicle devices that are mounted in a vehicle and used are used as a display device and an operation device will be exemplified. The in-vehicle device may be one installed after the vehicle is shipped (for example, a car navigation device on the market), or one that has already been incorporated into the vehicle at the vehicle shipment stage.

FIG. 1 is a system configuration diagram of an in-vehicle system SY according to one embodiment of the present invention. The in-vehicle system SY includes an in-vehicle device 1, a mobile terminal 2 possessed by a vehicle passenger such as a driver, a bracelet 3 worn on the wrist of the vehicle passenger, a vehicle control device 4 incorporated in the vehicle, and an Internet and an external server 5 provided in.

The in-vehicle device 1 includes a memory 11, a navigation unit 12, an AV unit 13, a touch panel TP, a speaker 14, a mobile communication interface (hereinafter abbreviated as "I/F") 15, a bracelet communication I/ F16, vehicle communication I/F17, server communication I/F18 and control unit 19 are provided.

The memory 11 nonvolatilely stores music data (including audio data and metadata) for reproducing music by the AV unit 13, in addition to various control programs and control data. It also stores the operation history (the number of times of reproduction, total reproduction time, etc.) of each piece of music data by the in-vehicle device 1 .

The navigation unit 12 includes programs and sensors (including GPS) for implementing navigation functions. The AV unit 13 includes programs and players for realizing music playback functions. The touch panel TP is used for displaying and operating various types of information. In particular, in this embodiment, an artwork screen D1 (see FIG. 3, etc.) for presenting recommended songs to the user, and a status screen D2 for displaying information about the song being played and making various settings. (see FIG. 12) is displayed.

A speaker 14 outputs sounds reproduced by the navigation unit 12 and the AV unit 13 . The mobile communication I/F 15 communicates with the mobile terminal 2 via wireless communication or wired communication. Examples of wireless communication include Bluetooth (registered trademark) communication and infrared communication. Wired communication may be communication via a dock connector or a dedicated cable. Note that the mobile communication I/F 15 may be configured to be capable of communicating with a plurality of mobile terminals 2 .

The bracelet communication I/F 16 communicates with the bracelet 3 via wireless communication such as Bluetooth communication and infrared communication. The bracelet communication I/F 16 may also be configured to be able to communicate with a plurality of bracelets 3 . The vehicle communication I/F 17 communicates with the vehicle control device 4 via a dedicated circuit. The server communication I/F 18 communicates with the external server 5 via the Internet line. Also, the control unit 19 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc., and controls the in-vehicle device 1 in an integrated manner.

The mobile terminal 2 includes a mobile communication I/F 21, a music memory 22, and an operation history memory 23 as main hardware components. As the mobile terminal 2, a tablet terminal such as a smart phone, a mobile phone, a PDA, or the like can be used.

The mobile communication I/F 21 communicates with the in-vehicle device 1 . The music memory 22 nonvolatilely stores music data. The music data stored in the mobile terminal 2 can be played back by the music playback function (not shown) of the mobile terminal 2 , but can also be played back by the AV unit 13 of the in-vehicle device 1 . The operation history memory 23 stores the number of times each piece of music data has been reproduced by the music reproduction function of the portable terminal 2, the total reproduction time, and the like. If the mobile terminal 2 has an Internet connection function, the music search history, audition history, and purchase history of the Web browser or a predetermined Web server (not shown) are also stored. The music data and operation history stored in the mobile terminal 2 are transmitted to the in-vehicle device 1 via the mobile communication I/F 21 .

The bracelet 3 has a bracelet communication I/F 31, a body temperature sensor 32 and a heartbeat sensor 33 as main hardware components. The bracelet 3 is formed by bending an elongated plate-shaped resin material into a C shape, and is worn so that the inner surface thereof contacts the user's wrist.

The bracelet communication I/F 31 communicates with the in-vehicle device 1 . A body temperature sensor 32 measures the body temperature of the user. A heart rate sensor 33 measures the user's heart rate. In addition to the body temperature sensor 32 and the heart rate sensor 33, various sensors (perspiration sensor, etc.) for detecting the user's biological information may be additionally installed. Moreover, the bracelet 3 may be provided with a display function to display the measurement result of the sensor or display the time. The measurement result of the bracelet 3 is transmitted to the in-vehicle device 1 via the bracelet communication I/F 31 .

The vehicle control device 4 includes a vehicle communication I/F 41, an acceleration sensor 42 and a vibration sensor 43 as main hardware components. In addition, it is equipped with various sensors and parts (installed in a general vehicle control device) necessary for vehicle travel control.

The vehicle communication I/F 41 communicates with the in-vehicle device 1 . An acceleration sensor 42 measures the acceleration of the vehicle. A vibration sensor 43 measures the vibration of the vehicle. These measurement results are transmitted to the in-vehicle device 1 via the vehicle communication I/F 41 . In addition to the measurement results of the acceleration sensor 42 and the vibration sensor 43 , detection results of steering wheel operation and detection results of the vehicle skidding, swaying, and deviation from oblique lines may be transmitted to the in-vehicle device 1 .

The external server 5 has a music database 51 storing a lot of music data. The in-vehicle device 1 can acquire music data from the music database 51 and reproduce the acquired music data by the AV unit 13 .

With the above configuration, the in-vehicle device 1 can target music data stored in a predetermined storage area such as the music database 51 of the external server 5, the music memory 22 of the mobile terminal 2, the memory 11 of the in-vehicle device 1, etc. Generate a list of songs by volume. Then, for each song list, the recommendation level (recommendation level to the user) of each song is calculated based on the user's operation history, the measurement result of the bracelet 3, the detection result of the vehicle control device 4, and the like. Artwork of several songs is presented to the user (displayed on the touch panel TP, see FIG. 3, etc.).

Next, with reference to FIG. 2(a), the functional configuration of the in-vehicle device 1 will be described. The in-vehicle device 1 includes a display unit 110, an operation unit 120, a music list generation unit 130, a recommendation level determination unit 140, a display control unit 150, and a reproduction control unit 160 as main functional components. Among them, the display unit 110 and the operation unit 120 are realized by the touch panel TP. Other units are mainly implemented by the AV unit 13 and the control unit 19 .

For example, in the artwork mode, the display unit 110 displays artworks of a plurality of songs arranged in tiles on the touch panel TP (predetermined display area). FIG. 3 is a diagram showing a display example of the artwork screen D1 displayed in the artwork mode. In the figure, the tiles (rectangular areas) marked with "(AW-***)" indicate the artwork (disc jacket, etc.) of each song. Also, the tiles described as "GENRE REFRESH", "HIT CHART REFRESH", and "EPM REFRESH" correspond to the song features "genre", "hit chart", and "EPM", respectively, and are displayed on the artwork screen D1. are arranged one by one at arbitrary positions of . Hereinafter, the tiles indicating these music feature amounts are referred to as "feature amount tiles". Since the “feature amount tiles” are displayed according to the music feature amount set by the user, the number of displayed “feature amount tiles” is arbitrary. Also, it may be hidden by operating a refresh tile, which will be described later.

Also, the tiles described as "ALL REFRESH" are refresh tiles arranged at arbitrary positions on the artwork screen D1. The refresh tile is always displayed in only one place in the artwork screen D1 regardless of the set music feature amount. Also, the large tile displayed in the center of the touch panel TP indicates the artwork of the song being played. On the other hand, in the status mode, the display unit 110 displays a status screen D2 (see FIG. 12) showing detailed information about the song being played. Details of each of the screens D1 and D2 will be described later.

The operation unit 120 operates the screens D1 and D2 displayed on the touch panel TP. For example, in the artwork mode, the artwork is replaced and a reproduction start instruction is given. Also, in the status mode, playback operations and various settings are performed.

The music list generation unit 130 generates a music list by classifying music stored in predetermined storage areas such as the memory 11, the music memory 22, and the music database 51 according to the music feature amount. Here, it is possible to set on the status screen D2 what is adopted as the music feature amount. In this embodiment, it is assumed that three types of "genre", "hit chart", and "EPM" are set as music feature amounts. Note that the song feature amount refers to information that serves as a reference for classifying songs. Therefore, in addition to these three types, "age", "artist", "BPM (Beats Per Minute)", "key", etc. can be set.

FIG. 2(b) is a diagram showing an example of a created music list. Here, the "genre" song list is a list of songs belonging to the genre (jazz, rock, pops, etc.) set on the status screen D2. Also, the "hit chart" song list is a list of songs belonging to the top rankings determined based on song sales and requests. It is assumed that the song rankings are stored in the song database 51 of the external server 5 . The "EPM" song list is a list of songs to which EPM values are added as metadata. The EPM value is a numerical representation of the feeling of activeness of a piece of music, and is expressed in 100 steps from "1 to 100", for example.

The recommendation degree determination unit 140 determines the recommendation degree of each music piece based on one or more elements of "user's preference", "user's biological information", and "environmental information" for each music list. Which of these elements to use is set for each music list on the status screen D2. Weighting of each element is also set for each music list on the status screen D2. Therefore, even for the same song, the degree of recommendation calculated according to the sorted song list is different. In the music list shown in FIG. 2B, the identification information (music ID) of each music is listed in descending order of recommendation. Note that the degree of recommendation is expressed, for example, in 100 levels from "1 to 100" (see parentheses after each song ID).

Here, the "user's preference" refers to the operation history of each song data (the number of times of playback of each song data, the total playback time, the number of searches, the number of trial listenings, the presence or absence of purchase, etc.) of each song data in the in-vehicle device 1 and/or the mobile terminal 2. determined based on In other words, the degree of recommendation is high for a piece of music determined to be the user's favorite from the operation history. "User's biological information" is determined based on the measurement results of the bracelet 3 (body temperature sensor 32 and/or heart rate sensor 33). What to use as biometric information is set on the status screen D2. However, the "user's biometric information" is reflected only when "EPM" is adopted as the music feature amount on the status screen D2. For example, when it is determined that the user is in an excited state based on the measurement result of the bracelet 3, the degree of recommendation of songs with a low sense of activity (low EPM value) is increased.

Also, the "environmental information" is determined based on the vehicle's running position and/or the vehicle's running state. What to use as environment information is set on the status screen D2. The "vehicle travel position" includes area type (sea, mountain, urban area, etc.), road type (expressway, national road, prefectural road, municipal road, etc.), nearest sightseeing spot, and information registered in the navigation unit 12. It refers to destinations and marked points. The “vehicle travel position” can be detected by acquiring current position information from the navigation unit 12 . In addition, "vehicle running condition" refers to running speed, vehicle shaking condition (skidding, wobble, deviating from oblique lines, etc.), braking frequency, and the like. The “running state of the vehicle” can be detected by obtaining measurement results of the acceleration sensor 42 and the vibration sensor 43 from the vehicle control device 4 . When the recommendation level is determined based on "environmental information", for example, if the current driving position is near the "sea", the recommendation level of songs related to the sea (songs with sea-related keywords added as metadata) When BPM increases and the vehicle wobbles significantly, the degree of recommendation of music with a high BPM increases to prevent falling asleep.

When displaying the artwork screen D1, the display control unit 150 preferentially displays artwork related to highly recommended songs in each song list. For example, when the music list shown in FIG. 2B is generated, as shown in FIG. , 16) are selected and displayed. It should be noted that "***" in the notation (AW-***) of each artwork is the music feature amount (G: genre, H: hit chart, E: EPM) of the corresponding music and the ranking in each music list ( 2 digit number).

In addition, the display control unit 150 arranges the artworks of the songs belonging to the same song list close to each other on the artwork screen D1, and replaces the artworks to be displayed as time elapses. In this embodiment, the artwork is replaced every predetermined time t2 (regularly). In addition, the artwork is replaced when at least one of the "user's biological information" and the "environmental information" changes. It should be noted that, among the artworks displayed on the touch panel TP, priority is given to the artworks of songs with a low recommendation degree in each song list when replacing the artworks. For example, for a given song list, if 5 artworks with 1st to 5th recommendation are displayed, the artwork with 5th recommendation is first replaced with the artwork with 6th recommendation, and the next timing is Then, display control is performed such as replacing the artwork with the fourth-ranked recommendation with the artwork with the seventh-ranked recommendation. It should be noted that, depending on the settings on the status screen D2, a predetermined number of artworks with the highest recommendation degrees may not be replaced.

Further, when the operation unit 120 performs a flick operation (an operation having a first directionality) toward the outside of the touch panel TP with an arbitrary artwork as a starting point (starting point), the display control unit 150 controls the arbitrary to replace the artwork with other artwork that is not displayed. Note that the “flick operation” refers to an operation of quickly touching the screen. Also, when a feature amount tile indicating the song feature amount of each song is touched by the operation unit 120, all the displayed artwork is displayed as the art of the song in the song list corresponding to the touched feature amount tile. Replace with work. Further, when a refresh tile arranged only at one place on the touch panel TP is touched by the operation unit 120, all displayed artworks are replaced.

In addition, the display control unit 150 displays a group of artworks classified by feature quantity, which are aggregates of artworks of songs belonging to the same song list (each artwork (AW-***) has the same initial “*” alphabet). 3, the display positions of the symbols E02 to E04) within the touch panel TP are changed as time elapses. In this embodiment, the display position of each feature-based artwork group (the display position of each artwork constituting the feature-based artwork group) is gradually rotated clockwise every predetermined time t1 (regularly). rotate.

When a flick operation toward the inside of the touch panel TP is performed on the artwork screen D1 starting from an arbitrary artwork, the reproduction control unit 160 starts reproducing the music corresponding to the arbitrary artwork. In addition, after the completion of music reproduction, automatic reproduction (automatic selection/automatic reproduction of the next music) is performed. At this time, it is preferable to select the next song based on the song list to which each song belongs and the degree of recommendation. Note that the reproduction control unit 160 performs automatic reproduction after the start of display of the artwork screen D1 until the user performs a reproduction start operation.

Next, the configuration of the artwork screen D1 will be described with reference to FIG. In the artwork screen D1, the artwork of the song being played (the song "AW-E04" in the example shown in the figure) is displayed in a large size in the center of the touch panel TP (playback song display area), as indicated by symbol E01. E01). In the example shown in the figure, the reproduced music display area E01 is four times as large as the other artwork, but it may be set to a size desired by the user. Also, the size of the artwork (the artwork of the music not being reproduced) other than the reproduced music display area E01 may be settable. Note that the size of the artwork may be set by an absolute value such as a unit of mm or a unit of display pixel, or may be set by a relative value such as large, medium, or small.

Also, as indicated by reference numerals E02 to E04, artwork groups by feature amount are displayed (display areas by feature amount) corresponding to the three types of music feature amounts "genre", "hit chart", and "EPM". E02-E04). In addition, each feature amount tile (“GENRE REFRESH”, “HIT CHART REFRESH”, “EPM REFRESH”) indicating the corresponding feature amount is arranged so as to be in contact with at least one artwork in each feature amount-specific artwork group. do. In the example shown in the figure, the feature amount tile has the same size as the surrounding artwork, but it may be set to the user's preferred size.

Also, as indicated by reference numerals E02 to E04, the artwork and feature tiles belonging to the same artwork group by feature quantity are displayed with the same decoration. In this embodiment, as a decoration, a frame of the same color is added for each music feature amount (in the drawing, the color of the frame is represented by different filling patterns). Note that the music feature amount and the color of the frame are determined by the selection order of the music feature amount, not in a one-to-one correspondence. For example, if three of "genre", "hit chart", and "EPM" are selected as song feature values, the frame for "genre" is red, the frame for "hit chart" is blue, and the frame for "EPM" is yellow, and when two of "hit chart" and "EPM" are selected, the number and selection of the selected music feature amounts are displayed, for example, the frame of "hit chart" is red and the frame of "EPM" is blue. The setting color is changed according to the order. In addition, the display position of each feature-based artwork group on the touch panel TP is determined according to the set frame color. In this embodiment, the arrangement order of the artwork groups for each feature amount in an arbitrary rotation direction around the reproduced music display area E01 is determined according to the color wheel.

Also, as indicated by reference numeral E05, only one refresh tile is displayed at an arbitrary position on the touch panel TP (refresh tile display area E05). The refresh tiles are decorated differently from the decorations added to the artwork group for each feature amount.

Next, referring to FIG. 4, changes in the artwork screen D1 over time will be described. FIG. 4 shows a display example of the artwork screen D1 after a certain period of time (longer than the prescribed periods of time t1 and t2) has elapsed from the state of FIG. However, it is assumed that the music being reproduced is the same music.

As shown in FIG. 4, the display areas E02 to E04 classified by feature quantity have moved slightly clockwise around the playback music display area E01 compared to the state shown in FIG. At this time, each feature tile also moves in the same way as the corresponding artwork. Furthermore, the refresh tile display area E05 also moves clockwise along with the movement of the other tiles. In addition, in FIG. 4, the artwork to be displayed is also replaced. In this case, the artwork of songs with a low recommendation degree is preferentially replaced in each song list. For example, two artworks (“AW-G07” and “AW-G08”) are not displayed in the display area E02 classified by feature quantity for “Genre” compared to the state of FIG. In addition, one artwork (“AW-H06”) is added to the “hit chart” display area by feature amount E03, and one artwork (“AW-H06”) is added to the display area by feature amount E04 of “EPM”. E05”) is added. Further, in each of the display areas E02 to E04 classified by feature amount, the artwork is rearranged as well as the artwork is replaced. The arrangement of artwork is based on a predetermined algorithm such as random arrangement.

Next, the flow of display control in the in-vehicle device 1 will be described with reference to the flowchart of FIG. Here, it is assumed that the user does not perform an artwork replacement operation. The in-vehicle device 1 (display control unit 150) determines whether or not a predetermined time t1 has elapsed since the previous rotation (movement of the display position) of the artwork group classified by feature amount (S01). When the predetermined time t1 has passed (S01: Yes), the display position of the artwork group classified by feature quantity is rotated (S02). If the predetermined time t1 has not passed (S01: No), S02 is omitted.

After that, it is determined whether or not a predetermined time t2 has elapsed since the last artwork replacement (S03). If the predetermined time t2 has not elapsed (S03: No), whether or not at least one of the "user's biological information" and "environmental information" has changed (whether there has been a change in the ranking of the degree of recommendation of each song list). (S04), and if not changed (S04: No), return to S01. Also, if a predetermined time t2 has passed since the previous artwork replacement (S03: Yes), or if at least one of the "user's biometric information" and "environmental information" has changed (S04: Yes), the artwork are exchanged (S05), and the process returns to S01.

Next, referring to FIGS. 6 to 11, changes in the artwork screen D1 accompanying user operations will be described. As shown in FIG. 6, a flick operation is performed from an arbitrary artwork (“AW-H04” in the example of FIG. 6) toward the outside of the touch panel TP (for example, in the direction of reference numerals 61 to 63). Then, as shown in FIG. 7, another artwork is displayed instead of the arbitrary artwork ("AW-H06" in the example of FIG. 7). However, the replacement with another artwork is subject to the condition that the song belongs to the same song list as the song corresponding to the given artwork.

Further, as shown in FIG. 8, with an arbitrary artwork (“AW-H04” in the example of FIG. 8) as a starting point, a flick operation is performed toward the inside of the touch panel TP (for example, in the direction of reference numerals 65 and 66). is performed, as shown in FIG. 9, an arbitrary artwork is displayed in the reproduction music display area E01, and the reproduction of the music corresponding to the arbitrary artwork is started. In addition, in the area where the arbitrary artwork was displayed, another artwork is displayed instead of the arbitrary artwork ("AW-H06" in the example of the figure). In this case as well, the replacement with another artwork is subject to belonging to the same music list as the music corresponding to any artwork.

Further, as shown in FIG. 10, when an arbitrary feature amount tile (“GENRE REFRESH” in the example of FIG. 3) is touched from the state of FIG. The feature amount tiles other than the arbitrary feature amount tile ("HIT CHART REFRESH" and "EPM REFRESH" in the example shown in the figure) are replaced with the artwork of the music in the music list corresponding to the touched feature amount tile. In other words, in the example of FIG. 3, all the displayed artworks are artworks of songs belonging to the song list of "genre". In this case, the artworks are not exchanged or rearranged in the display area E02 classified by feature amount of "genre". Further, the display positions of the reproduced music (display of the reproduced music display area E01) and the refresh tile display area E05 do not change.

Further, as shown in FIG. 11, when the refresh tile (“ALL REFRESH”) is touched from the state of FIG. 3, all the artworks displayed on the touch panel TP are replaced. In this case, the display position of each feature amount tile does not change. Further, the display positions of the reproduced music (display of the reproduced music display area E01) and the refresh tile display area E05 do not change. Furthermore, the display positions of the display areas E02 to E04 classified by feature amount and the number of artworks forming each artwork group classified by feature amount also do not change.

Next, the configuration of the status screen D2 will be described with reference to FIG. Display switching from the artwork screen D1 to the status screen D2 (switching from the artwork mode to the status mode) is executed by touching the playback music display area E01 of the artwork screen D1 (not shown). As shown in the figure, the status screen D2 has a "circle" based design as a whole, and can be distinguished from the artwork screen D1 based on "square" at a glance. Display switching from the status screen D2 to the artwork screen D1 is executed by touching a predetermined screen switching button (not shown) provided on the status screen D2 or a playback music display area E11 described later. .

In the center of the status screen D2, a circular reproduced music display area E11 for displaying the artwork of the music being reproduced is arranged. A reproduction music information area E12, a reproduction music operation area E13, a recommendation level setting area E14, and a sound setting area E15 are arranged so as to divide a large circular area into sectors. The reproduced music information area E12 displays the metadata of the music being reproduced and the source (recording media such as the memory 11, the music memory 22, and the music database 51). The reproduction music operation area E13 displays a GUI (Graphical User Interface) such as a play/pause button, a fast forward/rewind button, and the like, which is installed in general audio equipment and is related to reproduction music operation.

The recommendation level setting area E14 is an area for selecting/setting each condition for determining the recommendation level, and displays selection buttons/setting areas for the following items. In the recommendation degree setting area E14, selection of music feature amount (selection of feature amount types such as "genre", "hit chart", "EPM", and "age", and detailed setting thereof (designation of "genre", "age") etc.)), selection of parameters for determining the degree of recommendation (for each song list, which factors to adopt among "user's preference", "user's biological information" and "environmental information", and their weighting) settings), selection of biometric information (whether to adopt body temperature sensor 32 or heart rate sensor 33), selection of environmental information (whether to adopt either “driving position” or “driving location” of vehicle), A source source is selected (which one of the memory 11, the music memory 22, and the music database 51 is targeted). When the setting is changed in the recommendation level setting area E14, the recommendation level of each music list is affected, so the display of the artwork screen D1 is updated.

A sound setting area E15 displays a setting area for equalizer setting and volume setting, a spectrum analyzer (music waveform) display, and other GUIs related to sound settings that are installed in general audio equipment.

A link display area E16 is arranged in the lower right portion of the status screen D2. The link display area E16 indicates the link state between the in-vehicle device 1 and the bracelet 3 by ON/OFF of an image simulating the bracelet 3 . When the in-vehicle device 1 and the bracelet 3 are in a non-linked state, the biometric information does not affect the recommendation level of the music list "EPM" even if the biometric information is selected in the recommendation level setting area E14.

As described above, according to the present embodiment, on the artwork screen D1, the artwork of one or more songs belonging to each song list classified by feature amount is arranged and displayed in tiles on the touch panel TP. Since the target artwork is replaced over time, it is possible to present songs with a better appearance than conventional playlists in which song titles are listed according to the playback order. Also, by replacing the artwork, it is possible to always present fresh music to the user. In addition, by expanding the sources of music, such as the external server 5, users can expect unexpected encounters with music that they have never heard before.

In addition, when the user does not perform any operation, automatic playback eliminates the need for music selection operation, so the user is not bothered while driving. On the other hand, it is also possible to change or stop music by user operation. As described above, according to the present embodiment, it is possible to realize a method of presenting music that takes advantage of the radio and eliminates the disadvantages.

Further, according to the present embodiment, on the artwork screen D1, by flicking an arbitrary artwork toward the outside of the touch panel as a starting point, the arbitrary artwork is exchanged with another artwork. can be easily performed in one step. In addition, by touching the feature amount tile or the refresh tile, it is possible to collectively replace a plurality of songs, making the operation even easier. In addition, by flicking an arbitrary artwork toward the inside of the touch panel, playback of the music corresponding to the arbitrary artwork is started, so the playback operation can be easily performed in one step.

Also, by touching the artwork of the song being played (playback song display area E01) displayed in the center of the artwork screen D1, the screen can be switched to the status screen D2. Compared to the conventional screen switching method of switching to the screen of , detailed information can be confirmed and detailed settings can be performed with fewer steps.

In addition, the following modifications can be adopted. For example, the display control unit 150 of the above-described embodiment displays the artwork of all songs except the artwork of the song being played back in the same size (see FIG. 3, etc.). , the display size of each artwork may be changed. That is, the artwork of songs with a high recommendation degree may be displayed larger than the artwork of songs with a low recommendation degree. According to this configuration, the user can grasp the degree of recommendation of a song at a glance.

In the above-described embodiment, the color of the frame added to the artwork is variable as a decoration for each song feature quantity, but instead of the frame color, and together with the frame color, the frame pattern is variable. You can Also, instead of the frame, the background color of each artwork (tile) may be changed, or a predetermined mark may be added.

As a modified example, instead of setting the color of the frame for each music feature amount, an intermediate color between two types of music feature amounts may be set. For example, a reddish purple frame is applied to an artwork corresponding to a song with a recommendation level of "1" for a "genre" set in red and a recommendation level of "5" for a "hit chart" set in blue. may be added. As a result, gradation can be formed over the entire artwork, and the appearance can be further improved. In addition, since the user can guess two types of music feature amounts from the color of the frame, the user can select music more intuitively.

Also, in the above embodiment, the artwork is the disk jacket of the song, but the artwork is not limited to this, and an original image created by the user for the song may be used as the artwork. In other words, "artwork of a song" in the claims means artwork associated with the song.

Further, in the above-described embodiment, when the predetermined time t1 has passed, the group of artworks classified by feature quantity is rotated, and when the predetermined time t2 has passed, or at least one of "user's biometric information" and "environmental information" is rotated. Although the artwork is exchanged when , is changed (see FIG. 5), the rotation of the group of artworks classified by quantity and the exchange of artworks may be performed at the same timing. In addition, it is also possible to change the presence/absence of rotation of the group of artworks classified by feature quantity, the rotation direction, the presence/absence of replacement of artworks, the replacement algorithm, and the predetermined times t1 and t2 by setting.

Further, in the above-described embodiment, in the case of exchanging artworks or instructing the start of playback, "an operation on an arbitrary artwork" is an operation starting from an arbitrary artwork. An operation with a work as an end point or an operation with an arbitrary artwork as a transit point may be defined. In addition, it may be possible to set, on the status screen D2, which of these operations is used to instruct the replacement of artworks or the start of reproduction.

Further, in the above-described embodiment, as an operation for exchanging artworks (an operation having a first directionality), an outward flick operation on the touch panel TP was exemplified. It may be defined as one or more of downward, rightward, leftward, rightward diagonal, and leftward diagonal directions. Alternatively, it may be defined as inside. Similarly, as an operation (an operation having a second directionality) for instructing the start of reproduction, an inward flick operation on the touch panel TP was exemplified, but one or more of the above options may be defined. . In addition to the flick operation, the artwork may be exchanged or playback may be started by another operation with directionality such as a drag operation, pinch-in (pinch-close)/pinch-out (pinch-open), or the like.

Further, in the above-described embodiment, in the recommendation level setting area E14 of the status screen D2, a parameter for determining the recommendation level is set for each music list. Batch setting is also possible.

In the above embodiment, the biometric information of the vehicle passenger (driver) is detected by the bracelet 3, but the biometric information may be detected by another device (for example, a thermometer or a heart rate measuring device). Also, the mobile terminal 2 may be provided with a biometric information detection function (body temperature sensor 32 or heart rate sensor 33).

Also, in the above embodiment, the artwork is displayed for the purpose of presenting the music to the user, but the present invention can also be applied when presenting content other than music data (videos, still images, etc.). .

Further, in the above embodiment, the display unit 110 and the operation unit 120 are implemented by the touch panel TP, but they may be implemented by individual hardware. Further, in the above embodiment, the case where the present invention is applied to the in-vehicle device 1 was illustrated, but the present invention can also be applied to other electronic devices (display devices, operating devices).

Further, it is possible to provide each component of the vehicle-mounted system SY described above as a program. It is also possible to store the program in various recording media (CD-ROM, flash memory, etc.) and provide it. That is, a program for causing a computer to function as each component of the in-vehicle system SY and a recording medium recording it are also included in the scope of the present invention. In addition, appropriate modifications are possible without departing from the gist of the present invention.

1: In-vehicle device 2: Mobile terminal 3: Bracelet 4: Vehicle control device 5: External server 110: Display unit 120: Operation unit 130: Music list generation unit 140: Recommendation level determination unit 150: Display control unit 160: Playback control unit D1: Artwork screen D2: Status screen E01: Playback music display area E02: Display area according to feature amount of "genre" E03: Display area according to feature amount of "hit chart" E04: Display area according to feature amount of "EPM" E05 : refresh tile display area E11: playback music display area E12: playback music information area E13: playback music operation area E14: recommendation level setting area E15: sound setting area E16: link display area SY: in-vehicle system TP: touch panel

Claims (1)

a display unit that displays artworks of a plurality of songs arranged in tiles in a predetermined display area;
an operation unit for performing an operation on the display area;
A display control unit that performs display control of the display area,
The display control unit replaces the arbitrary artwork with another artwork that is not displayed when an operation having the first directionality is performed on the arbitrary artwork by the operation unit. An operating device characterized by:

Images