Last Fm logging Scrobbler

[Bilgus]

Last Fm Scrobbler

The Scrobbler plugin keeps a log of songs played and songs skipped

There are some new options

Settings

• Remove duplicates
  Only keeps the same track with the most time elapsed
  
• Delete playback log
  Remove the current playback log once it has been read
  
• View log
  View the current playback log
  
• Save threshold
  0-100% when this percentage of time has elapsed the track will be marked (L)istened
  
• Minimum Elapsed
  0-10000(ms) Tracks played less than Minimum Elapsed will not be logged
  
• Revert to Defaults
  removes changes to settings
  
• Cancel
  quit the plugin
  
• Export
  Only visible if playback.log exists exports log saves changes and exits plugin
  

[Bilgus]

There is a new version of this in the latest dev versions

we now have playback logging in core and you can parse that to export your scrobbler file

see the manual for your device for more info

[orgone]

There is a new version of this in the latest dev versions

we now have playback logging in core and you can parse that to export your scrobbler file

see the manual for your device for more info

I don't see Last Fm entry in the Playback settings. How can I use scrobbler.log now?

[Bilgus]

Plugins>apps>lastfm_scrobbler

when you run it the first time it'll ask you to 'enable playback logging' select YES
and optionally set your options, cick cancel and if asked select yes to save changes
go play some tracks at some time later in the future run the scrobbler plugin again and select Export
you now have your log its located at /.scrobbler.log

Note: you don't have to run the scrobbler plugin except when you want to update the log
but do be aware that you should do it occasionally once playback logging is active
since it will dump rockbox's internal log and mitigate performance issues trying to load such a large log
 I've had no ill effect with a playback log as big as 10mb but its something to be aware of if you let it go for months..

[orgone]

Thank you.
Usability got worse, in my opinion.
1) One more action to export;
2) Listened files must be accessible during export; no metadata in .scrobbler.log otherwise

[Bilgus]

Sorry?
The previous version was a TSR plugin that you had to remember to run
I think remembering to export before track removal is probably less problematic

The main issue I have with scrobbler in core is the amount of data
you have to write to the buffer (and to disk) during playback

With this method devices without a spinning harddisk can just write directly to the disk
they don't need a big buffer to do it quickly enough and it doesn't consume so much core RAM even for the spinning disk devices
because we have a set limit on the amount of data and can have a sensible buffer that is able to hold at least 10 tracks it should also result in less battery used

Not that you aren't still doing the processing anyway but it can be deferred till charging is close at hand..

[pfych]

I just swapped to the daily build and am looking for some clarification regarding the new scrobbling plugin. Once I've started it for the first time and set up playback logging - do I need to launch it every time I start my device (iPod 6th gen)?

Also, will automatic export ever be an option for devices with a bit more grunt and flash storage? It was convenient just plugging in my device and having a script grab/delete my scrobble log file. Needing to remember to go into the plugin, select "export" & then go back into the plugin and select "Delete playback log" is a bit tedious. Especially if you're doing it every night after a day of listening.

Thanks!

[Bilgus]

once you start it it enables playback logging, you don't need to run it again till you want to reap your log and export it then run the plugin and copy the .scrobbler.log file

[pfych]

once you start it it enables playback logging, you don't need to run it again till you want to reap your log and export it then run the plugin and copy the .scrobbler.log file

Awesome, Thanks for the clarification.

[orgone]

The new mechanism skips some listens without any visible reason. Don't know how to debug it to provide more detailed info.
Some listens are just not listed in the result .scrobbler.log file

Sorry?
The previous version was a TSR plugin that you had to remember to run
I think remembering to export before track removal is probably less problematic

The main issue I have with scrobbler in core is the amount of data
you have to write to the buffer (and to disk) during playback

With this method devices without a spinning harddisk can just write directly to the disk
they don't need a big buffer to do it quickly enough and it doesn't consume so much core RAM even for the spinning disk devices
because we have a set limit on the amount of data and can have a sensible buffer that is able to hold at least 10 tracks it should also result in less battery used

Not that you aren't still doing the processing anyway but it can be deferred till charging is close at hand..

[Bilgus]

its parsing files from the log could you see if they exist in playback_old.log?

[Nerten]

Can't understand how this

Code: [Select]

#Parsed Playback log tags: '#' comment, '!' too short, '@' duplicate
#Parsed Playback log tags: '#' comment, '!' too short, '@' duplicate
# Started Ver. 4.0 / Time 250403-164751
# Started Ver. 4.0 / Time 250403-180638
 1743704313:686103:686120:/<HDD0>/Music/AstroPilot/2014 - Iriy [2014, Altar Records, ARCDA40]/01 - Gamayun.flac
 1743704986:672914:673000:/<HDD0>/Music/AstroPilot/2014 - Iriy [2014, Altar Records, ARCDA40]/02 - The Last Night of Svarog.flac
 1743705544:557836:557880:/<HDD0>/Music/AstroPilot/2014 - Iriy [2014, Altar Records, ARCDA40]/03 - Svarog's Morning.flac
 1743706103:559415:559453:/<HDD0>/Music/AstroPilot/2014 - Iriy [2014, Altar Records, ARCDA40]/04 - Rod.flac
 1743706531:427525:427573:/<HDD0>/Music/AstroPilot/2014 - Iriy [2014, Altar Records, ARCDA40]/05 - Makosh.flac
 1743707034:503594:503613:/<HDD0>/Music/AstroPilot/2014 - Iriy [2014, Altar Records, ARCDA40]/06 - Svar-ga.flac
 1743707639:604647:604693:/<HDD0>/Music/AstroPilot/2014 - Iriy [2014, Altar Records, ARCDA40]/07 - Veda [AstroPilot feat. Mikrokosmos].flac
 1743708415:775918:776000:/<HDD0>/Music/AstroPilot/2014 - Iriy [2014, Altar Records, ARCDA40]/08 - Back to Midgard-Earth.flac
# Started Ver. 4.0 / Time 250404-074434
 1743752879:170248:170253:/<HDD0>/Music/Arctic Monkeys/2007 - Favourite Worst Nightmare (made in the EU) [2007, Hostess Ente.._/01 - Brianstorm.flac
 1743753042:163096:163146:/<HDD0>/Music/Arctic Monkeys/2007 - Favourite Worst Nightmare (made in the EU) [2007, Hostess Ente.._/02 - Teddy Picker.flac
 1743753178:136068:136106:/<HDD0>/Music/Arctic Monkeys/2007 - Favourite Worst Nightmare (made in the EU) [2007, Hostess Ente.._/03 - D Is for Dangerous.flac
 1743753348:169134:169226:/<HDD0>/Music/Arctic Monkeys/2007 - Favourite Worst Nightmare (made in the EU) [2007, Hostess Ente.._/04 - Balaclava.flac
 1743753525:177493:177533:/<HDD0>/Music/Arctic Monkeys/2007 - Favourite Worst Nightmare (made in the EU) [2007, Hostess Ente.._/05 - Fluorescent Adolescent.flac
 1743753708:182694:182760:/<HDD0>/Music/Arctic Monkeys/2007 - Favourite Worst Nightmare (made in the EU) [2007, Hostess Ente.._/06 - Only Ones Who Know.flac
 1743753915:207214:207253:/<HDD0>/Music/Arctic Monkeys/2007 - Favourite Worst Nightmare (made in the EU) [2007, Hostess Ente.._/07 - Do Me a Favour.flac
 1743754105:189660:189680:/<HDD0>/Music/Arctic Monkeys/2007 - Favourite Worst Nightmare (made in the EU) [2007, Hostess Ente.._/08 - This House Is a Circus.flac
 1743754379:274181:274200:/<HDD0>/Music/Arctic Monkeys/2007 - Favourite Worst Nightmare (made in the EU) [2007, Hostess Ente.._/09 - If You Were There, Beware.flac
 1743754522:143127:143213:/<HDD0>/Music/Arctic Monkeys/2007 - Favourite Worst Nightmare (made in the EU) [2007, Hostess Ente.._/10 - The Bad Thing.flac
 1743754714:191146:191226:/<HDD0>/Music/Arctic Monkeys/2007 - Favourite Worst Nightmare (made in the EU) [2007, Hostess Ente.._/11 - Old Yellow Bricks.flac
 1743754997:283376:283400:/<HDD0>/Music/Arctic Monkeys/2007 - Favourite Worst Nightmare (made in the EU) [2007, Hostess Ente.._/12 - 505.flac
 1743755137:139969:139986:/<HDD0>/Music/Arctic Monkeys/2007 - Favourite Worst Nightmare (made in the EU) [2007, Hostess Ente.._/13 - Da Frame 2R.flac
 1743755434:297308:297400:/<HDD0>/Music/Arctic Monkeys/2007 - Favourite Worst Nightmare (made in the EU) [2007, Hostess Ente.._/14 - Matador.flac
# Started Ver. 4.0 / Time 250404-094810
# Started Ver. 4.0 / Time 250404-110536

can be less amount of data than this

Code: [Select]

#AUDIOSCROBBLER/1.1
#TZ/UNKNOWN
#CLIENT/Rockbox ipodvideo $Revision$
#ARTIST #ALBUM #TITLE #TRACKNUM #LENGTH #RATING #TIMESTAMP #MUSICBRAINZ_TRACKID
AstroPilot Iriy Gamayun 1 686 L 1743704313 a4cfa745-0a89-437d-ad1b-fac3cf96313e
AstroPilot Iriy The Last Night of Svarog 2 673 L 1743704986 01c459aa-fce6-4e3e-ac3c-0d2b72b76cc8
AstroPilot Iriy Svarog's Morning 3 557 L 1743705544 0266e14c-df73-422a-8c0d-5fc794ccb06c
AstroPilot Iriy Rod 4 559 L 1743706103 3d834c40-5d0e-4860-97bf-e6e87952e21f
AstroPilot Iriy Makosh 5 427 L 1743706531 ef770f39-7a3b-44f2-a808-2c76db7fc2cf
AstroPilot Iriy Svar-ga 6 503 L 1743707034 2c634f43-f55b-4b7f-aace-20da23de6350
AstroPilot feat. Mikrokosmos Iriy Veda 7 604 L 1743707639 09995996-a9c3-4483-b39f-bc068f94b797
AstroPilot Iriy Back to Midgard-Earth 8 776 L 1743708415 49cf4525-6b42-4ad5-a036-e1fbe66779c7
Arctic Monkeys Favourite Worst Nightmare Brianstorm 1 170 L 1743752879 6ad56a7f-6e50-4fe8-8249-508ae990dfba
Arctic Monkeys Favourite Worst Nightmare Teddy Picker 2 163 L 1743753042 d0b676e6-471d-42a5-8d26-11a4580c161d
Arctic Monkeys Favourite Worst Nightmare D Is for Dangerous 3 136 L 1743753178 9ce6407c-41ee-4831-b087-73351ca503c0
Arctic Monkeys Favourite Worst Nightmare Balaclava 4 169 L 1743753348 19e395eb-2018-44ba-8bbf-cde37833c9f4
Arctic Monkeys Favourite Worst Nightmare Fluorescent Adolescent 5 177 L 1743753525 4810b42e-2bb1-4795-874b-85df8fd62ca9
Arctic Monkeys Favourite Worst Nightmare Only Ones Who Know 6 182 L 1743753708 fd081a38-5bb3-43aa-94c5-d50743ec23cf
Arctic Monkeys Favourite Worst Nightmare Do Me a Favour 7 207 L 1743753915 c1221eef-89e5-433d-9e10-9e2417b13aa3
Arctic Monkeys Favourite Worst Nightmare This House Is a Circus 8 189 L 1743754105 8f84da07-09a0-477b-b216-cc982dabcde1
Arctic Monkeys Favourite Worst Nightmare If You Were There, Beware 9 274 L 1743754379 dab20810-4afd-402f-90c7-f5ab6e271e57
Arctic Monkeys Favourite Worst Nightmare The Bad Thing 10 143 L 1743754522 a72ee6d8-048c-4ccc-81e6-51f265dfe1d7
Arctic Monkeys Favourite Worst Nightmare Old Yellow Bricks 11 191 L 1743754714 6ecf3ac2-b1c8-4154-b2a2-8ec2ab0adec2
Arctic Monkeys Favourite Worst Nightmare 505 12 283 L 1743754997 8dee0224-bcf9-4023-a805-9562bafd3450
Arctic Monkeys Favourite Worst Nightmare Da Frame 2R 13 139 L 1743755137 e9c53d06-52eb-4e65-9acc-c710b551bdf2
Arctic Monkeys Favourite Worst Nightmare Matador 14 297 L 1743755434 fdcbc261-6699-4d75-b70f-3a3f17253832

In 3.15 i have ability to auto launch scrobbler plugin by: General Settings > Startup/Shutdown > Start Screen > Open Plugin > lastfm_scrobbler

[Bilgus]

Its not about data as much as the processing of said data on top of the bin size and cache, the disk write isn't the only issue

That said, things like this got removed to make room for other features

The other thing I don't like is the lack options with this and being that it takes up a lot of space already
its hard to justify adding anything to it where as this allows multiple logging use cases
and we can do a lot in a plugin

I'm not putting scrobbling back in core so if it carries that much import use 3.15
or parse your own playback log directly

I would however put the TSR plugin back if there is interest in that I just figured it was redundant

[Nerten]

I don't think bringing back TSR is a good idea.

If you see the new playback.log implementation as a first step towards developing something more advanced, so be it. I just have no idea what else it could be for

Now it's just inconvenient to have to remember to export playback.log before connecting the player to the computer every time

[Bilgus]

what I envision is several other plugins to parse that log, first on my list at least is a way to parse the log and auto remove tracks that you skipped