Tagcache ignores certain folders\Tagcache freezes\Tagcache messes navigation up

[cal]

The tagcache thingie is driving me crazy.  Basically I have 3 particular problems with tagcache with several builds, so I'm posting them all here, and I hope a kind soul helps me  

Problem #1  EDIT: SOLVED
I posted this problem in another fora/forum/forums

And I have noticed that tag cache doesn't add certain folders. For example MUSIC/BLUES-FOLK-INDIE-POSTROCK/J/Joni Mitchell is never added, while Josh Ritter at the same level, is. Both folders contain at least one folder with one album ripped @ ogg-192 and one orphan track in the Joni Mitchel folder, several ones in 'Josh Ritter'. The orphans are mp3s.

I also have another Joni Mitchell song in another folder, it's a multi-artist folder and that's the only Joni Mitchell song added.

I have more than 10K songs in my X5, so I don't know if that's the only folder that tag cache doesn't read. I think not, but I haven't found another missing folder.

I also have another problem with my playlists. Basically, even though a playlist has more than 10k tracks, I can only see 10k and I get the message: Playlist Buffer Full.

I don't know if both problems are related or not but I would like to know if anybody has experienced either one. (EDIT:  SOLVED)  BTW, I've tried several builds, including Max's latest two builds: same result, that folder is not read. Now I'm using 060904-0132.

PS. When I said I've tried several builds, I mean full installation, I delete the whole .rockbox folder and install the new build.

I am using build 060919-0047, no patches.  Today I noticed that the folder MUSIC\ROCK-POP\S\The Shins is also ignored.  It has one album ogg@192 and one mp3@192.  The vorbis files were decoded with Mediamonkey and the mp3s were **coughs downloaded coughs**

I've tried deleting the tag cache files and start the whole process several times with several builds (patched and unpatched) and the same files are always ignored.

Problem #2

I think this same problem was just posted by another member but the thread got a bit off-topic so I'm posting it here too.
Tag cache freezes.  From 'view tagcache info' the tagcache process freezes.  I've noticed that it usually stops at a very low percentage or at 97%.  I've tried several options, 'load to ram', etc.  And of course when the updating of the tagcache freezes, I can't use ID browsing (I only use the search function of ID browsing).

Problem #3

Again, I tried several builds.  Basically, (sometimes) when I initiate/update the tagcache, I can't navigate my files.  For example, left-click doesn't work at all, or instead of going back one folder, goes all the way to the root folder.
-------

I don't know if those 3 problems are related but I'd like to know if there are more people experience any of these problems.

[Llorean]

Wait, so how do you know it misses folders if it freezes before it completes?

[cal]

That's why I said they're 2 different problems.  Sometimes the tagcache process freezes (I know coz the percentage doesn't change at all) and I can't access the database, sometimes it freezes and I can access it even though the process has stopped.  Sometimes it doesn't freeze at all, at least not that I know.

Like right now, tagcache says:
Initialized:Yes
DB Ready: Yes
RAM cache: Yes
RAM: 915008/948096 B
Progress: 97% (20137 entries) < i don't have 20k tracks
Commit step: 0
Commit delayed: No

And I CAN use ID browsing.

PS.   When I say freeze, I mean the process freezes, not the player.  Although sometimes it does, also when running tagcache.

PS2.  I'm gonna try to move one of those folders to a different location and see what happens.

[Llorean]

Try moving both of the folders that cause problems *off* the player, and then Initialize Tagcache and see if it gets to 100%. Or -1%. Or really anything different.

[cal]

The problem is that I keep finding missing folders.  I've found 3 so far.  But I'll do that later, I moved one of those folders to my Music folder and updated the tagcache to see what happens.

[Llorean]

What do you mean 'moved it to my music folder'?

Moving the folders around on your player shouldn't make any difference (unless their filename including path is too long).

[cal]

Here's what happened:

I moved one of those folders (Joni Mitchel) and selected 'Update tagcache'.  Waited 5 minutes then checked the info:
Initialized:Yes
DB Ready: No
RAM cache:
RAM:
Progress: -1% (20187 entries) < i don't have 20k tracks

I turned it off/on. And this is what I got
Info:
Initialized:Yes
DB Ready: Yes
RAM cache: Yes
RAM: 915008/948096 B
Progress: 16% (it's working)
Commit step: 0
Commit delayed: No

Artist:  Now, only two artists show up:  The postal service and ....  Joni Mitchell  

What I don't understand is that the Joni Mitchel folder was ignored and the Josh Ritter at the same level was read and added to the database.

PS.
I keep all my music in 9 global genres, i.e. > MUSIC/BLUES-FOLK-INDIE-POSTROCK/J/Joni Mitchell.  So I moved /Joni Mitchell to MUSIC and it was added.  But as I said other files at the same level are added:  Josh Ritter.  But I don't think that path is too long  

PS2.  Thanks btw.

[Llorean]

I don't think the folder name is too long (I could be wrong). The num ber of entries in TagCache is always greater tha n the number of songs you have (in my experience) and I'm not exactly sure what it relates to.

Anyway, when you tried to rebuild it after moving the folder, did you "Update" or did you do "Initialize Now" to recreate it?

[cal]

Update

Right now it's at 97%.  I'll wait a few minutes and see if it changes to anything.

[cal]

This is weird:  I rebooted the player and moved the folder back from music, to where it was before.  I can't select 'update' so I select 'initialize'.  The player freezes twice.  I reset the player and go to tagcache information and I see that it's tagcache is scanning the files but the DB is ready.  I go to artist from the ID browsing window and the same two folders are showing up.  And even though I had moved the joni mithchel folder, I can still select the songs and play them.  So I guess that's good.

I'll wait until the tagcache is ready and do the same with the other folders.

[Febs]

With respect to your playlist problem, try increasing the playlist song limit:  General Settings --> System --> Limits --> Max Playlist Size

[cal]

Yeah thanks.  That was a problem with the patched build.

[cal]

Problem 1 was solved.  I just cut/paste the folders in the root folder and then pasted them again where they used to be, and voila!  They're in the database now