Rockbox.org home
Downloads
Release release
Dev builds dev builds
Extras extras
themes themes
Documentation
Manual manual
Wiki wiki
Device Status device status
Support
Forums forums
Mailing lists mailing lists
IRC IRC
Development
Bugs bugs
Patches patches
Dev Guide dev guide
Search



Donate

Rockbox Technical Forums


Login with username, password and session length
Home Help Search Staff List Login Register
News:

Rockbox Ports are now being developed for various digital audio players!

+  Rockbox Technical Forums
|-+  Support and General Use
| |-+  Plugins/Viewers
| | |-+  wikipedia xml dump to dir script
« previous next »
  • Print
Pages: [1]

Author Topic: wikipedia xml dump to dir script  (Read 1724 times)

Offline man

  • Member
  • *
  • Posts: 7
wikipedia xml dump to dir script
« on: September 16, 2007, 07:17:31 PM »
here is a php script I wrote for the command line:
http://x.hopto.org/wikidump.php
Problem: on a 5G FAT32 filesystem the script cannot create more files: "No space left on device"
But there is only about 600M used... (122029 files, 3585 dirs)

but moving just a little bit of the wiki to my Ipod and using it with rockbox was great.

however, maybe someone finds this helpful.

man
Logged

Offline dionoea

  • Member
  • *
  • Posts: 30
Re: wikipedia xml dump to dir script
« Reply #1 on: September 17, 2007, 07:11:22 AM »
You could split up the dirs in subdirs based on the 2 or 3 first letters of the wikipedia topic name. That'd make it possible to have all the pages.
Logged

Offline man

  • Member
  • *
  • Posts: 7
Re: wikipedia xml dump to dir script
« Reply #2 on: September 20, 2007, 10:35:51 AM »
Thats what the script already does... But it doesnt work either. Is this a limit to the FAT32 filesystem, or is the partition too small?
Logged

Offline Chronon

  • Rockbox Expert
  • Member
  • *
  • Posts: 4379
Re: wikipedia xml dump to dir script
« Reply #3 on: September 20, 2007, 01:26:00 PM »
It should be easy to tell if you simply ran out of space on that partition.  You can write individual files of up to 4GB to FAT32, so I don't think that's the issue.  
Logged
Sansa e280, Gigabeat F40, Gigabeat S60, Sansa Clip+, iPod Mini 2g

Offline cool_walking_

  • Rockbox Expert
  • Member
  • *
  • Posts: 695
Re: wikipedia xml dump to dir script
« Reply #4 on: September 21, 2007, 04:18:11 AM »
There are also limits on:

number of files in the partition.
number of files in a folder.
number of files/folders in root directory.

122029 and 3585 don't seem like very "even" numbers to hit upon a limit, but maybe you've hit the "number of file in root directory" limit, which I think is one of the smaller limits (somewhere in the range 128-512, i think).
Logged

  • Print
Pages: [1]
« previous next »
+  Rockbox Technical Forums
|-+  Support and General Use
| |-+  Plugins/Viewers
| | |-+  wikipedia xml dump to dir script
 

  • SMF 2.0.17 | SMF © 2019, Simple Machines
  • Rockbox Privacy Policy
  • XHTML
  • RSS
  • WAP2

Page created in 0.084 seconds with 16 queries.