Historical backlog of SB programs

[litdev]

Split from https://litdev.uk/mybb/showthread.php?tid=75&page=2

WhTurner,

Do you have an archive of all uploaded SB programs - did you systematically scrape them or have some other way to access them?

Just curious - I do remember someone in the past on the old forum doing something like this.

[WhTurner]

Hi litdev,

There are still 277 posts with the tag smallbasic in the MS Q&A available (14 pages, not all about Small Basic)
https://learn.microsoft.com/en-us/answer...sic?page=3

On page 3 the first post is : (from Dec. 24 2022)
""https://learn.microsoft.com/en-us/answers/questions/1141096/how-can-i-download-all-microsoft-smallbasic-progra?page=1#answers""
https://learn.microsoft.com/en-us/answer...=1#answers


"Scout" published in this thread links to textfiles with the program names.

[litdev]

Thanks, great resource and good thinking Scout to grab it before forum was lost!

[z-s]

I guess a command line program named gau(get all url ) in github through which we can get all url if we add like this url in command: http://smallbasic.com/program/ we would get all small basic program publish till now any one can try or else I will try it soon.
Github url : https://github.com/lc/gau
Read instructions and try

[litdev]

gau looks like fun - not sure if it will reveal anything, but may be fun for you to have a go.

I did have a think about brute force, but just using the old AAA111 syntax, there are 26^3*10^3 = is about 17 million possible IDs to check, and to do a download or even check if there is a valid file takes around 1 sec each for the network call (a bit less, but not much less).  Also, most 'interesting' files (those someone wanted to share) were probably published to the old forum so this archive of 7000 odd files which we have is a good resource - I wrote a prog to get them all and save in a folder with original date attribute and a comment in the top of each file about which forum thread it came from with thread author (data originally scraped by Scout I think).  I can then search these (and my cases) using SB-Prime file searcher.

There are the files on Facebook or files with the more recent ID indexing which I don't have many of, after the demise of old forum.

EDIT

gau http://smallbasic.com/program does find around 1126 files - so not all of them, but maybe those most downloaded or something?

[z-s]

I found a crazy idea i searched in Google for this and got thousands of results.
Search this ............. http://smallbasic.com/program