[sldev] Proposition of cache improvment

[Laurent Laborde]

On Tue, Apr 21, 2009 at 3:30 AM, Carlo Wood <carlo at alinoe.com> wrote:
> One could use an arbitrary cache "file tree" to represent
> a (frequently visited) sim, and sync it again with the servers
> view of that sim using rsync.
>
> http://en.wikipedia.org/wiki/Rsync
>
> Rsync is a well established, stable and robust tool with
> an extremely efficient way of syncing slowly changing
> arbitrary data.

As far as i know (and it make sense), eveything but textures files,
sound, animation are in database (probably mysql).
You can't rsync that ^^

Also, rsync is very good to save bandwith (copy only the modified/new
file), but the initial check (comparaison of distant vs local file) is
very slow and ressource intensive.
(an overkill for a usage in SL (it check too many things that make no
sense to check in SL)
It's much faster to copy everything when you know that something
changed. (that's what we're doing at work)

And sooner or later, everything will be http(s) based, which is a very
good idea !
Proxy, reverse proxy, CDN, huuuuge webserver cloud/farm (amazon,
google, sun, ibm, microsoft, ...)
Extremly wide and very well supported set of sotfware for everything
you can dream about any usage of http.

I'm waiting since years(!) to be able to plug a proxy (like Squid)
between the SL Viewer and LL's servers.
Because :
- I have 100Mbps fiber optic at home, with good ping in france
(<10ms). But the ping to USA is over 100ms. (and when you have to
request thousands of textures, it's important)
- LL server can be slow
- my desktop computer is not made for that
- i'll be happy to dedicate an old/cheap linux server just for that.
With as many TB of disk i may need (a few GB will probably be enough,
and could fit in ram disk cache of a dedicated server :D )

-- 
F4FQM
Kerunix Flan
Laurent Laborde