How would I learn more about sharding userdata for a website?
sharding
Solution
You should check the very informative site http://highscalability.com . Posts worth reading:
- Flickr Architecture and Federation
- Livejournal Architecture
- Habits of Highly Scalable Web Applications
Generally you are following the right approach but this can get nasty quite fast if you need to do queries on more than one cluster - e.g. "your friends' recent posts" type queries.
Problem
I'm interested in sharding my websites user data across multiple servers. For example, users will login from the same place. but the login script needs to figure out what server that users data resides on. So the login script would query the master registry for that user name, and it might return that it's on server B. The login script would then connect to server B and verify the username/password. Does that make sense? Is it normal to have something like a master registry to resolve where data resides? also- I've searched but I haven't had much luck finding tutorials/information/strategies on sharding. If there are any online resources that you are aware of on the topic I would greatly appreciate it if you would share so that I may educate myself. Thanks!