Steve: Developing on the Edge - Convenience over Correctness
Steve: Developing on the Edge
Thoughts on development, Web-services, technology and mountains.
2Jul
Wed2008
Convenience over Correctness

Lovely posting and article by Steve Vinoski criticising the ongoing pursuit of an RPC library that works. I look forward to Michi Henning's response.

Hadoop uses RPC to chat between nodes; everything has custom serialization and the heartbeats include data -tricks that work on a LAN. But they have a hard time keeping clients and clusters in Sync: what makes a workable and efficient protocol for the gigabit LAN in the datacentre is not appropriate for client-cluster comms, not when the clients aren't under control, or when they are a distance away. I'd like to work on a good REST api there -something like S3FS for storage, a pure REST model for Jobs too.

Comments