Fastest serialization/deserialization of Scala case classes
redis, scala
Solution
UPDATE (2018): scala/pickling is no longer actively maintained. There are hoards of other libraries that have arisen as alternatives which take similar approaches but which tend to focus on specific serialization formats; e.g., JSON, binary, protobuf.
Your use case is exactly the targeted use case for scala/pickling (https://github.com/scala/pickling). Disclaimer: I'm an author.
Scala/pickling was designed to be a faster, more typesafe, and more open alternative to automatic frameworks like Java or Kryo. It was built in particular for distributed applications, so serialization/deserialization time and serialized data size take a front seat. It takes a different approach to serialization all together- it generates pickling (serialization) code inline at the use-site at compile-time, so it's really very fast.
The latest benchmarks are in our OOPSLA paper- for the binary pickle format (you can also choose others, like JSON) scala/pickling is consistently faster than Java and Kryo, and produces binary representations that are on par or smaller than Kryo's, meaning less latency when passing your pickled data over the network.
For more info, there's a project page: http://lampwww.epfl.ch/~hmiller/pickling
And a ScalaDays 2013 talk from June on Parley's.
We'll also be presenting some new developments in particular related to dealing with sending closures over the network at Strange Loop 2013, in case that might also be a pain point for your use case.
As of the time of this writing, scala/pickling is in pre-release, with our first stable release planned for August 21st.
Problem
If I've got a nested object graph of case classes, similar to the example below, and I want to store collections of them in a redis list, what libraries or tools should I look at that that will give the fastest overall round trip to redis? This will include: - Time to serialize the item - network cost of transferring the serialized data - network cost of retrieving stored serialized data time to deserialize back into case classes ``` case class Person(name: String, age: Int, children: List[Person]) {} ```