README.md 636 B

This repo contains tools to extract empirical distributions from the "Share and Multiply" (SaM) dataset of WhatsApp chat metadata.

More thorough documentation is coming soon, but the gist is:

  • Download the json_files.zip file they provide, and extract it somewhere.
  • Run the extract tool to pare and serialize the SaM data.
  • Use the tools in hmm to label messages as "active" or "idle".
  • Run the process tool to generate all empirical distributions other than message sizes.
  • Run the message-lens tool to generate distributions for message sizes.