Kezdőlap Felfedezés Súgó
Bejelentkezés
j3tracey
/
SaM-extractor
1
0
Másolás 0
Fájlok Problémák 0 Beolvasztási kérések 0 Wiki

Extract data from the "Share and Multiply" dataset for use with MGen.

Fa: 338aead827
Branch-ok Tag-ek
SaM-extractor
ZIP TAR.GZ
Justin Tracey 338aead827 hmm: fix bug in parallel_run.sh preventing waiting 6 hónapja
hmm 338aead827 hmm: fix bug in parallel_run.sh preventing waiting 6 hónapja
src 88e3e914be nit: use default hashmap 6 hónapja
Cargo.toml 903b430b76 incorporate file sizes into message lengths 1 éve
README.md 4b84f3685a add some (too) minimal docs and markov model script 6 hónapja

README.md

This repo contains tools to extract empirical distributions from the "Share and Multiply" (SaM) dataset of WhatsApp chat metadata.

More thorough documentation is coming soon, but the gist is:

  • Download the json_files.zip file they provide, and extract it somewhere.
  • Run the extract tool to pare and serialize the SaM data.
  • Use the tools in hmm to label messages as "active" or "idle".
  • Run the process tool to generate all empirical distributions other than message sizes.
  • Run the message-lens tool to generate distributions for message sizes.