TODO 12 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258
  1. mutiny suggests: if none of the ports is defined maybe it shouldn't start.
  2. aaron got a crash in tor_timegm in tzset on os x, with -l warn but not with -l debug.
  3. Oct 25 04:29:17.017 [warn] directory_initiate_command(): No running dirservers known. This is really bad.
  4. rename ACI to CircID
  5. rotate tls-level connections -- make new ones, expire old ones.
  6. dirserver shouldn't put you in running-routers list if you haven't
  7. uploading a descriptor recently
  8. Legend:
  9. SPEC!! - Not specified
  10. SPEC - Spec not finalized
  11. NICK - nick claims
  12. ARMA - arma claims
  13. - Not done
  14. * Top priority
  15. . Partially done
  16. o Done
  17. D Deferred
  18. X Abandoned
  19. Short-term:
  20. . integrate rep_ok functions, see what breaks
  21. - update tor faq
  22. . obey SocksBindAddress, ORBindAddress
  23. - warn if we're running as root
  24. - make connection_flush_buf() more obviously obsolete
  25. . let hup reread the config file, eg so we can get new exit
  26. policies without restarting
  27. - use times(2) rather than gettimeofday to measure how long it
  28. takes to process a cell
  29. . Exit policies
  30. o Spec how to write the exit policies
  31. - Path selection algorithms
  32. - Let user request certain nodes
  33. - And disallow certain nodes
  34. D Choose path by jurisdiction, etc?
  35. - Make relay end cells have failure status and payload attached
  36. - Streams that fail due to exit policy must reextend to new node
  37. - Add extend_wait state to edge connections, thumb through them
  38. when the AP get an extended cell.
  39. - let non-approved routers handshake.
  40. - just list approved routers in directory.
  41. . migrate to using nickname rather than addr:port for routers
  42. o decide_aci_type
  43. - generate onion skins
  44. - circuit_send_next_onion_skin
  45. - circuit_extend
  46. - onion_generate_cpath
  47. - get_unique_aci_by_addr_port
  48. - circ->n_addr and circ->n_port
  49. - circuit_enumerate_by_naddr_nport
  50. - cpath layers
  51. - connection_or_connect
  52. - connection_exact_get_by_addr_port
  53. - connection_twin_get_by_addr_port
  54. - router_get_by_addr_port
  55. - connection_or_init_conn_from_router
  56. - tag_pack, tag_unpack, connection_cpu_process_inbuf
  57. - directory_initiate_command
  58. . Move from onions to ephemeral DH
  59. o incremental path building
  60. o transition circuit-level sendmes to hop-level sendmes
  61. o implement truncate, truncated
  62. o move from 192byte DH to 128byte DH, so it isn't so damn slow
  63. - exiting from not-last hop
  64. - OP logic to decide to extend/truncate a path
  65. - make sure exiting from the not-last hop works
  66. - logic to find last *open* hop, not last hop, in cpath
  67. - choose exit nodes by exit policies
  68. - Remember address and port when resolving.
  69. - Extend by nickname/hostname/something, not by IP.
  70. On-going
  71. . Better comments for functions!
  72. . Go through log messages, reduce confusing error messages.
  73. . make the logs include more info (fd, etc)
  74. . Unit tests
  75. Mid-term:
  76. . Redo scheduler
  77. o fix SSL_read bug for buffered records
  78. - make round-robining more fair
  79. - What happens when a circuit's length is 1? What breaks?
  80. . streams / circuits
  81. o Implement streams
  82. o Rotate circuits after N minutes?
  83. X Circuits should expire when circuit->expire triggers
  84. NICK . Handle half-open connections
  85. o openssh is an application that uses half-open connections
  86. o Figure out what causes connections to close, standardize
  87. when we mark a connection vs when we tear it down
  88. o Look at what ssl does to keep from mutating data streams
  89. ARMA - Reduce streamid footprint from 7 bytes to 2 bytes
  90. - Check for collisions in streamid (now possible with
  91. just 2 bytes), and back up & replace with padding if so
  92. - Use the 3 saved bytes to put pseudorandomness in each relay cell
  93. - Use the 4 reserved bytes in each cell header to keep 1/5
  94. of a sha1 of the relay payload (move into stream header)
  95. - Move length into the stream header too
  96. - Spec the stream_id stuff. Clarify that nobody on the backward
  97. stream should look at stream_id.
  98. . Put CPU workers in separate processes
  99. o Handle multiple cpu workers (one for each cpu, plus one)
  100. o Queue for pending tasks if all workers full
  101. o Support the 'process this onion' task
  102. D Merge dnsworkers and cpuworkers to some extent
  103. - Handle cpuworkers dying
  104. . Scrubbing proxies
  105. - Find an smtp proxy?
  106. - Check the old smtp proxy code
  107. o Find an ftp proxy? wget --passive
  108. D Wait until there are packet redirectors for Linux
  109. . Get socks4a support into Mozilla
  110. . Develop rendezvous points
  111. SPEC!! - Handle socks commands other than connect, eg, bind?
  112. o Design
  113. - Spec
  114. - Implement
  115. - Tests
  116. o Testing harness/infrastructure
  117. D System tests (how?)
  118. - Performance tests, so we know when we've improved
  119. . webload infrastructure (Bruce)
  120. . httperf infrastructure (easy to set up)
  121. . oprofile (installed in RH >8.0)
  122. NICK . Daemonize and package
  123. o Teach it to fork and background
  124. - Red Hat spec file
  125. - Debian spec file equivalent
  126. . Portability
  127. . Which .h files are we actually using?
  128. . Port to:
  129. o Linux
  130. o BSD
  131. . Solaris
  132. o Cygwin
  133. . Win32
  134. o OS X
  135. - deal with pollhup / reached_eof on all platforms
  136. o openssl randomness
  137. o inet_ntoa
  138. . stdint.h
  139. - Make a script to set up a local network on your machine
  140. - More flexibility in node addressing
  141. D Support IPv6 rather than just 4
  142. - Handle multihomed servers (config variable to set IP)
  143. In the distant future:
  144. D Load balancing between router twins
  145. D Keep track of load over links/nodes, to
  146. know who's hosed
  147. SPEC!! D Non-clique topologies
  148. D Implement our own memory management, at least for common structs
  149. (Not ever necessary?)
  150. D Advanced directory servers
  151. D Automated reputation management
  152. SPEC!! D Figure out how to do threshold directory servers
  153. D jurisdiction info in dirserver entries? other info?
  154. Older (done) todo stuff:
  155. o Get tor to act like a socks server
  156. o socks4, socks4a
  157. o socks5
  158. o routers have identity key, link key, onion key.
  159. o link key certs are
  160. D signed by identity key
  161. D not in descriptor
  162. o not in config
  163. D not on disk
  164. o identity and onion keys are in descriptor (and disk)
  165. o upon boot, if it doesn't find identity key, generate it and write it.
  166. o also write a file with the identity key fingerprint in it
  167. o router generates descriptor: flesh out router_get_my_descriptor()
  168. o Routers sign descriptors with identity key
  169. o routers put version number in descriptor
  170. o routers should maybe have `uname -a` in descriptor?
  171. o Give nicknames to routers
  172. o in config
  173. o in descriptors
  174. o router posts descriptor
  175. o when it boots
  176. D when it changes
  177. o change tls stuff so certs don't get written to disk, or read from disk
  178. o make directory.c 'thread'safe
  179. o dirserver parses descriptor
  180. o dirserver checks signature
  181. D client checks signature?
  182. o dirserver writes directory to file
  183. o reads that file upon boot
  184. o directory includes all routers, up and down
  185. o add "up" line to directory, listing nicknames
  186. o instruments ORs to report stats
  187. o average cell fullness
  188. o average bandwidth used
  189. o configure log files. separate log file, separate severities.
  190. o what assumptions break if we fclose(0) when we daemonize?
  191. o make buffer struct elements opaque outside buffers.c
  192. o add log convention to the HACKING file
  193. o make 'make install' do the right thing
  194. o change binary name to tor
  195. o change config files so you look at commandline, else look in
  196. /etc/torrc. no cascading.
  197. o have an absolute datadir with fixed names for files, and fixed-name
  198. keydir under that with fixed names
  199. o Move (most of) the router/directory code out of main.c
  200. o Simple directory servers
  201. o Include key in source; sign directories
  202. o Signed directory backend
  203. o Document
  204. o Integrate
  205. o Add versions to code
  206. o Have directories list recommended-versions
  207. o Include line in directories
  208. o Check for presence of line.
  209. o Quit if running the wrong version
  210. o Command-line option to override quit
  211. o Add more information to directory server entries
  212. o Exit policies
  213. o Clearer bandwidth management
  214. o Do we want to remove bandwidth from OR handshakes?
  215. o What about OP handshakes?
  216. X Move away from openssl
  217. o Abstract out crypto calls
  218. X Look at nss, others? Just include code?
  219. o Use a stronger cipher
  220. o aes now, by including the code ourselves
  221. X On the fly compression of each stream
  222. o Clean up the event loop (optimize and sanitize)
  223. o Remove that awful concept of 'roles'
  224. o Terminology
  225. o Circuits, topics, cells stay named that
  226. o 'Connection' gets divided, or renamed, or something?
  227. o DNS farm
  228. o Distribute queries onto the farm, get answers
  229. o Preemptively grow a new worker before he's needed
  230. o Prune workers when too many are idle
  231. o DNS cache
  232. o Clear DNS cache over time
  233. D Honor DNS TTL info (how??)
  234. o Have strategy when all workers are busy
  235. o Keep track of which connections are in dns_wait
  236. o Need to cache positives/negatives on the tor side
  237. o Keep track of which queries have been asked
  238. o Better error handling when
  239. o An address doesn't resolve
  240. o We have max workers running
  241. o Consider taking the master out of the loop?
  242. X Implement reply onions
  243. o Total rate limiting
  244. o Look at OR handshake in more detail
  245. o Spec it
  246. o Merge OR and OP handshakes
  247. o rearrange connection_or so it doesn't suck so much to read
  248. D Periodic link key rotation. Spec?
  249. o wrap malloc with something that explodes when it fails
  250. o Clean up the number of places that get to look at prkey