Mercurial > dovecot > core-2.2
annotate TODO @ 15030:af00d5c42ac1
TODO updated
author | Timo Sirainen <tss@iki.fi> |
---|---|
date | Tue, 04 Sep 2012 19:05:44 +0300 |
parents | 9c69df65af7b |
children | 12cd194553a8 |
rev | line source |
---|---|
14926
9c69df65af7b
Simplified hash table union now that it again works only with pointers.
Timo Sirainen <tss@iki.fi>
parents:
14865
diff
changeset
|
1 - libssl-iostream read all of file input stream, no buffer limits in ssl |
9c69df65af7b
Simplified hash table union now that it again works only with pointers.
Timo Sirainen <tss@iki.fi>
parents:
14865
diff
changeset
|
2 - finish dsync rewrite |
9c69df65af7b
Simplified hash table union now that it again works only with pointers.
Timo Sirainen <tss@iki.fi>
parents:
14865
diff
changeset
|
3 |
9c69df65af7b
Simplified hash table union now that it again works only with pointers.
Timo Sirainen <tss@iki.fi>
parents:
14865
diff
changeset
|
4 - doveadm: if running via doveadm-server and it fails, say something about |
9c69df65af7b
Simplified hash table union now that it again works only with pointers.
Timo Sirainen <tss@iki.fi>
parents:
14865
diff
changeset
|
5 error being in the log |
14753 | 6 - indexer-worker and maybe others (doveadm?) could support dropping privileges |
7 permanently when service_count=1. Note that LMTP can't with multiple RCPT | |
8 TOs. | |
9 - after reading whole message text, update has_nul-state to cache | |
10 - if indexpvt is enabled, mailbox_list_indexes should go there? at least | |
11 private flags are otherwise problematic.. possibly only for shared/public | |
12 mailboxes?.. | |
13 - index_mail_parse_headers() etc. message_parsers don't check for stream errors | |
14585 | 14 - FIFOs maybe should be counted as connections, but unlisten should |
15 unlink+reopen it in master? | |
14926
9c69df65af7b
Simplified hash table union now that it again works only with pointers.
Timo Sirainen <tss@iki.fi>
parents:
14865
diff
changeset
|
16 - change proxy TTL so it stops at 1? (instead of 0) |
14140 | 17 - lmtp client/proxy: Handle multiline replies better |
18 - recreate mailbox -> existing sessions log "indexid changed" error | |
13907 | 19 - add message/mime limits |
13677 | 20 - imapc: |
21 - prefetching to THREAD and SORT | |
22 - check all imap extensions and see if some don't work (condstore) | |
13900 | 23 - per-namespace imapc_* settings? create a way to "copy" a settings struct, |
24 so mail_storage_settings are copied to mail_namespace_settings. use the | |
25 change tracking to figure out what settings are namespace-specific. | |
13677 | 26 |
13900 | 27 - passdb, userdb { username_format } that doesn't permanently change |
28 the username | |
13470 | 29 - mdbox/sdbox index rebuild -> quota rebuild? |
13360 | 30 - solr separate attachments (patch) |
31 - sql connection pooling: Count lookup latencies, avoid servers with | |
13777 | 32 significantly higher latencies. optionally use the secondary server only |
33 as fallback | |
13360 | 34 - maildir_storage_sync_force() shouldn't do anything except find the new |
35 file, don't go expunging any more stuff or we could get recursively back to | |
36 where we started, and stuff would break | |
37 - imap: append/copy could trigger indexing (optionally) | |
38 - fuzzy: be fuzzy about date/size | |
12756 | 39 - mailbox list index: |
40 - with in-memory indexes be sure to refresh it more often | |
41 - refreshing could refresh only the parts that are actually requested, | |
42 e.g. % | |
43 - mailbox_get_metadata(guid) could be optimized | |
44 - virtual could use it to avoid keeping all mailboxes open | |
12586
a2780b694b2d
lib-storage: mailbox_alloc() now takes a virtual mailbox name and other related API changes.
Timo Sirainen <tss@iki.fi>
parents:
12579
diff
changeset
|
45 - check: |
a2780b694b2d
lib-storage: mailbox_alloc() now takes a virtual mailbox name and other related API changes.
Timo Sirainen <tss@iki.fi>
parents:
12579
diff
changeset
|
46 - dsyncing between two namespace separators is probably broken.. |
12579 | 47 - remove mail_deliver_session after all, do all the stuff transparently |
48 by hooking into mailbox_copy(). | |
49 - use this hook also to do the mail deduplication: 1) sort all destination | |
50 users, 2) create mail_user only once for each user, 3) remember in | |
51 src_mail the previously copied mail, 4) use that for mailbox_copy()ing | |
52 to following recipients | |
12551 | 53 - notify_sync() could have "what changed" struct with old/new flags |
12546 | 54 - maildir: copy dovecot-shared file from parent mailbox, not root. |
55 - if global ACL path points to a file instead of a directory, read all of | |
56 them from there. support wildcards in names. | |
57 | |
12476 | 58 - master passdb preserves userdb_* extra fields. should it preserve |
59 non-userdb_* extra fields too? | |
12400 | 60 - imap, pop3: if client init fails, wait a second or two before disconnecting |
61 client. | |
62 - doveadm search savedbefore 7d could be optimized in large mailboxes.. | |
12336 | 63 - mdbox: storage rebuilding could log about changes it does |
12400 | 64 - mdbox: broken extrefs header keeps causing index rebuilds |
12336 | 65 - cache: mail_cache_lookup() should be able to return mail_cache_add()ed |
66 fields even before they've been flushed to disk. this is useful when copying | |
67 messages and some plugin (e.g. mail_log) fetches some fields that are | |
68 already added to cache (to avoid opening and parsing the message) | |
12231 | 69 - doveadm -A <<EOF expunge + purge + EOF |
70 - sent, drafts: .Sent/dovecot.index: modseq_hdr.log_offset too large | |
12181 | 71 - mail_max_lock_timeout error could be reported more nicely, also ones coming |
72 from lib-index | |
73 - dsync: if mailbox is renamed due to it being invalid, its subscription | |
74 isn't renamed | |
12095 | 75 - sql pool: if async query is pending and sync query is sent and there |
76 are no more empty connections, it should flush the async query first | |
11683 | 77 - NTLMv1 and LM should be disabled if disable_plaintext_auth=yes |
11387 | 78 - SEARCH SENT*/HEADER/etc. doesn't seem optimized when using with TEXT/BODY |
12476 | 79 - dict sql: support ignoring some search key hierarchies (e.g. acl "anyone") |
11273 | 80 |
10479 | 81 - mdbox |
11485 | 82 - dotlocking: cleanup should delete stale *.lock files |
10968 | 83 - purging seems to be inefficient. run imaptest for a while, get >500 |
84 files, start purging, it's slow until there are about 100 files left, | |
85 then the rest is suddenly fast. | |
86 - make sure that when reading mdbox mails sequentially the data is being | |
87 read from disk in n kB blocks and reads cross mail boundaries and when | |
88 reading the next mail it uses the previously read data in buffer | |
10479 | 89 - Add some kind of checksum about data+metadata and use it when checking |
90 consistency | |
10798 | 91 - figure out a way to efficiently trigger purging when user has too much |
92 mail expunged (e.g. keep track of total storage size, trigger purging | |
93 when it's 2*quota limit) | |
94 - keep track of total bytes in dbox storage in map header. also if | |
95 possible keep track of refcount=0 bytes. use these to optimize checks. | |
96 - save some stuff to map index header so we don't need to keep retrying | |
97 it. like when saving the lowest file_id which to bother checking. | |
98 - test crash-fixing | |
99 - mail_index_fsck() should perhaps cause dbox to be resynced? | |
10968 | 100 - optimize away reading file header? |
10479 | 101 - maildir: out-of-disk-space failures apparently cause all kinds of |
102 problems, e.g. "Expunged message reappeared", "Duplicate file entry"? | |
10163 | 103 - deliver -r <address> used as autoreplies' From-address? |
104 - add fd limit checks/warnings | |
10546 | 105 - istream-seekable is inefficient. it shouldn't be reading the temp file |
106 immediately after writing to it | |
10968 | 107 - config process is handling requests too slowly. maybe add some caching. |
108 - maybe config should return all of the protocol/local/remote overrides | |
109 when requested? then the caller could do a single lookup at start and | |
110 merge them later internally. this would really help login processes. | |
111 - ipv6: auth penalty should begin from /64 and gradually grow to /48 if | |
112 necessary. and the same could be done for ipv4 as well.. | |
10052 | 113 |
9559 | 114 - dsync: |
11683 | 115 - check for uid conflicts in the middle of mailbox based on next existing |
116 message, not previous | |
10479 | 117 - subscriptions syncing doesn't handle mixed hierarchy separators |
10798 | 118 - Can't rename mailbox INBOX_019acf2169c5784b307f000074ccac23 to INBOX: Target mailbox already exists |
11683 | 119 - copying can't work in non-full mode unless source mailbox is modified |
120 in some way. possibly add some COPY records to transaction log in future? | |
121 - superfast mode: when syncing changes within a mailbox, use modseqs to | |
122 figure out what has changed similar to QRESYNC. | |
10052 | 123 |
10479 | 124 - lda: add some -h 'Header: value' parameter that adds/replaces header |
10163 | 125 - ldap: fix multiple-gid support somehow |
9459 | 126 - search: use mail_get_parts() only when it's already cached. if it's not, |
127 add it to cache afterwards. | |
9235
2e2b957f1cca
Implemented anvil service, which is used to implement mail_max_userip_connections.
Timo Sirainen <tss@iki.fi>
parents:
9159
diff
changeset
|
128 - move ssl proxying code to lib-master |
9004
a5555606846b
Fixed plugins to work with config rewrite.
Timo Sirainen <tss@iki.fi>
parents:
9002
diff
changeset
|
129 - dict pooling |
9015 | 130 |
9000 | 131 /* currently non-external transactions can be applied multiple times, |
132 causing multiple increments. */ | |
133 //FIXME:i_assert((t->flags & MAIL_INDEX_TRANSACTION_FLAG_EXTERNAL) != 0); | |
134 ^ appears to work now though, probably because of the added syncing stuff.. | |
135 | |
136 - transaction log corruption should make sure dovecot.index is rewritten | |
137 and perhaps not delete the file. | |
138 - use backup index in mail_index_fsck() | |
139 | |
8564
3c4934783aff
Mention SSL/TLS in "plaintext auth disallowed" error.
Timo Sirainen <tss@iki.fi>
parents:
8555
diff
changeset
|
140 - proxying: support fallbacking to local (or other?) server if the first |
3c4934783aff
Mention SSL/TLS in "plaintext auth disallowed" error.
Timo Sirainen <tss@iki.fi>
parents:
8555
diff
changeset
|
141 one is down |
8555 | 142 - i_panic("Message count decreased") happens - why? |
8714
bbdbab5354d6
Implemented support for ESORT capability.
Timo Sirainen <tss@iki.fi>
parents:
8564
diff
changeset
|
143 - at least one backtrace shows client_destroy -> client_command_cancel -> |
bbdbab5354d6
Implemented support for ESORT capability.
Timo Sirainen <tss@iki.fi>
parents:
8564
diff
changeset
|
144 imap_sync_deinit |
8555 | 145 - fsck -> log_file_tail_offset 2273345664 -> 996 -> |
146 mail-transaction-log.c: line 341 (mail_transaction_log_set_mailbox_sync_pos): | |
147 assertion failed: (file_offset >= log->head->saved_tail_offset) | |
11765 | 148 - virtual: If last message matching INTHREAD rule gets expunged, the rest of |
149 the thread doesn't go away | |
8488 | 150 - how do shared mailboxes work with plugins? |
151 - lazy-expunge, fts, etc.? | |
11974 | 152 - listescape+acl can't handle shared mailboxes with escape chars |
8488 | 153 - dovecot-acl-list: |
154 - how does it work with global acls? | |
155 - update immediately after SETACL: add/remove entries, update timestamps | |
156 - read the entire file to memory only once and keep it there, stat() later | |
157 to see if it has changed. if not, perhaps don't even bother stat()ing | |
158 dovecot-acl files? at least not that often.. | |
159 - fs quota: getquotaroot inbox vs. other-box should return different quotas | |
160 if two quotas are defined | |
8158 | 161 - new primes code: are hash tables now being resized too often? |
162 - auth_log_prefix setting similar to mail_log_prefix | |
163 | |
164 - thread indexes: if we expunge a duplicate message-id: and we have a sibling | |
165 with identical message-id:, we can probably just move the children? | |
166 (unless there are non-sibling duplicates) | |
167 - SEARCH INTHREAD requires no thread sorting by date - don't do it | |
168 - CONDSTORE: use per-flag/per-keyword conflict checking | |
169 - QRESYNC: Drop expunges from the middle of given seq sets if possible | |
170 - use universal hash functions? | |
171 | |
172 - UIDVALIDITY changed while saving -> sync errors | |
173 - mbox: copy to Trash, manually delete copied msg, change uidvalidity, | |
174 set nextuid=1, copy again -> error | |
175 - recent_uids assert at least with mbox | |
176 - quota fs: Should values returned by quota be divided by the actual | |
177 filesystem block size instead of hardcoded DEV_BSIZE? not with AIX.. | |
7259 | 178 - squat: |
7380 | 179 - wrong indexid |
180 - fts_build_init() assertion failed: (last_uid < last_uid_locked) | |
7259 | 181 - is locking done right? it reads header without file being locked? |
182 - split after ~8 bytes? | |
7391 | 183 - expunges are delayed until more mails are added |
7259 | 184 - test replacement chars (SEARCH / SORT / Squat) |
6987 | 185 |
7449 | 186 - DEBUG: buffer overflow checking code probably doesn't handle a successful |
187 t_try_realloc() or pool_alloconly_realloc() properly | |
8738 | 188 - ldap: |
13324 | 189 - sasl bind + auth_bind=yes should probably be doing only sasl binds.. |
12400 | 190 - support multiple connections for doing auth binds |
8738 | 191 - domain lookups which set the base for user lookup |
14140 | 192 - multiple ldap values could be joined into one field with specified |
193 separator (e.g. mail_access_groups=%{ldap:gidNumber:,}) | |
8738 | 194 - implement something like: |
195 user_attrs { | |
196 uid = %{ldap:uidNumber} | |
197 home = %{ldap:homeDirectory} | |
198 quota_bytes = *:bytes=%{ldap:quota} | |
199 } | |
5621 | 200 |
9159
6324a79d3ee1
Initial commit for v2.0 master rewrite. Several features are still missing.
Timo Sirainen <tss@iki.fi>
parents:
9015
diff
changeset
|
201 - maildir+pop3 fast updates: |
6105 | 202 - with locking enabled, pop3 could just keep the one and same sync lock and |
203 do the whole thing using sync transaction | |
204 - don't update dovecot-uidlist if dovecot.index.cache doesn't exist / | |
205 there's nothing to cache | |
206 - if all messages are expunged and there are no unknown extensions in index, | |
207 unlink dovecot.index and rotate log and add some initial useful info to | |
208 the log (uidvalidity, nextuid) | |
5621 | 209 |
6105 | 210 - maildir |
6987 | 211 - don't allow more than 26 keywords |
5621 | 212 |
5557 | 213 - file_cache: we're growing the mmap in page size blocks, which is horribly |
214 slow if mremap() doesn't exist. | |
215 | |
3087 | 216 - keywords: |
217 - add some limits to how many there can be | |
218 - don't return \* in PERMANENTFLAGS when we're full | |
219 - remove unused keywords? | |
2774 | 220 |
11273 | 221 - mail caching |
3904 | 222 - force bits should be used only for nonregistered fields |
223 - change envelope parsing not to use get_headers() so imap.envelope can | |
224 actually be cached without all the headers.. | |
6105 | 225 - if there's no other pressure for compression, we should do it when |
226 enough temp fields are ready to be dropped | |
3904 | 227 - we could try compressing same field values into a single |
228 location in cache file. | |
7259 | 229 - place some maximum limit of fields to cache file? maybe some soft and |
230 hard limits, so when soft limit is reached drop fields that have | |
231 been used only once. when hard limit is reached drop any fields to get | |
232 more space. all this to avoid cache file growing infinitely. | |
2774 | 233 |
3087 | 234 - mbox |
11273 | 235 - UID renumbering doesn't really work after all? |
12476 | 236 - still problems with CRLF mboxes.. especially with broken Content-Length |
237 headers (pointing between CR-LF?) | |
3904 | 238 - syncing existing indexes takes 4x longer than creating new one, why? |
239 - how well does dirty sync + status work? it reads the last mail every | |
240 time? not very good.. | |
241 - always add empty line. make the parser require it too? syncing should | |
242 make sure there always exists two LFs at end of file. raw-mbox-stream | |
243 should make sure the last message ends with LF even if it doesn't exist | |
244 in the file | |
245 - Quote "From ", unquote ">From " | |
4449 | 246 - COPY doesn't work to itself (lock assert crash, for now just disallowed) |
2143 | 247 |
248 - index | |
3087 | 249 - read-only support for mailboxes where we don't have write-access |
6105 | 250 - index file format changes: |
10968 | 251 - split to "old" and "new" indexes and try to avoid loading "old" into |
252 memory until needed | |
6105 | 253 - pack UIDs to beginning of file with UID ranges |
254 - use squat-like compressed uid ranges everywhere | |
6782 | 255 - write first extension intros in dovecot.index.log always with names |
256 - or better yet, drop the intro concept completely as it is now | |
257 - add "transaction boundaries" so we know which records belong to a | |
258 single transaction. | |
259 - only after that we can remove the transaction log offset | |
260 overwriting (otherwise we can get partial transactions in views) | |
2143 | 261 |
3087 | 262 - login |
263 - Digest-MD5: support integrity protection, and maybe crypting. Do it | |
264 through login process like SSL is done? | |
474 | 265 |
3087 | 266 - auth |
4449 | 267 - with blocking passdb we're not caching lookups if the password was wrong |
5557 | 268 - non-plaintext authentication doesn't support all features: |
269 - multiple passdbs don't work, only the first one is used | |
270 - auth cache's last_success password change check doesn't exist | |
9459 | 271 - auth_cache_negative_ttl doesn't check password mismatches |
4449 | 272 - dovecot-auth should limit how fast authentication requests are allowed |
273 from login processes. especially if there's one login/connection the speed | |
3087 | 274 should be something like once/sec. also limit how fast to accept new |
275 connections. | |
276 - support read-only logins. user could with alternative password get only | |
277 read-access to mails so mails could be read relatively safely with | |
278 untrusted computers. Maybe always send [ALERT] about the previous | |
279 read-only login time with IP? | |
280 | |
281 - ssl | |
282 - add setting: ssl_options = bitmask. by default we enable all openssl | |
283 workarounds, this could be used to disable some of them | |
284 - gnutls support isn't working | |
965 | 285 |
3087 | 286 - search |
6232 | 287 - message header search: we should ignore LWSP between two MIME blocks(?) |
288 - message_search_init() could accept multiple search keywords so we | |
1250 | 289 wouldn't need to call it separately for each one (so we wouldn't need |
290 to parse the message multiple times). | |
291 - Create our own extension: When searching with TEXT/BODY, return | |
292 the message text surrounding the keywords just like web search engines | |
293 do. like: SEARCH X-PRINT-MATCHES TEXT "hello" -> * SEARCH 1 "He said: | |
294 Hello world!" 2 "Hello, I'm ...". This would be especially useful with | |
295 the above attachment scanning. | |
0 | 296 |
3087 | 297 - general |
298 - things break if next_uid gets to 2^32 |