Mercurial > dovecot > core-2.2
annotate TODO @ 11525:93c3d6a46446 HEAD
TODO updated.
author | Timo Sirainen <tss@iki.fi> |
---|---|
date | Fri, 11 Jun 2010 22:45:09 +0100 |
parents | e9fed6359699 |
children | 148fccbe9f32 |
rev | line source |
---|---|
11485 | 1 - maildir: sometimes rm -rf Maildir;imaptest logout=0 gives |
2 Error: Opening INBOX failed: Mailbox doesn't exist: INBOX | |
11387 | 3 - director: |
4 - user list iter should skip expired records | |
5 - sequence stuff is unused.. | |
11485 | 6 - master shouldn't stop it when idling |
11387 | 7 |
8 - SEARCH SENT*/HEADER/etc. doesn't seem optimized when using with TEXT/BODY | |
11273 | 9 |
10 07:00 < Faxe> Info: dovecot: uidnext changed from -> to, has the wrong | |
11 variables assigned: | |
12 07:00 < Faxe> Info: dovecot: uidnext changed 81528 -> 81463 | |
13 07:00 < Faxe> (copy one mail and sync again) | |
14 07:00 < Faxe> Info: dovecot: uidnext changed 81529 -> 81528 | |
15 - same for highestmodseq, ~/m/dsync-v_mirror.txt | |
10968 | 16 |
11273 | 17 - solr: crashes if expunge is done while search is indexing |
18 | |
19 - mdbox: existing INBOX dir in alt_path -> can't create INBOX. | |
20 do storage rebuild instead | |
10968 | 21 - single-dbox: |
22 - we get back to sdbox_sync_file() over and over again when expunging.. | |
23 especially with a broken guid expunge, it doesn't go away. | |
24 - fts-solr: handle DELETE, RENAME. use mailbox GUIDs (optionally) | |
10546 | 25 |
10619 | 26 - virtual: removed messages don't get expunged unless EXPUNGE is issued in |
27 same session. otherwise they get forgotten and never removed. | |
10479 | 28 - mdbox |
11485 | 29 - dotlocking: cleanup should delete stale *.lock files |
10968 | 30 - purging seems to be inefficient. run imaptest for a while, get >500 |
31 files, start purging, it's slow until there are about 100 files left, | |
32 then the rest is suddenly fast. | |
33 - make sure that when reading mdbox mails sequentially the data is being | |
34 read from disk in n kB blocks and reads cross mail boundaries and when | |
35 reading the next mail it uses the previously read data in buffer | |
10479 | 36 - Add some kind of checksum about data+metadata and use it when checking |
37 consistency | |
10798 | 38 - figure out a way to efficiently trigger purging when user has too much |
39 mail expunged (e.g. keep track of total storage size, trigger purging | |
40 when it's 2*quota limit) | |
41 - keep track of total bytes in dbox storage in map header. also if | |
42 possible keep track of refcount=0 bytes. use these to optimize checks. | |
43 - save some stuff to map index header so we don't need to keep retrying | |
44 it. like when saving the lowest file_id which to bother checking. | |
45 - test crash-fixing | |
46 - mail_index_fsck() should perhaps cause dbox to be resynced? | |
10968 | 47 - optimize away reading file header? |
10479 | 48 - maildir: out-of-disk-space failures apparently cause all kinds of |
49 problems, e.g. "Expunged message reappeared", "Duplicate file entry"? | |
50 - quota_warn: add $QUOTA_LIMIT environment or %variable parameter | |
10163 | 51 - deliver -r <address> used as autoreplies' From-address? |
52 - add fd limit checks/warnings | |
10546 | 53 - istream-seekable is inefficient. it shouldn't be reading the temp file |
54 immediately after writing to it | |
10968 | 55 - config process is handling requests too slowly. maybe add some caching. |
56 - maybe config should return all of the protocol/local/remote overrides | |
57 when requested? then the caller could do a single lookup at start and | |
58 merge them later internally. this would really help login processes. | |
59 - ipv6: auth penalty should begin from /64 and gradually grow to /48 if | |
60 necessary. and the same could be done for ipv4 as well.. | |
10052 | 61 |
9559 | 62 - dsync: |
10479 | 63 - subscriptions syncing doesn't handle mixed hierarchy separators |
10798 | 64 - Can't rename mailbox INBOX_019acf2169c5784b307f000074ccac23 to INBOX: Target mailbox already exists |
10479 | 65 - copying: does it work correctly with non-full syncs? |
10798 | 66 - "backup mode" where one side is read-only and other side gets forced |
67 everything exactly as they're in read-only side, even if backup side had | |
68 done some changes of its own | |
10546 | 69 - superfast mode |
10052 | 70 |
10479 | 71 - lda: add some -h 'Header: value' parameter that adds/replaces header |
10163 | 72 - ldap: fix multiple-gid support somehow |
9459 | 73 - search: use mail_get_parts() only when it's already cached. if it's not, |
74 add it to cache afterwards. | |
9235
2e2b957f1cca
Implemented anvil service, which is used to implement mail_max_userip_connections.
Timo Sirainen <tss@iki.fi>
parents:
9159
diff
changeset
|
75 - move ssl proxying code to lib-master |
10798 | 76 - proxy: verify ssl cert's cname |
9004
a5555606846b
Fixed plugins to work with config rewrite.
Timo Sirainen <tss@iki.fi>
parents:
9002
diff
changeset
|
77 - dict pooling |
9015 | 78 |
9000 | 79 /* currently non-external transactions can be applied multiple times, |
80 causing multiple increments. */ | |
81 //FIXME:i_assert((t->flags & MAIL_INDEX_TRANSACTION_FLAG_EXTERNAL) != 0); | |
82 ^ appears to work now though, probably because of the added syncing stuff.. | |
83 | |
84 - transaction log corruption should make sure dovecot.index is rewritten | |
85 and perhaps not delete the file. | |
86 - use backup index in mail_index_fsck() | |
87 | |
8564
3c4934783aff
Mention SSL/TLS in "plaintext auth disallowed" error.
Timo Sirainen <tss@iki.fi>
parents:
8555
diff
changeset
|
88 - proxying: support fallbacking to local (or other?) server if the first |
3c4934783aff
Mention SSL/TLS in "plaintext auth disallowed" error.
Timo Sirainen <tss@iki.fi>
parents:
8555
diff
changeset
|
89 one is down |
8555 | 90 - i_panic("Message count decreased") happens - why? |
8714
bbdbab5354d6
Implemented support for ESORT capability.
Timo Sirainen <tss@iki.fi>
parents:
8564
diff
changeset
|
91 - at least one backtrace shows client_destroy -> client_command_cancel -> |
bbdbab5354d6
Implemented support for ESORT capability.
Timo Sirainen <tss@iki.fi>
parents:
8564
diff
changeset
|
92 imap_sync_deinit |
8555 | 93 - fsck -> log_file_tail_offset 2273345664 -> 996 -> |
94 mail-transaction-log.c: line 341 (mail_transaction_log_set_mailbox_sync_pos): | |
95 assertion failed: (file_offset >= log->head->saved_tail_offset) | |
8488 | 96 - virtual: "Searched n% of the mailbox" gives broken numbers since |
8555 | 97 ctx->seq jumps around. And why is it also returned when fts is enabled |
98 along with "Indexed n% of the mailbox"? | |
8488 | 99 - how do shared mailboxes work with plugins? |
100 - lazy-expunge, fts, etc.? | |
101 - dovecot-acl-list: | |
102 - how does it work with global acls? | |
103 - update immediately after SETACL: add/remove entries, update timestamps | |
104 - read the entire file to memory only once and keep it there, stat() later | |
105 to see if it has changed. if not, perhaps don't even bother stat()ing | |
106 dovecot-acl files? at least not that often.. | |
10798 | 107 - add anonymous environment for anon logins (for managesieve mainly) |
8488 | 108 - fs quota: getquotaroot inbox vs. other-box should return different quotas |
109 if two quotas are defined | |
8158 | 110 - new primes code: are hash tables now being resized too often? |
111 - auth_log_prefix setting similar to mail_log_prefix | |
112 | |
113 - thread indexes: if we expunge a duplicate message-id: and we have a sibling | |
114 with identical message-id:, we can probably just move the children? | |
115 (unless there are non-sibling duplicates) | |
116 - SEARCH INTHREAD requires no thread sorting by date - don't do it | |
117 - CONDSTORE: use per-flag/per-keyword conflict checking | |
118 - QRESYNC: Drop expunges from the middle of given seq sets if possible | |
119 - use universal hash functions? | |
120 | |
121 - UIDVALIDITY changed while saving -> sync errors | |
122 - mbox: copy to Trash, manually delete copied msg, change uidvalidity, | |
123 set nextuid=1, copy again -> error | |
124 - recent_uids assert at least with mbox | |
125 - quota fs: Should values returned by quota be divided by the actual | |
126 filesystem block size instead of hardcoded DEV_BSIZE? not with AIX.. | |
127 - mailbox list fs: Listing subscriptions with children return options doesn't | |
128 work unless iter_is_mailbox() returns the children flags | |
7259 | 129 - lucene: handle replacement chars? |
130 - squat: | |
11273 | 131 - support ORs |
7380 | 132 - wrong indexid |
133 - fts_build_init() assertion failed: (last_uid < last_uid_locked) | |
7259 | 134 - is locking done right? it reads header without file being locked? |
135 - split after ~8 bytes? | |
7391 | 136 - expunges are delayed until more mails are added |
7259 | 137 - test replacement chars (SEARCH / SORT / Squat) |
6987 | 138 |
7449 | 139 - DEBUG: buffer overflow checking code probably doesn't handle a successful |
140 t_try_realloc() or pool_alloconly_realloc() properly | |
8738 | 141 - ldap: |
142 - domain lookups which set the base for user lookup | |
143 - same attribute can't be used for multiple values. | |
144 - multiple attributes can't be merged to a single value. | |
145 - implement something like: | |
146 user_attrs { | |
147 uid = %{ldap:uidNumber} | |
148 home = %{ldap:homeDirectory} | |
149 quota_bytes = *:bytes=%{ldap:quota} | |
150 } | |
5621 | 151 |
9159
6324a79d3ee1
Initial commit for v2.0 master rewrite. Several features are still missing.
Timo Sirainen <tss@iki.fi>
parents:
9015
diff
changeset
|
152 - maildir+pop3 fast updates: |
6105 | 153 - with locking enabled, pop3 could just keep the one and same sync lock and |
154 do the whole thing using sync transaction | |
155 - don't update dovecot-uidlist if dovecot.index.cache doesn't exist / | |
156 there's nothing to cache | |
157 - if all messages are expunged and there are no unknown extensions in index, | |
158 unlink dovecot.index and rotate log and add some initial useful info to | |
159 the log (uidvalidity, nextuid) | |
5621 | 160 |
6105 | 161 - maildir |
6987 | 162 - don't allow more than 26 keywords |
6105 | 163 - physical separator could be configurable |
9159
6324a79d3ee1
Initial commit for v2.0 master rewrite. Several features are still missing.
Timo Sirainen <tss@iki.fi>
parents:
9015
diff
changeset
|
164 - lda+maildir: if new mails are in new/ or cur/ they're not added to |
6105 | 165 dovecot-uidlist but newly saved mails are, so UIDs will be in wrong order |
10798 | 166 - maildir_copy_with_hardlinks: copy already-cached data |
5621 | 167 |
5557 | 168 - file_cache: we're growing the mmap in page size blocks, which is horribly |
169 slow if mremap() doesn't exist. | |
170 | |
3087 | 171 - keywords: |
172 - add some limits to how many there can be | |
173 - don't return \* in PERMANENTFLAGS when we're full | |
174 - remove unused keywords? | |
2774 | 175 |
11273 | 176 - mail caching |
177 - compress when we can drop temporary fields. | |
3904 | 178 - force bits should be used only for nonregistered fields |
179 - change envelope parsing not to use get_headers() so imap.envelope can | |
180 actually be cached without all the headers.. | |
6105 | 181 - if there's no other pressure for compression, we should do it when |
182 enough temp fields are ready to be dropped | |
3904 | 183 - we could try compressing same field values into a single |
184 location in cache file. | |
7259 | 185 - place some maximum limit of fields to cache file? maybe some soft and |
186 hard limits, so when soft limit is reached drop fields that have | |
187 been used only once. when hard limit is reached drop any fields to get | |
188 more space. all this to avoid cache file growing infinitely. | |
2774 | 189 |
3087 | 190 - mbox |
11273 | 191 - UID renumbering doesn't really work after all? |
192 - still problems with CRLF mboxes.. | |
3904 | 193 - syncing existing indexes takes 4x longer than creating new one, why? |
194 - how well does dirty sync + status work? it reads the last mail every | |
195 time? not very good.. | |
196 - always add empty line. make the parser require it too? syncing should | |
197 make sure there always exists two LFs at end of file. raw-mbox-stream | |
198 should make sure the last message ends with LF even if it doesn't exist | |
199 in the file | |
200 - Quote "From ", unquote ">From " | |
4449 | 201 - COPY doesn't work to itself (lock assert crash, for now just disallowed) |
2143 | 202 |
203 - index | |
3087 | 204 - read-only support for mailboxes where we don't have write-access |
6105 | 205 - index file format changes: |
10968 | 206 - split to "old" and "new" indexes and try to avoid loading "old" into |
207 memory until needed | |
6105 | 208 - pack UIDs to beginning of file with UID ranges |
209 - use squat-like compressed uid ranges everywhere | |
6782 | 210 - write first extension intros in dovecot.index.log always with names |
211 - or better yet, drop the intro concept completely as it is now | |
212 - add "transaction boundaries" so we know which records belong to a | |
213 single transaction. | |
214 - only after that we can remove the transaction log offset | |
215 overwriting (otherwise we can get partial transactions in views) | |
2143 | 216 |
4449 | 217 - lib-storage |
218 - x search charset asdf all -> should fail | |
3087 | 219 |
220 - login | |
221 - Digest-MD5: support integrity protection, and maybe crypting. Do it | |
222 through login process like SSL is done? | |
474 | 223 |
3087 | 224 - auth |
4449 | 225 - with blocking passdb we're not caching lookups if the password was wrong |
5557 | 226 - non-plaintext authentication doesn't support all features: |
227 - multiple passdbs don't work, only the first one is used | |
228 - auth cache's last_success password change check doesn't exist | |
9459 | 229 - auth_cache_negative_ttl doesn't check password mismatches |
4449 | 230 - dovecot-auth should limit how fast authentication requests are allowed |
231 from login processes. especially if there's one login/connection the speed | |
3087 | 232 should be something like once/sec. also limit how fast to accept new |
233 connections. | |
234 - support read-only logins. user could with alternative password get only | |
235 read-access to mails so mails could be read relatively safely with | |
236 untrusted computers. Maybe always send [ALERT] about the previous | |
237 read-only login time with IP? | |
238 | |
239 - quota | |
240 - if dovecot-uidlist can't be written, assume the new mails have UIDs | |
241 beginning from uidlist.next_uid. Whenever mails are expunged, overwrite | |
242 the next_uid field with the current highest next_uid. Whenever we have | |
243 assumed UIDs and uidlist gets updated, throw the client out with | |
244 "inconsist mailbox". | |
245 | |
246 - ssl | |
247 - add setting: ssl_options = bitmask. by default we enable all openssl | |
248 workarounds, this could be used to disable some of them | |
249 - gnutls support isn't working | |
965 | 250 |
3087 | 251 - search |
6232 | 252 - message header search: we should ignore LWSP between two MIME blocks(?) |
253 - message_search_init() could accept multiple search keywords so we | |
1250 | 254 wouldn't need to call it separately for each one (so we wouldn't need |
255 to parse the message multiple times). | |
256 - could optionally support scanning inside file attachments and use | |
257 plugins to extract text out of them (word, excel, pdf, etc. etc.) | |
258 - Create our own extension: When searching with TEXT/BODY, return | |
259 the message text surrounding the keywords just like web search engines | |
260 do. like: SEARCH X-PRINT-MATCHES TEXT "hello" -> * SEARCH 1 "He said: | |
261 Hello world!" 2 "Hello, I'm ...". This would be especially useful with | |
262 the above attachment scanning. | |
0 | 263 |
3087 | 264 - general |
265 - things break if next_uid gets to 2^32 |