dovecot/core-2.2: src/lib-storage/index/dbox-common/dbox-file.c annotate

annotate src/lib-storage/index/dbox-common/dbox-file.c @ 12322:d94957cafd3e

lib-storage: Added istream_opened() method to struct mail. This can be hooked into by plugins that want to do something with the message's stream in the message file, rather than the virtual resulting stream visible to client. For example when using dbox attachments, this stream contains only the data in the dbox files without any external attachments.

author	Timo Sirainen <tss@iki.fi>
date	Wed, 20 Oct 2010 18:55:36 +0100
parents	28eaaa23f2c6
children	251612ef4186

rev	line source
10582 615eef3139c2 Updated copyright notices to include year 2010. Timo Sirainen <tss@iki.fi> parents: 10524 diff changeset	1 /* Copyright (c) 2007-2010 Dovecot authors, see the included COPYING file */
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	2
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	3 #include "lib.h"
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	4 #include "ioloop.h"
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	5 #include "array.h"
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	6 #include "hex-dec.h"
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	7 #include "hex-binary.h"
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	8 #include "hostpid.h"
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	9 #include "istream.h"
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	10 #include "ostream.h"
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	11 #include "file-lock.h"
11180 0eff8ef104e6 mdbox: If flock() isn't available, use dotlock files. Timo Sirainen <tss@iki.fi> parents: 11132 diff changeset	12 #include "file-dotlock.h"
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	13 #include "mkdir-parents.h"
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	14 #include "eacces-error.h"
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	15 #include "str.h"
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	16 #include "dbox-storage.h"
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	17 #include "dbox-file.h"
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	18
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	19 #include <stdio.h>
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	20 #include <stdlib.h>
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	21 #include <unistd.h>
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	22 #include <ctype.h>
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	23 #include <fcntl.h>
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	24
11309 88d7a36c7fa5 Use IO_BLOCK_SIZE macro to specify how large read/write syscalls to use. Timo Sirainen <tss@iki.fi> parents: 11216 diff changeset	25 #define DBOX_READ_BLOCK_SIZE IO_BLOCK_SIZE
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	26
11191 4f6fa828d0c9 mdbox: Recent change enabled dotlocking always, instead of using flock. Timo Sirainen <tss@iki.fi> parents: 11180 diff changeset	27 #ifndef DBOX_FILE_LOCK_METHOD_FLOCK
11180 0eff8ef104e6 mdbox: If flock() isn't available, use dotlock files. Timo Sirainen <tss@iki.fi> parents: 11132 diff changeset	28 static const struct dotlock_settings dotlock_set = {
0eff8ef104e6 mdbox: If flock() isn't available, use dotlock files. Timo Sirainen <tss@iki.fi> parents: 11132 diff changeset	29 .stale_timeout = 60*10,
0eff8ef104e6 mdbox: If flock() isn't available, use dotlock files. Timo Sirainen <tss@iki.fi> parents: 11132 diff changeset	30 .use_excl_lock = TRUE
0eff8ef104e6 mdbox: If flock() isn't available, use dotlock files. Timo Sirainen <tss@iki.fi> parents: 11132 diff changeset	31 };
11132 3d585e69aa95 dbox: Use flock() for file locking if possible. If not, require client_limit=1. Timo Sirainen <tss@iki.fi> parents: 11033 diff changeset	32 #endif
3d585e69aa95 dbox: Use flock() for file locking if possible. If not, require client_limit=1. Timo Sirainen <tss@iki.fi> parents: 11033 diff changeset	33
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	34 const char *dbox_generate_tmp_filename(void)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	35 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	36 static unsigned int create_count = 0;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	37
11192 abf262317b2c mdbox: Automatically delete old temp.* files from storage/ directory. Timo Sirainen <tss@iki.fi> parents: 11191 diff changeset	38 return t_strdup_printf(DBOX_TEMP_FILE_PREFIX"%lu.P%sQ%uM%u.%s",
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	39 (unsigned long)ioloop_timeval.tv_sec, my_pid,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	40 create_count++,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	41 (unsigned int)ioloop_timeval.tv_usec,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	42 my_hostname);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	43 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	44
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	45 void dbox_file_set_syscall_error(struct dbox_file file, const char function)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	46 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	47 mail_storage_set_critical(&file->storage->storage,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	48 "%s failed for file %s: %m",
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	49 function, file->cur_path);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	50 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	51
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	52 void dbox_file_set_corrupted(struct dbox_file file, const char reason, ...)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	53 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	54 va_list args;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	55
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	56 va_start(args, reason);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	57 mail_storage_set_critical(&file->storage->storage,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	58 "Corrupted dbox file %s (around offset=%"PRIuUOFF_T"): %s",
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	59 file->cur_path, file->input == NULL ? 0 : file->input->v_offset,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	60 t_strdup_vprintf(reason, args));
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	61 va_end(args);
11216 de0ed7bea201 mdbox: Avoid rebuilding storage if another process already did it. Timo Sirainen <tss@iki.fi> parents: 11192 diff changeset	62
de0ed7bea201 mdbox: Avoid rebuilding storage if another process already did it. Timo Sirainen <tss@iki.fi> parents: 11192 diff changeset	63 file->storage->v.set_file_corrupted(file);
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	64 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	65
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	66 void dbox_file_init(struct dbox_file *file)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	67 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	68 file->refcount = 1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	69 file->fd = -1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	70 file->cur_offset = (uoff_t)-1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	71 file->cur_path = file->primary_path;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	72 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	73
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	74 void dbox_file_free(struct dbox_file *file)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	75 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	76 i_assert(file->refcount == 0);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	77
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	78 if (file->metadata_pool != NULL)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	79 pool_unref(&file->metadata_pool);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	80 dbox_file_close(file);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	81 i_free(file->primary_path);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	82 i_free(file->alt_path);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	83 i_free(file);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	84 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	85
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	86 void dbox_file_unref(struct dbox_file **_file)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	87 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	88 struct dbox_file file = _file;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	89
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	90 *_file = NULL;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	91
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	92 i_assert(file->refcount > 0);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	93 if (--file->refcount == 0)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	94 file->storage->v.file_unrefed(file);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	95 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	96
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	97 static int dbox_file_parse_header(struct dbox_file file, const char line)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	98 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	99 const char const tmp, *value;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	100 unsigned int pos;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	101 enum dbox_header_key key;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	102
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	103 file->file_version = *line - '0';
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	104 if (!i_isdigit(line[0]) \|\| line[1] != ' ' \|\|
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	105 (file->file_version != 1 && file->file_version != DBOX_VERSION)) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	106 dbox_file_set_corrupted(file, "Invalid dbox version");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	107 return -1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	108 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	109 line += 2;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	110 pos = 2;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	111
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	112 file->msg_header_size = 0;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	113
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	114 for (tmp = t_strsplit(line, " "); *tmp != NULL; tmp++) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	115 key = **tmp;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	116 value = *tmp + 1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	117
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	118 switch (key) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	119 case DBOX_HEADER_OLDV1_APPEND_OFFSET:
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	120 break;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	121 case DBOX_HEADER_MSG_HEADER_SIZE:
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	122 file->msg_header_size = strtoul(value, NULL, 16);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	123 break;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	124 case DBOX_HEADER_CREATE_STAMP:
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	125 file->create_time = strtoul(value, NULL, 16);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	126 break;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	127 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	128 pos += strlen(value) + 2;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	129 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	130
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	131 if (file->msg_header_size == 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	132 dbox_file_set_corrupted(file, "Missing message header size");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	133 return -1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	134 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	135 return 0;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	136 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	137
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	138 static int dbox_file_read_header(struct dbox_file *file)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	139 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	140 const char *line;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	141 unsigned int hdr_size;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	142 int ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	143
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	144 i_stream_seek(file->input, 0);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	145 line = i_stream_read_next_line(file->input);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	146 if (line == NULL) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	147 if (file->input->stream_errno == 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	148 dbox_file_set_corrupted(file,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	149 "EOF while reading file header");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	150 return 0;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	151 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	152
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	153 dbox_file_set_syscall_error(file, "read()");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	154 return -1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	155 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	156 hdr_size = file->input->v_offset;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	157 T_BEGIN {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	158 ret = dbox_file_parse_header(file, line) < 0 ? 0 : 1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	159 } T_END;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	160 if (ret > 0)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	161 file->file_header_size = hdr_size;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	162 return ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	163 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	164
10635 c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	165 static int dbox_file_open_fd(struct dbox_file *file, bool try_altpath)
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	166 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	167 const char *path;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	168 bool alt = FALSE;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	169
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	170 /* try the primary path first */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	171 path = file->primary_path;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	172 while ((file->fd = open(path, O_RDWR)) == -1) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	173 if (errno != ENOENT) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	174 mail_storage_set_critical(&file->storage->storage,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	175 "open(%s) failed: %m", path);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	176 return -1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	177 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	178
10635 c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	179 if (file->alt_path == NULL \|\| alt \|\| !try_altpath) {
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	180 /* not found */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	181 return 0;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	182 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	183
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	184 /* try the alternative path */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	185 path = file->alt_path;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	186 alt = TRUE;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	187 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	188 file->cur_path = path;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	189 return 1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	190 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	191
10635 c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	192 static int dbox_file_open_full(struct dbox_file *file, bool try_altpath,
c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	193 bool *notfound_r)
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	194 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	195 int ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	196
10635 c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	197 *notfound_r = FALSE;
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	198 if (file->input != NULL)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	199 return 1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	200
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	201 if (file->fd == -1) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	202 T_BEGIN {
10635 c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	203 ret = dbox_file_open_fd(file, try_altpath);
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	204 } T_END;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	205 if (ret <= 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	206 if (ret < 0)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	207 return -1;
10635 c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	208 *notfound_r = TRUE;
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	209 return 1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	210 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	211 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	212
11993 ae4a82ced01e dbox: Don't allow unlimited buffer size when reading message body. Timo Sirainen <tss@iki.fi> parents: 11826 diff changeset	213 file->input = i_stream_create_fd(file->fd, DBOX_READ_BLOCK_SIZE, FALSE);
10849 638c4ea4a9ce Set input stream names for mail file streams. Timo Sirainen <tss@iki.fi> parents: 10765 diff changeset	214 i_stream_set_name(file->input, file->cur_path);
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	215 i_stream_set_init_buffer_size(file->input, DBOX_READ_BLOCK_SIZE);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	216 return dbox_file_read_header(file);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	217 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	218
10635 c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	219 int dbox_file_open(struct dbox_file file, bool deleted_r)
c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	220 {
c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	221 return dbox_file_open_full(file, TRUE, deleted_r);
c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	222 }
c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	223
c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	224 int dbox_file_open_primary(struct dbox_file file, bool notfound_r)
c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	225 {
c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	226 return dbox_file_open_full(file, FALSE, notfound_r);
c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	227 }
c60910419861 mdbox: Purging now also moves mails to alt storage (if it's used). Timo Sirainen <tss@iki.fi> parents: 10582 diff changeset	228
10964 cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	229 int dbox_file_stat(struct dbox_file file, struct stat st_r)
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	230 {
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	231 const char *path;
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	232 bool alt = FALSE;
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	233
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	234 if (dbox_file_is_open(file)) {
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	235 if (fstat(file->fd, st_r) < 0) {
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	236 mail_storage_set_critical(&file->storage->storage,
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	237 "fstat(%s) failed: %m", file->cur_path);
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	238 return -1;
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	239 }
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	240 return 0;
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	241 }
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	242
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	243 /* try the primary path first */
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	244 path = file->primary_path;
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	245 while (stat(path, st_r) < 0) {
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	246 if (errno != ENOENT) {
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	247 mail_storage_set_critical(&file->storage->storage,
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	248 "stat(%s) failed: %m", path);
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	249 return -1;
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	250 }
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	251
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	252 if (file->alt_path == NULL \|\| alt) {
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	253 /* not found */
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	254 return -1;
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	255 }
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	256
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	257 /* try the alternative path */
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	258 path = file->alt_path;
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	259 alt = TRUE;
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	260 }
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	261 file->cur_path = path;
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	262 return 0;
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	263 }
cc42255736ad dbox: Don't write save-date to metadata, use file's ctime as fallback. Timo Sirainen <tss@iki.fi> parents: 10849 diff changeset	264
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	265 int dbox_file_header_write(struct dbox_file file, struct ostream output)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	266 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	267 string_t *hdr;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	268
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	269 hdr = t_str_new(128);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	270 str_printfa(hdr, "%u %c%x %c%x\n", DBOX_VERSION,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	271 DBOX_HEADER_MSG_HEADER_SIZE,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	272 (unsigned int)sizeof(struct dbox_message_header),
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	273 DBOX_HEADER_CREATE_STAMP, (unsigned int)ioloop_time);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	274
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	275 file->file_version = DBOX_VERSION;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	276 file->file_header_size = str_len(hdr);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	277 file->msg_header_size = sizeof(struct dbox_message_header);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	278 return o_stream_send(output, str_data(hdr), str_len(hdr));
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	279 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	280
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	281 void dbox_file_close(struct dbox_file *file)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	282 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	283 dbox_file_unlock(file);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	284 if (file->input != NULL)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	285 i_stream_unref(&file->input);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	286 if (file->fd != -1) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	287 if (close(file->fd) < 0)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	288 dbox_file_set_syscall_error(file, "close()");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	289 file->fd = -1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	290 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	291 file->cur_offset = (uoff_t)-1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	292 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	293
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	294 int dbox_file_try_lock(struct dbox_file *file)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	295 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	296 int ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	297
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	298 i_assert(file->fd != -1);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	299
11191 4f6fa828d0c9 mdbox: Recent change enabled dotlocking always, instead of using flock. Timo Sirainen <tss@iki.fi> parents: 11180 diff changeset	300 #ifdef DBOX_FILE_LOCK_METHOD_FLOCK
4f6fa828d0c9 mdbox: Recent change enabled dotlocking always, instead of using flock. Timo Sirainen <tss@iki.fi> parents: 11180 diff changeset	301 ret = file_try_lock(file->fd, file->cur_path, F_WRLCK,
4f6fa828d0c9 mdbox: Recent change enabled dotlocking always, instead of using flock. Timo Sirainen <tss@iki.fi> parents: 11180 diff changeset	302 FILE_LOCK_METHOD_FLOCK, &file->lock);
4f6fa828d0c9 mdbox: Recent change enabled dotlocking always, instead of using flock. Timo Sirainen <tss@iki.fi> parents: 11180 diff changeset	303 if (ret < 0) {
4f6fa828d0c9 mdbox: Recent change enabled dotlocking always, instead of using flock. Timo Sirainen <tss@iki.fi> parents: 11180 diff changeset	304 mail_storage_set_critical(&file->storage->storage,
4f6fa828d0c9 mdbox: Recent change enabled dotlocking always, instead of using flock. Timo Sirainen <tss@iki.fi> parents: 11180 diff changeset	305 "file_try_lock(%s) failed: %m", file->cur_path);
4f6fa828d0c9 mdbox: Recent change enabled dotlocking always, instead of using flock. Timo Sirainen <tss@iki.fi> parents: 11180 diff changeset	306 }
4f6fa828d0c9 mdbox: Recent change enabled dotlocking always, instead of using flock. Timo Sirainen <tss@iki.fi> parents: 11180 diff changeset	307 #else
11180 0eff8ef104e6 mdbox: If flock() isn't available, use dotlock files. Timo Sirainen <tss@iki.fi> parents: 11132 diff changeset	308 ret = file_dotlock_create(&dotlock_set, file->cur_path,
0eff8ef104e6 mdbox: If flock() isn't available, use dotlock files. Timo Sirainen <tss@iki.fi> parents: 11132 diff changeset	309 DOTLOCK_CREATE_FLAG_NONBLOCK, &file->lock);
0eff8ef104e6 mdbox: If flock() isn't available, use dotlock files. Timo Sirainen <tss@iki.fi> parents: 11132 diff changeset	310 if (ret < 0) {
0eff8ef104e6 mdbox: If flock() isn't available, use dotlock files. Timo Sirainen <tss@iki.fi> parents: 11132 diff changeset	311 mail_storage_set_critical(&file->storage->storage,
0eff8ef104e6 mdbox: If flock() isn't available, use dotlock files. Timo Sirainen <tss@iki.fi> parents: 11132 diff changeset	312 "file_dotlock_create(%s) failed: %m", file->cur_path);
0eff8ef104e6 mdbox: If flock() isn't available, use dotlock files. Timo Sirainen <tss@iki.fi> parents: 11132 diff changeset	313 }
0eff8ef104e6 mdbox: If flock() isn't available, use dotlock files. Timo Sirainen <tss@iki.fi> parents: 11132 diff changeset	314 #endif
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	315 return ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	316 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	317
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	318 void dbox_file_unlock(struct dbox_file *file)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	319 {
10683 9c68c8d42ff2 mdbox: Saving now closes newly created files if they become full. Timo Sirainen <tss@iki.fi> parents: 10635 diff changeset	320 i_assert(!file->appending \|\| file->lock == NULL);
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	321
11180 0eff8ef104e6 mdbox: If flock() isn't available, use dotlock files. Timo Sirainen <tss@iki.fi> parents: 11132 diff changeset	322 if (file->lock != NULL) {
11191 4f6fa828d0c9 mdbox: Recent change enabled dotlocking always, instead of using flock. Timo Sirainen <tss@iki.fi> parents: 11180 diff changeset	323 #ifdef DBOX_FILE_LOCK_METHOD_FLOCK
4f6fa828d0c9 mdbox: Recent change enabled dotlocking always, instead of using flock. Timo Sirainen <tss@iki.fi> parents: 11180 diff changeset	324 file_unlock(&file->lock);
4f6fa828d0c9 mdbox: Recent change enabled dotlocking always, instead of using flock. Timo Sirainen <tss@iki.fi> parents: 11180 diff changeset	325 #else
11180 0eff8ef104e6 mdbox: If flock() isn't available, use dotlock files. Timo Sirainen <tss@iki.fi> parents: 11132 diff changeset	326 (void)file_dotlock_delete(&file->lock);
0eff8ef104e6 mdbox: If flock() isn't available, use dotlock files. Timo Sirainen <tss@iki.fi> parents: 11132 diff changeset	327 #endif
0eff8ef104e6 mdbox: If flock() isn't available, use dotlock files. Timo Sirainen <tss@iki.fi> parents: 11132 diff changeset	328 }
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	329 if (file->input != NULL)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	330 i_stream_sync(file->input);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	331 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	332
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	333 int dbox_file_read_mail_header(struct dbox_file file, uoff_t physical_size_r)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	334 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	335 struct dbox_message_header hdr;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	336 const unsigned char *data;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	337 size_t size;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	338 int ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	339
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	340 ret = i_stream_read_data(file->input, &data, &size,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	341 file->msg_header_size - 1);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	342 if (ret <= 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	343 if (file->input->stream_errno == 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	344 /* EOF, broken offset or file truncated */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	345 dbox_file_set_corrupted(file, "EOF reading msg header "
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	346 "(got %"PRIuSIZE_T"/%u bytes)",
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	347 size, file->msg_header_size);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	348 return 0;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	349 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	350 dbox_file_set_syscall_error(file, "read()");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	351 return -1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	352 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	353 memcpy(&hdr, data, I_MIN(sizeof(hdr), file->msg_header_size));
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	354 if (memcmp(hdr.magic_pre, DBOX_MAGIC_PRE, sizeof(hdr.magic_pre)) != 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	355 /* probably broken offset */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	356 dbox_file_set_corrupted(file, "msg header has bad magic value");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	357 return 0;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	358 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	359
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	360 if (data[file->msg_header_size-1] != '\n') {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	361 dbox_file_set_corrupted(file, "msg header doesn't end with LF");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	362 return 0;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	363 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	364
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	365 *physical_size_r = hex2dec(hdr.message_size_hex,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	366 sizeof(hdr.message_size_hex));
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	367 return 1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	368 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	369
11826 7520b31ea95b dbox: Split dbox_file_seek() from dbox_file_get_mail_stream() Timo Sirainen <tss@iki.fi> parents: 11805 diff changeset	370 int dbox_file_seek(struct dbox_file *file, uoff_t offset)
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	371 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	372 uoff_t size;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	373 int ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	374
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	375 i_assert(file->input != NULL);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	376
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	377 if (offset == 0)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	378 offset = file->file_header_size;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	379
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	380 if (offset != file->cur_offset) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	381 i_stream_seek(file->input, offset);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	382 ret = dbox_file_read_mail_header(file, &size);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	383 if (ret <= 0)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	384 return ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	385 file->cur_offset = offset;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	386 file->cur_physical_size = size;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	387 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	388 i_stream_seek(file->input, offset + file->msg_header_size);
11826 7520b31ea95b dbox: Split dbox_file_seek() from dbox_file_get_mail_stream() Timo Sirainen <tss@iki.fi> parents: 11805 diff changeset	389 return 1;
7520b31ea95b dbox: Split dbox_file_seek() from dbox_file_get_mail_stream() Timo Sirainen <tss@iki.fi> parents: 11805 diff changeset	390 }
7520b31ea95b dbox: Split dbox_file_seek() from dbox_file_get_mail_stream() Timo Sirainen <tss@iki.fi> parents: 11805 diff changeset	391
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	392 static int
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	393 dbox_file_seek_next_at_metadata(struct dbox_file file, uoff_t offset)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	394 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	395 const char *line;
11993 ae4a82ced01e dbox: Don't allow unlimited buffer size when reading message body. Timo Sirainen <tss@iki.fi> parents: 11826 diff changeset	396 size_t buf_size;
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	397 int ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	398
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	399 i_stream_seek(file->input, *offset);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	400 if ((ret = dbox_file_metadata_skip_header(file)) <= 0)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	401 return ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	402
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	403 /* skip over the actual metadata */
11993 ae4a82ced01e dbox: Don't allow unlimited buffer size when reading message body. Timo Sirainen <tss@iki.fi> parents: 11826 diff changeset	404 buf_size = i_stream_get_max_buffer_size(file->input);
ae4a82ced01e dbox: Don't allow unlimited buffer size when reading message body. Timo Sirainen <tss@iki.fi> parents: 11826 diff changeset	405 i_stream_set_max_buffer_size(file->input, 0);
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	406 while ((line = i_stream_read_next_line(file->input)) != NULL) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	407 if (line == DBOX_METADATA_OLDV1_SPACE \|\| line == '\0') {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	408 /* end of metadata */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	409 break;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	410 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	411 }
11993 ae4a82ced01e dbox: Don't allow unlimited buffer size when reading message body. Timo Sirainen <tss@iki.fi> parents: 11826 diff changeset	412 i_stream_set_max_buffer_size(file->input, buf_size);
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	413 *offset = file->input->v_offset;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	414 return 1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	415 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	416
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	417 void dbox_file_seek_rewind(struct dbox_file *file)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	418 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	419 file->cur_offset = (uoff_t)-1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	420 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	421
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	422 int dbox_file_seek_next(struct dbox_file file, uoff_t offset_r, bool *last_r)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	423 {
10765 19df4309e389 lib-storage: Added support for plugins to specify message's physical size when saving. Timo Sirainen <tss@iki.fi> parents: 10683 diff changeset	424 uoff_t offset;
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	425 int ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	426
10524 824b7072c6d9 dbox: Added assert. Timo Sirainen <tss@iki.fi> parents: 9977 diff changeset	427 i_assert(file->input != NULL);
824b7072c6d9 dbox: Added assert. Timo Sirainen <tss@iki.fi> parents: 9977 diff changeset	428
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	429 if (file->cur_offset == (uoff_t)-1) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	430 /* first mail. we may not have read the file at all yet,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	431 so set the offset afterwards. */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	432 offset = 0;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	433 } else {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	434 offset = file->cur_offset + file->msg_header_size +
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	435 file->cur_physical_size;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	436 if ((ret = dbox_file_seek_next_at_metadata(file, &offset)) <= 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	437 *offset_r = file->cur_offset;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	438 return ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	439 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	440 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	441 *offset_r = offset;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	442
10524 824b7072c6d9 dbox: Added assert. Timo Sirainen <tss@iki.fi> parents: 9977 diff changeset	443 if (i_stream_is_eof(file->input)) {
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	444 *last_r = TRUE;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	445 return 0;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	446 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	447 *last_r = FALSE;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	448
11826 7520b31ea95b dbox: Split dbox_file_seek() from dbox_file_get_mail_stream() Timo Sirainen <tss@iki.fi> parents: 11805 diff changeset	449 ret = dbox_file_seek(file, offset);
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	450 if (*offset_r == 0)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	451 *offset_r = file->file_header_size;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	452 return ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	453 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	454
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	455 struct dbox_file_append_context dbox_file_append_init(struct dbox_file file)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	456 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	457 struct dbox_file_append_context *ctx;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	458
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	459 i_assert(!file->appending);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	460
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	461 file->appending = TRUE;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	462
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	463 ctx = i_new(struct dbox_file_append_context, 1);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	464 ctx->file = file;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	465 if (file->fd != -1) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	466 ctx->output = o_stream_create_fd_file(file->fd, 0, FALSE);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	467 o_stream_cork(ctx->output);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	468 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	469 return ctx;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	470 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	471
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	472 int dbox_file_append_commit(struct dbox_file_append_context **_ctx)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	473 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	474 struct dbox_file_append_context ctx = _ctx;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	475 int ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	476
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	477 i_assert(ctx->file->appending);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	478
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	479 *_ctx = NULL;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	480
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	481 ret = dbox_file_append_flush(ctx);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	482 o_stream_unref(&ctx->output);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	483 ctx->file->appending = FALSE;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	484 i_free(ctx);
11033 0bc933c35a17 dbox: Save error handling fix. Timo Sirainen <tss@iki.fi> parents: 10964 diff changeset	485 return ret;
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	486 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	487
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	488 void dbox_file_append_rollback(struct dbox_file_append_context **_ctx)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	489 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	490 struct dbox_file_append_context ctx = _ctx;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	491 struct dbox_file *file = ctx->file;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	492 bool close_file = FALSE;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	493
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	494 i_assert(ctx->file->appending);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	495
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	496 *_ctx = NULL;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	497 if (ctx->first_append_offset == 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	498 /* nothing changed */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	499 } else if (ctx->first_append_offset == file->file_header_size) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	500 /* rollbacking everything */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	501 if (unlink(file->cur_path) < 0)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	502 dbox_file_set_syscall_error(file, "unlink()");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	503 close_file = TRUE;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	504 } else {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	505 /* truncating only some mails */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	506 o_stream_close(ctx->output);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	507 if (ftruncate(file->fd, ctx->first_append_offset) < 0)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	508 dbox_file_set_syscall_error(file, "ftruncate()");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	509 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	510 if (ctx->output != NULL)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	511 o_stream_unref(&ctx->output);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	512 i_free(ctx);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	513
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	514 if (close_file)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	515 dbox_file_close(file);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	516 file->appending = FALSE;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	517 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	518
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	519 int dbox_file_append_flush(struct dbox_file_append_context *ctx)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	520 {
11634 7f19062f58fd Renamed fsync_disable to mail_fsync=optimized\|always\|never. Timo Sirainen <tss@iki.fi> parents: 11309 diff changeset	521 struct mail_storage *storage = &ctx->file->storage->storage;
7f19062f58fd Renamed fsync_disable to mail_fsync=optimized\|always\|never. Timo Sirainen <tss@iki.fi> parents: 11309 diff changeset	522
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	523 if (ctx->last_flush_offset == ctx->output->offset)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	524 return 0;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	525
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	526 if (o_stream_flush(ctx->output) < 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	527 dbox_file_set_syscall_error(ctx->file, "write()");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	528 return -1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	529 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	530
11634 7f19062f58fd Renamed fsync_disable to mail_fsync=optimized\|always\|never. Timo Sirainen <tss@iki.fi> parents: 11309 diff changeset	531 if (storage->set->parsed_fsync_mode != FSYNC_MODE_NEVER) {
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	532 if (fdatasync(ctx->file->fd) < 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	533 dbox_file_set_syscall_error(ctx->file, "fdatasync()");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	534 return -1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	535 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	536 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	537 ctx->last_flush_offset = ctx->output->offset;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	538 return 0;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	539 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	540
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	541 int dbox_file_get_append_stream(struct dbox_file_append_context *ctx,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	542 struct ostream **output_r)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	543 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	544 struct dbox_file *file = ctx->file;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	545 struct stat st;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	546
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	547 if (ctx->output == NULL) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	548 /* file creation had failed */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	549 return -1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	550 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	551
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	552 if (file->file_version == 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	553 /* newly created file, write the file header */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	554 if (dbox_file_header_write(file, ctx->output) < 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	555 dbox_file_set_syscall_error(file, "write()");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	556 return -1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	557 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	558 *output_r = ctx->output;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	559 return 1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	560 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	561
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	562 /* file has existing mails */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	563 if (file->file_version != DBOX_VERSION \|\|
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	564 file->msg_header_size != sizeof(struct dbox_message_header)) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	565 /* created by an incompatible version, can't append */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	566 return 0;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	567 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	568
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	569 if (ctx->output->offset == 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	570 /* first append to existing file. seek to eof first. */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	571 if (fstat(file->fd, &st) < 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	572 dbox_file_set_syscall_error(file, "fstat()");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	573 return -1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	574 }
11805 0a2dc81ed513 dbox: Added a sanity check so that too small dbox files won't be appended to. Timo Sirainen <tss@iki.fi> parents: 11764 diff changeset	575 if (st.st_size < file->msg_header_size) {
0a2dc81ed513 dbox: Added a sanity check so that too small dbox files won't be appended to. Timo Sirainen <tss@iki.fi> parents: 11764 diff changeset	576 dbox_file_set_corrupted(file,
0a2dc81ed513 dbox: Added a sanity check so that too small dbox files won't be appended to. Timo Sirainen <tss@iki.fi> parents: 11764 diff changeset	577 "dbox file size too small");
0a2dc81ed513 dbox: Added a sanity check so that too small dbox files won't be appended to. Timo Sirainen <tss@iki.fi> parents: 11764 diff changeset	578 return 0;
0a2dc81ed513 dbox: Added a sanity check so that too small dbox files won't be appended to. Timo Sirainen <tss@iki.fi> parents: 11764 diff changeset	579 }
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	580 o_stream_seek(ctx->output, st.st_size);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	581 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	582 *output_r = ctx->output;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	583 return 1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	584 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	585
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	586 int dbox_file_metadata_skip_header(struct dbox_file *file)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	587 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	588 struct dbox_metadata_header metadata_hdr;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	589 const unsigned char *data;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	590 size_t size;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	591 int ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	592
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	593 ret = i_stream_read_data(file->input, &data, &size,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	594 sizeof(metadata_hdr) - 1);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	595 if (ret <= 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	596 if (file->input->stream_errno == 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	597 /* EOF, broken offset */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	598 dbox_file_set_corrupted(file,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	599 "Unexpected EOF while reading metadata header");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	600 return 0;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	601 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	602 dbox_file_set_syscall_error(file, "read()");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	603 return -1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	604 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	605 memcpy(&metadata_hdr, data, sizeof(metadata_hdr));
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	606 if (memcmp(metadata_hdr.magic_post, DBOX_MAGIC_POST,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	607 sizeof(metadata_hdr.magic_post)) != 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	608 /* probably broken offset */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	609 dbox_file_set_corrupted(file,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	610 "metadata header has bad magic value");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	611 return 0;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	612 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	613 i_stream_skip(file->input, sizeof(metadata_hdr));
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	614 return 1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	615 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	616
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	617 static int
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	618 dbox_file_metadata_read_at(struct dbox_file *file, uoff_t metadata_offset)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	619 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	620 const char *line;
11993 ae4a82ced01e dbox: Don't allow unlimited buffer size when reading message body. Timo Sirainen <tss@iki.fi> parents: 11826 diff changeset	621 size_t buf_size;
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	622 int ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	623
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	624 if (file->metadata_pool != NULL)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	625 p_clear(file->metadata_pool);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	626 else {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	627 file->metadata_pool =
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	628 pool_alloconly_create("dbox metadata", 1024);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	629 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	630 p_array_init(&file->metadata, file->metadata_pool, 16);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	631
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	632 i_stream_seek(file->input, metadata_offset);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	633 if ((ret = dbox_file_metadata_skip_header(file)) <= 0)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	634 return ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	635
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	636 ret = 0;
11993 ae4a82ced01e dbox: Don't allow unlimited buffer size when reading message body. Timo Sirainen <tss@iki.fi> parents: 11826 diff changeset	637 buf_size = i_stream_get_max_buffer_size(file->input);
ae4a82ced01e dbox: Don't allow unlimited buffer size when reading message body. Timo Sirainen <tss@iki.fi> parents: 11826 diff changeset	638 i_stream_set_max_buffer_size(file->input, 0);
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	639 while ((line = i_stream_read_next_line(file->input)) != NULL) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	640 if (line == DBOX_METADATA_OLDV1_SPACE \|\| line == '\0') {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	641 /* end of metadata */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	642 ret = 1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	643 break;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	644 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	645 line = p_strdup(file->metadata_pool, line);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	646 array_append(&file->metadata, &line, 1);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	647 }
11993 ae4a82ced01e dbox: Don't allow unlimited buffer size when reading message body. Timo Sirainen <tss@iki.fi> parents: 11826 diff changeset	648 i_stream_set_max_buffer_size(file->input, buf_size);
9977 0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	649 if (ret == 0)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	650 dbox_file_set_corrupted(file, "missing end-of-metadata line");
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	651 return ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	652 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	653
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	654 int dbox_file_metadata_read(struct dbox_file *file)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	655 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	656 uoff_t metadata_offset;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	657 int ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	658
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	659 i_assert(file->cur_offset != (uoff_t)-1);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	660
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	661 if (file->metadata_read_offset == file->cur_offset)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	662 return 1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	663
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	664 metadata_offset = file->cur_offset + file->msg_header_size +
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	665 file->cur_physical_size;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	666 ret = dbox_file_metadata_read_at(file, metadata_offset);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	667 if (ret <= 0)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	668 return ret;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	669
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	670 file->metadata_read_offset = file->cur_offset;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	671 return 1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	672 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	673
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	674 const char dbox_file_metadata_get(struct dbox_file file,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	675 enum dbox_metadata_key key)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	676 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	677 const char const metadata;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	678 unsigned int i, count;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	679
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	680 metadata = array_get(&file->metadata, &count);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	681 for (i = 0; i < count; i++) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	682 if (*metadata[i] == (char)key)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	683 return metadata[i] + 1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	684 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	685 return NULL;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	686 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	687
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	688 void dbox_msg_header_fill(struct dbox_message_header *dbox_msg_hdr,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	689 uoff_t message_size)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	690 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	691 memset(dbox_msg_hdr, ' ', sizeof(*dbox_msg_hdr));
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	692 memcpy(dbox_msg_hdr->magic_pre, DBOX_MAGIC_PRE,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	693 sizeof(dbox_msg_hdr->magic_pre));
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	694 dbox_msg_hdr->type = DBOX_MESSAGE_TYPE_NORMAL;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	695 dec2hex(dbox_msg_hdr->message_size_hex, message_size,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	696 sizeof(dbox_msg_hdr->message_size_hex));
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	697 dbox_msg_hdr->save_lf = '\n';
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	698 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	699
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	700 int dbox_file_unlink(struct dbox_file *file)
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	701 {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	702 const char *path;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	703 bool alt = FALSE;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	704
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	705 path = file->primary_path;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	706 while (unlink(path) < 0) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	707 if (errno != ENOENT) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	708 mail_storage_set_critical(&file->storage->storage,
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	709 "unlink(%s) failed: %m", path);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	710 return -1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	711 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	712 if (file->alt_path == NULL \|\| alt) {
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	713 /* not found */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	714 i_warning("dbox: File unexpectedly lost: %s",
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	715 file->primary_path);
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	716 return 0;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	717 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	718
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	719 /* try the alternative path */
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	720 path = file->alt_path;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	721 alt = TRUE;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	722 }
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	723 return 1;
0bb321c347ae Split dbox (single-dbox) and mdbox (multi-dbox) into separate storage backends. Timo Sirainen <tss@iki.fi> parents: diff changeset	724 }

Mercurial > dovecot > core-2.2

annotate src/lib-storage/index/dbox-common/dbox-file.c @ 12322:d94957cafd3e