dovecot/core-2.2: src/director/director-connection.c annotate

annotate src/director/director-connection.c @ 19973:0b5aeb95924a

director: Avoid a potential assert-crash after removing a director from ring. This should fix the crash: Panic: director: file director-connection.c: line 1926 (director_connection_init_out): assertion failed: (!host->removed) Also moved the last_network_failure timestamp reset a bit later, since there's no need to reset the timestamp if we're not actually connecting to the server.

author	Timo Sirainen <timo.sirainen@dovecot.fi>
date	Wed, 30 Mar 2016 08:24:51 +0300
parents	82ffadc8c4d7
children	0fd0fb05e2b3

rev	line source
19552 0f22db71df7a global: freshen copyright Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19506 diff changeset	1 /* Copyright (c) 2010-2016 Dovecot authors, see the included COPYING file */
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	3 /*
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	4 Handshaking:
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	5
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	6 Incoming director connections send:
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	7
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	8 VERSION
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	9 ME
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	10 <wait for DONE from remote handshake>
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	11 DONE
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	12 <make this connection our "left" connection, potentially disconnecting
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	13 another one>
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	14
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	15 Outgoing director connections send:
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	16
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	17 VERSION
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	18 ME
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	19 [0..n] DIRECTOR
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	20 HOST-HAND-START
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	21 [0..n] HOST
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	22 HOST-HAND-END
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	23 [0..n] USER
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	24 <possibly other non-handshake commands between USERs>
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	25 DONE
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	26 <wait for DONE from remote>
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	27 <make this connection our "right" connection, potentially disconnecting
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	28 another one>
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	29 */
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	30
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	31 #include "lib.h"
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	32 #include "ioloop.h"
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	33 #include "array.h"
15187 02451e967a06 Renamed network.[ch] to net.[ch]. Timo Sirainen <tss@iki.fi> parents: 15162 diff changeset	34 #include "net.h"
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	35 #include "istream.h"
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	36 #include "ostream.h"
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	37 #include "str.h"
18067 a7e830b9b967 director: Added support for backend cluster "tags". Timo Sirainen <tss@iki.fi> parents: 18065 diff changeset	38 #include "strescape.h"
11373 26cfc1c3a4b1 director: Update connection count when client disconnects. Timo Sirainen <tss@iki.fi> parents: 11355 diff changeset	39 #include "master-service.h"
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	40 #include "mail-host.h"
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	41 #include "director.h"
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	42 #include "director-host.h"
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	43 #include "director-request.h"
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	44 #include "user-directory.h"
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	45 #include "director-connection.h"
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	46
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	47 #include <unistd.h>
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	48
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	49 #define MAX_INBUF_SIZE 1024
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	50 #define MAX_OUTBUF_SIZE (1024102410)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	51 #define OUTBUF_FLUSH_THRESHOLD (1024*128)
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	52 /* Max idling time before "ME" command must have been received,
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	53 or we'll disconnect. */
14467 110673e82868 director: Increased timeouts. Timo Sirainen <tss@iki.fi> parents: 14437 diff changeset	54 #define DIRECTOR_CONNECTION_ME_TIMEOUT_MSECS (10*1000)
14477 ea5b949a623b director: Increased timeout for sending USER data in handshake. Timo Sirainen <tss@iki.fi> parents: 14476 diff changeset	55 /* Max time to wait for USERs in handshake to be sent. With a lot of users the
ea5b949a623b director: Increased timeout for sending USER data in handshake. Timo Sirainen <tss@iki.fi> parents: 14476 diff changeset	56 kernel may quickly eat up everything we send, while the receiver is busy
ea5b949a623b director: Increased timeout for sending USER data in handshake. Timo Sirainen <tss@iki.fi> parents: 14476 diff changeset	57 parsing the data. */
14483 10f5456704a7 director: USER sending timeout was higher than it needed to be. Timo Sirainen <tss@iki.fi> parents: 14482 diff changeset	58 #define DIRECTOR_CONNECTION_SEND_USERS_TIMEOUT_MSECS (30*1000)
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	59 /* Max idling time before "DONE" command must have been received,
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	60 or we'll disconnect. */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	61 #define DIRECTOR_CONNECTION_DONE_TIMEOUT_MSECS (30*1000)
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	62 /* How long to wait for PONG for an idling connection */
14467 110673e82868 director: Increased timeouts. Timo Sirainen <tss@iki.fi> parents: 14437 diff changeset	63 #define DIRECTOR_CONNECTION_PING_IDLE_TIMEOUT_MSECS (10*1000)
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	64 /* Maximum time to wait for PONG reply */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	65 #define DIRECTOR_CONNECTION_PONG_TIMEOUT_MSECS (60*1000)
11586 e75dab14bb2f director: Send PINGs every 15 seconds for idling director connections. Timo Sirainen <tss@iki.fi> parents: 11585 diff changeset	66 /* How long to wait to send PING when connection is idle */
e75dab14bb2f director: Send PINGs every 15 seconds for idling director connections. Timo Sirainen <tss@iki.fi> parents: 11585 diff changeset	67 #define DIRECTOR_CONNECTION_PING_INTERVAL_MSECS (15*1000)
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	68 /* How long to wait before sending PING while waiting for SYNC reply */
14405 168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	69 #define DIRECTOR_CONNECTION_PING_SYNC_INTERVAL_MSECS 1000
12065 ff5a47012287 director: If outgoing connection dies soon, mark the host as failed to avoid immediate reconnect. Timo Sirainen <tss@iki.fi> parents: 11816 diff changeset	70 /* If outgoing director connection exists for less than this many seconds,
ff5a47012287 director: If outgoing connection dies soon, mark the host as failed to avoid immediate reconnect. Timo Sirainen <tss@iki.fi> parents: 11816 diff changeset	71 mark the host as failed so we won't try to reconnect to it immediately */
14432 366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	72 #define DIRECTOR_SUCCESS_MIN_CONNECT_SECS 40
14575 dbe6d05fd595 director: When we find unwanted connection, wait for 10s for it to disconnect us, not 10ms. Timo Sirainen <tss@iki.fi> parents: 14571 diff changeset	73 #define DIRECTOR_WAIT_DISCONNECT_SECS 10
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	74 #define DIRECTOR_HANDSHAKE_WARN_SECS 29
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	75 #define DIRECTOR_HANDSHAKE_BYTES_LOG_MIN_SECS (60*30)
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	76 #define DIRECTOR_MAX_SYNC_SEQ_DUPLICATES 4
16790 c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	77 /* If we receive SYNCs with a timestamp this many seconds higher than the last
c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	78 valid received SYNC timestamp, assume that we lost the director's restart
c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	79 notification and reset the last_sync_seq */
c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	80 #define DIRECTOR_SYNC_STALE_TIMESTAMP_RESET_SECS (60*2)
19294 d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	81 #define DIRECTOR_MAX_CLOCK_DIFF_WARN_SECS 1
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	82
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	83 #if DIRECTOR_CONNECTION_DONE_TIMEOUT_MSECS <= DIRECTOR_CONNECTION_PING_TIMEOUT_MSECS
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	84 # error DIRECTOR_CONNECTION_DONE_TIMEOUT_MSECS is too low
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	85 #endif
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	86
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	87 #if DIRECTOR_CONNECTION_PONG_TIMEOUT_MSECS <= DIRECTOR_CONNECTION_PING_IDLE_TIMEOUT_MSECS
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	88 # error DIRECTOR_CONNECTION_PONG_TIMEOUT_MSECS is too low
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	89 #endif
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	90
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	91 #define CMD_IS_USER_HANDHAKE(args) \
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	92 (str_array_length(args) > 2)
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	93
18065 b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	94 #define DIRECTOR_OPT_CONSISTENT_HASHING "consistent-hashing"
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	95
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	96 struct director_connection {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	97 struct director *dir;
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	98 char *name;
12065 ff5a47012287 director: If outgoing connection dies soon, mark the host as failed to avoid immediate reconnect. Timo Sirainen <tss@iki.fi> parents: 11816 diff changeset	99 time_t created;
14431 084064444f89 director: Don't try to send the new SYNC parameter to old director versions. Timo Sirainen <tss@iki.fi> parents: 14409 diff changeset	100 unsigned int minor_version;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	101
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	102 /* for incoming connections the director host isn't known until
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	103 ME-line is received */
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	104 struct director_host *host;
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	105 /* this is set only for wrong connections: */
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	106 struct director_host *connect_request_to;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	107
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	108 int fd;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	109 struct io *io;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	110 struct istream *input;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	111 struct ostream *output;
14494 d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	112 struct timeout to_disconnect, to_ping, *to_pong;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	113
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	114 struct user_directory_iter *user_iter;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	115
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	116 /* set during command execution */
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	117 const char cur_cmd, cur_line;
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	118
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	119 unsigned int in:1;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	120 unsigned int connected:1;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	121 unsigned int version_received:1;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	122 unsigned int me_received:1;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	123 unsigned int handshake_received:1;
11350 5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	124 unsigned int ignore_host_events:1;
11585 f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	125 unsigned int handshake_sending_hosts:1;
11586 e75dab14bb2f director: Send PINGs every 15 seconds for idling director connections. Timo Sirainen <tss@iki.fi> parents: 11585 diff changeset	126 unsigned int ping_waiting:1;
14405 168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	127 unsigned int synced:1;
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	128 unsigned int wrong_host:1;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	129 unsigned int verifying_left:1;
16621 5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	130 unsigned int users_unsorted:1;
18065 b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	131 unsigned int done_pending:1;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	132 };
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	133
18662 27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	134 static void director_connection_disconnected(struct director_connection **conn,
27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	135 const char *reason);
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	136 static void director_connection_reconnect(struct director_connection **conn,
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	137 const char *reason);
16618 0ad8da149774 director: Log director disconnection errno correctly. Timo Sirainen <tss@iki.fi> parents: 15715 diff changeset	138 static void
18662 27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	139 director_connection_log_disconnect(struct director_connection *conn, int err,
27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	140 const char *errstr);
18065 b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	141 static int director_connection_send_done(struct director_connection *conn);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	142
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	143 static void ATTR_FORMAT(2, 3)
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	144 director_cmd_error(struct director_connection conn, const char fmt, ...)
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	145 {
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	146 va_list args;
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	147
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	148 va_start(args, fmt);
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	149 i_error("director(%s): Command %s: %s (input: %s)", conn->name,
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	150 conn->cur_cmd, t_strdup_vprintf(fmt, args), conn->cur_line);
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	151 va_end(args);
14479 293ada796ae6 director: Fixed protocol error detection/handling. Timo Sirainen <tss@iki.fi> parents: 14478 diff changeset	152
18663 1c268a7cc74a director: Fixed crash if director sent invalid data too early. Timo Sirainen <tss@iki.fi> parents: 18662 diff changeset	153 if (conn->host != NULL)
1c268a7cc74a director: Fixed crash if director sent invalid data too early. Timo Sirainen <tss@iki.fi> parents: 18662 diff changeset	154 conn->host->last_protocol_failure = ioloop_time;
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	155 }
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	156
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	157 static void
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	158 director_connection_init_timeout(struct director_connection *conn)
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	159 {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	160 unsigned int secs = ioloop_time - conn->created;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	161
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	162 if (!conn->connected) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	163 i_error("director(%s): Connect timed out (%u secs)",
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	164 conn->name, secs);
14476 8245a97bf36c director: Improved error message Timo Sirainen <tss@iki.fi> parents: 14475 diff changeset	165 } else if (conn->io == NULL) {
8245a97bf36c director: Improved error message Timo Sirainen <tss@iki.fi> parents: 14475 diff changeset	166 i_error("director(%s): Sending handshake (%u secs)",
8245a97bf36c director: Improved error message Timo Sirainen <tss@iki.fi> parents: 14475 diff changeset	167 conn->name, secs);
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	168 } else if (!conn->me_received) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	169 i_error("director(%s): Handshaking ME timed out (%u secs)",
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	170 conn->name, secs);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	171 } else {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	172 i_error("director(%s): Handshaking DONE timed out (%u secs)",
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	173 conn->name, secs);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	174 }
18662 27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	175 director_connection_disconnected(&conn, "Handshake timeout");
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	176 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	177
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	178 static void
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	179 director_connection_set_ping_timeout(struct director_connection *conn)
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	180 {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	181 unsigned int msecs;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	182
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	183 msecs = conn->synced \|\| !conn->handshake_received ?
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	184 DIRECTOR_CONNECTION_PING_INTERVAL_MSECS :
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	185 DIRECTOR_CONNECTION_PING_SYNC_INTERVAL_MSECS;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	186
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	187 timeout_remove(&conn->to_ping);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	188 conn->to_ping = timeout_add(msecs, director_connection_ping, conn);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	189 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	190
14494 d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	191 static void director_connection_wait_timeout(struct director_connection *conn)
d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	192 {
18662 27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	193 director_connection_log_disconnect(conn, ETIMEDOUT, "");
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	194 director_connection_deinit(&conn,
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	195 "Timeout waiting for disconnect after CONNECT");
14494 d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	196 }
d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	197
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	198 static void director_connection_send_connect(struct director_connection *conn,
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	199 struct director_host *host)
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	200 {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	201 const char *connect_str;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	202
14494 d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	203 if (conn->to_disconnect != NULL)
d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	204 return;
d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	205
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	206 connect_str = t_strdup_printf("CONNECT\t%s\t%u\n",
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	207 net_ip2addr(&host->ip), host->port);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	208 director_connection_send(conn, connect_str);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	209 o_stream_uncork(conn->output);
14494 d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	210
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	211 /* wait for a while for the remote to disconnect, so it will hopefully
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	212 see our CONNECT command. we'll also log the warning later to avoid
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	213 multiple log lines about it. */
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	214 conn->connect_request_to = host;
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	215 director_host_ref(conn->connect_request_to);
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	216
14494 d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	217 conn->to_disconnect =
14575 dbe6d05fd595 director: When we find unwanted connection, wait for 10s for it to disconnect us, not 10ms. Timo Sirainen <tss@iki.fi> parents: 14571 diff changeset	218 timeout_add(DIRECTOR_WAIT_DISCONNECT_SECS*1000,
14494 d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	219 director_connection_wait_timeout, conn);
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	220 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	221
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	222 static void director_connection_assigned(struct director_connection *conn)
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	223 {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	224 struct director *dir = conn->dir;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	225
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	226 if (dir->left != NULL && dir->right != NULL) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	227 /* we're connected to both directors. see if the ring is
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	228 finished by sending a SYNC. if we get it back, it's done. */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	229 dir->sync_seq++;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	230 director_set_ring_unsynced(dir);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	231 director_sync_send(dir, dir->self_host, dir->sync_seq,
19293 8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	232 DIRECTOR_VERSION_MINOR, ioloop_time,
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	233 mail_hosts_hash(dir->mail_hosts));
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	234 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	235 director_connection_set_ping_timeout(conn);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	236 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	237
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	238 static bool director_connection_assign_left(struct director_connection *conn)
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	239 {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	240 struct director *dir = conn->dir;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	241
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	242 i_assert(conn->in);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	243 i_assert(dir->left != conn);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	244
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	245 /* make sure this is the correct incoming connection */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	246 if (conn->host->self) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	247 i_error("Connection from self, dropping");
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	248 return FALSE;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	249 } else if (dir->left == NULL) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	250 /* no conflicts yet */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	251 } else if (dir->left->host == conn->host) {
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	252 i_warning("Replacing left director connection %s with %s",
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	253 dir->left->host->name, conn->host->name);
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	254 director_connection_deinit(&dir->left, t_strdup_printf(
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	255 "Replacing with %s", conn->host->name));
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	256 } else if (dir->left->verifying_left) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	257 /* we're waiting to verify if our current left is still
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	258 working. if we don't receive a PONG, the current left
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	259 gets disconnected and a new left gets assigned. if we do
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	260 receive a PONG, we'll wait until the current left
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	261 disconnects us and then reassign the new left. */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	262 return TRUE;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	263 } else if (director_host_cmp_to_self(dir->left->host, conn->host,
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	264 dir->self_host) < 0) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	265 /* the old connection is the correct one.
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	266 refer the client there (FIXME: do we ever get here?) */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	267 director_connection_send_connect(conn, dir->left->host);
14494 d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	268 return TRUE;
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	269 } else {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	270 /* this new connection is the correct one, but wait until the
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	271 old connection gets disconnected before using this one.
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	272 that guarantees that the director inserting itself into
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	273 the ring has finished handshaking its left side, so the
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	274 switch will be fast. */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	275 return TRUE;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	276 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	277 dir->left = conn;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	278 i_free(conn->name);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	279 conn->name = i_strdup_printf("%s/left", conn->host->name);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	280 director_connection_assigned(conn);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	281 return TRUE;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	282 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	283
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	284 static void director_assign_left(struct director *dir)
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	285 {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	286 struct director_connection conn, const *connp;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	287
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	288 array_foreach(&dir->connections, connp) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	289 conn = *connp;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	290
14494 d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	291 if (conn->in && conn->handshake_received &&
d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	292 conn->to_disconnect == NULL && conn != dir->left) {
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	293 /* either use this or disconnect it */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	294 if (!director_connection_assign_left(conn)) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	295 /* we don't want this */
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	296 director_connection_deinit(&conn,
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	297 "Unwanted incoming connection");
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	298 director_assign_left(dir);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	299 break;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	300 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	301 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	302 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	303 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	304
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	305 static bool director_has_outgoing_connections(struct director *dir)
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	306 {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	307 struct director_connection const connp;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	308
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	309 array_foreach(&dir->connections, connp) {
14494 d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	310 if (!(connp)->in && (connp)->to_disconnect == NULL)
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	311 return TRUE;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	312 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	313 return FALSE;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	314 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	315
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	316 static bool director_connection_assign_right(struct director_connection *conn)
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	317 {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	318 struct director *dir = conn->dir;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	319
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	320 i_assert(!conn->in);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	321
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	322 if (dir->right != NULL) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	323 /* see if we should disconnect or keep the existing
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	324 connection. */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	325 if (director_host_cmp_to_self(conn->host, dir->right->host,
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	326 dir->self_host) <= 0) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	327 /* the old connection is the correct one */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	328 i_warning("Aborting incorrect outgoing connection to %s "
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	329 "(already connected to correct one: %s)",
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	330 conn->host->name, dir->right->host->name);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	331 conn->wrong_host = TRUE;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	332 return FALSE;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	333 }
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	334 i_warning("Replacing right director connection %s with %s",
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	335 dir->right->host->name, conn->host->name);
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	336 director_connection_deinit(&dir->right, t_strdup_printf(
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	337 "Replacing with %s", conn->host->name));
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	338 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	339 dir->right = conn;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	340 i_free(conn->name);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	341 conn->name = i_strdup_printf("%s/right", conn->host->name);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	342 director_connection_assigned(conn);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	343 return TRUE;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	344 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	345
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	346 static bool
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	347 director_args_parse_ip_port(struct director_connection *conn,
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	348 const char const args,
19035 aabfe48db1cf Changed type of internet port values to in_port_t everywhere. Stephan Bosch <stephan@rename-it.nl> parents: 18858 diff changeset	349 struct ip_addr ip_r, in_port_t port_r)
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	350 {
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	351 if (args[0] == NULL \|\| args[1] == NULL) {
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	352 director_cmd_error(conn, "Missing IP+port parameters");
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	353 return FALSE;
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	354 }
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	355 if (net_addr2ip(args[0], ip_r) < 0) {
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	356 director_cmd_error(conn, "Invalid IP address: %s", args[0]);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	357 return FALSE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	358 }
19035 aabfe48db1cf Changed type of internet port values to in_port_t everywhere. Stephan Bosch <stephan@rename-it.nl> parents: 18858 diff changeset	359 if (net_str2port(args[1], port_r) < 0) {
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	360 director_cmd_error(conn, "Invalid port: %s", args[1]);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	361 return FALSE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	362 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	363 return TRUE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	364 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	365
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	366 static bool director_cmd_me(struct director_connection *conn,
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	367 const char const args)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	368 {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	369 struct director *dir = conn->dir;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	370 const char *connect_str;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	371 struct ip_addr ip;
19035 aabfe48db1cf Changed type of internet port values to in_port_t everywhere. Stephan Bosch <stephan@rename-it.nl> parents: 18858 diff changeset	372 in_port_t port;
14432 366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	373 time_t next_comm_attempt;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	374
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	375 if (!director_args_parse_ip_port(conn, args, &ip, &port))
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	376 return FALSE;
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	377 if (conn->me_received) {
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	378 director_cmd_error(conn, "Duplicate ME");
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	379 return FALSE;
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	380 }
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	381
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	382 if (!conn->in && (!net_ip_compare(&conn->host->ip, &ip) \|\|
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	383 conn->host->port != port)) {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	384 i_error("Remote director thinks it's someone else "
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	385 "(connected to %s:%u, remote says it's %s:%u)",
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	386 net_ip2addr(&conn->host->ip), conn->host->port,
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	387 net_ip2addr(&ip), port);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	388 return FALSE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	389 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	390 conn->me_received = TRUE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	391
19294 d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	392 if (args[2] != NULL) {
d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	393 time_t remote_time;
d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	394 int diff;
d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	395
d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	396 if (str_to_time(args[2], &remote_time) < 0) {
d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	397 director_cmd_error(conn, "Invalid ME timestamp");
d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	398 return FALSE;
d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	399 }
d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	400 diff = ioloop_time - remote_time;
d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	401 if (diff > DIRECTOR_MAX_CLOCK_DIFF_WARN_SECS \|\|
d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	402 (diff < 0 && -diff > DIRECTOR_MAX_CLOCK_DIFF_WARN_SECS)) {
d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	403 i_warning("Director %s clock differs from ours by %d secs",
d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	404 conn->name, diff);
d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	405 }
d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	406 }
d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	407
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	408 timeout_remove(&conn->to_ping);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	409 conn->to_ping = timeout_add(DIRECTOR_CONNECTION_DONE_TIMEOUT_MSECS,
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	410 director_connection_init_timeout, conn);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	411
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	412 if (!conn->in)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	413 return TRUE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	414
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	415 /* Incoming connection:
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	416
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	417 a) we don't have an established ring yet. make sure we're connecting
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	418 to our right side (which might become our left side).
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	419
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	420 b) it's our current "left" connection. the previous connection
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	421 is most likely dead.
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	422
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	423 c) we have an existing ring. tell our current "left" to connect to
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	424 it with CONNECT command.
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	425
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	426 d) the incoming connection doesn't belong to us at all, refer it
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	427 elsewhere with CONNECT. however, before disconnecting it verify
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	428 first that our left side is actually still functional.
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	429 */
14571 42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	430 i_assert(conn->host == NULL);
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	431 conn->host = director_host_get(dir, &ip, port);
14571 42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	432 /* the host shouldn't be removed at this point, but if for some
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	433 reason it is we don't want to crash */
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	434 conn->host->removed = FALSE;
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	435 director_host_ref(conn->host);
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	436 /* make sure we don't keep old sequence values across restarts */
16699 9531ec8afe8b director: Reset last-seen-sync-sequence after remote director restarts. Timo Sirainen <tss@iki.fi> parents: 16695 diff changeset	437 director_host_restarted(conn->host);
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	438
14432 366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	439 next_comm_attempt = conn->host->last_protocol_failure +
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	440 DIRECTOR_PROTOCOL_FAILURE_RETRY_SECS;
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	441 if (next_comm_attempt > ioloop_time) {
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	442 /* the director recently sent invalid protocol data,
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	443 don't try retrying yet */
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	444 i_error("director(%s): Remote sent invalid protocol data recently, "
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	445 "waiting %u secs before allowing further communication",
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	446 conn->name, (unsigned int)(next_comm_attempt-ioloop_time));
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	447 return FALSE;
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	448 } else if (dir->left == NULL) {
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	449 /* a) - just in case the left is also our right side reset
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	450 its failed state, so we can connect to it */
14432 366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	451 conn->host->last_network_failure = 0;
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	452 if (!director_has_outgoing_connections(dir))
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	453 director_connect(dir);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	454 } else if (dir->left->host == conn->host) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	455 /* b) */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	456 i_assert(dir->left != conn);
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	457 director_connection_deinit(&dir->left,
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	458 "Replacing with new incoming connection");
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	459 } else if (director_host_cmp_to_self(conn->host, dir->left->host,
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	460 dir->self_host) < 0) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	461 /* c) */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	462 connect_str = t_strdup_printf("CONNECT\t%s\t%u\n",
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	463 net_ip2addr(&conn->host->ip),
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	464 conn->host->port);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	465 director_connection_send(dir->left, connect_str);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	466 } else {
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	467 /* d) */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	468 dir->left->verifying_left = TRUE;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	469 director_connection_ping(dir->left);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	470 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	471 return TRUE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	472 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	473
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	474 static bool
14303 d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	475 director_user_refresh(struct director_connection *conn,
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	476 unsigned int username_hash, struct mail_host *host,
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	477 time_t timestamp, bool weak, struct user **user_r)
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	478 {
14303 d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	479 struct director *dir = conn->dir;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	480 struct user *user;
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	481 bool ret = FALSE, unset_weak_user = FALSE;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	482
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	483 user = user_directory_lookup(dir->users, username_hash);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	484 if (user == NULL) {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	485 *user_r = user_directory_add(dir->users, username_hash,
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	486 host, timestamp);
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	487 (*user_r)->weak = weak;
15326 48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	488 dir_debug("user refresh: %u added", username_hash);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	489 return TRUE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	490 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	491
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	492 if (user->weak) {
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	493 if (!weak) {
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	494 /* removing user's weakness */
15326 48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	495 dir_debug("user refresh: %u weakness removed",
48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	496 username_hash);
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	497 unset_weak_user = TRUE;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	498 user->weak = FALSE;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	499 ret = TRUE;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	500 } else {
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	501 /* weak user marked again as weak */
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	502 }
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	503 } else if (weak &&
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	504 !user_directory_user_is_recently_updated(dir->users, user)) {
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	505 /* mark the user as weak */
15326 48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	506 dir_debug("user refresh: %u set weak", username_hash);
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	507 user->weak = TRUE;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	508 ret = TRUE;
16619 9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	509 } else if (weak) {
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	510 dir_debug("user refresh: %u weak update to %s ignored, "
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	511 "we recently changed it to %s",
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	512 username_hash, net_ip2addr(&host->ip),
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	513 net_ip2addr(&user->host->ip));
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	514 host = user->host;
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	515 ret = TRUE;
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	516 } else if (user->host == host) {
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	517 /* update to the same host */
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	518 } else if (user_directory_user_is_near_expiring(dir->users, user)) {
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	519 /* host conflict for a user that is already near expiring. we can
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	520 assume that the other director had already dropped this user
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	521 and we should have as well. use the new host. */
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	522 dir_debug("user refresh: %u is nearly expired, "
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	523 "replacing host %s with %s", username_hash,
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	524 net_ip2addr(&user->host->ip), net_ip2addr(&host->ip));
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	525 ret = TRUE;
18708 51ee438392c7 director: Moving a user to another host sometimes caused the move to fail. Timo Sirainen <tss@iki.fi> parents: 18665 diff changeset	526 } else if (user->kill_state != USER_KILL_STATE_NONE &&
51ee438392c7 director: Moving a user to another host sometimes caused the move to fail. Timo Sirainen <tss@iki.fi> parents: 18665 diff changeset	527 user->kill_state < USER_KILL_STATE_DELAY) {
51ee438392c7 director: Moving a user to another host sometimes caused the move to fail. Timo Sirainen <tss@iki.fi> parents: 18665 diff changeset	528 /* user is still being moved - ignore conflicting host updates
51ee438392c7 director: Moving a user to another host sometimes caused the move to fail. Timo Sirainen <tss@iki.fi> parents: 18665 diff changeset	529 from other directors who don't yet know about the move. */
51ee438392c7 director: Moving a user to another host sometimes caused the move to fail. Timo Sirainen <tss@iki.fi> parents: 18665 diff changeset	530 dir_debug("user refresh: %u is being moved, "
51ee438392c7 director: Moving a user to another host sometimes caused the move to fail. Timo Sirainen <tss@iki.fi> parents: 18665 diff changeset	531 "preserve its host %s instead of replacing with %s",
51ee438392c7 director: Moving a user to another host sometimes caused the move to fail. Timo Sirainen <tss@iki.fi> parents: 18665 diff changeset	532 username_hash, net_ip2addr(&user->host->ip),
51ee438392c7 director: Moving a user to another host sometimes caused the move to fail. Timo Sirainen <tss@iki.fi> parents: 18665 diff changeset	533 net_ip2addr(&host->ip));
51ee438392c7 director: Moving a user to another host sometimes caused the move to fail. Timo Sirainen <tss@iki.fi> parents: 18665 diff changeset	534 host = user->host;
16619 9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	535 } else {
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	536 /* non-weak user received a non-weak update with
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	537 conflicting host. this shouldn't happen. */
14303 d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	538 string_t *str = t_str_new(128);
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	539
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	540 str_printfa(str, "User hash %u "
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	541 "is being redirected to two hosts: %s and %s",
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	542 username_hash, net_ip2addr(&user->host->ip),
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	543 net_ip2addr(&host->ip));
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	544 str_printfa(str, " (old_ts=%ld", (long)user->timestamp);
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	545
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	546 if (!conn->handshake_received) {
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	547 str_printfa(str, ",handshaking,recv_ts=%ld",
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	548 (long)timestamp);
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	549 }
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	550 if (user->to_move != NULL)
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	551 str_append(str, ",moving");
14486 58286c1e272d director: Minor error message fix Timo Sirainen <tss@iki.fi> parents: 14485 diff changeset	552 if (user->kill_state != USER_KILL_STATE_NONE)
14303 d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	553 str_printfa(str, ",kill_state=%d", user->kill_state);
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	554 str_append_c(str, ')');
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	555 i_error("%s", str_c(str));
11581 ecf195115922 director: If same user gets redirected to two hosts, don't crash later. Timo Sirainen <tss@iki.fi> parents: 11579 diff changeset	556
11585 f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	557 /* we want all the directors to redirect the user to same
f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	558 server, but we don't want two directors fighting over which
f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	559 server it belongs to, so always use the lower IP address */
f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	560 if (net_ip_cmp(&user->host->ip, &host->ip) > 0) {
f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	561 /* change the host. we'll also need to remove the user
f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	562 from the old host's user_count, because we can't
f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	563 keep track of the user for more than one host */
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	564 } else {
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	565 /* keep the host */
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	566 host = user->host;
11585 f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	567 }
17419 8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	568 /* especially IMAP connections can take a long time to die.
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	569 make sure we kill off the connections in the wrong
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	570 backends. */
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	571 director_kick_user_hash(dir, dir->self_host, NULL,
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	572 username_hash, &host->ip);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	573 ret = TRUE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	574 }
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	575 if (user->host != host) {
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	576 user->host->user_count--;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	577 user->host = host;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	578 user->host->user_count++;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	579 ret = TRUE;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	580 }
14303 d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	581 if (timestamp == ioloop_time && (time_t)user->timestamp != timestamp) {
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	582 user_directory_refresh(dir->users, user);
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	583 ret = TRUE;
d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	584 }
15326 48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	585 dir_debug("user refresh: %u refreshed timeout to %ld",
48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	586 username_hash, (long)user->timestamp);
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	587
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	588 if (unset_weak_user) {
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	589 /* user is no longer weak. handle pending requests for
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	590 this user if there are any */
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	591 director_set_state_changed(conn->dir);
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	592 }
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	593
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	594 *user_r = user;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	595 return ret;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	596 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	597
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	598 static bool
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	599 director_handshake_cmd_user(struct director_connection *conn,
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	600 const char const args)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	601 {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	602 unsigned int username_hash, timestamp;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	603 struct ip_addr ip;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	604 struct mail_host *host;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	605 struct user *user;
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	606 bool weak;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	607
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	608 if (str_array_length(args) < 3 \|\|
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	609 str_to_uint(args[0], &username_hash) < 0 \|\|
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	610 net_addr2ip(args[1], &ip) < 0 \|\|
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	611 str_to_uint(args[2], &timestamp) < 0) {
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	612 director_cmd_error(conn, "Invalid parameters");
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	613 return FALSE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	614 }
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	615 weak = args[3] != NULL && args[3][0] == 'w';
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	616
11352 19336bddada2 director: Code cleanup - keep mail hosts in a struct rather than in static variables. Timo Sirainen <tss@iki.fi> parents: 11350 diff changeset	617 host = mail_host_lookup(conn->dir->mail_hosts, &ip);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	618 if (host == NULL) {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	619 i_error("director(%s): USER used unknown host %s in handshake",
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	620 conn->name, args[1]);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	621 return FALSE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	622 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	623
14682 d0d7b810646b Make sure we check all the functions' return values. Minor API changes to simplify this. Timo Sirainen <tss@iki.fi> parents: 14681 diff changeset	624 (void)director_user_refresh(conn, username_hash, host,
d0d7b810646b Make sure we check all the functions' return values. Minor API changes to simplify this. Timo Sirainen <tss@iki.fi> parents: 14681 diff changeset	625 timestamp, weak, &user);
16621 5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	626 if (user->timestamp < timestamp) {
5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	627 conn->users_unsorted = TRUE;
5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	628 user->timestamp = timestamp;
5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	629 }
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	630 return TRUE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	631 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	632
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	633 static bool
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	634 director_cmd_user(struct director_connection *conn,
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	635 const char const args)
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	636 {
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	637 unsigned int username_hash;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	638 struct ip_addr ip;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	639 struct mail_host *host;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	640 struct user *user;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	641
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	642 /* NOTE: if more parameters are added, update also
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	643 CMD_IS_USER_HANDHAKE() macro */
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	644 if (str_array_length(args) != 2 \|\|
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	645 str_to_uint(args[0], &username_hash) < 0 \|\|
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	646 net_addr2ip(args[1], &ip) < 0) {
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	647 director_cmd_error(conn, "Invalid parameters");
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	648 return FALSE;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	649 }
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	650
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	651 host = mail_host_lookup(conn->dir->mail_hosts, &ip);
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	652 if (host == NULL) {
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	653 /* we probably just removed this host. */
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	654 return TRUE;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	655 }
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	656
14303 d048cebc1fd4 director: Add more info to "User hash .. is being redirected to two hosts" error. Timo Sirainen <tss@iki.fi> parents: 14133 diff changeset	657 if (director_user_refresh(conn, username_hash,
14487 45be27ff3414 director: Removed special (time_t)-1 code, it's not actually needed. Timo Sirainen <tss@iki.fi> parents: 14486 diff changeset	658 host, ioloop_time, FALSE, &user)) {
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	659 i_assert(!user->weak);
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	660 director_update_user(conn->dir, conn->host, user);
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	661 }
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	662 return TRUE;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	663 }
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	664
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	665 static bool director_cmd_director(struct director_connection *conn,
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	666 const char const args)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	667 {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	668 struct director_host *host;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	669 struct ip_addr ip;
19035 aabfe48db1cf Changed type of internet port values to in_port_t everywhere. Stephan Bosch <stephan@rename-it.nl> parents: 18858 diff changeset	670 in_port_t port;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	671
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	672 if (!director_args_parse_ip_port(conn, args, &ip, &port))
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	673 return FALSE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	674
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	675 host = director_host_lookup(conn->dir, &ip, port);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	676 if (host != NULL) {
14493 1856e9085f94 director: Forward DIRECTOR commands to other connected directors. Timo Sirainen <tss@iki.fi> parents: 14488 diff changeset	677 if (host == conn->dir->self_host) {
1856e9085f94 director: Forward DIRECTOR commands to other connected directors. Timo Sirainen <tss@iki.fi> parents: 14488 diff changeset	678 /* ignore updates to ourself */
1856e9085f94 director: Forward DIRECTOR commands to other connected directors. Timo Sirainen <tss@iki.fi> parents: 14488 diff changeset	679 return TRUE;
1856e9085f94 director: Forward DIRECTOR commands to other connected directors. Timo Sirainen <tss@iki.fi> parents: 14488 diff changeset	680 }
14571 42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	681 if (host->removed) {
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	682 /* ignore re-adds of removed directors */
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	683 return TRUE;
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	684 }
14493 1856e9085f94 director: Forward DIRECTOR commands to other connected directors. Timo Sirainen <tss@iki.fi> parents: 14488 diff changeset	685
14432 366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	686 /* already have this. just reset its last_network_failure
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	687 timestamp, since it might be up now. */
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	688 host->last_network_failure = 0;
16789 5d43c926eb97 director: Make sure director restart notifications go to everyone in the ring. Timo Sirainen <tss@iki.fi> parents: 16788 diff changeset	689 /* it also may have been restarted, reset its state */
5d43c926eb97 director: Make sure director restart notifications go to everyone in the ring. Timo Sirainen <tss@iki.fi> parents: 16788 diff changeset	690 director_host_restarted(host);
14493 1856e9085f94 director: Forward DIRECTOR commands to other connected directors. Timo Sirainen <tss@iki.fi> parents: 14488 diff changeset	691 } else {
1856e9085f94 director: Forward DIRECTOR commands to other connected directors. Timo Sirainen <tss@iki.fi> parents: 14488 diff changeset	692 /* save the director and forward it */
14571 42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	693 host = director_host_add(conn->dir, &ip, port);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	694 }
16789 5d43c926eb97 director: Make sure director restart notifications go to everyone in the ring. Timo Sirainen <tss@iki.fi> parents: 16788 diff changeset	695 /* just forward this to the entire ring until it reaches back to
5d43c926eb97 director: Make sure director restart notifications go to everyone in the ring. Timo Sirainen <tss@iki.fi> parents: 16788 diff changeset	696 itself. some hosts may see this twice, but that's the only way to
5d43c926eb97 director: Make sure director restart notifications go to everyone in the ring. Timo Sirainen <tss@iki.fi> parents: 16788 diff changeset	697 guarantee that it gets seen by everyone. reseting the host multiple
5d43c926eb97 director: Make sure director restart notifications go to everyone in the ring. Timo Sirainen <tss@iki.fi> parents: 16788 diff changeset	698 times may cause us to handle its commands multiple times, but the
18665 b7aed6290e7e director: Don't send DIRECTOR command infinitely in loop if that director got disconnected. Timo Sirainen <tss@iki.fi> parents: 18664 diff changeset	699 commands can handle that. however, we need to also handle a
b7aed6290e7e director: Don't send DIRECTOR command infinitely in loop if that director got disconnected. Timo Sirainen <tss@iki.fi> parents: 18664 diff changeset	700 situation where the added director never comes back - we don't want
b7aed6290e7e director: Don't send DIRECTOR command infinitely in loop if that director got disconnected. Timo Sirainen <tss@iki.fi> parents: 18664 diff changeset	701 to send the director information in a loop forever. */
b7aed6290e7e director: Don't send DIRECTOR command infinitely in loop if that director got disconnected. Timo Sirainen <tss@iki.fi> parents: 18664 diff changeset	702 if (conn->dir->right != NULL &&
b7aed6290e7e director: Don't send DIRECTOR command infinitely in loop if that director got disconnected. Timo Sirainen <tss@iki.fi> parents: 18664 diff changeset	703 director_host_cmp_to_self(host, conn->dir->right->host,
b7aed6290e7e director: Don't send DIRECTOR command infinitely in loop if that director got disconnected. Timo Sirainen <tss@iki.fi> parents: 18664 diff changeset	704 conn->dir->self_host) > 0) {
b7aed6290e7e director: Don't send DIRECTOR command infinitely in loop if that director got disconnected. Timo Sirainen <tss@iki.fi> parents: 18664 diff changeset	705 dir_debug("Received DIRECTOR update for a host where we should be connected to. "
b7aed6290e7e director: Don't send DIRECTOR command infinitely in loop if that director got disconnected. Timo Sirainen <tss@iki.fi> parents: 18664 diff changeset	706 "Not forwarding it since it's probably crashed.");
b7aed6290e7e director: Don't send DIRECTOR command infinitely in loop if that director got disconnected. Timo Sirainen <tss@iki.fi> parents: 18664 diff changeset	707 } else {
b7aed6290e7e director: Don't send DIRECTOR command infinitely in loop if that director got disconnected. Timo Sirainen <tss@iki.fi> parents: 18664 diff changeset	708 director_notify_ring_added(host,
b7aed6290e7e director: Don't send DIRECTOR command infinitely in loop if that director got disconnected. Timo Sirainen <tss@iki.fi> parents: 18664 diff changeset	709 director_connection_get_host(conn));
b7aed6290e7e director: Don't send DIRECTOR command infinitely in loop if that director got disconnected. Timo Sirainen <tss@iki.fi> parents: 18664 diff changeset	710 }
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	711 return TRUE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	712 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	713
14571 42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	714 static bool director_cmd_director_remove(struct director_connection *conn,
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	715 const char const args)
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	716 {
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	717 struct director_host *host;
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	718 struct ip_addr ip;
19035 aabfe48db1cf Changed type of internet port values to in_port_t everywhere. Stephan Bosch <stephan@rename-it.nl> parents: 18858 diff changeset	719 in_port_t port;
14571 42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	720
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	721 if (!director_args_parse_ip_port(conn, args, &ip, &port))
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	722 return FALSE;
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	723
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	724 host = director_host_lookup(conn->dir, &ip, port);
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	725 if (host != NULL && !host->removed)
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	726 director_ring_remove(host, director_connection_get_host(conn));
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	727 return TRUE;
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	728 }
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	729
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	730 static bool
11350 5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	731 director_cmd_host_hand_start(struct director_connection *conn,
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	732 const char const args)
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	733 {
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	734 const ARRAY_TYPE(mail_host) *hosts;
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	735 struct mail_host const hostp;
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	736 unsigned int remote_ring_completed;
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	737
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	738 if (args[0] == NULL \|\|
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	739 str_to_uint(args[0], &remote_ring_completed) < 0) {
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	740 director_cmd_error(conn, "Invalid parameters");
11350 5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	741 return FALSE;
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	742 }
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	743
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	744 if (remote_ring_completed && !conn->dir->ring_handshaked) {
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	745 /* clear everything we have and use only what remote sends us */
11352 19336bddada2 director: Code cleanup - keep mail hosts in a struct rather than in static variables. Timo Sirainen <tss@iki.fi> parents: 11350 diff changeset	746 hosts = mail_hosts_get(conn->dir->mail_hosts);
11350 5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	747 while (array_count(hosts) > 0) {
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	748 hostp = array_idx(hosts, 0);
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	749 director_remove_host(conn->dir, NULL, NULL, *hostp);
11350 5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	750 }
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	751 } else if (!remote_ring_completed && conn->dir->ring_handshaked) {
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	752 /* ignore whatever remote sends */
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	753 conn->ignore_host_events = TRUE;
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	754 }
11585 f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	755 conn->handshake_sending_hosts = TRUE;
11350 5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	756 return TRUE;
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	757 }
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	758
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	759 static int
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	760 director_cmd_is_seen(struct director_connection *conn,
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	761 const char const *_args,
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	762 struct director_host **host_r)
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	763 {
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	764 const char const args = *_args;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	765 struct ip_addr ip;
19035 aabfe48db1cf Changed type of internet port values to in_port_t everywhere. Stephan Bosch <stephan@rename-it.nl> parents: 18858 diff changeset	766 in_port_t port;
aabfe48db1cf Changed type of internet port values to in_port_t everywhere. Stephan Bosch <stephan@rename-it.nl> parents: 18858 diff changeset	767 unsigned int seq;
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	768 struct director_host *host;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	769
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	770 if (str_array_length(args) < 3 \|\|
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	771 net_addr2ip(args[0], &ip) < 0 \|\|
19035 aabfe48db1cf Changed type of internet port values to in_port_t everywhere. Stephan Bosch <stephan@rename-it.nl> parents: 18858 diff changeset	772 net_str2port(args[1], &port) < 0 \|\|
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	773 str_to_uint(args[2], &seq) < 0) {
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	774 director_cmd_error(conn, "Invalid parameters");
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	775 return -1;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	776 }
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	777 *_args = args + 3;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	778
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	779 host = director_host_lookup(conn->dir, &ip, port);
14571 42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	780 if (host == NULL \|\| host->removed) {
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	781 /* director is already gone, but we can't be sure if this
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	782 command was sent everywhere. re-send it as if it was from
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	783 ourself. */
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	784 *host_r = NULL;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	785 } else {
15350 bb095315d025 Make static analyzer happier. Timo Sirainen <tss@iki.fi> parents: 15337 diff changeset	786 *host_r = host;
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	787 if (seq <= host->last_seq) {
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	788 /* already seen this */
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	789 return 1;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	790 }
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	791 host->last_seq = seq;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	792 }
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	793 return 0;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	794 }
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	795
11350 5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	796 static bool
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	797 director_cmd_user_weak(struct director_connection *conn,
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	798 const char const args)
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	799 {
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	800 struct director_host *dir_host;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	801 struct ip_addr ip;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	802 unsigned int username_hash;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	803 struct mail_host *host;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	804 struct user *user;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	805 struct director_host *src_host = conn->host;
16619 9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	806 bool weak = TRUE, weak_forward = FALSE;
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	807 int ret;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	808
15320 e4c337f38ed6 director: Fixed previous broken change for handling USER-WEAK commands. Timo Sirainen <tss@iki.fi> parents: 15132 diff changeset	809 /* note that unlike other commands we don't want to just ignore
e4c337f38ed6 director: Fixed previous broken change for handling USER-WEAK commands. Timo Sirainen <tss@iki.fi> parents: 15132 diff changeset	810 duplicate commands */
e4c337f38ed6 director: Fixed previous broken change for handling USER-WEAK commands. Timo Sirainen <tss@iki.fi> parents: 15132 diff changeset	811 if ((ret = director_cmd_is_seen(conn, &args, &dir_host)) < 0)
15324 1dcf0090648e director: Minor code cleanup Timo Sirainen <tss@iki.fi> parents: 15320 diff changeset	812 return FALSE;
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	813
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	814 if (str_array_length(args) != 2 \|\|
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	815 str_to_uint(args[0], &username_hash) < 0 \|\|
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	816 net_addr2ip(args[1], &ip) < 0) {
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	817 director_cmd_error(conn, "Invalid parameters");
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	818 return FALSE;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	819 }
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	820
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	821 host = mail_host_lookup(conn->dir->mail_hosts, &ip);
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	822 if (host == NULL) {
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	823 /* we probably just removed this host. */
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	824 return TRUE;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	825 }
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	826
19953 a502d38e7b70 director: Fixed user weakness getting stuck if multiple directors set user weak simultaneously Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19608 diff changeset	827 if (ret == 0) {
a502d38e7b70 director: Fixed user weakness getting stuck if multiple directors set user weak simultaneously Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19608 diff changeset	828 /* First time we're seeing this - forward it to others also.
a502d38e7b70 director: Fixed user weakness getting stuck if multiple directors set user weak simultaneously Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19608 diff changeset	829 We'll want to do it even if the user was already marked as
a502d38e7b70 director: Fixed user weakness getting stuck if multiple directors set user weak simultaneously Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19608 diff changeset	830 weak, because otherwise if two directors mark the user weak
a502d38e7b70 director: Fixed user weakness getting stuck if multiple directors set user weak simultaneously Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19608 diff changeset	831 at the same time both the USER-WEAK notifications reach
a502d38e7b70 director: Fixed user weakness getting stuck if multiple directors set user weak simultaneously Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19608 diff changeset	832 only half the directors until they collide and neither one
a502d38e7b70 director: Fixed user weakness getting stuck if multiple directors set user weak simultaneously Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19608 diff changeset	833 finishes going through the whole ring marking the user
a502d38e7b70 director: Fixed user weakness getting stuck if multiple directors set user weak simultaneously Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19608 diff changeset	834 non-weak. */
a502d38e7b70 director: Fixed user weakness getting stuck if multiple directors set user weak simultaneously Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19608 diff changeset	835 weak_forward = TRUE;
a502d38e7b70 director: Fixed user weakness getting stuck if multiple directors set user weak simultaneously Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19608 diff changeset	836 } else if (dir_host == conn->dir->self_host) {
16619 9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	837 /* We originated this USER-WEAK request. The entire ring has seen
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	838 it and there weren't any conflicts. Make the user non-weak. */
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	839 dir_debug("user refresh: %u Our USER-WEAK seen by the entire ring",
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	840 username_hash);
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	841 src_host = conn->dir->self_host;
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	842 weak = FALSE;
16619 9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	843 } else {
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	844 /* The original USER-WEAK sender will send a new non-weak USER
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	845 update saying what really happened. We'll still need to forward
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	846 this around the ring to the origin so it also knows it has
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	847 travelled through the ring. */
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	848 dir_debug("user refresh: %u Remote USER-WEAK from %s seen by the entire ring, ignoring",
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	849 username_hash, net_ip2addr(&dir_host->ip));
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	850 weak_forward = TRUE;
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	851 }
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	852
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	853 if (director_user_refresh(conn, username_hash,
16619 9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	854 host, ioloop_time, weak, &user) \|\|
9b8b5ce6ecb0 director: Fixes to handling users near expiration. Timo Sirainen <tss@iki.fi> parents: 16618 diff changeset	855 weak_forward) {
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	856 if (!user->weak)
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	857 director_update_user(conn->dir, src_host, user);
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	858 else {
17259 6269063f8408 director: Fixed handling weak users when there were exactly 2 director servers in the ring. Timo Sirainen <tss@iki.fi> parents: 17130 diff changeset	859 director_update_user_weak(conn->dir, src_host, conn,
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	860 dir_host, user);
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	861 }
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	862 }
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	863 return TRUE;
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	864 }
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	865
14629 c93ca5e46a8a Marked functions parameters that are allowed to be NULL. Some APIs were also changed. Timo Sirainen <tss@iki.fi> parents: 14575 diff changeset	866 static bool ATTR_NULL(3)
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	867 director_cmd_host_int(struct director_connection conn, const char const *args,
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	868 struct director_host *dir_host)
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	869 {
19287 0f9d4f1a083d director: Don't become desynced if two directors change the same backend in incompatible ways. Timo Sirainen <tss@iki.fi> parents: 19036 diff changeset	870 struct director_host *src_host = conn->host;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	871 struct mail_host *host;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	872 struct ip_addr ip;
19408 7e47f561ad49 director: Code cleanup - access host->tag via mail_host_get_tag() Timo Sirainen <tss@iki.fi> parents: 19407 diff changeset	873 const char tag = "", host_tag, *hostname = NULL;
19309 8e9cada0c8fc director: Small code cleanup - make it easier to add parameters to HOST Timo Sirainen <tss@iki.fi> parents: 19294 diff changeset	874 unsigned int arg_count, vhost_count;
18729 0ee3e734249a director: Added "up" vs "down" states and doveadm director up/down commands. Timo Sirainen <tss@iki.fi> parents: 18708 diff changeset	875 bool update, down = FALSE;
0ee3e734249a director: Added "up" vs "down" states and doveadm director up/down commands. Timo Sirainen <tss@iki.fi> parents: 18708 diff changeset	876 time_t last_updown_change = 0;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	877
19309 8e9cada0c8fc director: Small code cleanup - make it easier to add parameters to HOST Timo Sirainen <tss@iki.fi> parents: 19294 diff changeset	878 arg_count = str_array_length(args);
8e9cada0c8fc director: Small code cleanup - make it easier to add parameters to HOST Timo Sirainen <tss@iki.fi> parents: 19294 diff changeset	879 if (arg_count < 2 \|\|
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	880 net_addr2ip(args[0], &ip) < 0 \|\|
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	881 str_to_uint(args[1], &vhost_count) < 0) {
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	882 director_cmd_error(conn, "Invalid parameters");
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	883 return FALSE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	884 }
19309 8e9cada0c8fc director: Small code cleanup - make it easier to add parameters to HOST Timo Sirainen <tss@iki.fi> parents: 19294 diff changeset	885 if (arg_count >= 3)
18067 a7e830b9b967 director: Added support for backend cluster "tags". Timo Sirainen <tss@iki.fi> parents: 18065 diff changeset	886 tag = args[2];
19309 8e9cada0c8fc director: Small code cleanup - make it easier to add parameters to HOST Timo Sirainen <tss@iki.fi> parents: 19294 diff changeset	887 if (arg_count >= 4) {
8e9cada0c8fc director: Small code cleanup - make it easier to add parameters to HOST Timo Sirainen <tss@iki.fi> parents: 19294 diff changeset	888 if ((args[3][0] != 'D' && args[3][0] != 'U') \|\|
8e9cada0c8fc director: Small code cleanup - make it easier to add parameters to HOST Timo Sirainen <tss@iki.fi> parents: 19294 diff changeset	889 str_to_time(args[3]+1, &last_updown_change) < 0) {
8e9cada0c8fc director: Small code cleanup - make it easier to add parameters to HOST Timo Sirainen <tss@iki.fi> parents: 19294 diff changeset	890 director_cmd_error(conn, "Invalid updown parameters");
8e9cada0c8fc director: Small code cleanup - make it easier to add parameters to HOST Timo Sirainen <tss@iki.fi> parents: 19294 diff changeset	891 return FALSE;
18729 0ee3e734249a director: Added "up" vs "down" states and doveadm director up/down commands. Timo Sirainen <tss@iki.fi> parents: 18708 diff changeset	892 }
19309 8e9cada0c8fc director: Small code cleanup - make it easier to add parameters to HOST Timo Sirainen <tss@iki.fi> parents: 19294 diff changeset	893 down = args[3][0] == 'D';
18729 0ee3e734249a director: Added "up" vs "down" states and doveadm director up/down commands. Timo Sirainen <tss@iki.fi> parents: 18708 diff changeset	894 }
19310 7f718c840aff director: Remember backends' hostnames and send them in login reply. Timo Sirainen <tss@iki.fi> parents: 19309 diff changeset	895 if (arg_count >= 5)
7f718c840aff director: Remember backends' hostnames and send them in login reply. Timo Sirainen <tss@iki.fi> parents: 19309 diff changeset	896 hostname = args[4];
11350 5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	897 if (conn->ignore_host_events) {
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	898 /* remote is sending hosts in a handshake, but it doesn't have
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	899 a completed ring and we do. */
11585 f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	900 i_assert(conn->handshake_sending_hosts);
11350 5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	901 return TRUE;
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	902 }
19411 0e05efd14b39 director: Fixed backend selection when multiple tags were used. Timo Sirainen <tss@iki.fi> parents: 19408 diff changeset	903 if (tag[0] != '\0' && conn->minor_version < DIRECTOR_VERSION_TAGS_V2) {
0e05efd14b39 director: Fixed backend selection when multiple tags were used. Timo Sirainen <tss@iki.fi> parents: 19408 diff changeset	904 director_cmd_error(conn, "Received a host tag from older director version with incompatible tagging support");
0e05efd14b39 director: Fixed backend selection when multiple tags were used. Timo Sirainen <tss@iki.fi> parents: 19408 diff changeset	905 return FALSE;
0e05efd14b39 director: Fixed backend selection when multiple tags were used. Timo Sirainen <tss@iki.fi> parents: 19408 diff changeset	906 }
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	907
11352 19336bddada2 director: Code cleanup - keep mail hosts in a struct rather than in static variables. Timo Sirainen <tss@iki.fi> parents: 11350 diff changeset	908 host = mail_host_lookup(conn->dir->mail_hosts, &ip);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	909 if (host == NULL) {
19310 7f718c840aff director: Remember backends' hostnames and send them in login reply. Timo Sirainen <tss@iki.fi> parents: 19309 diff changeset	910 host = mail_host_add_hostname(conn->dir->mail_hosts,
7f718c840aff director: Remember backends' hostnames and send them in login reply. Timo Sirainen <tss@iki.fi> parents: 19309 diff changeset	911 hostname, &ip, tag);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	912 update = TRUE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	913 } else {
18729 0ee3e734249a director: Added "up" vs "down" states and doveadm director up/down commands. Timo Sirainen <tss@iki.fi> parents: 18708 diff changeset	914 update = host->vhost_count != vhost_count \|\|
19506 e6aa0aa3d599 director: Don't trigger a ring resync if only last_updown_change has changed. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19411 diff changeset	915 host->down != down;
19292 bae8efd8b5b3 director: Use mail_hosts_hash() to improve debug log messages. Timo Sirainen <tss@iki.fi> parents: 19289 diff changeset	916
19408 7e47f561ad49 director: Code cleanup - access host->tag via mail_host_get_tag() Timo Sirainen <tss@iki.fi> parents: 19407 diff changeset	917 host_tag = mail_host_get_tag(host);
7e47f561ad49 director: Code cleanup - access host->tag via mail_host_get_tag() Timo Sirainen <tss@iki.fi> parents: 19407 diff changeset	918 if (strcmp(tag, host_tag) != 0) {
18067 a7e830b9b967 director: Added support for backend cluster "tags". Timo Sirainen <tss@iki.fi> parents: 18065 diff changeset	919 i_error("director(%s): Host %s changed tag from '%s' to '%s'",
a7e830b9b967 director: Added support for backend cluster "tags". Timo Sirainen <tss@iki.fi> parents: 18065 diff changeset	920 conn->name, net_ip2addr(&host->ip),
19408 7e47f561ad49 director: Code cleanup - access host->tag via mail_host_get_tag() Timo Sirainen <tss@iki.fi> parents: 19407 diff changeset	921 host_tag, tag);
18067 a7e830b9b967 director: Added support for backend cluster "tags". Timo Sirainen <tss@iki.fi> parents: 18065 diff changeset	922 mail_host_set_tag(host, tag);
a7e830b9b967 director: Added support for backend cluster "tags". Timo Sirainen <tss@iki.fi> parents: 18065 diff changeset	923 update = TRUE;
a7e830b9b967 director: Added support for backend cluster "tags". Timo Sirainen <tss@iki.fi> parents: 18065 diff changeset	924 }
19287 0f9d4f1a083d director: Don't become desynced if two directors change the same backend in incompatible ways. Timo Sirainen <tss@iki.fi> parents: 19036 diff changeset	925 if (update && host->desynced) {
19608 01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	926 string_t *str = t_str_new(128);
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	927
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	928 str_printfa(str, "director(%s): Host %s is being updated before previous update had finished (",
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	929 conn->name, net_ip2addr(&host->ip));
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	930 if (host->down != down) {
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	931 if (host->down)
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	932 str_append(str, "down -> up");
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	933 else
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	934 str_append(str, "up -> down");
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	935 }
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	936 if (host->vhost_count != vhost_count) {
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	937 if (host->down != down)
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	938 str_append(str, ", ");
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	939 str_printfa(str, "vhosts %u -> %u",
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	940 host->vhost_count, vhost_count);
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	941 }
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	942 str_append(str, ") - ");
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	943
19287 0f9d4f1a083d director: Don't become desynced if two directors change the same backend in incompatible ways. Timo Sirainen <tss@iki.fi> parents: 19036 diff changeset	944 vhost_count = I_MIN(vhost_count, host->vhost_count);
0f9d4f1a083d director: Don't become desynced if two directors change the same backend in incompatible ways. Timo Sirainen <tss@iki.fi> parents: 19036 diff changeset	945 if (host->down != down) {
0f9d4f1a083d director: Don't become desynced if two directors change the same backend in incompatible ways. Timo Sirainen <tss@iki.fi> parents: 19036 diff changeset	946 if (host->last_updown_change <= last_updown_change)
0f9d4f1a083d director: Don't become desynced if two directors change the same backend in incompatible ways. Timo Sirainen <tss@iki.fi> parents: 19036 diff changeset	947 down = host->last_updown_change;
0f9d4f1a083d director: Don't become desynced if two directors change the same backend in incompatible ways. Timo Sirainen <tss@iki.fi> parents: 19036 diff changeset	948 }
0f9d4f1a083d director: Don't become desynced if two directors change the same backend in incompatible ways. Timo Sirainen <tss@iki.fi> parents: 19036 diff changeset	949 last_updown_change = I_MAX(last_updown_change,
0f9d4f1a083d director: Don't become desynced if two directors change the same backend in incompatible ways. Timo Sirainen <tss@iki.fi> parents: 19036 diff changeset	950 host->last_updown_change);
19608 01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	951 str_printfa(str, "setting to state=%s vhosts=%u",
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	952 down ? "down" : "up", vhost_count);
01e33753b08e director: "Host is being updated before previous update had finished" logs now details. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19552 diff changeset	953 i_warning("%s", str_c(str));
19287 0f9d4f1a083d director: Don't become desynced if two directors change the same backend in incompatible ways. Timo Sirainen <tss@iki.fi> parents: 19036 diff changeset	954 /* make the change appear to come from us, so it
0f9d4f1a083d director: Don't become desynced if two directors change the same backend in incompatible ways. Timo Sirainen <tss@iki.fi> parents: 19036 diff changeset	955 reaches the full ring */
0f9d4f1a083d director: Don't become desynced if two directors change the same backend in incompatible ways. Timo Sirainen <tss@iki.fi> parents: 19036 diff changeset	956 dir_host = NULL;
0f9d4f1a083d director: Don't become desynced if two directors change the same backend in incompatible ways. Timo Sirainen <tss@iki.fi> parents: 19036 diff changeset	957 src_host = conn->dir->self_host;
0f9d4f1a083d director: Don't become desynced if two directors change the same backend in incompatible ways. Timo Sirainen <tss@iki.fi> parents: 19036 diff changeset	958 }
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	959 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	960
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	961 if (update) {
19407 39cfca637d60 director: Code cleanup - make most mail_host_() list parameters unnecessary. Timo Sirainen <tss@iki.fi>* parents: 19310 diff changeset	962 mail_host_set_down(host, down, last_updown_change);
39cfca637d60 director: Code cleanup - make most mail_host_() list parameters unnecessary. Timo Sirainen <tss@iki.fi>* parents: 19310 diff changeset	963 mail_host_set_vhost_count(host, vhost_count);
19287 0f9d4f1a083d director: Don't become desynced if two directors change the same backend in incompatible ways. Timo Sirainen <tss@iki.fi> parents: 19036 diff changeset	964 director_update_host(conn->dir, src_host, dir_host, host);
19292 bae8efd8b5b3 director: Use mail_hosts_hash() to improve debug log messages. Timo Sirainen <tss@iki.fi> parents: 19289 diff changeset	965 } else {
bae8efd8b5b3 director: Use mail_hosts_hash() to improve debug log messages. Timo Sirainen <tss@iki.fi> parents: 19289 diff changeset	966 dir_debug("Ignoring host %s update vhost_count=%u "
bae8efd8b5b3 director: Use mail_hosts_hash() to improve debug log messages. Timo Sirainen <tss@iki.fi> parents: 19289 diff changeset	967 "down=%d last_updown_change=%ld (hosts_hash=%u)",
bae8efd8b5b3 director: Use mail_hosts_hash() to improve debug log messages. Timo Sirainen <tss@iki.fi> parents: 19289 diff changeset	968 net_ip2addr(&ip), vhost_count, down,
bae8efd8b5b3 director: Use mail_hosts_hash() to improve debug log messages. Timo Sirainen <tss@iki.fi> parents: 19289 diff changeset	969 (long)last_updown_change,
bae8efd8b5b3 director: Use mail_hosts_hash() to improve debug log messages. Timo Sirainen <tss@iki.fi> parents: 19289 diff changeset	970 mail_hosts_hash(conn->dir->mail_hosts));
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	971 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	972 return TRUE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	973 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	974
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	975 static bool
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	976 director_cmd_host_handshake(struct director_connection *conn,
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	977 const char const args)
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	978 {
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	979 return director_cmd_host_int(conn, args, NULL);
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	980 }
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	981
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	982 static bool
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	983 director_cmd_host(struct director_connection conn, const char const *args)
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	984 {
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	985 struct director_host *dir_host;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	986 int ret;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	987
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	988 if ((ret = director_cmd_is_seen(conn, &args, &dir_host)) != 0)
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	989 return ret > 0;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	990 return director_cmd_host_int(conn, args, dir_host);
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	991 }
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	992
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	993 static bool
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	994 director_cmd_host_remove(struct director_connection *conn,
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	995 const char const args)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	996 {
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	997 struct director_host *dir_host;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	998 struct mail_host *host;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	999 struct ip_addr ip;
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1000 int ret;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1001
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1002 if ((ret = director_cmd_is_seen(conn, &args, &dir_host)) != 0)
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1003 return ret > 0;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1004
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1005 if (str_array_length(args) != 1 \|\|
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1006 net_addr2ip(args[0], &ip) < 0) {
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1007 director_cmd_error(conn, "Invalid parameters");
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1008 return FALSE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1009 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1010
11352 19336bddada2 director: Code cleanup - keep mail hosts in a struct rather than in static variables. Timo Sirainen <tss@iki.fi> parents: 11350 diff changeset	1011 host = mail_host_lookup(conn->dir->mail_hosts, &ip);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1012 if (host != NULL)
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1013 director_remove_host(conn->dir, conn->host, dir_host, host);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1014 return TRUE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1015 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1016
11355 ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1017 static bool
ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1018 director_cmd_host_flush(struct director_connection *conn,
ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1019 const char const args)
ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1020 {
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1021 struct director_host *dir_host;
11355 ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1022 struct mail_host *host;
ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1023 struct ip_addr ip;
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1024 int ret;
11355 ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1025
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1026 if ((ret = director_cmd_is_seen(conn, &args, &dir_host)) != 0)
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1027 return ret > 0;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1028
11816 9e41df232dd6 director: Fixed handling HOST-FLUSH commands. Timo Sirainen <tss@iki.fi> parents: 11758 diff changeset	1029 if (str_array_length(args) != 1 \|\|
9e41df232dd6 director: Fixed handling HOST-FLUSH commands. Timo Sirainen <tss@iki.fi> parents: 11758 diff changeset	1030 net_addr2ip(args[0], &ip) < 0) {
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1031 director_cmd_error(conn, "Invalid parameters");
11355 ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1032 return FALSE;
ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1033 }
ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1034
ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1035 host = mail_host_lookup(conn->dir->mail_hosts, &ip);
ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1036 if (host != NULL)
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1037 director_flush_host(conn->dir, conn->host, dir_host, host);
11355 ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1038 return TRUE;
ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1039 }
ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1040
13045 79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1041 static bool
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1042 director_cmd_user_move(struct director_connection *conn,
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1043 const char const args)
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1044 {
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1045 struct director_host *dir_host;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1046 struct mail_host *host;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1047 struct ip_addr ip;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1048 unsigned int username_hash;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1049 int ret;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1050
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1051 if ((ret = director_cmd_is_seen(conn, &args, &dir_host)) != 0)
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1052 return ret > 0;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1053
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1054 if (str_array_length(args) != 2 \|\|
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1055 str_to_uint(args[0], &username_hash) < 0 \|\|
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1056 net_addr2ip(args[1], &ip) < 0) {
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1057 director_cmd_error(conn, "Invalid parameters");
13045 79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1058 return FALSE;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1059 }
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1060
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1061 host = mail_host_lookup(conn->dir->mail_hosts, &ip);
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1062 if (host != NULL) {
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1063 director_move_user(conn->dir, conn->host, dir_host,
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1064 username_hash, host);
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1065 }
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1066 return TRUE;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1067 }
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1068
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1069 static bool
17418 64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1070 director_cmd_user_kick(struct director_connection *conn,
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1071 const char const args)
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1072 {
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1073 struct director_host *dir_host;
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1074 int ret;
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1075
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1076 if ((ret = director_cmd_is_seen(conn, &args, &dir_host)) != 0)
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1077 return ret > 0;
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1078
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1079 if (str_array_length(args) != 1) {
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1080 director_cmd_error(conn, "Invalid parameters");
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1081 return FALSE;
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1082 }
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1083
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1084 director_kick_user(conn->dir, conn->host, dir_host, args[0]);
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1085 return TRUE;
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1086 }
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1087
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1088 static bool
17419 8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1089 director_cmd_user_kick_hash(struct director_connection *conn,
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1090 const char const args)
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1091 {
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1092 struct director_host *dir_host;
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1093 unsigned int username_hash;
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1094 struct ip_addr except_ip;
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1095 int ret;
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1096
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1097 if ((ret = director_cmd_is_seen(conn, &args, &dir_host)) != 0)
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1098 return ret > 0;
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1099
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1100 if (str_array_length(args) != 2 \|\|
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1101 str_to_uint(args[0], &username_hash) < 0 \|\|
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1102 net_addr2ip(args[1], &except_ip) < 0) {
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1103 director_cmd_error(conn, "Invalid parameters");
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1104 return FALSE;
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1105 }
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1106
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1107 director_kick_user_hash(conn->dir, conn->host, dir_host,
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1108 username_hash, &except_ip);
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1109 return TRUE;
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1110 }
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1111
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1112 static bool
13045 79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1113 director_cmd_user_killed(struct director_connection *conn,
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1114 const char const args)
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1115 {
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1116 unsigned int username_hash;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1117
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1118 if (str_array_length(args) != 1 \|\|
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1119 str_to_uint(args[0], &username_hash) < 0) {
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1120 director_cmd_error(conn, "Invalid parameters");
13045 79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1121 return FALSE;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1122 }
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1123
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1124 director_user_killed(conn->dir, username_hash);
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1125 return TRUE;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1126 }
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1127
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1128 static bool
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1129 director_cmd_user_killed_everywhere(struct director_connection *conn,
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1130 const char const args)
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1131 {
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1132 struct director_host *dir_host;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1133 unsigned int username_hash;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1134 int ret;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1135
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1136 if ((ret = director_cmd_is_seen(conn, &args, &dir_host)) != 0)
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1137 return ret > 0;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1138
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1139 if (str_array_length(args) != 1 \|\|
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1140 str_to_uint(args[0], &username_hash) < 0) {
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1141 director_cmd_error(conn, "Invalid parameters");
13045 79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1142 return FALSE;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1143 }
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1144
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1145 director_user_killed_everywhere(conn->dir, conn->host,
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1146 dir_host, username_hash);
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1147 return TRUE;
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1148 }
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1149
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1150 static bool director_handshake_cmd_done(struct director_connection *conn)
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1151 {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1152 struct director *dir = conn->dir;
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1153 unsigned int handshake_secs = time(NULL) - conn->created;
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1154 string_t *str;
14478 ee169584bc44 director: Improved debug handshake message. Timo Sirainen <tss@iki.fi> parents: 14477 diff changeset	1155
16621 5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	1156 if (conn->users_unsorted && conn->user_iter == NULL) {
5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	1157 /* we sent our user list before receiving remote's */
5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	1158 conn->users_unsorted = FALSE;
5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	1159 user_directory_sort(conn->dir->users);
5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	1160 }
5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	1161
18063 91c525000811 director: Always log a message when director handshake finishes. Timo Sirainen <tss@iki.fi> parents: 18062 diff changeset	1162 str = t_str_new(128);
91c525000811 director: Always log a message when director handshake finishes. Timo Sirainen <tss@iki.fi> parents: 18062 diff changeset	1163 str_printfa(str, "director(%s): Handshake finished in %u secs "
91c525000811 director: Always log a message when director handshake finishes. Timo Sirainen <tss@iki.fi> parents: 18062 diff changeset	1164 "(bytes in=%"PRIuUOFF_T" out=%"PRIuUOFF_T")",
91c525000811 director: Always log a message when director handshake finishes. Timo Sirainen <tss@iki.fi> parents: 18062 diff changeset	1165 conn->name, handshake_secs, conn->input->v_offset,
91c525000811 director: Always log a message when director handshake finishes. Timo Sirainen <tss@iki.fi> parents: 18062 diff changeset	1166 conn->output->offset);
91c525000811 director: Always log a message when director handshake finishes. Timo Sirainen <tss@iki.fi> parents: 18062 diff changeset	1167 if (handshake_secs >= DIRECTOR_HANDSHAKE_WARN_SECS)
91c525000811 director: Always log a message when director handshake finishes. Timo Sirainen <tss@iki.fi> parents: 18062 diff changeset	1168 i_warning("%s", str_c(str));
91c525000811 director: Always log a message when director handshake finishes. Timo Sirainen <tss@iki.fi> parents: 18062 diff changeset	1169 else
91c525000811 director: Always log a message when director handshake finishes. Timo Sirainen <tss@iki.fi> parents: 18062 diff changeset	1170 i_info("%s", str_c(str));
11579 61708c33154d director: Debug message improvements. Timo Sirainen <tss@iki.fi> parents: 11572 diff changeset	1171
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1172 /* the host is up now, make sure we can connect to it immediately
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1173 if needed */
14432 366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	1174 conn->host->last_network_failure = 0;
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1175
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1176 conn->handshake_received = TRUE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1177 if (conn->in) {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1178 /* handshaked to left side. tell it we've received the
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1179 whole handshake. */
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1180 director_connection_send(conn, "DONE\n");
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1181
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1182 /* tell the "right" director about the "left" one */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1183 director_update_send(dir, director_connection_get_host(conn),
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1184 t_strdup_printf("DIRECTOR\t%s\t%u\n",
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1185 net_ip2addr(&conn->host->ip),
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1186 conn->host->port));
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1187 /* this is our "left" side. */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1188 return director_connection_assign_left(conn);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1189 } else {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1190 /* handshaked to "right" side. */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1191 return director_connection_assign_right(conn);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1192 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1193 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1194
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1195 static int
18065 b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1196 director_handshake_cmd_options(struct director_connection *conn,
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1197 const char const args)
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1198 {
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1199 bool consistent_hashing = FALSE;
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1200 unsigned int i;
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1201
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1202 for (i = 0; args[i] != NULL; i++) {
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1203 if (strcmp(args[i], DIRECTOR_OPT_CONSISTENT_HASHING) == 0)
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1204 consistent_hashing = TRUE;
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1205 }
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1206 if (consistent_hashing != conn->dir->set->director_consistent_hashing) {
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1207 i_error("director(%s): director_consistent_hashing settings differ between directors",
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1208 conn->name);
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1209 return -1;
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1210 }
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1211 return 1;
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1212 }
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1213
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1214 static int
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1215 director_connection_handle_handshake(struct director_connection *conn,
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1216 const char cmd, const char const *args)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1217 {
19036 f78e38c7cba2 Removed all invocations of atoi(). Stephan Bosch <stephan@rename-it.nl> parents: 19035 diff changeset	1218 unsigned int major_version;
f78e38c7cba2 Removed all invocations of atoi(). Stephan Bosch <stephan@rename-it.nl> parents: 19035 diff changeset	1219
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1220 /* both incoming and outgoing connections get VERSION and ME */
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1221 if (strcmp(cmd, "VERSION") == 0 && str_array_length(args) >= 3) {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1222 if (strcmp(args[0], DIRECTOR_VERSION_NAME) != 0) {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1223 i_error("director(%s): Wrong protocol in socket "
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1224 "(%s vs %s)",
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1225 conn->name, args[0], DIRECTOR_VERSION_NAME);
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1226 return -1;
19036 f78e38c7cba2 Removed all invocations of atoi(). Stephan Bosch <stephan@rename-it.nl> parents: 19035 diff changeset	1227 } else if (str_to_uint(args[1], &major_version) < 0 \|\|
f78e38c7cba2 Removed all invocations of atoi(). Stephan Bosch <stephan@rename-it.nl> parents: 19035 diff changeset	1228 str_to_uint(args[2], &conn->minor_version) < 0) {
f78e38c7cba2 Removed all invocations of atoi(). Stephan Bosch <stephan@rename-it.nl> parents: 19035 diff changeset	1229 i_error("director(%s): Invalid protocol version: "
f78e38c7cba2 Removed all invocations of atoi(). Stephan Bosch <stephan@rename-it.nl> parents: 19035 diff changeset	1230 "%s.%s", conn->name, args[1], args[2]);
f78e38c7cba2 Removed all invocations of atoi(). Stephan Bosch <stephan@rename-it.nl> parents: 19035 diff changeset	1231 return -1;
f78e38c7cba2 Removed all invocations of atoi(). Stephan Bosch <stephan@rename-it.nl> parents: 19035 diff changeset	1232 } else if (major_version != DIRECTOR_VERSION_MAJOR) {
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1233 i_error("director(%s): Incompatible protocol version: "
19036 f78e38c7cba2 Removed all invocations of atoi(). Stephan Bosch <stephan@rename-it.nl> parents: 19035 diff changeset	1234 "%u vs %u", conn->name, major_version,
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1235 DIRECTOR_VERSION_MAJOR);
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1236 return -1;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1237 }
19411 0e05efd14b39 director: Fixed backend selection when multiple tags were used. Timo Sirainen <tss@iki.fi> parents: 19408 diff changeset	1238 if (conn->minor_version < DIRECTOR_VERSION_TAGS_V2 &&
0e05efd14b39 director: Fixed backend selection when multiple tags were used. Timo Sirainen <tss@iki.fi> parents: 19408 diff changeset	1239 mail_hosts_have_tags(conn->dir->mail_hosts)) {
0e05efd14b39 director: Fixed backend selection when multiple tags were used. Timo Sirainen <tss@iki.fi> parents: 19408 diff changeset	1240 i_error("director(%s): Director version supports incompatible tags", conn->name);
0e05efd14b39 director: Fixed backend selection when multiple tags were used. Timo Sirainen <tss@iki.fi> parents: 19408 diff changeset	1241 return FALSE;
0e05efd14b39 director: Fixed backend selection when multiple tags were used. Timo Sirainen <tss@iki.fi> parents: 19408 diff changeset	1242 }
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1243 conn->version_received = TRUE;
18065 b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1244 if (conn->done_pending) {
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1245 if (director_connection_send_done(conn) < 0)
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1246 return -1;
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1247 }
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1248 return 1;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1249 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1250 if (!conn->version_received) {
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1251 director_cmd_error(conn, "Incompatible protocol");
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1252 return -1;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1253 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1254
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1255 if (strcmp(cmd, "ME") == 0)
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1256 return director_cmd_me(conn, args) ? 1 : -1;
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1257 if (!conn->me_received) {
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1258 director_cmd_error(conn, "Expecting ME command first");
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1259 return -1;
11585 f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	1260 }
11350 5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	1261
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1262 /* incoming connections get a HOST list */
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1263 if (conn->handshake_sending_hosts) {
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1264 if (strcmp(cmd, "HOST") == 0)
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1265 return director_cmd_host_handshake(conn, args) ? 1 : -1;
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1266 if (strcmp(cmd, "HOST-HAND-END") == 0) {
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1267 conn->ignore_host_events = FALSE;
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1268 conn->handshake_sending_hosts = FALSE;
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1269 return 1;
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1270 }
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1271 director_cmd_error(conn, "Unexpected command during host list");
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1272 return -1;
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1273 }
18065 b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1274 if (strcmp(cmd, "OPTIONS") == 0)
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1275 return director_handshake_cmd_options(conn, args);
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1276 if (strcmp(cmd, "HOST-HAND-START") == 0) {
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1277 if (!conn->in) {
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1278 director_cmd_error(conn,
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1279 "Host list is only for incoming connections");
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1280 return -1;
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1281 }
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1282 return director_cmd_host_hand_start(conn, args) ? 1 : -1;
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1283 }
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1284
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1285 if (conn->in && strcmp(cmd, "USER") == 0 && CMD_IS_USER_HANDHAKE(args))
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1286 return director_handshake_cmd_user(conn, args) ? 1 : -1;
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1287
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1288 /* both get DONE */
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1289 if (strcmp(cmd, "DONE") == 0)
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1290 return director_handshake_cmd_done(conn) ? 1 : -1;
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1291 return 0;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1292 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1293
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1294 static bool
13940 9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1295 director_connection_sync_host(struct director_connection *conn,
9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1296 struct director_host *host,
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1297 uint32_t seq, unsigned int minor_version,
19293 8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1298 unsigned int timestamp, unsigned int hosts_hash)
13940 9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1299 {
9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1300 struct director *dir = conn->dir;
9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1301
14306 334424e7465e director: Keep track of the highest supported protocol version in the ring. Timo Sirainen <tss@iki.fi> parents: 14303 diff changeset	1302 if (minor_version > DIRECTOR_VERSION_MINOR) {
334424e7465e director: Keep track of the highest supported protocol version in the ring. Timo Sirainen <tss@iki.fi> parents: 14303 diff changeset	1303 /* we're not up to date */
334424e7465e director: Keep track of the highest supported protocol version in the ring. Timo Sirainen <tss@iki.fi> parents: 14303 diff changeset	1304 minor_version = DIRECTOR_VERSION_MINOR;
334424e7465e director: Keep track of the highest supported protocol version in the ring. Timo Sirainen <tss@iki.fi> parents: 14303 diff changeset	1305 }
334424e7465e director: Keep track of the highest supported protocol version in the ring. Timo Sirainen <tss@iki.fi> parents: 14303 diff changeset	1306
13940 9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1307 if (host->self) {
9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1308 if (dir->sync_seq != seq) {
9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1309 /* stale SYNC event */
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1310 return FALSE;
13940 9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1311 }
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1312 /* sync_seq increases when we get disconnected, so we must be
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1313 successfully connected to both directions */
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1314 i_assert(dir->left != NULL && dir->right != NULL);
13940 9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1315
19293 8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1316 if (hosts_hash != 0 &&
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1317 hosts_hash != mail_hosts_hash(conn->dir->mail_hosts)) {
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1318 i_error("director(%s): Hosts unexpectedly changed during SYNC reply - resending"
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1319 "(seq=%u, old hosts_hash=%u, new hosts_hash=%u)",
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1320 conn->name, seq, hosts_hash,
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1321 mail_hosts_hash(dir->mail_hosts));
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1322 (void)director_resend_sync(dir);
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1323 return FALSE;
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1324 }
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1325
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	1326 dir->ring_min_version = minor_version;
13940 9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1327 if (!dir->ring_handshaked) {
9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1328 /* the ring is handshaked */
9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1329 director_set_ring_handshaked(dir);
9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1330 } else if (dir->ring_synced) {
9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1331 /* duplicate SYNC (which was sent just in case the
9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1332 previous one got lost) */
9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1333 } else {
19292 bae8efd8b5b3 director: Use mail_hosts_hash() to improve debug log messages. Timo Sirainen <tss@iki.fi> parents: 19289 diff changeset	1334 dir_debug("Ring is synced (%s sent seq=%u, hosts_hash=%u)",
bae8efd8b5b3 director: Use mail_hosts_hash() to improve debug log messages. Timo Sirainen <tss@iki.fi> parents: 19289 diff changeset	1335 conn->name, seq,
bae8efd8b5b3 director: Use mail_hosts_hash() to improve debug log messages. Timo Sirainen <tss@iki.fi> parents: 19289 diff changeset	1336 mail_hosts_hash(dir->mail_hosts));
13940 9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1337 director_set_ring_synced(dir);
9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1338 }
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1339 } else {
16790 c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	1340 if (seq < host->last_sync_seq &&
c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	1341 timestamp < host->last_sync_timestamp +
c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	1342 DIRECTOR_SYNC_STALE_TIMESTAMP_RESET_SECS) {
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1343 /* stale SYNC event */
16787 22a3ef9a006d director: Fix & improvement to debug logging. Timo Sirainen <tss@iki.fi> parents: 16786 diff changeset	1344 dir_debug("Ignore stale SYNC event for %s "
22a3ef9a006d director: Fix & improvement to debug logging. Timo Sirainen <tss@iki.fi> parents: 16786 diff changeset	1345 "(seq %u < %u, timestamp=%u)",
22a3ef9a006d director: Fix & improvement to debug logging. Timo Sirainen <tss@iki.fi> parents: 16786 diff changeset	1346 host->name, seq, host->last_sync_seq,
22a3ef9a006d director: Fix & improvement to debug logging. Timo Sirainen <tss@iki.fi> parents: 16786 diff changeset	1347 timestamp);
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1348 return FALSE;
16790 c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	1349 } else if (seq < host->last_sync_seq) {
c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	1350 i_warning("Last SYNC seq for %s appears to be stale, reseting "
c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	1351 "(seq=%u, timestamp=%u -> seq=%u, timestamp=%u)",
c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	1352 host->name, host->last_sync_seq,
c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	1353 host->last_sync_timestamp, seq, timestamp);
c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	1354 host->last_sync_seq = seq;
c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	1355 host->last_sync_timestamp = timestamp;
c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	1356 host->last_sync_seq_counter = 1;
c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	1357 } else if (seq > host->last_sync_seq \|\|
16695 f7a37b169f4a director: Previous change caused legitimate SYNC resends to be ignored. Timo Sirainen <tss@iki.fi> parents: 16678 diff changeset	1358 timestamp > host->last_sync_timestamp) {
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1359 host->last_sync_seq = seq;
a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1360 host->last_sync_timestamp = timestamp;
a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1361 host->last_sync_seq_counter = 1;
16790 c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	1362 dir_debug("Update SYNC for %s "
c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	1363 "(seq=%u, timestamp=%u -> seq=%u, timestamp=%u)",
c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	1364 host->name, host->last_sync_seq,
c30453a58b4c director: Detect lost director restarts and reset last_sync_seq. Timo Sirainen <tss@iki.fi> parents: 16789 diff changeset	1365 host->last_sync_timestamp, seq, timestamp);
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1366 } else if (++host->last_sync_seq_counter >
a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1367 DIRECTOR_MAX_SYNC_SEQ_DUPLICATES) {
a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1368 /* we've received this too many times already */
16786 17389ac3cb66 director: Added more debug logging. Timo Sirainen <tss@iki.fi> parents: 16699 diff changeset	1369 dir_debug("Ignore duplicate #%u SYNC event for %s "
17389ac3cb66 director: Added more debug logging. Timo Sirainen <tss@iki.fi> parents: 16699 diff changeset	1370 "(seq=%u, timestamp %u <= %u)",
16787 22a3ef9a006d director: Fix & improvement to debug logging. Timo Sirainen <tss@iki.fi> parents: 16786 diff changeset	1371 host->last_sync_seq_counter, host->name, seq,
16786 17389ac3cb66 director: Added more debug logging. Timo Sirainen <tss@iki.fi> parents: 16699 diff changeset	1372 timestamp, host->last_sync_timestamp);
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1373 return FALSE;
a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1374 }
a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1375
19293 8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1376 if (hosts_hash != 0 &&
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1377 hosts_hash != mail_hosts_hash(conn->dir->mail_hosts)) {
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1378 if (host->desynced_hosts_hash != hosts_hash) {
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1379 dir_debug("Ignore director %s stale SYNC request whose hosts don't match us "
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1380 "(seq=%u, remote hosts_hash=%u, my hosts_hash=%u)",
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1381 net_ip2addr(&host->ip), seq, hosts_hash,
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1382 mail_hosts_hash(dir->mail_hosts));
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1383 host->desynced_hosts_hash = hosts_hash;
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1384 return FALSE;
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1385 }
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1386 /* we'll get here only if we received a SYNC twice
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1387 with the same wrong hosts_hash. FIXME: this gets
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1388 triggered unnecessarily sometimes if hosts are
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1389 changing rapidly. */
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1390 i_error("director(%s): Director %s SYNC request hosts don't match us - resending hosts "
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1391 "(seq=%u, remote hosts_hash=%u, my hosts_hash=%u)",
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1392 conn->name, net_ip2addr(&host->ip), seq,
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1393 hosts_hash, mail_hosts_hash(dir->mail_hosts));
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1394 director_resend_hosts(dir);
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1395 return FALSE;
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1396 }
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1397 host->desynced_hosts_hash = 0;
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1398 if (dir->right != NULL) {
a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1399 /* forward it to the connection on right */
a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1400 director_sync_send(dir, host, seq, minor_version,
19293 8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1401 timestamp, hosts_hash);
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1402 }
13940 9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1403 }
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1404 return TRUE;
13940 9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1405 }
9e43af01f147 director: Make sure ring syncing doesn't get lost when directors get disconnected. Timo Sirainen <tss@iki.fi> parents: 13921 diff changeset	1406
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1407 static bool director_connection_sync(struct director_connection *conn,
14306 334424e7465e director: Keep track of the highest supported protocol version in the ring. Timo Sirainen <tss@iki.fi> parents: 14303 diff changeset	1408 const char const args)
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1409 {
11585 f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	1410 struct director *dir = conn->dir;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1411 struct director_host *host;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1412 struct ip_addr ip;
19035 aabfe48db1cf Changed type of internet port values to in_port_t everywhere. Stephan Bosch <stephan@rename-it.nl> parents: 18858 diff changeset	1413 in_port_t port;
19289 4e0c9df36a78 director: Small code cleanup - make it easier to add parameters to SYNC Timo Sirainen <tss@iki.fi> parents: 19287 diff changeset	1414 unsigned int arg_count, seq, minor_version = 0, timestamp = ioloop_time;
19293 8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1415 unsigned int hosts_hash = 0;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1416
19289 4e0c9df36a78 director: Small code cleanup - make it easier to add parameters to SYNC Timo Sirainen <tss@iki.fi> parents: 19287 diff changeset	1417 arg_count = str_array_length(args);
4e0c9df36a78 director: Small code cleanup - make it easier to add parameters to SYNC Timo Sirainen <tss@iki.fi> parents: 19287 diff changeset	1418 if (arg_count < 3 \|\|
12208 a224997afefd director: Properly detect invalid command parameters in director<->director connections. Timo Sirainen <tss@iki.fi> parents: 12065 diff changeset	1419 !director_args_parse_ip_port(conn, args, &ip, &port) \|\|
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1420 str_to_uint(args[2], &seq) < 0) {
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1421 director_cmd_error(conn, "Invalid parameters");
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1422 return FALSE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1423 }
19289 4e0c9df36a78 director: Small code cleanup - make it easier to add parameters to SYNC Timo Sirainen <tss@iki.fi> parents: 19287 diff changeset	1424 if (arg_count >= 4 && str_to_uint(args[3], &minor_version) < 0) {
4e0c9df36a78 director: Small code cleanup - make it easier to add parameters to SYNC Timo Sirainen <tss@iki.fi> parents: 19287 diff changeset	1425 director_cmd_error(conn, "Invalid parameters");
4e0c9df36a78 director: Small code cleanup - make it easier to add parameters to SYNC Timo Sirainen <tss@iki.fi> parents: 19287 diff changeset	1426 return FALSE;
4e0c9df36a78 director: Small code cleanup - make it easier to add parameters to SYNC Timo Sirainen <tss@iki.fi> parents: 19287 diff changeset	1427 }
4e0c9df36a78 director: Small code cleanup - make it easier to add parameters to SYNC Timo Sirainen <tss@iki.fi> parents: 19287 diff changeset	1428 if (arg_count >= 5 && str_to_uint(args[4], &timestamp) < 0) {
4e0c9df36a78 director: Small code cleanup - make it easier to add parameters to SYNC Timo Sirainen <tss@iki.fi> parents: 19287 diff changeset	1429 director_cmd_error(conn, "Invalid parameters");
4e0c9df36a78 director: Small code cleanup - make it easier to add parameters to SYNC Timo Sirainen <tss@iki.fi> parents: 19287 diff changeset	1430 return FALSE;
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1431 }
19293 8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1432 if (arg_count >= 6 && str_to_uint(args[5], &hosts_hash) < 0) {
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1433 director_cmd_error(conn, "Invalid parameters");
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1434 return FALSE;
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1435 }
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1436
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1437 /* find the originating director. if we don't see it, it was already
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1438 removed and we can ignore this sync. */
11585 f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	1439 host = director_host_lookup(dir, &ip, port);
14306 334424e7465e director: Keep track of the highest supported protocol version in the ring. Timo Sirainen <tss@iki.fi> parents: 14303 diff changeset	1440 if (host != NULL) {
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1441 if (!director_connection_sync_host(conn, host, seq,
19293 8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1442 minor_version, timestamp,
8f225e43e6e3 director: Detect if directors' hosts have become desynced by sending hosts_hash in SYNC parameter. Timo Sirainen <tss@iki.fi> parents: 19292 diff changeset	1443 hosts_hash))
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1444 return TRUE;
14306 334424e7465e director: Keep track of the highest supported protocol version in the ring. Timo Sirainen <tss@iki.fi> parents: 14303 diff changeset	1445 }
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1446
19954 82ffadc8c4d7 director: Don't re-send SYNC unnecessarily often. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19953 diff changeset	1447 /* If directors got disconnected while we were waiting a SYNC reply,
82ffadc8c4d7 director: Don't re-send SYNC unnecessarily often. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19953 diff changeset	1448 it might have gotten lost. If we've received a DIRECTOR update since
82ffadc8c4d7 director: Don't re-send SYNC unnecessarily often. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19953 diff changeset	1449 the last time we sent a SYNC, retry sending it here to make sure
82ffadc8c4d7 director: Don't re-send SYNC unnecessarily often. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19953 diff changeset	1450 it doesn't get stuck. We don't want to do this too eagerly because
82ffadc8c4d7 director: Don't re-send SYNC unnecessarily often. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19953 diff changeset	1451 it may trigger desynced_hosts_hash != hosts_hash mismatch, which
82ffadc8c4d7 director: Don't re-send SYNC unnecessarily often. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19953 diff changeset	1452 causes unnecessary error logging and hosts-resending. */
16622 a6736e42301e director: Avoid infinite SYNC loops if the originating director goes away for a long time. Timo Sirainen <tss@iki.fi> parents: 16621 diff changeset	1453 if ((host == NULL \|\| !host->self) &&
19954 82ffadc8c4d7 director: Don't re-send SYNC unnecessarily often. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19953 diff changeset	1454 dir->last_sync_sent_ring_change_counter != dir->ring_change_counter &&
16678 17e43eda8f22 Compiler warning fixes. Timo Sirainen <tss@iki.fi> parents: 16622 diff changeset	1455 (time_t)dir->self_host->last_sync_timestamp != ioloop_time)
14682 d0d7b810646b Make sure we check all the functions' return values. Minor API changes to simplify this. Timo Sirainen <tss@iki.fi> parents: 14681 diff changeset	1456 (void)director_resend_sync(dir);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1457 return TRUE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1458 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1459
11571 75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1460 static bool director_cmd_connect(struct director_connection *conn,
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1461 const char const args)
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1462 {
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1463 struct director *dir = conn->dir;
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1464 struct director_host *host;
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1465 struct ip_addr ip;
19035 aabfe48db1cf Changed type of internet port values to in_port_t everywhere. Stephan Bosch <stephan@rename-it.nl> parents: 18858 diff changeset	1466 in_port_t port;
11571 75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1467
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1468 if (str_array_length(args) != 2 \|\|
12208 a224997afefd director: Properly detect invalid command parameters in director<->director connections. Timo Sirainen <tss@iki.fi> parents: 12065 diff changeset	1469 !director_args_parse_ip_port(conn, args, &ip, &port)) {
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1470 director_cmd_error(conn, "Invalid parameters");
11571 75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1471 return FALSE;
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1472 }
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1473
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1474 host = director_host_get(conn->dir, &ip, port);
11571 75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1475
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1476 /* remote suggests us to connect elsewhere */
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1477 if (dir->right != NULL &&
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1478 director_host_cmp_to_self(host, dir->right->host,
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1479 dir->self_host) <= 0) {
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1480 /* the old connection is the correct one */
15326 48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	1481 dir_debug("Ignoring CONNECT request to %s (current right is %s)",
48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	1482 host->name, dir->right->name);
11571 75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1483 return TRUE;
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1484 }
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1485
19973 0b5aeb95924a director: Avoid a potential assert-crash after removing a director from ring. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19954 diff changeset	1486 /* reset failure timestamp so we'll actually try to connect there. */
0b5aeb95924a director: Avoid a potential assert-crash after removing a director from ring. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19954 diff changeset	1487 host->last_network_failure = 0;
0b5aeb95924a director: Avoid a potential assert-crash after removing a director from ring. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19954 diff changeset	1488 /* reset removed-flag, so we don't crash */
0b5aeb95924a director: Avoid a potential assert-crash after removing a director from ring. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19954 diff changeset	1489 host->removed = FALSE;
0b5aeb95924a director: Avoid a potential assert-crash after removing a director from ring. Timo Sirainen <timo.sirainen@dovecot.fi> parents: 19954 diff changeset	1490
15326 48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	1491 if (dir->right == NULL) {
48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	1492 dir_debug("Received CONNECT request to %s, "
48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	1493 "initializing right", host->name);
48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	1494 } else {
48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	1495 dir_debug("Received CONNECT request to %s, "
48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	1496 "replacing current right %s",
48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	1497 host->name, dir->right->name);
11579 61708c33154d director: Debug message improvements. Timo Sirainen <tss@iki.fi> parents: 11572 diff changeset	1498 }
61708c33154d director: Debug message improvements. Timo Sirainen <tss@iki.fi> parents: 11572 diff changeset	1499
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1500 /* connect here */
11571 75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1501 (void)director_connect_host(dir, host);
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1502 return TRUE;
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1503 }
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1504
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1505 static void director_disconnect_wrong_lefts(struct director *dir)
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1506 {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1507 struct director_connection const connp, *conn;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1508
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1509 array_foreach(&dir->connections, connp) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1510 conn = *connp;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1511
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1512 if (conn->in && conn != dir->left && conn->me_received &&
14494 d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	1513 conn->to_disconnect == NULL &&
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1514 director_host_cmp_to_self(dir->left->host, conn->host,
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1515 dir->self_host) < 0)
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1516 director_connection_send_connect(conn, dir->left->host);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1517 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1518 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1519
11586 e75dab14bb2f director: Send PINGs every 15 seconds for idling director connections. Timo Sirainen <tss@iki.fi> parents: 11585 diff changeset	1520 static bool director_cmd_pong(struct director_connection *conn)
e75dab14bb2f director: Send PINGs every 15 seconds for idling director connections. Timo Sirainen <tss@iki.fi> parents: 11585 diff changeset	1521 {
e75dab14bb2f director: Send PINGs every 15 seconds for idling director connections. Timo Sirainen <tss@iki.fi> parents: 11585 diff changeset	1522 if (!conn->ping_waiting)
e75dab14bb2f director: Send PINGs every 15 seconds for idling director connections. Timo Sirainen <tss@iki.fi> parents: 11585 diff changeset	1523 return TRUE;
14405 168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	1524 conn->ping_waiting = FALSE;
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1525 timeout_remove(&conn->to_pong);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1526
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1527 if (conn->verifying_left) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1528 conn->verifying_left = FALSE;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1529 if (conn == conn->dir->left) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1530 /* our left side is functional. tell all the wrong
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1531 incoming connections to connect to it instead. */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1532 director_disconnect_wrong_lefts(conn->dir);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1533 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1534 }
11586 e75dab14bb2f director: Send PINGs every 15 seconds for idling director connections. Timo Sirainen <tss@iki.fi> parents: 11585 diff changeset	1535
14405 168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	1536 director_connection_set_ping_timeout(conn);
11586 e75dab14bb2f director: Send PINGs every 15 seconds for idling director connections. Timo Sirainen <tss@iki.fi> parents: 11585 diff changeset	1537 return TRUE;
e75dab14bb2f director: Send PINGs every 15 seconds for idling director connections. Timo Sirainen <tss@iki.fi> parents: 11585 diff changeset	1538 }
e75dab14bb2f director: Send PINGs every 15 seconds for idling director connections. Timo Sirainen <tss@iki.fi> parents: 11585 diff changeset	1539
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1540 static bool
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1541 director_connection_handle_cmd(struct director_connection *conn,
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1542 const char cmd, const char const *args)
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1543 {
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1544 int ret;
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1545
11327 9d886ae434c3 director: If connecting to director fails, try connecting to next one. Timo Sirainen <tss@iki.fi> parents: 11321 diff changeset	1546 if (!conn->handshake_received) {
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1547 ret = director_connection_handle_handshake(conn, cmd, args);
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1548 if (ret > 0)
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1549 return TRUE;
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1550 if (ret < 0) {
11327 9d886ae434c3 director: If connecting to director fails, try connecting to next one. Timo Sirainen <tss@iki.fi> parents: 11321 diff changeset	1551 /* invalid commands during handshake,
9d886ae434c3 director: If connecting to director fails, try connecting to next one. Timo Sirainen <tss@iki.fi> parents: 11321 diff changeset	1552 we probably don't want to reconnect here */
9d886ae434c3 director: If connecting to director fails, try connecting to next one. Timo Sirainen <tss@iki.fi> parents: 11321 diff changeset	1553 return FALSE;
9d886ae434c3 director: If connecting to director fails, try connecting to next one. Timo Sirainen <tss@iki.fi> parents: 11321 diff changeset	1554 }
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1555 /* allow also other commands during handshake */
11327 9d886ae434c3 director: If connecting to director fails, try connecting to next one. Timo Sirainen <tss@iki.fi> parents: 11321 diff changeset	1556 }
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1557
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1558 if (strcmp(cmd, "PING") == 0) {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1559 director_connection_send(conn, "PONG\n");
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1560 return TRUE;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1561 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1562 if (strcmp(cmd, "PONG") == 0)
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1563 return director_cmd_pong(conn);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1564 if (strcmp(cmd, "USER") == 0)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1565 return director_cmd_user(conn, args);
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	1566 if (strcmp(cmd, "USER-WEAK") == 0)
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	1567 return director_cmd_user_weak(conn, args);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1568 if (strcmp(cmd, "HOST") == 0)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1569 return director_cmd_host(conn, args);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1570 if (strcmp(cmd, "HOST-REMOVE") == 0)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1571 return director_cmd_host_remove(conn, args);
11355 ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1572 if (strcmp(cmd, "HOST-FLUSH") == 0)
ef1de95396d4 Added doveadm director flush command for dropping user associations from memory. Timo Sirainen <tss@iki.fi> parents: 11352 diff changeset	1573 return director_cmd_host_flush(conn, args);
13045 79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1574 if (strcmp(cmd, "USER-MOVE") == 0)
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1575 return director_cmd_user_move(conn, args);
17418 64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1576 if (strcmp(cmd, "USER-KICK") == 0)
64808a9703db doveadm director kick command added. Timo Sirainen <tss@iki.fi> parents: 17259 diff changeset	1577 return director_cmd_user_kick(conn, args);
17419 8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1578 if (strcmp(cmd, "USER-KICK-HASH") == 0)
8aa0cd95d6a8 director: If we detect that a user is being proxied to multiple backends, disconnect wrong connections. Timo Sirainen <tss@iki.fi> parents: 17418 diff changeset	1579 return director_cmd_user_kick_hash(conn, args);
13045 79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1580 if (strcmp(cmd, "USER-KILLED") == 0)
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1581 return director_cmd_user_killed(conn, args);
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1582 if (strcmp(cmd, "USER-KILLED-EVERYWHERE") == 0)
79f9dce5d5fd director: Added support for moving user to another server with "doveadm director move". Timo Sirainen <tss@iki.fi> parents: 12935 diff changeset	1583 return director_cmd_user_killed_everywhere(conn, args);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1584 if (strcmp(cmd, "DIRECTOR") == 0)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1585 return director_cmd_director(conn, args);
14571 42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	1586 if (strcmp(cmd, "DIRECTOR-REMOVE") == 0)
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	1587 return director_cmd_director_remove(conn, args);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1588 if (strcmp(cmd, "SYNC") == 0)
14306 334424e7465e director: Keep track of the highest supported protocol version in the ring. Timo Sirainen <tss@iki.fi> parents: 14303 diff changeset	1589 return director_connection_sync(conn, args);
11571 75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1590 if (strcmp(cmd, "CONNECT") == 0)
75d5e31ea8cc director: Handle CONNECT commands (properly). Timo Sirainen <tss@iki.fi> parents: 11569 diff changeset	1591 return director_cmd_connect(conn, args);
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1592 if (strcmp(cmd, "QUIT") == 0) {
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1593 i_warning("Director %s disconnected us with reason: %s",
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1594 conn->name, t_strarray_join(args, " "));
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1595 return FALSE;
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1596 }
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1597
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1598 director_cmd_error(conn, "Unknown command %s", cmd);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1599 return FALSE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1600 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1601
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1602 static bool
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1603 director_connection_handle_line(struct director_connection *conn,
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1604 const char *line)
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1605 {
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1606 const char cmd, const *args;
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1607 bool ret;
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1608
15326 48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	1609 dir_debug("input: %s: %s", conn->name, line);
48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	1610
14471 fc8031c5e691 Use t_strsplit_tab() wherever possible Timo Sirainen <tss@iki.fi> parents: 14468 diff changeset	1611 args = t_strsplit_tab(line);
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1612 cmd = args[0]; args++;
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1613 if (cmd == NULL) {
14479 293ada796ae6 director: Fixed protocol error detection/handling. Timo Sirainen <tss@iki.fi> parents: 14478 diff changeset	1614 director_cmd_error(conn, "Received empty line");
14407 d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1615 return FALSE;
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1616 }
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1617
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1618 conn->cur_cmd = cmd;
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1619 conn->cur_line = line;
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1620 ret = director_connection_handle_cmd(conn, cmd, args);
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1621 conn->cur_cmd = NULL;
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1622 conn->cur_line = NULL;
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1623 return ret;
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1624 }
d6cd93e32b37 director: Improved error logging for handling invalid commands/parameters. Timo Sirainen <tss@iki.fi> parents: 14406 diff changeset	1625
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1626 static void
18662 27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	1627 director_connection_log_disconnect(struct director_connection *conn, int err,
27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	1628 const char *errstr)
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1629 {
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1630 unsigned int secs = ioloop_time - conn->created;
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1631 string_t *str = t_str_new(128);
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1632
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1633 i_assert(conn->connected);
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1634
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1635 if (conn->connect_request_to != NULL) {
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1636 i_warning("Director %s tried to connect to us, "
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1637 "should use %s instead",
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1638 conn->name, conn->connect_request_to->name);
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1639 return;
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1640 }
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1641
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1642 str_printfa(str, "Director %s disconnected: ", conn->name);
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1643 str_append(str, "Connection closed");
16618 0ad8da149774 director: Log director disconnection errno correctly. Timo Sirainen <tss@iki.fi> parents: 15715 diff changeset	1644 if (err != 0 && err != EPIPE) {
0ad8da149774 director: Log director disconnection errno correctly. Timo Sirainen <tss@iki.fi> parents: 15715 diff changeset	1645 errno = err;
18662 27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	1646 if (errstr[0] == '\0')
27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	1647 str_printfa(str, ": %m");
27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	1648 else
27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	1649 str_printfa(str, ": %s", errstr);
16618 0ad8da149774 director: Log director disconnection errno correctly. Timo Sirainen <tss@iki.fi> parents: 15715 diff changeset	1650 }
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1651
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1652 str_printfa(str, " (connected %u secs, "
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1653 "in=%"PRIuUOFF_T" out=%"PRIuUOFF_T,
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1654 secs, conn->input->v_offset, conn->output->offset);
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1655
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1656 if (!conn->me_received)
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1657 str_append(str, ", handshake ME not received");
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1658 else if (!conn->handshake_received)
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1659 str_append(str, ", handshake DONE not received");
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1660 i_error("%s", str_c(str));
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1661 }
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1662
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1663 static void director_connection_input(struct director_connection *conn)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1664 {
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1665 struct director *dir = conn->dir;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1666 char *line;
18664 502755a1af5f director: Include useful statistics in process title. Timo Sirainen <tss@iki.fi> parents: 18663 diff changeset	1667 uoff_t prev_offset;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1668 bool ret;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1669
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1670 switch (i_stream_read(conn->input)) {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1671 case 0:
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1672 return;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1673 case -1:
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1674 /* disconnected */
18662 27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	1675 director_connection_log_disconnect(conn, conn->input->stream_errno,
27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	1676 i_stream_get_error(conn->input));
27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	1677 director_connection_disconnected(&conn, i_stream_get_error(conn->input));
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1678 return;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1679 case -2:
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1680 /* buffer full */
14479 293ada796ae6 director: Fixed protocol error detection/handling. Timo Sirainen <tss@iki.fi> parents: 14478 diff changeset	1681 director_cmd_error(conn, "Director sent us more than %d bytes",
293ada796ae6 director: Fixed protocol error detection/handling. Timo Sirainen <tss@iki.fi> parents: 14478 diff changeset	1682 MAX_INBUF_SIZE);
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1683 director_connection_reconnect(&conn, "Too long input line");
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1684 return;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1685 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1686
14494 d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	1687 if (conn->to_disconnect != NULL) {
d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	1688 /* just read everything the remote sends, and wait for it
d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	1689 to disconnect. we mainly just want the remote to read the
d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	1690 CONNECT we sent it. */
14683 9646f80ac3e9 Added i_stream_get_data_size(). Used it where possible. Timo Sirainen <tss@iki.fi> parents: 14682 diff changeset	1691 i_stream_skip(conn->input, i_stream_get_data_size(conn->input));
14494 d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	1692 return;
d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	1693 }
d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	1694
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1695 director_sync_freeze(dir);
18664 502755a1af5f director: Include useful statistics in process title. Timo Sirainen <tss@iki.fi> parents: 18663 diff changeset	1696 prev_offset = conn->input->v_offset;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1697 while ((line = i_stream_next_line(conn->input)) != NULL) {
18664 502755a1af5f director: Include useful statistics in process title. Timo Sirainen <tss@iki.fi> parents: 18663 diff changeset	1698 dir->ring_traffic_input += conn->input->v_offset - prev_offset;
502755a1af5f director: Include useful statistics in process title. Timo Sirainen <tss@iki.fi> parents: 18663 diff changeset	1699 prev_offset = conn->input->v_offset;
502755a1af5f director: Include useful statistics in process title. Timo Sirainen <tss@iki.fi> parents: 18663 diff changeset	1700
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1701 T_BEGIN {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1702 ret = director_connection_handle_line(conn, line);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1703 } T_END;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1704
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1705 if (!ret) {
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1706 director_connection_reconnect(&conn, t_strdup_printf(
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1707 "Invalid input: %s", line));
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1708 break;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1709 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1710 }
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1711 director_sync_thaw(dir);
14405 168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	1712 if (conn != NULL)
168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	1713 timeout_reset(conn->to_ping);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1714 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1715
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1716 static void director_connection_send_directors(struct director_connection *conn,
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1717 string_t *str)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1718 {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1719 struct director_host const hostp;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1720
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1721 array_foreach(&conn->dir->dir_hosts, hostp) {
14571 42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	1722 if ((*hostp)->removed)
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	1723 continue;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1724 str_printfa(str, "DIRECTOR\t%s\t%u\n",
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1725 net_ip2addr(&(hostp)->ip), (hostp)->port);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1726 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1727 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1728
11350 5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	1729 static void
5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	1730 director_connection_send_hosts(struct director_connection conn, string_t str)
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1731 {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1732 struct mail_host const hostp;
18729 0ee3e734249a director: Added "up" vs "down" states and doveadm director up/down commands. Timo Sirainen <tss@iki.fi> parents: 18708 diff changeset	1733 bool send_updowns;
0ee3e734249a director: Added "up" vs "down" states and doveadm director up/down commands. Timo Sirainen <tss@iki.fi> parents: 18708 diff changeset	1734
0ee3e734249a director: Added "up" vs "down" states and doveadm director up/down commands. Timo Sirainen <tss@iki.fi> parents: 18708 diff changeset	1735 send_updowns = conn->minor_version >= DIRECTOR_VERSION_UPDOWN;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1736
11350 5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	1737 str_printfa(str, "HOST-HAND-START\t%u\n", conn->dir->ring_handshaked);
11352 19336bddada2 director: Code cleanup - keep mail hosts in a struct rather than in static variables. Timo Sirainen <tss@iki.fi> parents: 11350 diff changeset	1738 array_foreach(mail_hosts_get(conn->dir->mail_hosts), hostp) {
18729 0ee3e734249a director: Added "up" vs "down" states and doveadm director up/down commands. Timo Sirainen <tss@iki.fi> parents: 18708 diff changeset	1739 struct mail_host host = hostp;
19408 7e47f561ad49 director: Code cleanup - access host->tag via mail_host_get_tag() Timo Sirainen <tss@iki.fi> parents: 19407 diff changeset	1740 const char *host_tag = mail_host_get_tag(host);
18729 0ee3e734249a director: Added "up" vs "down" states and doveadm director up/down commands. Timo Sirainen <tss@iki.fi> parents: 18708 diff changeset	1741
18067 a7e830b9b967 director: Added support for backend cluster "tags". Timo Sirainen <tss@iki.fi> parents: 18065 diff changeset	1742 str_printfa(str, "HOST\t%s\t%u",
18729 0ee3e734249a director: Added "up" vs "down" states and doveadm director up/down commands. Timo Sirainen <tss@iki.fi> parents: 18708 diff changeset	1743 net_ip2addr(&host->ip), host->vhost_count);
19408 7e47f561ad49 director: Code cleanup - access host->tag via mail_host_get_tag() Timo Sirainen <tss@iki.fi> parents: 19407 diff changeset	1744 if (host_tag[0] != '\0' \|\| send_updowns) {
18067 a7e830b9b967 director: Added support for backend cluster "tags". Timo Sirainen <tss@iki.fi> parents: 18065 diff changeset	1745 str_append_c(str, '\t');
19408 7e47f561ad49 director: Code cleanup - access host->tag via mail_host_get_tag() Timo Sirainen <tss@iki.fi> parents: 19407 diff changeset	1746 str_append_tabescaped(str, host_tag);
18729 0ee3e734249a director: Added "up" vs "down" states and doveadm director up/down commands. Timo Sirainen <tss@iki.fi> parents: 18708 diff changeset	1747 }
0ee3e734249a director: Added "up" vs "down" states and doveadm director up/down commands. Timo Sirainen <tss@iki.fi> parents: 18708 diff changeset	1748 if (send_updowns) {
19310 7f718c840aff director: Remember backends' hostnames and send them in login reply. Timo Sirainen <tss@iki.fi> parents: 19309 diff changeset	1749 str_printfa(str, "\t%c%ld\t", host->down ? 'D' : 'U',
18729 0ee3e734249a director: Added "up" vs "down" states and doveadm director up/down commands. Timo Sirainen <tss@iki.fi> parents: 18708 diff changeset	1750 (long)host->last_updown_change);
19310 7f718c840aff director: Remember backends' hostnames and send them in login reply. Timo Sirainen <tss@iki.fi> parents: 19309 diff changeset	1751 if (host->hostname != NULL)
7f718c840aff director: Remember backends' hostnames and send them in login reply. Timo Sirainen <tss@iki.fi> parents: 19309 diff changeset	1752 str_append_tabescaped(str, host->hostname);
18067 a7e830b9b967 director: Added support for backend cluster "tags". Timo Sirainen <tss@iki.fi> parents: 18065 diff changeset	1753 }
a7e830b9b967 director: Added support for backend cluster "tags". Timo Sirainen <tss@iki.fi> parents: 18065 diff changeset	1754 str_append_c(str, '\n');
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1755 }
11350 5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	1756 str_printfa(str, "HOST-HAND-END\t%u\n", conn->dir->ring_handshaked);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1757 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1758
18065 b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1759 static int director_connection_send_done(struct director_connection *conn)
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1760 {
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1761 i_assert(conn->version_received);
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1762
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1763 if (!conn->dir->set->director_consistent_hashing)
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1764 ;
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1765 else if (conn->minor_version >= DIRECTOR_VERSION_OPTIONS) {
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1766 director_connection_send(conn,
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1767 "OPTIONS\t"DIRECTOR_OPT_CONSISTENT_HASHING"\n");
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1768 } else {
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1769 i_error("director(%s): Director version is too old for supporting director_consistent_hashing=yes",
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1770 conn->name);
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1771 return -1;
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1772 }
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1773 director_connection_send(conn, "DONE\n");
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1774 conn->done_pending = FALSE;
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1775 return 0;
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1776 }
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1777
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1778 static int director_connection_send_users(struct director_connection *conn)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1779 {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1780 struct user *user;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1781 int ret;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1782
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1783 while ((user = user_directory_iter_next(conn->user_iter)) != NULL) {
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	1784 T_BEGIN {
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	1785 string_t *str = t_str_new(128);
11598 d3dfe9c271bc director: Don't send expired user records to remote servers. Timo Sirainen <tss@iki.fi> parents: 11586 diff changeset	1786
14310 7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	1787 str_printfa(str, "USER\t%u\t%s\t%u",
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	1788 user->username_hash,
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	1789 net_ip2addr(&user->host->ip),
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	1790 user->timestamp);
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	1791 if (user->weak)
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	1792 str_append(str, "\tw");
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	1793 str_append_c(str, '\n');
7a26c427fc78 director: Avoid user getting redirected to different servers near its expiration. Timo Sirainen <tss@iki.fi> parents: 14306 diff changeset	1794 director_connection_send(conn, str_c(str));
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1795 } T_END;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1796
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1797 if (o_stream_get_buffer_used_size(conn->output) >= OUTBUF_FLUSH_THRESHOLD) {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1798 if ((ret = o_stream_flush(conn->output)) <= 0) {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1799 /* continue later */
14405 168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	1800 timeout_reset(conn->to_ping);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1801 return ret;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1802 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1803 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1804 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1805 user_directory_iter_deinit(&conn->user_iter);
18065 b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1806 if (!conn->version_received)
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1807 conn->done_pending = TRUE;
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1808 else {
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1809 if (director_connection_send_done(conn) < 0)
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1810 return -1;
b9df3d654710 director: Added director_consistent_hashing setting. Timo Sirainen <tss@iki.fi> parents: 18063 diff changeset	1811 }
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1812
16621 5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	1813 if (conn->users_unsorted && conn->handshake_received) {
5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	1814 /* we received remote's list of users before sending ours */
5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	1815 conn->users_unsorted = FALSE;
5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	1816 user_directory_sort(conn->dir->users);
5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	1817 }
5ef62caea61b director: Update existing users' timestamps during handshake. Timo Sirainen <tss@iki.fi> parents: 16619 diff changeset	1818
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1819 ret = o_stream_flush(conn->output);
14405 168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	1820 timeout_reset(conn->to_ping);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1821 return ret;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1822 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1823
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1824 static int director_connection_output(struct director_connection *conn)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1825 {
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1826 int ret;
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1827
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1828 if (conn->user_iter != NULL) {
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1829 /* still handshaking USER list */
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1830 o_stream_cork(conn->output);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1831 ret = director_connection_send_users(conn);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1832 o_stream_uncork(conn->output);
18662 27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	1833 if (ret < 0) {
27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	1834 director_connection_disconnected(&conn,
27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	1835 o_stream_get_error(conn->output));
27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	1836 } else {
14480 d9f33d78fa3d director: Make sure handshaking doesn't get stuck sending USERs. Timo Sirainen <tss@iki.fi> parents: 14479 diff changeset	1837 o_stream_set_flush_pending(conn->output, TRUE);
18662 27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	1838 }
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1839 return ret;
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1840 }
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	1841 return o_stream_flush(conn->output);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1842 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1843
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1844 static struct director_connection *
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1845 director_connection_init_common(struct director *dir, int fd)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1846 {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1847 struct director_connection *conn;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1848
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1849 conn = i_new(struct director_connection, 1);
12065 ff5a47012287 director: If outgoing connection dies soon, mark the host as failed to avoid immediate reconnect. Timo Sirainen <tss@iki.fi> parents: 11816 diff changeset	1850 conn->created = ioloop_time;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1851 conn->fd = fd;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1852 conn->dir = dir;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1853 conn->input = i_stream_create_fd(conn->fd, MAX_INBUF_SIZE, FALSE);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1854 conn->output = o_stream_create_fd(conn->fd, MAX_OUTBUF_SIZE, FALSE);
14681 ca37d1577291 Added o_stream_nsend() and related functions to make delayed error handling safer. Timo Sirainen <tss@iki.fi>* parents: 14674 diff changeset	1855 o_stream_set_no_error_handling(conn->output, TRUE);
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1856 conn->to_ping = timeout_add(DIRECTOR_CONNECTION_ME_TIMEOUT_MSECS,
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1857 director_connection_init_timeout, conn);
14406 c760ac046203 director: List of director connections belongs to struct director. Timo Sirainen <tss@iki.fi> parents: 14405 diff changeset	1858 array_append(&dir->connections, &conn, 1);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1859 return conn;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1860 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1861
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1862 static void director_connection_send_handshake(struct director_connection *conn)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1863 {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1864 director_connection_send(conn, t_strdup_printf(
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1865 "VERSION\t"DIRECTOR_VERSION_NAME"\t%u\t%u\n"
19294 d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	1866 "ME\t%s\t%u\t%lld\n",
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1867 DIRECTOR_VERSION_MAJOR, DIRECTOR_VERSION_MINOR,
19294 d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	1868 net_ip2addr(&conn->dir->self_ip), conn->dir->self_port,
d96595e2363b director: Log a warning if directors' clocks are too much out of sync. Timo Sirainen <tss@iki.fi> parents: 19293 diff changeset	1869 (long long)time(NULL)));
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1870 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1871
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1872 struct director_connection *
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1873 director_connection_init_in(struct director *dir, int fd,
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1874 const struct ip_addr *ip)
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1875 {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1876 struct director_connection *conn;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1877
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1878 conn = director_connection_init_common(dir, fd);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1879 conn->in = TRUE;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1880 conn->connected = TRUE;
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1881 conn->name = i_strdup_printf("%s/in", net_ip2addr(ip));
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1882 conn->io = io_add(conn->fd, IO_READ, director_connection_input, conn);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1883
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1884 director_connection_send_handshake(conn);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1885 return conn;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1886 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1887
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1888 static void director_connection_connected(struct director_connection *conn)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1889 {
11327 9d886ae434c3 director: If connecting to director fails, try connecting to next one. Timo Sirainen <tss@iki.fi> parents: 11321 diff changeset	1890 struct director *dir = conn->dir;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1891 string_t *str = t_str_new(1024);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1892 int err;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1893
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1894 if ((err = net_geterror(conn->fd)) != 0) {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1895 i_error("director(%s): connect() failed: %s", conn->name,
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1896 strerror(err));
18662 27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	1897 director_connection_disconnected(&conn, strerror(err));
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1898 return;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1899 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1900 conn->connected = TRUE;
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1901 o_stream_set_flush_callback(conn->output,
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1902 director_connection_output, conn);
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1903
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1904 io_remove(&conn->io);
14484 25ca6b6d754a director: Adding 25c941423e42 patch yet again, now it seems to work right. Timo Sirainen <tss@iki.fi> parents: 14483 diff changeset	1905 conn->io = io_add(conn->fd, IO_READ, director_connection_input, conn);
25ca6b6d754a director: Adding 25c941423e42 patch yet again, now it seems to work right. Timo Sirainen <tss@iki.fi> parents: 14483 diff changeset	1906
14477 ea5b949a623b director: Increased timeout for sending USER data in handshake. Timo Sirainen <tss@iki.fi> parents: 14476 diff changeset	1907 timeout_remove(&conn->to_ping);
ea5b949a623b director: Increased timeout for sending USER data in handshake. Timo Sirainen <tss@iki.fi> parents: 14476 diff changeset	1908 conn->to_ping = timeout_add(DIRECTOR_CONNECTION_SEND_USERS_TIMEOUT_MSECS,
ea5b949a623b director: Increased timeout for sending USER data in handshake. Timo Sirainen <tss@iki.fi> parents: 14476 diff changeset	1909 director_connection_init_timeout, conn);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1910
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1911 o_stream_cork(conn->output);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1912 director_connection_send_handshake(conn);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1913 director_connection_send_directors(conn, str);
11350 5f77c91f3df0 director: Preserve old mail server state when a new director connects to ring. Timo Sirainen <tss@iki.fi> parents: 11349 diff changeset	1914 director_connection_send_hosts(conn, str);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1915 director_connection_send(conn, str_c(str));
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1916
11327 9d886ae434c3 director: If connecting to director fails, try connecting to next one. Timo Sirainen <tss@iki.fi> parents: 11321 diff changeset	1917 conn->user_iter = user_directory_iter_init(dir->users);
14481 ce4e1bf7262d director: Another fix for stuck handshake. Timo Sirainen <tss@iki.fi> parents: 14480 diff changeset	1918 if (director_connection_send_users(conn) == 0)
ce4e1bf7262d director: Another fix for stuck handshake. Timo Sirainen <tss@iki.fi> parents: 14480 diff changeset	1919 o_stream_set_flush_pending(conn->output, TRUE);
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1920 o_stream_uncork(conn->output);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1921 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1922
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1923 struct director_connection *
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1924 director_connection_init_out(struct director *dir, int fd,
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1925 struct director_host *host)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1926 {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1927 struct director_connection *conn;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1928
14571 42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	1929 i_assert(!host->removed);
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	1930
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1931 /* make sure we don't keep old sequence values across restarts */
16699 9531ec8afe8b director: Reset last-seen-sync-sequence after remote director restarts. Timo Sirainen <tss@iki.fi> parents: 16695 diff changeset	1932 director_host_restarted(host);
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1933
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1934 conn = director_connection_init_common(dir, fd);
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1935 conn->name = i_strdup_printf("%s/out", host->name);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1936 conn->host = host;
14571 42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	1937 director_host_ref(host);
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1938 conn->io = io_add(conn->fd, IO_WRITE,
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1939 director_connection_connected, conn);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1940 return conn;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1941 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1942
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1943 void director_connection_deinit(struct director_connection **_conn,
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1944 const char *remote_reason)
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1945 {
14406 c760ac046203 director: List of director connections belongs to struct director. Timo Sirainen <tss@iki.fi> parents: 14405 diff changeset	1946 struct director_connection const conns, conn = _conn;
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1947 struct director *dir = conn->dir;
14406 c760ac046203 director: List of director connections belongs to struct director. Timo Sirainen <tss@iki.fi> parents: 14405 diff changeset	1948 unsigned int i, count;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1949
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1950 *_conn = NULL;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1951
15326 48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	1952 if (conn->host != NULL) {
48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	1953 dir_debug("Disconnecting from %s: %s",
48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	1954 conn->host->name, remote_reason);
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1955 }
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1956 if (*remote_reason != '\0' &&
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1957 conn->minor_version >= DIRECTOR_VERSION_QUIT) {
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1958 o_stream_send_str(conn->output, t_strdup_printf(
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1959 "QUIT\t%s\n", remote_reason));
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1960 }
12935 e9139f74c451 director: Improved debug/error logging. Timo Sirainen <tss@iki.fi> parents: 12934 diff changeset	1961
14406 c760ac046203 director: List of director connections belongs to struct director. Timo Sirainen <tss@iki.fi> parents: 14405 diff changeset	1962 conns = array_get(&dir->connections, &count);
c760ac046203 director: List of director connections belongs to struct director. Timo Sirainen <tss@iki.fi> parents: 14405 diff changeset	1963 for (i = 0; i < count; i++) {
c760ac046203 director: List of director connections belongs to struct director. Timo Sirainen <tss@iki.fi> parents: 14405 diff changeset	1964 if (conns[i] == conn) {
c760ac046203 director: List of director connections belongs to struct director. Timo Sirainen <tss@iki.fi> parents: 14405 diff changeset	1965 array_delete(&dir->connections, i, 1);
c760ac046203 director: List of director connections belongs to struct director. Timo Sirainen <tss@iki.fi> parents: 14405 diff changeset	1966 break;
c760ac046203 director: List of director connections belongs to struct director. Timo Sirainen <tss@iki.fi> parents: 14405 diff changeset	1967 }
c760ac046203 director: List of director connections belongs to struct director. Timo Sirainen <tss@iki.fi> parents: 14405 diff changeset	1968 }
c760ac046203 director: List of director connections belongs to struct director. Timo Sirainen <tss@iki.fi> parents: 14405 diff changeset	1969 i_assert(i < count);
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1970 if (dir->left == conn) {
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1971 dir->left = NULL;
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1972 /* if there is already another handshaked incoming connection,
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1973 use it as the new "left" */
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1974 director_assign_left(dir);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1975 }
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1976 if (dir->right == conn)
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1977 dir->right = NULL;
14571 42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	1978 if (conn->host != NULL)
42cca8a1d179 director: Implemented ability to remove directors from a running ring. Timo Sirainen <tss@iki.fi> parents: 14570 diff changeset	1979 director_host_unref(conn->host);
11572 659bb1a26da4 director: Added initial testing framework and some debugging output. Timo Sirainen <tss@iki.fi> parents: 11571 diff changeset	1980
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1981 if (conn->connect_request_to != NULL)
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	1982 director_host_unref(conn->connect_request_to);
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1983 if (conn->user_iter != NULL)
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1984 user_directory_iter_deinit(&conn->user_iter);
14494 d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	1985 if (conn->to_disconnect != NULL)
d27b743c9921 director: Delay disconnecting director after sending CONNECT command. Timo Sirainen <tss@iki.fi> parents: 14493 diff changeset	1986 timeout_remove(&conn->to_disconnect);
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1987 if (conn->to_pong != NULL)
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	1988 timeout_remove(&conn->to_pong);
14405 168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	1989 timeout_remove(&conn->to_ping);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1990 if (conn->io != NULL)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1991 io_remove(&conn->io);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1992 i_stream_unref(&conn->input);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1993 o_stream_unref(&conn->output);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1994 if (close(conn->fd) < 0)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	1995 i_error("close(director connection) failed: %m");
11569 467ca06a7dbe director: Outgoing director connections shouldn't be counted as master clients. Timo Sirainen <tss@iki.fi> parents: 11373 diff changeset	1996
467ca06a7dbe director: Outgoing director connections shouldn't be counted as master clients. Timo Sirainen <tss@iki.fi> parents: 11373 diff changeset	1997 if (conn->in)
467ca06a7dbe director: Outgoing director connections shouldn't be counted as master clients. Timo Sirainen <tss@iki.fi> parents: 11373 diff changeset	1998 master_service_client_connection_destroyed(master_service);
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	1999 i_free(conn->name);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2000 i_free(conn);
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2001
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2002 if (dir->left == NULL \|\| dir->right == NULL) {
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2003 /* we aren't synced until we're again connected to a ring */
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2004 dir->sync_seq++;
13921 c70965e8b27d director: If request is timed out, log an error. Timo Sirainen <tss@iki.fi> parents: 13053 diff changeset	2005 director_set_ring_unsynced(dir);
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2006 }
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2007 }
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2008
18858 8bde19f080ad director: explicitly mark _disconnect() helper static to match proto Phil Carmody <phil@dovecot.fi> parents: 18729 diff changeset	2009 static void director_connection_disconnected(struct director_connection **_conn,
8bde19f080ad director: explicitly mark _disconnect() helper static to match proto Phil Carmody <phil@dovecot.fi> parents: 18729 diff changeset	2010 const char *reason)
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2011 {
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2012 struct director_connection conn = _conn;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2013 struct director *dir = conn->dir;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2014
14570 40f958c7643b director: Don't crash with quickly disconnecting incoming director connections. Timo Sirainen <tss@iki.fi> parents: 14494 diff changeset	2015 if (conn->created + DIRECTOR_SUCCESS_MIN_CONNECT_SECS > ioloop_time &&
40f958c7643b director: Don't crash with quickly disconnecting incoming director connections. Timo Sirainen <tss@iki.fi> parents: 14494 diff changeset	2016 conn->host != NULL) {
14432 366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	2017 /* connection didn't exist for very long, assume it has a
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	2018 network problem */
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	2019 conn->host->last_network_failure = ioloop_time;
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	2020 }
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	2021
18662 27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	2022 director_connection_deinit(_conn, reason);
14432 366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	2023 if (dir->right == NULL)
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	2024 director_connect(dir);
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	2025 }
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	2026
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	2027 static void director_connection_reconnect(struct director_connection **_conn,
27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	2028 const char *reason)
14432 366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	2029 {
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	2030 struct director_connection conn = _conn;
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	2031 struct director *dir = conn->dir;
366b9e5fc85c director: Don't communicate with directors that recently sent invalid input. Timo Sirainen <tss@iki.fi> parents: 14431 diff changeset	2032
15132 27d3289e1f5c director: Improved logging related to disconnections. Timo Sirainen <tss@iki.fi> parents: 15131 diff changeset	2033 director_connection_deinit(_conn, reason);
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2034 if (dir->right == NULL)
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2035 director_connect(dir);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2036 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2037
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2038 void director_connection_send(struct director_connection *conn,
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2039 const char *data)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2040 {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2041 unsigned int len = strlen(data);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2042 off_t ret;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2043
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2044 if (conn->output->closed \|\| !conn->connected)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2045 return;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2046
15326 48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	2047 if (director_debug) T_BEGIN {
48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	2048 const char const lines = t_strsplit(data, "\n");
48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	2049 for (; lines[1] != NULL; lines++)
48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	2050 dir_debug("output: %s: %s", conn->name, *lines);
48af47f2eb9c director: -D parameter now enables extensive debug logging. Timo Sirainen <tss@iki.fi> parents: 15324 diff changeset	2051 } T_END;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2052 ret = o_stream_send(conn->output, data, len);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2053 if (ret != (off_t)len) {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2054 if (ret < 0)
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2055 i_error("director(%s): write() failed: %m", conn->name);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2056 else {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2057 i_error("director(%s): Output buffer full, "
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2058 "disconnecting", conn->name);
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2059 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2060 o_stream_close(conn->output);
18664 502755a1af5f director: Include useful statistics in process title. Timo Sirainen <tss@iki.fi> parents: 18663 diff changeset	2061 } else {
502755a1af5f director: Include useful statistics in process title. Timo Sirainen <tss@iki.fi> parents: 18663 diff changeset	2062 conn->dir->ring_traffic_output += len;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2063 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2064 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2065
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	2066 static void
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	2067 director_connection_ping_idle_timeout(struct director_connection *conn)
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2068 {
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2069 i_error("director(%s): Ping timed out, disconnecting", conn->name);
18662 27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	2070 director_connection_disconnected(&conn, "Ping timeout");
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2071 }
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2072
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	2073 static void director_connection_pong_timeout(struct director_connection *conn)
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	2074 {
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	2075 i_error("director(%s): PONG reply not received although other "
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	2076 "input keeps coming, disconnecting", conn->name);
18662 27baf04f2b18 director: If we disconnect a director, pass the reason all the way to deinit's debug logging. Timo Sirainen <tss@iki.fi> parents: 18137 diff changeset	2077 director_connection_disconnected(&conn, "Pong timeout");
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	2078 }
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	2079
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	2080 void director_connection_ping(struct director_connection *conn)
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2081 {
11586 e75dab14bb2f director: Send PINGs every 15 seconds for idling director connections. Timo Sirainen <tss@iki.fi> parents: 11585 diff changeset	2082 if (conn->ping_waiting)
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2083 return;
5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2084
14405 168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	2085 timeout_remove(&conn->to_ping);
14409 b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	2086 conn->to_ping = timeout_add(DIRECTOR_CONNECTION_PING_IDLE_TIMEOUT_MSECS,
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	2087 director_connection_ping_idle_timeout, conn);
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	2088 conn->to_pong = timeout_add(DIRECTOR_CONNECTION_PONG_TIMEOUT_MSECS,
b43ae3805f5f director: Redesigned connection handling and error handling. Timo Sirainen <tss@iki.fi> parents: 14408 diff changeset	2089 director_connection_pong_timeout, conn);
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2090 director_connection_send(conn, "PING\n");
11586 e75dab14bb2f director: Send PINGs every 15 seconds for idling director connections. Timo Sirainen <tss@iki.fi> parents: 11585 diff changeset	2091 conn->ping_waiting = TRUE;
11321 5f350b5ff6d9 Added initial implementation of a director process (for NFS users). Timo Sirainen <tss@iki.fi> parents: diff changeset	2092 }
11585 f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	2093
f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	2094 const char director_connection_get_name(struct director_connection conn)
f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	2095 {
f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	2096 return conn->name;
f0fb8151c6b4 director: A lot of fixes. Timo Sirainen <tss@iki.fi> parents: 11581 diff changeset	2097 }
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2098
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2099 struct director_host *
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2100 director_connection_get_host(struct director_connection *conn)
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2101 {
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2102 return conn->host;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2103 }
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2104
14408 544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	2105 bool director_connection_is_handshaked(struct director_connection *conn)
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	2106 {
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	2107 return conn->handshake_received;
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	2108 }
544a8c4705e5 director: Handle all commands during handshake. Timo Sirainen <tss@iki.fi> parents: 14407 diff changeset	2109
18062 ade6dcace5cd doveadm director ring status shows now more information Timo Sirainen <tss@iki.fi> parents: 17419 diff changeset	2110 bool director_connection_is_synced(struct director_connection *conn)
ade6dcace5cd doveadm director ring status shows now more information Timo Sirainen <tss@iki.fi> parents: 17419 diff changeset	2111 {
ade6dcace5cd doveadm director ring status shows now more information Timo Sirainen <tss@iki.fi> parents: 17419 diff changeset	2112 return conn->synced;
ade6dcace5cd doveadm director ring status shows now more information Timo Sirainen <tss@iki.fi> parents: 17419 diff changeset	2113 }
ade6dcace5cd doveadm director ring status shows now more information Timo Sirainen <tss@iki.fi> parents: 17419 diff changeset	2114
14406 c760ac046203 director: List of director connections belongs to struct director. Timo Sirainen <tss@iki.fi> parents: 14405 diff changeset	2115 bool director_connection_is_incoming(struct director_connection *conn)
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2116 {
14406 c760ac046203 director: List of director connections belongs to struct director. Timo Sirainen <tss@iki.fi> parents: 14405 diff changeset	2117 return conn->in;
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2118 }
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2119
14431 084064444f89 director: Don't try to send the new SYNC parameter to old director versions. Timo Sirainen <tss@iki.fi> parents: 14409 diff changeset	2120 unsigned int
084064444f89 director: Don't try to send the new SYNC parameter to old director versions. Timo Sirainen <tss@iki.fi> parents: 14409 diff changeset	2121 director_connection_get_minor_version(struct director_connection *conn)
084064444f89 director: Don't try to send the new SYNC parameter to old director versions. Timo Sirainen <tss@iki.fi> parents: 14409 diff changeset	2122 {
084064444f89 director: Don't try to send the new SYNC parameter to old director versions. Timo Sirainen <tss@iki.fi> parents: 14409 diff changeset	2123 return conn->minor_version;
084064444f89 director: Don't try to send the new SYNC parameter to old director versions. Timo Sirainen <tss@iki.fi> parents: 14409 diff changeset	2124 }
084064444f89 director: Don't try to send the new SYNC parameter to old director versions. Timo Sirainen <tss@iki.fi> parents: 14409 diff changeset	2125
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2126 void director_connection_cork(struct director_connection *conn)
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2127 {
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2128 o_stream_cork(conn->output);
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2129 }
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2130
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2131 void director_connection_uncork(struct director_connection *conn)
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2132 {
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2133 o_stream_uncork(conn->output);
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2134 }
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2135
14405 168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	2136 void director_connection_set_synced(struct director_connection *conn,
168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	2137 bool synced)
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2138 {
14405 168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	2139 if (conn->synced == synced)
168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	2140 return;
168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	2141 conn->synced = synced;
168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	2142
168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	2143 /* switch ping timeout, unless we're already waiting for PONG */
168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	2144 if (conn->ping_waiting)
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2145 return;
a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2146
14405 168e3b5cb6e8 director: Changes to PING handling. Timo Sirainen <tss@iki.fi> parents: 14310 diff changeset	2147 director_connection_set_ping_timeout(conn);
11629 a07aa85f68c9 director: Lots of fixes. It should be pretty stable now. Timo Sirainen <tss@iki.fi> parents: 11598 diff changeset	2148 }

Mercurial > dovecot > core-2.2

annotate src/director/director-connection.c @ 19973:0b5aeb95924a