MinIO

Commit Graph

Author	SHA1	Message	Date
Aditya Manthramurthy	85a5c358d8	Add bucket metadata state client/handler (Fixes #3022 ) (#3152 ) - Adds an interface to update in-memory bucket metadata state called BucketMetaState - this interface has functions to: - update bucket notification configuration, - bucket listener configuration, - bucket policy configuration, and - send bucket event - This interface is implemented by `localBMS` a type for manipulating local node in-memory bucket metadata, and by `remoteBMS` a type for manipulating remote node in-memory bucket metadata. - The remote node interface, makes an RPC call, but the local node interface does not - it updates in-memory bucket state directly. - Rename mkPeersFromEndpoints to makeS3Peers and refactored it. - Use arrayslice instead of map in s3Peers struct - `s3Peers.SendUpdate` now receives an arrayslice of peer indexes to send the request to, with a special nil value slice indicating that all peers should be sent the update. - `s3Peers.SendUpdate` now returns an arrayslice of errors, representing errors from peers when sending an update. The array positions correspond to peer array s3Peers.peers Improve globalS3Peers: - Make isDistXL a global `globalIsDistXL` and remove from s3Peers - Make globalS3Peers an array of (address, bucket-meta-state) pairs. - Fix code and tests.	9 years ago
Harshavardhana	9e2d0ac50b	Move to URL based syntax formatting. (#3092 ) For command line arguments we are currently following - <node-1>:/path ... <node-n>:/path This patch changes this to - http://<node-1>/path ... http://<node-n>/path	9 years ago
Aditya Manthramurthy	30dc11a931	No `listener.json` for single-node mode (Fixes #3052 ) (#3108 ) In FS or single-node XL mode, there is no need to save listener configuration to persistent storage. As there is only one server, if it is restarted, any connected listenBucketAPI clients were disconnected and will have to reconnect - so there is nothing to actually store. This incidentally solves #3052 by avoiding the problem.	9 years ago
Harshavardhana	5782ec3ada	Fix peers and web UIVersion validation. (#3048 )	9 years ago
Krishna Srinivas	32c3a558e9	distributed-XL: Support to run one minio process per export even on the same machine. (#2999 ) fixes #2983	9 years ago
Aditya Manthramurthy	c3bbadacbf	Improve Peer RPC error handling (Fixes #2992 ) (#2995 ) * Check for RPC connection shutdown and try again just once. * Refactor SendRPC to use sync.WaitGroup	9 years ago
Anis Elleuch	bbba8e432a	Add ssl support to s3/web peers connections (#2988 )	9 years ago
Aditya Manthramurthy	d02cb963d5	Fix listen-bucket (Fixes #2942 ) (#2949 ) Don't close socket while re-initializing notify-listeners, as the rpc client object is shared between notify-listeners and peer clients. Also, improves SendRPC() readability by using GetPeerClient().	9 years ago
Aditya Manthramurthy	17eeec6895	Bucket policy propagation (Fixes #2930 ) (#2932 ) Fixes a serialisation bug - encoding/gob does not directly support serializing `map[string]interface{}`, so we serialise to JSON and send a byte array in the RPC call, and deserialize and update on the receiver.	9 years ago
Aditya Manthramurthy	0aabc1d8d9	Use Peer RPC to propagate bucket policy changes (#2891 )	9 years ago
Aditya Manthramurthy	6303f26330	Protect map from concurrent access (Fixes #2915 ) (#2916 ) Protects the Peers RPC clients map from concurrent access to fix a data race condition.	9 years ago
Aditya Manthramurthy	6199aa0707	Peer RPCs for bucket notifications (#2877 ) * Implements a Peer RPC router that sends info to all Minio servers in the cluster. * Bucket notifications are propagated to all nodes via this RPC router. * Bucket listener configuration is persisted to separate object layer file (`listener.json`) and peer RPCs are used to communicate changes throughout the cluster. * When events are generated, RPC calls to send them to other servers where bucket listeners may be connected is implemented. * Some bucket notification tests are now disabled as they cannot work in the new design. * Minor fix in `funcFromPC` to use `path.Join`	9 years ago

12 Commits (85a5c358d8e15521cf29d836d65c08a01aae6ca3)