RabbitMQ Filter

Overview

This filter is designed to extract queries and transform them into a canonical form e.g. INSERT INTO database.table VALUES ("John Doe", "Downtown",100,50.0); turns into INSERT INTO database.table VALUES ("?", "?",?,?);. The filter pushes these canonized queries and their replies into a RabbitMQ broker where they can later be retrieved from. The retrieval can be done with a custom application or the RabbitMQ Consumer Client utility tool, which reads the messages from the broker and sends the contents of those messages as SQL queries to a database.

Configuration

The configuration block for the mqfilter requires the minimal filter options in its section within the MaxScale configuration file. Although the filter will start, it will use the default values which only work with a freshly installed RabbitMQ server and use its default values. This setup is mostly intended for testing the filter.

The following is an example of an mqfilter configuration used for actual logging of queries to a RabbitMQ broker on a different host.

[RabbitMQ]
type=filter
module=mqfilter
hostname=192.168.122.100
port=4000
username=messageuser
password=msgpwd
exchange=msg-ex-1
key=MaxScale
logging_trigger=object,schema,source
logging_strict=false
logging_log_all=false
logging_object=my1
logging_schema=test
logging_source_user=maxtest

[RabbitMQ-Service]
type=service
router=readconnroute
servers=server1
user=myuser
password=mypasswd
filters=RabbitMQ

Filter Options

The mqfilter filter does not support any filter options.

Filter Parameters

The RabbitMQ filter has parameters to control which queries are logged based on either the attributes of the user or the query itself. These can be combined to to only log queries targeting a certain table in a certain database from a certain user from a certain network address.

Option	Description	Accepted Values	Default
Option	Description	Accepted Values	Default
logging_trigger	Set the logging level	all, source, schema, object	all
logging_strict	Sets whether to trigger when any of the parameters match or only if all parameters match	true, false	false
logging_log_all	Log only SELECT, UPDATE, DELETE and INSERT or all possible queries	true, false	true
logging_source_user	Comma-separated list of usernames to log
logging_source_host	Comma-separated list of hostnames to log
logging_schema	Comma-separated list of databases
logging_object	Comma-separated list of database objects
hostname	The server hostname where the messages are sent		localhost
port	Port to send the messages to		5672
username	Server login username		guest
password	Server login password		guest
vhost	The virtual host location on the server, where the messages are sent		/
exchange	The name of the exchange		default_exchange
exchange_type	The type of the exchange	direct, fanout, topic, headers	direct
key	The routing key used when sending messages to the exchange		key
queue	The queue that will be bound to the used exchange
ssl_CA_cert	Path to the CA certificate in PEM format
ssl_client_cert	Path to the client certificate in PEM format
ssl_client_key	Path to the client public key in PEM format

_{This page is licensed: CC BY-SA / Gnu FDL}