sql

Insert data into a SQL database

Currently only Postgres and Sqlite (embedded) are supported.

Example

action:

sql:
  source:
    kind: sqlite
    connection: test.db
  table: person
  fields:
  - name
  - age
  - birthdate

Field Name	Description	Type	Default
batch	Maximum number of events in an output batch. If 'document' send on end of document	integer or the 'document'	-
timeout	Interval after which the batch is sent, to keep throughput going	interval	100ms
header	Put a header line before the batch	templated text	-
footer	Put a header line after the last line of the batch	templated text	-
use-document-marker	Enrich the pipe metadata with a document marker (for document handling in batch mode)	bool	false
fields	The fields to be inserted into the table	array of fields	-
table	An existing table	string	-
source	SQL connection options	OutputSqlSource	-

batch

Maximum number of events in an output batch. If 'document' send on end of document

Type: integer or the 'document'

timeout

Interval after which the batch is sent, to keep throughput going

Type: interval

header

Put a header line before the batch

Type: templated text

footer

Put a header line after the last line of the batch

Type: templated text

use-document-marker

Enrich the pipe metadata with a document marker (for document handling in batch mode)

Type: bool

fields

The fields to be inserted into the table

If the field does not exist in the data, the output column becomes NULL (if possible)

Type: array of fields

table

An existing table

Type: string

source

SQL connection options

Type: OutputSqlSource

Field Name	Description	Type	Default
kind	The type of SQL server being written to	string	-
connection	A valid SQL connection string to the kind of server being connected to	string	-

kind

The type of SQL server being written to

Type: string

connection

A valid SQL connection string to the kind of server being connected to

Type: string