Tap and Target Metrics¶
Metrics logging is specified in the Singer Spec.
The SDK will automatically emit the following metrics:
record_count: The number of records processed by the tap or target.http_request_duration: The duration of HTTP requests made by the tap.sync_duration: The duration of the sync operation.batch_processing_time: The duration of processing a batch of records.
Customization options¶
metrics_log_level¶
Metrics are logged at the INFO level. Developers may optionally add a
metrics_log_level config option to their taps, WARNING or ERROR to disable
metrics logging.
SINGER_SDK_LOG_CONFIG¶
Metrics are written by the singer.metrics logger, so the end user can set
SINGER_SDK_LOG_CONFIG to a logging config file that defines the format and output
for metrics. See the logging docs for an example file.
Note
The metrics implementation lives in the singer.metrics module, from the
meltano-singer-python package.
Prior to singer-sdk v0.55, metrics were logged under the singer_sdk.metrics
logger name; logging configs that filter or route on that name should be updated
to singer.metrics. Metric log points also gained a pid tag.