[Python] Configuring a custom log handler to add kwargs from "extra" dict for captured logs in...

I'm using structlog with keyword arguments to generate stdlib log events with the extra dict storing keyword arguments necessary to understand the context around the log message being printed.

When my program is run under pytest, the log messages written directly to stdout honor the application's log settings, but when pytest prints captured log messages they go through a default-to-pytest formatter that doesn't include this information.

As far as I know, a format string can't be used to format a dictionary into a string with key=value pairs (rather, when extra= is in use, the expectation is that a format string will pull in specific keywords from that dictionary), so it isn't obvious to me that log_cli_format (as recommended by numerous preexisting Q&A entries) is sufficient for the task at hand.


Consider the following reproducer:

import pytest
import logging

logger = logging.getLogger()

def test_logging():
# in the real use case "extra" is generated by structlog
# ...the names may change for each log message and cannot be hardcoded
logger.info('message here', extra={"foo": "bar", "baz": "qux"})
assert False, 'Trigger failure'


When running:

pytest --log-cli-level INFO


this outputs:

----------------------------------------- Captured log call -----------------------------------------
INFO root:test_me.py:8 message here
====================================== short test summary info ======================================
FAILED test_me.py::test_logging - AssertionError: Trigger failure
assert False
========================================= 1 failed in 0.08s =========================================


I want message here (within the Captured log call section, not captured stdout or stderr) to contain content equivalent to foo='bar' baz='qux'. How can this be accomplished?

Continue reading...