Skip to content

feat(logger): add new logging apis - #759

Open
Abhijeet Prasad (AbhiPrasad) wants to merge 6 commits into
mainfrom
abhi-logs
Open

Abhijeet Prasad (AbhiPrasad) wants to merge 6 commits into
mainfrom
abhi-logs

Conversation

@AbhiPrasad

@AbhiPrasad Abhijeet Prasad (AbhiPrasad) commented Sep 10, 2026

Copy link
Copy Markdown
Member

resolves https://linear.app/braintrustdata/issue/SDK-341/add-logging-api-to-python-sdk
ref https://app.notion.com/p/braintrustdata/Braintrust-Logs-Schema-and-SDK-API-3def7858028980e29a83cddb3f81203b

AI Summary

Add first-class log emission to the project logger so applications can create independent type="log" rows without constructing spans manually.

  • Add Logger.emit_log(body, level, metadata).
  • Add trace(), debug(), info(), warn(), error(), and fatal() convenience methods.
  • Store the canonical severity in metadata["braintrust.log_level"].
  • Add SpanTypeAttribute.LOG.
  • Support named Python format parameters while retaining the original template and parameter values in metadata.
  • On Python 3.14+, support t-string objects with embedded interpolation values, conversions, and format specifications.

Usage

Emit directly or use a severity helper:

logger.error(
    "Payment failed",
    metadata={"payment_id": "pay_123"},
)

logger.emit_log(
    body="Retrying payment",
    level="info",
    metadata={"attempt": 2},
)

Log methods also accept named str.format parameters:

logger.info(
    "User {user_id} paid {amount:.2f}",
    user_id="user_123",
    amount=12.5,
    metadata={"source": "checkout"},
)

On Python 3.14+, log methods also accept t-strings. Their interpolation values are already embedded, so no separate keyword parameters are needed:

user_id = "user_123"
amount = 12.5

logger.info(
    t"User {user_id} paid {amount:.2f}",
    metadata={"source": "checkout"},
)

Both forms store the rendered message in output:

User user_123 paid 12.50

They also retain the stable template and its raw parameters for querying and grouping:

{
    "source": "checkout",
    "braintrust.log_level": "info",
    "braintrust.template": "User {user_id} paid {amount:.2f}",
    "braintrust.template.parameter.user_id": "user_123",
    "braintrust.template.parameter.amount": 12.5,
}

Missing str.format parameters remain as placeholders, and malformed templates fall back to the original body so formatting errors do not disrupt application code. T-string conversions and format specifications follow f-string rendering semantics; unsupported formatting leaves the affected placeholder intact. Bodies may remain non-string JSON values when no template parameters are supplied.

T-string support is loaded only on Python 3.14+, preserving SDK compatibility with Python 3.10 through 3.13.

Trace correlation

Each log has a unique row ID and span ID unless it is correlated with an active span. A logger seeds one baseline trace ID when it is created, so consecutive unscoped logs from that logger remain grouped without grouping logs from separate logger instances.

helper -> emit_log -> type="log" row
                     |-- active span
                     |     trace_id = active trace_id
                     |     span_id  = active span_id
                     |
                     `-- no active span
                           trace_id = logger baseline trace_id
                           span_id  = newly generated span_id

This works with both native Braintrust spans and active OpenTelemetry spans through the existing context manager abstraction.

Python logging handler

The opt-in BraintrustLogHandler forwards standard-library logging records without enabling automatic instrumentation:

import logging

from braintrust import BraintrustLogHandler, init_logger

handler = BraintrustLogHandler(init_logger(project="my-project"))
logging.getLogger().addHandler(handler)

The handler preserves formatted messages, original timestamps, exceptions, template parameters, extra fields, logger/source metadata, and active span correlation. Logs from Braintrust and its urllib3 transport are excluded to prevent recursive forwarding.

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Sep 10, 2026

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review Completed 2026-09-17T18:09:34.501541Z 3e9b5f1 New commits
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: fd6b7345e4

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "Codex (@codex) review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "Codex (@codex) address that feedback".

)
rendered_metadata["braintrust.template"] = body
try:
rendered_body = body.format_map(_LogTemplateParameters(parameters))

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Preserve formatting for missing fields with format specs

When an omitted placeholder has a conversion or format specifier, such as logger.info("{user} owes {amount:.2f}", user="alice"), __missing__ supplies the string "{amount}", formatting that string as a float raises, and this broad fallback restores the entire original template. Consequently even supplied parameters are left uninterpolated, contrary to the documented behavior that only missing parameters remain as placeholders. Preserve the missing field's conversion/specifier instead of abandoning all rendering.

Useful? React with 👍 / 👎.

if parameters:
if not isinstance(body, str):
raise TypeError("Log body must be a string when template parameters are provided")
rendered_metadata = dict(metadata) if metadata is not None else {}

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Normalize supported metadata before adding template attributes

When a caller combines template parameters with Pydantic-style metadata accepted by the rest of the logger API, this direct conversion can raise TypeError: an object implementing the supported model_dump() or dict() protocol is not necessarily iterable. The same metadata works when no template parameters are supplied because the normal event sanitizer handles those protocols, so logger.info("User {id}", metadata=model, id=...) unexpectedly emits no log. Retain the Metadata input contract and normalize it before merging the template attributes.

Useful? React with 👍 / 👎.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 657bcd32df

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "Codex (@codex) review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "Codex (@codex) address that feedback".


def info(self, body: Any, metadata: dict[str, Any] | None = None, **parameters: object) -> str:
"""Capture a log at OpenTelemetry INFO severity."""
return self.emit_log(body=body, level="info", metadata=metadata, **parameters)

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Preserve level as a template parameter in helpers

When a severity helper is given a template parameter named level, such as logger.info("Connected at {level}", level="database"), the helper collects it in parameters and then passes it alongside the fixed level="info" argument, causing Python to raise TypeError: got multiple values for keyword argument 'level' before any log is emitted. Since named placeholders are otherwise advertised without restrictions, pass template parameters through a non-colliding container or render them before forwarding.

Useful? React with 👍 / 👎.

Comment thread py/src/braintrust/logs.py
Comment on lines +43 to +44
parameters = record.args.items() if isinstance(record.args, dict) else enumerate(record.args)
metadata.update({f"braintrust.template.parameter.{key}": value for key, value in parameters})

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Preserve mapping keys in logging template metadata

When standard logging interpolation uses a non-dict mapping such as collections.UserDict (logger.info("%(user)s", UserDict(user="alice"))), LogRecord stores that mapping directly in record.args and formats the message successfully. This branch instead treats it as positional arguments and enumerates its keys, recording braintrust.template.parameter.0 = "user" rather than braintrust.template.parameter.user = "alice", so the emitted template attributes are silently incorrect; recognize general Mapping instances here.

Useful? React with 👍 / 👎.

@AbhiPrasad Abhijeet Prasad (AbhiPrasad) changed the title feat(logger): add OpenTelemetry-compatible log emission feat(logger): add new logging apis Sep 17, 2026
Add `Logger.emit_log()` so applications can emit independent `type="log"`
rows without constructing spans manually. Correlate rows with the active
Braintrust or OpenTelemetry context when available.

Seed each logger with a baseline trace ID for unscoped logs. This keeps
consecutive logs from one logger together while preserving unique row and span
IDs, and avoids grouping logs emitted by separate logger instances.

Map the six base OpenTelemetry severities into `context.otel.log` and add
`trace()`, `debug()`, `info()`, `warn()`, `error()`, and `fatal()` helpers.

    logger.error("Payment failed", metadata={"payment_id": "pay_123"})

    helper -> emit_log -> `type="log"` row
                         |-- active span: reuse trace/span IDs
                         `-- no span: reuse logger trace, generate span ID
Allow `emit_log()` and severity helpers to interpolate named parameters with
Python format strings. Preserve the original template and parameter values in
`braintrust.template` metadata so repeated messages remain queryable by their
stable structure.

Missing placeholders and malformed templates remain unchanged so logging does
not disrupt application code.
Expose an opt-in standard-library logging handler that forwards formatted records, source metadata, timestamps, and template parameters through the Braintrust logging API while avoiding recursive SDK transport logs.
Render string.templatelib.Template bodies with their embedded values while
retaining the reconstructed template and raw parameters in metadata.

Load templatelib only on Python 3.14+ so the SDK remains compatible with
Python 3.10 through 3.13.
Comment thread py/src/braintrust/logs.py
self.handleError(record)

def flush(self) -> None:
self._logger.flush()

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AI reviewer flagged a potential deadlock:


logging.shutdown() (registered at exit) acquires each handler's RLock and holds it across h.flush(). BraintrustLogHandler.flush() delegates to Logger.flush(), which submits batches to HTTP_REQUEST_THREAD_POOL and blocks on concurrent.futures.wait (logger.py:1270, 1279). Those pool threads run requests/urllib3, which emit their own log records; each one enters Handler.handle(), hits with self.lock, and parks because a different thread holds the RLock. The future never resolves, wait() never returns, the lock is never released. The "urllib3" entry in _IGNORED_LOGGER_PREFIXES doesn't help — it's checked at the top of emit() (logs.py:71), which is already inside the lock.

@realark

Copy link
Copy Markdown
Contributor

🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants