artefactual.preprocessing.parser

Module for parsing model outputs from various sources to extract log probabilities. Each format is handled by a dedicated parser function, defined in their respective modules.

Functions

parse_model_outputs(outputs)

Parse different output formats to extract logprobs.

artefactual.preprocessing.parser.parse_model_outputs(outputs)

Parse different output formats to extract logprobs.

Return type:

list[dict[int, list[float]]]

Args:

outputs: Model outputs. Can be:

• List of vLLM RequestOutput objects.

• OpenAI ChatCompletion object (or dict).

• OpenAI Responses object (or dict).

Returns:

List of dictionaries mapping token indices to lists of log probs.

Raises:

TypeError: If the output format is not supported.