artefactual.preprocessing.vllm_parser

Functions

process_vllm_logprobs(outputs, iterations)

Processes log probabilities from vllm.chat outputs for a given number of iterations.

artefactual.preprocessing.vllm_parser.process_vllm_logprobs(outputs, iterations)

Processes log probabilities from vllm.chat outputs for a given number of iterations.

Return type:

list[dict[int, list[float]]]

Args:

outputs (list[RequestOutput]): A list containing model output objects, each with log probability data. iterations (int): The number of iterations to process, corresponding to the number of output sequences.

Returns:

list[dict[int, list[float]]]: A list of dictionaries mapping token indices to lists of log probs for each token in the sequence.