artefactual.scoring.entropy_methods.entropy_contributions#

Functions

compute_entropy_contributions(logprobs, k)

artefactual.scoring.entropy_methods.entropy_contributions.compute_entropy_contributions(logprobs, k)[source]#
Return type:

ndarray[tuple[int, ...], dtype[floating]]

Compute entropic contributions s_kj = -p_k log(p_k) for top-K logprobs using vectorized operations. Args:

logprobs: A 2D array of shape (num_tokens, num_logprobs) containing log probabilities. k: Number of top log probabilities to consider per token.

Returns:

A 2D array of shape (num_tokens, K) containing entropy contributions.