paired-llama-3.2-1b-embeddings-lmsys-chat-1m

Paired Llama 3.2 1B Token Embeddings (LMSYS-Chat-1M) This dataset contains paired activations corresponding to single token locations extracted from Meta’s Llama 3.2 1B Instruct on conversations from LMSYS-Chat-1M. Embeddings are provided for layers 5 through 14, which capture the most interesting intermediate representations. This dataset was built to study things like: Learning different basis for activations at a given layer Studying if there are cases where position encodes… See the full description on the dataset page:

Source: Hugging Face Hub (scaleinvariant/paired-llama-3.2-1b-embeddings-lmsys-chat-1m). Metadata imported from the dataset’s Hub tags.