CLM-8B: Dual-Encoder Scoring and Agentic Trajectory Verification

Introduction

Recent studies in artificial intelligence are making more use of the technique of contrastive representation learning that enables the joining of contextual situational knowledge and subsequent operational activities. The direct linking of states and actions into a continuous vector space is made possible by Contrastive Language Models. The latter provides an overall approach for the evaluation of alternatives through semantic matching of decisions in continuous vectors. This enables the operational processes to be significantly faster when running, especially while implementing difficult tasks such as programming or gaming simulation. In addition, with clean scalability of vector alignment relative to data and computing power, the increase in computing and data resources leads to higher precision in the system.

For those seeking a flexible open-weights approach to contrastive learning, CLM-8B represents the ideal baseline model for modern decision-making. This model offers practical ways of implementing the evaluation of candidates and their trajectory using contrastive projections on a well-established foundation model. Using CLM-8B helps to create a flexible architecture that does away with proprietary operational dependencies in the process of deployment.

What is CLM-8B?

CLM-8B is a joint effort between the researchers from Stanford University and NVIDIA Research. This is an 8B parameter contrastive language model that serves as an open-weights 'System One' decision engine. Whereas traditional generative language models use auto-regressive token sequence prediction, CLM-8B is capable of evaluating and ranking actions based on the cosine similarity of their 512-dimensional vector representations relative to incoming environmental state.

Key Features of CLM-8B

• Independent Action Vector Caching: Precomputes and caches embeddings of potential actions  to GPU directly, needing only one pass over newly arriving environmental states.
• Zero-Token Cost for Cached Vectors: Metering  strictly counts only encoder tokens consumed by missing vectors in cache, therefore using cached vectors of actions or states takes zero encoder tokens.
• Wire-Format TypeSafe Primitive Availability: Ensures complete wire-format availability for decision-making primitives such as Noul for probability calibrated Boolean decisions, Choice for criterion multi-option decisions, and Score for rubric scoring, thus enabling direct replay of TypeSafe/Jev requests.
• Candidate Reranking Primitive: Provides a native endpoint and API-method  for evaluating and ranking arbitrary candidate text lists in one pass.
• Robotics Extension (CoVer-VLA): Applies the contrastive state-action verification concept to the robotics setting where VLA models can validate their physical trajectory via the CoVer-VLA framework.
• Prose Plain Language State Representation: Encodes state information as prose text (key: value for dictionary and -item lists for arrays) instead of encoding states as a string of JSON which skips completely parsing and schema matching issues.

Use Cases of CLM-8B

• Cost-Free Memory Management for Repeated Environment Navigation: Autonomous systems regularly navigate consistent digital environments, admin portals, or standard operational processes. CLM-8B maintains memory management cost efficiency by storing the representations of previous decisions of a model. This removes the need to incur the recurrent token cost calculation when navigating a known UI state, while keeping a steady VRAM memory footprint that ensures stability of servers during a long-running process.
• Low-Cost Adaptation for Proprietary Enterprise Taxonomies: Enterprises often have the need for an automated decision model that is aligned with their internal processes, special product catalogs or proprietary taxonomies of operation. CLM-8B supports such low-cost adaption in enterprise specific datasets with only updates to their lightweight projection heads of 20 million parameters.
• Scalable Action Routing for Large Candidate Spaces: The digital workflows of agents can often have hundreds or thousands of candidate tools as options, such as extensive microservice collections or databases in e-commerce. CLM-8B scales well in dealing with large candidate spaces by separating state evaluation from candidate embedding. This allows enterprises to scale their capability of integrating new tools without facing latency issues or cost explosion.

How Does CLM-8B Work?

The architecture of CLM-8B utilizes the concept of a dual-encoder which is constructed based on a frozen language model backbone. Instead of training the model of eight billion parameters from scratch or doing fine-tuning of the whole set of parameters, the system utilizes a frozen Qwen3-8B base encoder which extracts the hidden states representations of the input text. Two lightweight encoders with 20 million parameters—each dedicated for either environmental states or candidate actions—are used with the frozen base model. The projection heads convert the high-dimensional output from the base encoder into normalized continuous vector embeddings. While inferring, the system computes the similarity between the state embedding and each candidate action embedding. Then the system computes the scaled relative probability distribution over these similarity scores to get the ranking of the optimal action choice without generating text token-by-token.

source - |https://contrastive-lm.notion.site

This strong verification capability is achieved through a three-step alignment training process. At the initial stage of pre-training, the projection heads are trained on about sixty million question-answer pairs in order to lay down a well-defined decision space. At the second stage of mid-training, about thirty million artificial hard negatives are added to make the system more discriminative among similar and plausible choices. At the third and final stage of post-training, the system is trained on one million complex execution paths of agents. In order not to forget earlier learned concepts, this stage includes mixing of new trajectory data with replayed earlier trajectory data.

Performance Evaluation with Other Models

When considered as a trajectory verifier for multi-step agentic coding tasks, fine-tuned CLM-8B sets new records in comparison with other decision engines. On the DeepSWE benchmark, the fine-tuned CLM-8B showed 81.6% verification accuracy over 38 held-out tasks when choosing the best-of-N solution candidates produced by frontier models such as Opus 5. At the same time, proprietary joint-evaluation architectures like TypeSafe's Jev did not work as verifiers on this benchmark as their performance was worse than the random selection Pass@1 baseline.

source - |https://contrastive-lm.notion.site/

On the Terminal-Bench 2.1 benchmark, the fine-tuned CLM-8B showed 87.6% accuracy over 30 held-out tasks when verifying multi-step shell execution traces produced by Fable 5. Importantly, CLM-8B provided these verification decisions 4.1× to 5.7× faster than joint autoregressive forward passes on NVIDIA H100 GPUs. This proves that the decoupled contrastive scoring is efficient.

For short-horizon tasks such as browser games  and game scenarios, CLM-8B is on par with Jevs in terms of decision correctness with up to 9× lower average latency. With candidate spaces growing to around 1,000 actions, CLM-8B shows a 13× speed-up compared to uncached joint model evaluation thanks to the caching action vectors capability. Task-specific fine-tuning provides state-of-the-art verifiers for long-horizon executions.

How to Access And Use CLM-8B

CLM-8B is hosted on the GitHub platform in the repository named Contrastive-LM/CLM where the model parameters can be found on Hugging Face and documentation on the Contrastive-LM Notion webpage. The model can be self-hosted locally by pairing it with a local embedding server, which involves a local web playground along with the Python SDK. The CLM projection head checkpoints along with the Qwen3-8B base encoder are released as per the open-source Apache 2.0 license and can thus be used freely for any commercial purpose.

Limitations

The CLM-8B model has a number of significant limitations. First, the architecture is encoder-locked because the twenty-million parameter projection heads used by CLM-8B rely only on last-token-pooled embeddings generated by the Qwen3-8B base model and cannot be used with other backbones. Second, the model does not generate freeform text, relying solely on scoring and ranking provided candidate options. Finally, the ability of the model to generalize in zero-shot open-domain mode is limited by the eight billion parameter count. The future work will consist of developing CLM-35B in the multimodal domain.

Conclusion

CLM-8B represents a design shift in developing agents' infrastructure, which is changing the token-by-token generative evaluation for continuous vector-space contrastive alignment of the System One. The developers of scalable agentic infrastructure can use CLM-8B as a low-overhead, weights-open architecture, allowing the decision routing to be computationally and monetarily feasible.

Sources:
|https://contrastive-lm.notion.site/
https://github.com/Contrastive-LM/CLM
https://huggingface.co/Contrastive-LM/CLM-v0.1-8B