Jev: Bounded semantic judgments for messy text

Summary

Jev is a managed API from TypeSafe that performs bounded semantic judgments on messy text, returning probabilities instead of binary answers or generated text. It supports three question types: Choice selects from developer-defined options, Noul provides a probability for yes/no queries, and Score rates on an ordered scale such as frustration level. Each decision uses application state as input and returns confidence values, allowing code to apply business thresholds rather than treating the model’s output as permission. Jev is not self-hostable; it runs as a closed API in TypeSafe’s US West Coast data center, introducing network latency and data transfer concerns for teams outside that region. The article uses a coffee shop metaphor to illustrate Jev’s role as an order taker making bounded judgments, contrasting it with generative models and exact computation, and noting alternatives like open models on vLLM.

Takeaways

1. 1

   Jev provides three bounded question types: Choice selects from developer-supplied options, Noul returns a probability for yes/no questions, and Score rates on an ordered scale. Each returns probabilities and confidence values.

2. 2

   Jev decisions are probabilities, not binary answers; application code interprets the probability and applies its own business threshold before taking action. The model does not authorize actions directly.

3. 3

   Jev is a managed API hosted exclusively on TypeSafe’s US West Coast infrastructure, not available for self-hosting or download. Teams requiring local processing or data sovereignty must consider alternatives like open models on vLLM.

FAQ