Prompt API
The contextoverflow event fires on a LanguageModel instance when a call to LanguageModel.prompt(), LanguageModel.promptStreaming(), or LanguageModel.append() causes the session's LanguageModel.contextUsage to exceed the LanguageModel.contextWindow.
Syntax
Use the event name in EventTarget/addEventListener:
addEventListener("contextoverflow", (event) => {})
Alternatively, assign to the event handler property of the interface:
oncontextoverflow = (event) => {}
Event type
A generic Event.
Examples
Reacting to a context overflow
The code below shows two methods of creating an event listener for the contextoverflow event.
const session = await LanguageModel.create();
session.addEventListener("contextoverflow", () => {
console.warn("Context overflow detected.");
});
Alternatively, use the oncontextoverflow event handler property (but note that this replaces other event listeners added using oncontextoverflow, if any):
const session = await LanguageModel.create();
session.oncontextoverflow = () => {
console.warn(
"The session's context window is full. " +
"Consider cloning the session or starting a new one.",
);
};
Resetting the session on overflow
The following example creates a new session when the contextoverflow event is triggered.
let session = await LanguageModel.create({
initialPrompts: [{ role: "system", content: "You are a helpful assistant." }],
});
session.addEventListener("contextoverflow", async () => {
console.log("Context full — creating a fresh session.");
session.destroy();
session = await LanguageModel.create({
initialPrompts: [
{ role: "system", content: "You are a helpful assistant." },
],
});
});
async function chat(userMessage) {
const response = await session.prompt(userMessage);
return response;
}
Specifications
Browser compatibility
See also
- LanguageModel.contextUsage
- LanguageModel.contextWindow
- LanguageModel.measureContextUsage()
- Prompt API
来源:MDN Web Docs / Mozilla 贡献者 · 作者与贡献记录 · CC BY-SA 2.5。离线整理了版式、链接和媒体显示。
